2023-11-24T07:46:50.457 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T07:46:50.457 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --verbose --owner scheduled_rishabh@teuthology --name rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579 -- /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/orig.config.yaml 2023-11-24T07:46:50.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T07:46:50.591 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7465579' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-tests sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9764 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-tests suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCeL7qpF0g8jOSUJk9M3DdZzOZBiSaEjQJplzTLcUp4IbDOp1u0rj4wznLjrsN8DRqMVk/huQCDco4ekQVz6sNs= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGIe2tkCczRgq6/RDlu4Ojzb+oCLrtYmGgskPGqK3yhm3Y1A4CW64NRWjOpumgD1KT/psl644oFybQ8RZXnuuTc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_07:31:48 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T07:46:50.591 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa; will attempt to use it 2023-11-24T07:46:50.592 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks 2023-11-24T07:46:50.592 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T07:46:50.593 INFO:teuthology.task.internal:Checking packages... 2023-11-24T07:46:50.625 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T07:46:50.625 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T07:46:50.625 INFO:teuthology.packaging:ref: None 2023-11-24T07:46:50.625 INFO:teuthology.packaging:tag: None 2023-11-24T07:46:50.625 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T07:46:50.625 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:46:50.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T07:46:50.778 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T07:46:50.778 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T07:46:50.788 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T07:46:50.789 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T07:46:50.806 INFO:teuthology.task.internal:Saving configuration 2023-11-24T07:46:50.835 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T07:46:50.840 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T07:46:50.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:40:55.919543', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJE6UJEVY+vCV94ITIkGfNk7mGZPAKmn8WgYKYrfk+vo'} 2023-11-24T07:46:50.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:40:55.917838', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB8tZqs7D7A2kCq3YX8WbttvSGWlzW/EXmlAt2udU82M'} 2023-11-24T07:46:50.888 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T07:46:50.894 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T07:46:50.894 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T07:46:50.895 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T07:46:50.962 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb26f06aee0>, signals=[15]) 2023-11-24T07:46:50.963 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T07:46:50.970 INFO:teuthology.task.internal:Opening connections... 2023-11-24T07:46:50.970 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T07:46:50.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:46:51.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T07:46:51.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:46:51.132 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T07:46:51.139 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-11-24T07:46:51.144 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-11-24T07:46:51.145 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-11-24T07:46:51.192 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-24T07:46:51.193 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-11-24T07:46:51.193 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="22.04" 2023-11-24T07:46:51.193 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-24T07:46:51.193 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=jammy 2023-11-24T07:46:51.194 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-11-24T07:46:51.194 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-11-24T07:46:51.194 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-24T07:46:51.194 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-24T07:46:51.194 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-24T07:46:51.194 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-24T07:46:51.194 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=jammy 2023-11-24T07:46:51.195 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-11-24T07:46:51.222 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-11-24T07:46:51.227 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-11-24T07:46:51.228 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-24T07:46:51.273 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-24T07:46:51.274 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2023-11-24T07:46:51.274 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04" 2023-11-24T07:46:51.274 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-24T07:46:51.275 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy 2023-11-24T07:46:51.275 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2023-11-24T07:46:51.275 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2023-11-24T07:46:51.275 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-24T07:46:51.275 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-24T07:46:51.276 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-24T07:46:51.276 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-24T07:46:51.276 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy 2023-11-24T07:46:51.277 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-24T07:46:51.297 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T07:46:51.312 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T07:46:51.318 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T07:46:51.318 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:46:51.321 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:46:51.325 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T07:46:51.331 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T07:46:51.331 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:46:51.366 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:46:51.379 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T07:46:51.430 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T07:46:51.445 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T07:46:51.445 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-24T07:46:51.446 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-24T07:46:51.446 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:46:51.446 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:46:51.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:46:51.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-24T07:46:51.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:46:51.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-24T07:46:51.668 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:46:51.668 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:46:51.668 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-11-24T07:46:51.674 INFO:teuthology.orchestra.run.smithi132.stdout:5.15.0-56-generic 2023-11-24T07:46:51.674 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:46:51.675 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:46:51.676 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-24T07:46:51.676 DEBUG:teuthology.orchestra.run.smithi132:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-24T07:46:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-24T07:46:51.764 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:46:51.764 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:46:51.765 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-11-24T07:46:51.771 INFO:teuthology.orchestra.run.smithi057.stdout:5.15.0-56-generic 2023-11-24T07:46:51.771 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:46:51.772 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:46:51.772 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-24T07:46:51.773 DEBUG:teuthology.orchestra.run.smithi057:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-24T07:46:51.825 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-24T07:46:51.879 INFO:teuthology.orchestra.run.smithi132.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-24T07:46:51.880 INFO:teuthology.orchestra.run.smithi132.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-24T07:46:51.880 INFO:teuthology.orchestra.run.smithi132.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-24T07:46:51.880 INFO:teuthology.orchestra.run.smithi132.stderr:hint: 2023-11-24T07:46:51.880 INFO:teuthology.orchestra.run.smithi132.stderr:hint: git config --global init.defaultBranch 2023-11-24T07:46:51.881 INFO:teuthology.orchestra.run.smithi132.stderr:hint: 2023-11-24T07:46:51.881 INFO:teuthology.orchestra.run.smithi132.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-24T07:46:51.881 INFO:teuthology.orchestra.run.smithi132.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-24T07:46:51.881 INFO:teuthology.orchestra.run.smithi132.stderr:hint: 2023-11-24T07:46:51.882 INFO:teuthology.orchestra.run.smithi132.stderr:hint: git branch -m 2023-11-24T07:46:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-24T07:46:51.883 DEBUG:teuthology.orchestra.run.smithi132:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-24T07:46:51.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-24T07:46:51.956 INFO:teuthology.orchestra.run.smithi057.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-24T07:46:51.956 INFO:teuthology.orchestra.run.smithi057.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-24T07:46:51.956 INFO:teuthology.orchestra.run.smithi057.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-24T07:46:51.956 INFO:teuthology.orchestra.run.smithi057.stderr:hint: 2023-11-24T07:46:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:hint: git config --global init.defaultBranch 2023-11-24T07:46:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:hint: 2023-11-24T07:46:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-24T07:46:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-24T07:46:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:hint: 2023-11-24T07:46:51.957 INFO:teuthology.orchestra.run.smithi057.stderr:hint: git branch -m 2023-11-24T07:46:51.958 INFO:teuthology.orchestra.run.smithi057.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-24T07:46:51.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-24T07:46:52.010 DEBUG:teuthology.orchestra.run.smithi132:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-24T07:46:52.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-24T07:46:52.086 DEBUG:teuthology.orchestra.run.smithi057:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-24T07:47:56.031 INFO:teuthology.orchestra.run.smithi057.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-24T07:47:56.031 INFO:teuthology.orchestra.run.smithi057.stderr: * [new branch] main -> origin/main 2023-11-24T07:47:56.062 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190312 -> 20190312 2023-11-24T07:47:56.063 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190416 -> 20190416 2023-11-24T07:47:56.063 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190514 -> 20190514 2023-11-24T07:47:56.063 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190618 -> 20190618 2023-11-24T07:47:56.063 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190717 -> 20190717 2023-11-24T07:47:56.063 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190815 -> 20190815 2023-11-24T07:47:56.063 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190923 -> 20190923 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20191022 -> 20191022 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20191215 -> 20191215 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200122 -> 20200122 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200316 -> 20200316 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200421 -> 20200421 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200519 -> 20200519 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200619 -> 20200619 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200721 -> 20200721 2023-11-24T07:47:56.065 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200817 -> 20200817 2023-11-24T07:47:56.066 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200918 -> 20200918 2023-11-24T07:47:56.066 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201022 -> 20201022 2023-11-24T07:47:56.066 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201118 -> 20201118 2023-11-24T07:47:56.066 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201218 -> 20201218 2023-11-24T07:47:56.066 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210208 -> 20210208 2023-11-24T07:47:56.066 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210315 -> 20210315 2023-11-24T07:47:56.066 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210511 -> 20210511 2023-11-24T07:47:56.068 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210716 -> 20210716 2023-11-24T07:47:56.068 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210818 -> 20210818 2023-11-24T07:47:56.068 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210919 -> 20210919 2023-11-24T07:47:56.068 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20211027 -> 20211027 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20211216 -> 20211216 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220209 -> 20220209 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220310 -> 20220310 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220411 -> 20220411 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220509 -> 20220509 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220610 -> 20220610 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220708 -> 20220708 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220815 -> 20220815 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220913 -> 20220913 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221012 -> 20221012 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221109 -> 20221109 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221214 -> 20221214 2023-11-24T07:47:56.069 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230117 -> 20230117 2023-11-24T07:47:56.070 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230210 -> 20230210 2023-11-24T07:47:56.070 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230310 -> 20230310 2023-11-24T07:47:56.070 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230404 -> 20230404 2023-11-24T07:47:56.070 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230515 -> 20230515 2023-11-24T07:47:56.071 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230625 -> 20230625 2023-11-24T07:47:56.071 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230804 -> 20230804 2023-11-24T07:47:56.071 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230919 -> 20230919 2023-11-24T07:47:56.071 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20231030 -> 20231030 2023-11-24T07:47:56.071 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20231111 -> 20231111 2023-11-24T07:48:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:Updating files: 48% (1588/3248) Updating files: 49% (1592/3248) Updating files: 50% (1624/3248) Updating files: 51% (1657/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 63% (2072/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 79% (2579/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 85% (2763/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-24T07:48:00.282 INFO:teuthology.orchestra.run.smithi057.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-24T07:48:00.304 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T07:48:00.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:48:00.529 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-24T07:48:00.529 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-24T07:48:00.533 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-11-24T07:48:00.895 INFO:teuthology.orchestra.run.smithi132.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-24T07:48:00.895 INFO:teuthology.orchestra.run.smithi132.stderr: * [new branch] main -> origin/main 2023-11-24T07:48:00.919 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20190312 -> 20190312 2023-11-24T07:48:00.919 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20190416 -> 20190416 2023-11-24T07:48:00.919 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20190514 -> 20190514 2023-11-24T07:48:00.919 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20190618 -> 20190618 2023-11-24T07:48:00.919 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20190717 -> 20190717 2023-11-24T07:48:00.919 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20190815 -> 20190815 2023-11-24T07:48:00.919 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20190923 -> 20190923 2023-11-24T07:48:00.920 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20191022 -> 20191022 2023-11-24T07:48:00.920 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20191215 -> 20191215 2023-11-24T07:48:00.920 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200122 -> 20200122 2023-11-24T07:48:00.920 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200316 -> 20200316 2023-11-24T07:48:00.923 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200421 -> 20200421 2023-11-24T07:48:00.923 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200519 -> 20200519 2023-11-24T07:48:00.923 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200619 -> 20200619 2023-11-24T07:48:00.923 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200721 -> 20200721 2023-11-24T07:48:00.923 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200817 -> 20200817 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20200918 -> 20200918 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20201022 -> 20201022 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20201118 -> 20201118 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20201218 -> 20201218 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20210208 -> 20210208 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20210315 -> 20210315 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20210511 -> 20210511 2023-11-24T07:48:00.924 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20210716 -> 20210716 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20210818 -> 20210818 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20210919 -> 20210919 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20211027 -> 20211027 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20211216 -> 20211216 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220209 -> 20220209 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220310 -> 20220310 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220411 -> 20220411 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220509 -> 20220509 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220610 -> 20220610 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220708 -> 20220708 2023-11-24T07:48:00.925 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220815 -> 20220815 2023-11-24T07:48:00.926 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20220913 -> 20220913 2023-11-24T07:48:00.926 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20221012 -> 20221012 2023-11-24T07:48:00.926 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20221109 -> 20221109 2023-11-24T07:48:00.926 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20221214 -> 20221214 2023-11-24T07:48:00.926 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230117 -> 20230117 2023-11-24T07:48:00.926 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230210 -> 20230210 2023-11-24T07:48:00.927 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230310 -> 20230310 2023-11-24T07:48:00.927 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230404 -> 20230404 2023-11-24T07:48:00.927 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230515 -> 20230515 2023-11-24T07:48:00.927 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230625 -> 20230625 2023-11-24T07:48:00.927 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230804 -> 20230804 2023-11-24T07:48:00.927 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20230919 -> 20230919 2023-11-24T07:48:00.928 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20231030 -> 20231030 2023-11-24T07:48:00.928 INFO:teuthology.orchestra.run.smithi132.stderr: * [new tag] 20231111 -> 20231111 2023-11-24T07:48:02.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24 07:48:02 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-24T07:48:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2023-11-24 07:48:02-- 2023-11-24T07:48:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 1.5s 2023-11-24T07:48:02.032 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-11-24T07:48:02.035 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-24T07:48:02.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo dpkg -i /tmp/linux-image.deb 2023-11-24T07:48:02.450 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-24T07:48:04.423 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-24T07:48:04.428 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-24T07:48:04.609 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:48:04.947 INFO:teuthology.orchestra.run.smithi132.stderr:Updating files: 49% (1615/3248) Updating files: 50% (1624/3248) Updating files: 51% (1657/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 64% (2095/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2644/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-24T07:48:04.952 INFO:teuthology.orchestra.run.smithi132.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-24T07:48:04.973 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T07:48:04.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:48:05.205 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-24T07:48:05.205 DEBUG:teuthology.orchestra.run.smithi132:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-24T07:48:05.208 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi132.front.sepia.ceph.com to complete... 2023-11-24T07:48:06.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24 07:48:06 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-24T07:48:06.707 INFO:teuthology.orchestra.run.smithi132.stderr:FINISHED --2023-11-24 07:48:06-- 2023-11-24T07:48:06.708 INFO:teuthology.orchestra.run.smithi132.stderr:Total wall clock time: 1.5s 2023-11-24T07:48:06.708 INFO:teuthology.orchestra.run.smithi132.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-11-24T07:48:06.711 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-24T07:48:06.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo dpkg -i /tmp/linux-image.deb 2023-11-24T07:48:06.977 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-24T07:48:08.257 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:48:08.348 INFO:teuthology.orchestra.run.smithi057.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:48:09.008 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-24T07:48:09.013 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-24T07:48:09.175 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:48:12.777 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-24T07:48:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:48:29.850 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:48:30.201 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:48:30.201 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-11-24T07:48:30.223 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:48:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:48:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:48:30.540 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:48:30.601 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:48:30.607 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:48:30.778 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:48:30.779 INFO:teuthology.orchestra.run.smithi057.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:48:30.779 INFO:teuthology.orchestra.run.smithi057.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:48:30.811 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-11-24T07:48:31.011 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-deb -c /tmp/linux-image.deb 2023-11-24T07:48:31.019 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-24T07:48:31.019 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-24T07:48:31.019 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:48:31.029 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:48:31.029 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:48:31.047 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-24T07:48:31.048 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-24T07:48:31.049 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-24T07:48:31.049 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-24T07:48:31.049 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-24T07:48:31.051 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:48:31.051 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:48:31.051 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:48:31.051 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:48:31.051 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:48:31.052 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:48:31.052 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:48:31.052 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:48:31.052 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:48:31.052 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:48:31.053 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:48:31.054 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:48:31.117 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-24T07:48:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:48:31.119 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-24T07:48:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:48:31.121 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:48:31.122 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:48:31.123 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:48:31.124 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:48:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:48:31.126 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:48:31.127 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:48:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:48:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:48:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:48:31.131 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:48:31.132 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-24T07:48:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-24T07:48:31.134 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:48:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:48:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-24T07:48:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-24T07:48:31.138 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-24T07:48:31.139 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-24T07:48:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-24T07:48:31.141 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:48:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:48:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:48:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:48:31.145 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:48:31.146 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:48:31.147 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:48:31.148 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:48:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:48:31.150 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:48:31.151 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:48:31.152 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:48:31.153 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:48:31.154 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:48:31.155 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:48:31.156 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:48:31.157 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:48:31.158 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:48:31.159 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-24T07:48:31.160 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-24T07:48:31.161 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:48:31.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:48:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:48:31.164 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-24T07:48:31.165 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:48:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-24T07:48:31.167 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-24T07:48:31.168 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:48:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-24T07:48:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-24T07:48:31.172 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:48:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-24T07:48:31.174 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:48:31.175 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:48:31.176 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:48:31.177 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-24T07:48:31.178 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-24T07:48:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-24T07:48:31.180 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-24T07:48:31.181 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:48:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-24T07:48:31.183 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-24T07:48:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:48:31.185 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:48:31.186 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:48:31.187 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-24T07:48:31.188 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:48:31.188 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:48:31.188 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-24T07:48:31.188 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:48:31.188 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:48:31.188 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-24T07:48:31.188 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:48:31.258 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:48:31.259 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:48:31.260 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:48:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-24T07:48:31.262 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:48:31.263 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-24T07:48:31.264 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:48:31.265 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-24T07:48:31.266 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:48:31.267 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-24T07:48:31.268 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:48:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:48:31.270 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:48:31.271 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:48:31.272 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:48:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:48:31.274 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:48:31.275 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:48:31.276 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:48:31.277 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-24T07:48:31.278 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-24T07:48:31.279 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:48:31.280 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:48:31.281 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-24T07:48:31.282 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-24T07:48:31.283 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-24T07:48:31.284 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-24T07:48:31.285 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:48:31.286 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-24T07:48:31.287 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:48:31.288 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:48:31.289 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-24T07:48:31.290 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:48:31.291 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:48:31.292 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-24T07:48:31.293 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-24T07:48:31.294 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-24T07:48:31.295 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:48:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:48:31.297 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:48:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:48:31.299 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-24T07:48:31.300 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-24T07:48:31.301 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-24T07:48:31.302 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-24T07:48:31.303 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-24T07:48:31.304 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-24T07:48:31.305 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-24T07:48:31.306 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-24T07:48:31.307 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-24T07:48:31.308 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-24T07:48:31.309 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:48:31.310 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:48:31.311 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-24T07:48:31.312 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:48:31.313 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-24T07:48:31.314 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:48:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-24T07:48:31.316 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:48:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:48:31.318 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-24T07:48:31.319 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-24T07:48:31.320 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:48:31.321 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-24T07:48:31.322 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:48:31.323 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-24T07:48:31.324 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:48:31.325 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:48:31.326 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:48:31.327 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:48:31.328 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-24T07:48:31.329 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:48:31.330 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-24T07:48:31.331 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:48:31.332 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:48:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:48:31.334 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:48:31.335 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:48:31.336 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-24T07:48:31.337 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-24T07:48:31.338 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-24T07:48:31.339 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-24T07:48:31.340 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:48:31.341 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-24T07:48:31.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:48:31.341 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-24T07:48:31.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:48:31.341 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-24T07:48:31.341 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:48:31.372 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-24T07:48:31.372 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-24T07:48:31.372 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:48:31.373 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-24T07:48:31.374 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-24T07:48:31.375 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-24T07:48:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:48:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:48:31.378 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:48:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:48:31.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:48:31.381 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:48:31.382 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:48:31.383 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:48:31.384 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:48:31.385 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:48:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:48:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:48:31.388 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-24T07:48:31.389 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:48:31.390 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:48:31.391 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:48:31.392 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:48:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:48:31.394 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:48:31.395 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:48:31.396 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:48:31.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:48:31.398 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:48:31.399 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:48:31.400 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:48:31.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:48:31.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:48:31.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:48:31.401 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:48:31.402 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:48:31.403 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-24T07:48:31.404 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:48:31.405 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:48:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:48:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:48:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-24T07:48:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-24T07:48:31.410 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:48:31.411 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:48:31.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:48:31.412 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-24T07:48:31.412 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-24T07:48:31.412 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-24T07:48:31.412 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-24T07:48:31.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-24T07:48:31.412 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-24T07:48:31.413 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:48:31.413 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-24T07:48:31.413 DEBUG:teuthology.orchestra.run.smithi057:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-24T07:48:31.421 INFO:teuthology.orchestra.run.smithi057.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:48:31.421 INFO:teuthology.orchestra.run.smithi057.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:48:31.421 INFO:teuthology.orchestra.run.smithi057.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:48:31.422 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-24T07:48:31.422 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-24T07:48:31.422 DEBUG:teuthology.orchestra.run.smithi057:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-24T07:48:31.465 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-11-24T07:48:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:48:31.900 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:48:31.925 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-11-24T07:48:32.124 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:48:32.130 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:48:32.362 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:48:32.368 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:48:32.408 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:48:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:48:32.574 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:48:32.574 INFO:teuthology.orchestra.run.smithi057.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:48:32.574 INFO:teuthology.orchestra.run.smithi057.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:48:32.585 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-11-24T07:48:34.077 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:48:34.093 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:48:34.113 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-11-24T07:48:34.427 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:48:34.445 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:48:34.741 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:48:34.751 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:48:34.820 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:48:34.826 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:48:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:48:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:48:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:48:35.043 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-11-24T07:48:35.226 DEBUG:teuthology.orchestra.run.smithi132:> dpkg-deb -c /tmp/linux-image.deb 2023-11-24T07:48:35.234 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-24T07:48:35.234 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-24T07:48:35.234 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:48:35.246 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:48:35.246 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:48:35.268 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-24T07:48:35.268 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-24T07:48:35.269 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-24T07:48:35.269 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-24T07:48:35.269 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-24T07:48:35.269 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-24T07:48:35.269 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-24T07:48:35.269 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-24T07:48:35.270 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-24T07:48:35.270 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-24T07:48:35.270 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-24T07:48:35.270 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-24T07:48:35.270 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-24T07:48:35.270 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-24T07:48:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:48:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:48:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:48:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:48:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:48:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:48:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:48:35.272 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:48:35.272 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:48:35.272 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:48:35.272 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:48:35.272 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:48:35.272 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:48:35.273 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:48:35.273 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:48:35.273 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:48:35.273 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:48:35.273 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:48:35.273 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:48:35.273 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-24T07:48:35.274 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-24T07:48:35.274 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-24T07:48:35.274 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:48:35.274 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-24T07:48:35.274 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-24T07:48:35.274 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-24T07:48:35.275 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:48:35.275 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:48:35.347 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-24T07:48:35.348 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:48:35.349 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:48:35.350 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:48:35.351 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-24T07:48:35.352 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:48:35.353 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:48:35.354 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:48:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:48:35.356 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:48:35.357 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:48:35.358 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:48:35.359 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-24T07:48:35.360 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:48:35.361 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:48:35.362 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-24T07:48:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:48:35.364 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-24T07:48:35.365 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:48:35.366 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:48:35.367 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-24T07:48:35.368 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-24T07:48:35.369 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-24T07:48:35.370 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-24T07:48:35.371 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-24T07:48:35.372 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:48:35.373 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:48:35.374 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:48:35.375 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:48:35.376 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:48:35.377 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:48:35.378 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:48:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:48:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:48:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:48:35.382 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-24T07:48:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:48:35.384 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:48:35.385 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:48:35.386 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:48:35.387 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:48:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:48:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:48:35.390 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:48:35.391 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:48:35.392 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:48:35.393 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-24T07:48:35.394 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:48:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:48:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:48:35.397 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-24T07:48:35.398 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-24T07:48:35.399 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-24T07:48:35.400 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:48:35.401 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:48:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-24T07:48:35.403 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-24T07:48:35.404 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:48:35.405 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-24T07:48:35.406 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:48:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-24T07:48:35.408 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-24T07:48:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:48:35.410 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-24T07:48:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:48:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:48:35.413 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:48:35.414 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-24T07:48:35.415 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:48:35.416 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-24T07:48:35.417 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-24T07:48:35.418 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-24T07:48:35.419 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-24T07:48:35.420 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:48:35.421 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-24T07:48:35.422 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:48:35.423 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:48:35.424 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:48:35.425 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-24T07:48:35.426 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:48:35.427 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-24T07:48:35.428 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:48:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-24T07:48:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:48:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-24T07:48:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:48:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-24T07:48:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-24T07:48:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:48:35.533 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:48:35.534 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:48:35.535 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-24T07:48:35.536 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-24T07:48:35.537 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:48:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:48:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-24T07:48:35.540 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:48:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:48:35.542 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:48:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:48:35.544 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:48:35.545 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:48:35.546 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:48:35.547 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:48:35.548 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-24T07:48:35.549 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-24T07:48:35.550 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-24T07:48:35.551 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-24T07:48:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:48:35.553 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-24T07:48:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:48:35.555 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-24T07:48:35.556 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-24T07:48:35.557 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-24T07:48:35.558 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-24T07:48:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:48:35.560 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:48:35.561 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-24T07:48:35.562 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-24T07:48:35.563 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-24T07:48:35.564 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-24T07:48:35.565 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:48:35.566 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-24T07:48:35.567 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-24T07:48:35.568 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-24T07:48:35.569 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:48:35.570 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:48:35.571 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-24T07:48:35.572 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:48:35.573 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:48:35.574 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-24T07:48:35.575 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:48:35.576 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:48:35.577 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-24T07:48:35.578 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:48:35.579 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-24T07:48:35.580 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-24T07:48:35.581 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-24T07:48:35.582 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-24T07:48:35.583 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-24T07:48:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-24T07:48:35.585 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-24T07:48:35.586 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-24T07:48:35.587 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-24T07:48:35.588 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-24T07:48:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-24T07:48:35.590 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:48:35.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:48:35.592 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:48:35.593 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-24T07:48:35.594 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:48:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:48:35.596 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:48:35.597 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:48:35.598 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:48:35.599 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:48:35.600 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:48:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:48:35.602 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-24T07:48:35.603 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-24T07:48:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:48:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:48:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:48:35.607 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-24T07:48:35.608 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:48:35.609 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:48:35.610 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:48:35.611 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:48:35.612 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:48:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-24T07:48:35.614 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-24T07:48:35.615 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:48:35.616 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:48:35.617 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-24T07:48:35.618 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:48:35.619 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:48:35.620 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:48:35.621 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:48:35.622 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:48:35.623 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:48:35.624 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-24T07:48:35.625 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-24T07:48:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-24T07:48:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:48:35.628 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:48:35.629 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-24T07:48:35.630 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:48:35.631 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-24T07:48:35.632 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-24T07:48:35.633 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:48:35.634 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:48:35.635 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:48:35.636 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:48:35.637 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:48:35.638 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-24T07:48:35.639 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:48:35.640 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:48:35.641 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:48:35.642 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-24T07:48:35.643 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:48:35.644 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:48:35.645 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:48:35.646 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:48:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:48:35.648 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:48:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:48:35.650 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:48:35.650 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:48:35.650 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:48:35.650 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:48:35.650 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:48:35.650 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:48:35.650 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-24T07:48:35.651 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-24T07:48:35.652 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:48:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:48:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:48:35.655 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:48:35.656 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:48:35.657 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:48:35.658 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:48:35.659 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:48:35.660 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:48:35.661 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:48:35.662 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:48:35.663 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:48:35.664 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:48:35.665 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:48:35.666 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:48:35.667 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:48:35.668 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:48:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:48:35.670 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-24T07:48:35.671 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:48:35.672 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:48:35.673 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-24T07:48:35.674 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:48:35.675 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-24T07:48:35.676 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:48:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:48:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-24T07:48:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-24T07:48:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:48:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:48:35.677 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:48:35.681 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-24T07:48:35.681 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:48:35.681 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-24T07:48:35.681 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:48:35.682 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-24T07:48:35.683 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:48:35.684 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-24T07:48:35.685 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-24T07:48:35.686 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:48:35.686 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-24T07:48:35.686 DEBUG:teuthology.orchestra.run.smithi132:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-24T07:48:35.693 INFO:teuthology.orchestra.run.smithi132.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:48:35.693 INFO:teuthology.orchestra.run.smithi132.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:48:35.693 INFO:teuthology.orchestra.run.smithi132.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-24T07:48:35.694 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-24T07:48:35.694 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-24T07:48:35.694 DEBUG:teuthology.orchestra.run.smithi132:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-24T07:48:35.737 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi132.front.sepia.ceph.com to complete... 2023-11-24T07:48:36.142 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub' 2023-11-24T07:48:36.142 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-24T07:48:36.159 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-11-24T07:48:36.353 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:48:36.358 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-24T07:48:36.638 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-24T07:48:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-24T07:48:36.687 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-24T07:48:36.692 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-24T07:48:36.804 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-24T07:48:36.804 INFO:teuthology.orchestra.run.smithi132.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-24T07:48:36.804 INFO:teuthology.orchestra.run.smithi132.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-24T07:48:36.818 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-11-24T07:49:03.713 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-24T07:49:03.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-24T07:49:03.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:49:07.937 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-24T07:49:07.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-24T07:49:07.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:49:22.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-24T07:49:26.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-24T07:49:31.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-24T07:49:31.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:49:34.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-24T07:49:35.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-24T07:49:35.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:49:38.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-24T07:49:46.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-24T07:49:46.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:49:50.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-24T07:49:50.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:50:23.265 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-11-24T07:50:24.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-24T07:50:24.319 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:50:24.319 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-11-24T07:50:24.370 INFO:teuthology.orchestra.run.smithi132.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:50:24.371 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:50:24.371 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:50:24.371 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-24T07:50:25.372 DEBUG:teuthology.parallel:result is None 2023-11-24T07:50:46.221 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T07:51:01.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-24T07:51:01.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:51:01.498 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-11-24T07:51:02.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-24T07:51:02.164 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:51:02.164 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-11-24T07:51:02.217 INFO:teuthology.orchestra.run.smithi057.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:51:02.217 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:51:02.217 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:51:02.217 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-24T07:51:03.219 DEBUG:teuthology.parallel:result is None 2023-11-24T07:51:03.219 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T07:51:03.227 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T07:51:03.227 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:51:03.231 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:51:03.241 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T07:51:03.252 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T07:51:03.258 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T07:51:03.259 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:51:03.284 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:51:03.308 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T07:51:03.315 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T07:51:03.315 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:51:03.340 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:51:03.418 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:51:03.450 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:51:03.457 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:51:03.506 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:51:03.508 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T07:51:03.515 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T07:51:03.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:51:03.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:51:03.542 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T07:51:03.550 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T07:51:03.550 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:51:03.584 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:51:03.595 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:51:03.642 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:51:03.693 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T07:51:03.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:51:03.769 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:51:03.778 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:51:03.831 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T07:51:03.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:51:03.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-11-24T07:51:03.912 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2023-11-24T07:51:04.080 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T07:51:04.088 INFO:teuthology.task.internal:Starting timer... 2023-11-24T07:51:04.089 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T07:51:04.101 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T07:51:04.109 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2023-11-24T07:51:04.109 DEBUG:teuthology.task.selinux:Excluding smithi132: OS 'ubuntu' does not support SELinux 2023-11-24T07:51:04.109 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T07:51:04.109 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-24T07:51:04.110 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T07:51:04.110 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T07:51:04.118 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-24T07:51:04.123 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-24T07:51:04.322 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T07:51:04.338 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T07:51:04.340 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T07:59:46.801 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2023-11-24T07:59:46.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-24T07:59:46.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:59:46.886 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-11-24T07:59:47.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-24T07:59:47.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-24T07:59:47.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:59:47.083 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-11-24T07:59:47.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-24T07:59:47.213 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T07:59:47.223 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T07:59:47.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T07:59:47.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:59:47.227 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T07:59:47.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:59:47.265 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-24T07:59:47.265 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Command line: ntpd -gq 2023-11-24T07:59:47.265 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: ---------------------------------------------------- 2023-11-24T07:59:47.265 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: ntp-4 is maintained by Network Time Foundation, 2023-11-24T07:59:47.266 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-24T07:59:47.266 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: corporation. Support and training for ntp-4 are 2023-11-24T07:59:47.266 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: available at https://www.nwtime.org/support 2023-11-24T07:59:47.266 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: ---------------------------------------------------- 2023-11-24T07:59:47.266 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: proto: precision = 0.043 usec (-24) 2023-11-24T07:59:47.267 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: basedate set to 2022-02-04 2023-11-24T07:59:47.267 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: gps base set to 2022-02-06 (week 2196) 2023-11-24T07:59:47.267 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:59:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:59:47.267 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:59:47.268 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:59:47.268 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Listen and drop on 0 v6wildcard [::]:123 2023-11-24T07:59:47.268 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-24T07:59:47.268 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Listen normally on 2 lo 127.0.0.1:123 2023-11-24T07:59:47.268 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Listen normally on 3 ens1f0 172.21.15.57:123 2023-11-24T07:59:47.268 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Listen normally on 4 lo [::1]:123 2023-11-24T07:59:47.269 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%4]:123 2023-11-24T07:59:47.269 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:47 ntpd[27919]: Listening on routing socket on fd #22 for interface updates 2023-11-24T07:59:47.294 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-24T07:59:47.294 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Command line: ntpd -gq 2023-11-24T07:59:47.294 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: ---------------------------------------------------- 2023-11-24T07:59:47.295 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: ntp-4 is maintained by Network Time Foundation, 2023-11-24T07:59:47.295 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-24T07:59:47.295 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: corporation. Support and training for ntp-4 are 2023-11-24T07:59:47.295 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: available at https://www.nwtime.org/support 2023-11-24T07:59:47.295 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: ---------------------------------------------------- 2023-11-24T07:59:47.295 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: proto: precision = 0.041 usec (-24) 2023-11-24T07:59:47.295 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: basedate set to 2022-02-04 2023-11-24T07:59:47.296 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: gps base set to 2022-02-06 (week 2196) 2023-11-24T07:59:47.296 INFO:teuthology.orchestra.run.smithi132.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:59:47.296 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-24T07:59:47.296 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:59:47.297 INFO:teuthology.orchestra.run.smithi132.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-24T07:59:47.297 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Listen and drop on 0 v6wildcard [::]:123 2023-11-24T07:59:47.297 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-24T07:59:47.298 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Listen normally on 2 lo 127.0.0.1:123 2023-11-24T07:59:47.298 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Listen normally on 3 enp3s0f1 172.21.15.132:123 2023-11-24T07:59:47.298 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Listen normally on 4 lo [::1]:123 2023-11-24T07:59:47.298 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:773f%5]:123 2023-11-24T07:59:47.298 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:47 ntpd[28008]: Listening on routing socket on fd #22 for interface updates 2023-11-24T07:59:48.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:48.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:48.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:48 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:48 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:48 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:50.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:50 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:50.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:50 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:50.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:50 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:50.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:50 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:50.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:50 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:50.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:50 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:50 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:51.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:51.268 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:51.269 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:51.270 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:51 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:51.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:51 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:51.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:51 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:51.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:51 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:51.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:51 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:51.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:51 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:51.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:51 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:52.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:52 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:52.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:52 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:52.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:52 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:52.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:52 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:52.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:52 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:52.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:52 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:52.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:52.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:52.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:52.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:52.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:52.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:52.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:52.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:52.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:52.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:52.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:52.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:52 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:53.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:53 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:53.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:53 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:53.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:53 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:53.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:53 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:53.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:53 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:53.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:53 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:53.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:53 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:54.267 INFO:teuthology.orchestra.run.smithi057.stdout:24 Nov 07:59:54 ntpd[27919]: ntpd: time slew +0.000442 s 2023-11-24T07:59:54.267 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew +0.000442s 2023-11-24T07:59:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-24T07:59:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:24 Nov 07:59:54 ntpd[27919]: can't open /var/log/ntpstats/loopstats.20231124: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:54.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:54.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:54.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:54.296 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:54 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:54.398 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T07:59:54.399 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2023-11-24T07:59:54.399 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:59:54.399 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:59:54.399 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:59:54.399 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T07:59:55.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:55 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:55.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:55 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:55.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:55 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T07:59:55.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:55 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T07:59:55.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:55 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T07:59:55.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:55 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T07:59:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T08:00:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T08:00:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T08:00:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T08:00:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-24T08:00:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: can't open /var/log/ntpstats/rawstats.20231124: Permission denied 2023-11-24T08:00:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-24T08:00:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: can't open /var/log/ntpstats/peerstats.20231124: Permission denied 2023-11-24T08:00:04.993 INFO:teuthology.orchestra.run.smithi132.stdout:24 Nov 07:59:56 ntpd[28008]: ntpd: time slew +0.000045 s 2023-11-24T08:00:04.993 INFO:teuthology.orchestra.run.smithi132.stdout:ntpd: time slew +0.000045s 2023-11-24T08:00:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-24T08:00:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:24 Nov 07:59:56 ntpd[28008]: can't open /var/log/ntpstats/loopstats.20231124: Permission denied 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi132.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T08:00:04.999 INFO:teuthology.orchestra.run.smithi132.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T08:00:04.999 INFO:teuthology.orchestra.run.smithi132.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T08:00:04.999 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T08:00:04.999 INFO:teuthology.run_tasks:Running task install... 2023-11-24T08:00:05.022 DEBUG:teuthology.task.install:project ceph 2023-11-24T08:00:05.022 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T08:00:05.022 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T08:00:05.022 INFO:teuthology.task.install:Using flavor: default 2023-11-24T08:00:05.028 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T08:00:05.029 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T08:00:05.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2023-11-24T08:00:05.030 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-key list | grep Ceph 2023-11-24T08:00:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-24T08:00:05.149 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-24T08:00:05.198 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-24T08:00:05.198 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2023-11-24T08:00:05.199 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-24T08:00:05.199 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-24T08:00:05.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:00:05.206 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-24T08:00:05.206 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph.com (release key) 2023-11-24T08:00:05.206 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-24T08:00:05.206 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-24T08:00:05.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:00:05.349 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default/ 2023-11-24T08:00:05.350 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:00:05.429 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default/ 2023-11-24T08:00:05.429 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:00:05.518 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:00:05.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-24T08:00:05.536 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:00:05.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-24T08:00:05.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2023-11-24T08:00:05.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2023-11-24T08:00:05.838 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy InRelease 2023-11-24T08:00:05.856 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy InRelease 2023-11-24T08:00:05.874 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-24T08:00:05.892 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-24T08:00:05.911 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-24T08:00:05.929 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-24T08:00:05.948 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-11-24T08:00:05.965 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-24T08:00:05.996 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-24T08:00:06.013 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-11-24T08:00:10.092 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-24T08:00:10.099 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-24T08:00:10.119 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-24T08:00:10.936 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-24T08:00:11.013 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-24T08:00:11.016 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-24T08:00:11.033 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-24T08:00:11.164 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 28.5 kB in 5s (5,293 B/s) 2023-11-24T08:00:12.089 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-11-24T08:00:12.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-ga13ea5ff-1jammy cephadm=18.0.0-7484-ga13ea5ff-1jammy ceph-mds=18.0.0-7484-ga13ea5ff-1jammy ceph-mgr=18.0.0-7484-ga13ea5ff-1jammy ceph-common=18.0.0-7484-ga13ea5ff-1jammy ceph-fuse=18.0.0-7484-ga13ea5ff-1jammy ceph-test=18.0.0-7484-ga13ea5ff-1jammy ceph-volume=18.0.0-7484-ga13ea5ff-1jammy radosgw=18.0.0-7484-ga13ea5ff-1jammy python3-rados=18.0.0-7484-ga13ea5ff-1jammy python3-rgw=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy python3-rbd=18.0.0-7484-ga13ea5ff-1jammy libcephfs2=18.0.0-7484-ga13ea5ff-1jammy libcephfs-dev=18.0.0-7484-ga13ea5ff-1jammy librados2=18.0.0-7484-ga13ea5ff-1jammy librbd1=18.0.0-7484-ga13ea5ff-1jammy rbd-fuse=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy cephfs-shell=18.0.0-7484-ga13ea5ff-1jammy cephfs-top=18.0.0-7484-ga13ea5ff-1jammy cephfs-mirror=18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:00:12.178 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-11-24T08:00:12.345 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2023-11-24T08:00:12.346 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2023-11-24T08:00:12.501 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T08:00:12.501 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T08:00:12.501 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T08:00:12.501 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T08:00:12.502 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T08:00:12.502 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T08:00:12.502 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T08:00:12.502 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2023-11-24T08:00:12.502 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-24T08:00:12.503 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-24T08:00:12.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T08:00:12.505 INFO:teuthology.orchestra.run.smithi132.stdout: socat xmlstarlet 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-watchdog 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout:Recommended packages: 2023-11-24T08:00:12.506 INFO:teuthology.orchestra.run.smithi132.stdout: btrfs-tools 2023-11-24T08:00:12.647 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2023-11-24T08:00:12.648 INFO:teuthology.orchestra.run.smithi132.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-24T08:00:12.648 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-24T08:00:12.648 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-24T08:00:12.648 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-24T08:00:12.648 INFO:teuthology.orchestra.run.smithi132.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T08:00:12.648 INFO:teuthology.orchestra.run.smithi132.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-24T08:00:12.649 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-24T08:00:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-24T08:00:12.651 INFO:teuthology.orchestra.run.smithi132.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-24T08:00:12.651 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-24T08:00:12.651 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-24T08:00:12.651 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-24T08:00:12.651 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-24T08:00:12.652 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T08:00:12.652 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T08:00:12.652 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T08:00:12.652 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T08:00:12.652 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T08:00:12.652 INFO:teuthology.orchestra.run.smithi132.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-24T08:00:12.661 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-24T08:00:12.871 INFO:teuthology.orchestra.run.smithi132.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-24T08:00:12.871 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 186 MB of archives. 2023-11-24T08:00:12.871 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-24T08:00:12.872 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,458 kB] 2023-11-24T08:00:12.906 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 28.5 kB in 7s (3,991 B/s) 2023-11-24T08:00:13.316 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,112 kB] 2023-11-24T08:00:13.502 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-ga13ea5ff-1jammy [690 kB] 2023-11-24T08:00:13.538 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-ga13ea5ff-1jammy [356 kB] 2023-11-24T08:00:13.544 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-ga13ea5ff-1jammy [32.8 kB] 2023-11-24T08:00:13.544 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-ga13ea5ff-1jammy [180 kB] 2023-11-24T08:00:13.571 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-ga13ea5ff-1jammy [63.5 kB] 2023-11-24T08:00:13.572 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-ga13ea5ff-1jammy [330 kB] 2023-11-24T08:00:13.577 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-ga13ea5ff-1jammy [6,230 kB] 2023-11-24T08:00:13.838 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-ga13ea5ff-1jammy [112 kB] 2023-11-24T08:00:13.839 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-ga13ea5ff-1jammy [439 kB] 2023-11-24T08:00:13.859 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-11-24T08:00:13.865 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-ga13ea5ff-1jammy [22.6 MB] 2023-11-24T08:00:13.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-ga13ea5ff-1jammy cephadm=18.0.0-7484-ga13ea5ff-1jammy ceph-mds=18.0.0-7484-ga13ea5ff-1jammy ceph-mgr=18.0.0-7484-ga13ea5ff-1jammy ceph-common=18.0.0-7484-ga13ea5ff-1jammy ceph-fuse=18.0.0-7484-ga13ea5ff-1jammy ceph-test=18.0.0-7484-ga13ea5ff-1jammy ceph-volume=18.0.0-7484-ga13ea5ff-1jammy radosgw=18.0.0-7484-ga13ea5ff-1jammy python3-rados=18.0.0-7484-ga13ea5ff-1jammy python3-rgw=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy python3-rbd=18.0.0-7484-ga13ea5ff-1jammy libcephfs2=18.0.0-7484-ga13ea5ff-1jammy libcephfs-dev=18.0.0-7484-ga13ea5ff-1jammy librados2=18.0.0-7484-ga13ea5ff-1jammy librbd1=18.0.0-7484-ga13ea5ff-1jammy rbd-fuse=18.0.0-7484-ga13ea5ff-1jammy python3-cephfs=18.0.0-7484-ga13ea5ff-1jammy cephfs-shell=18.0.0-7484-ga13ea5ff-1jammy cephfs-top=18.0.0-7484-ga13ea5ff-1jammy cephfs-mirror=18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:00:13.951 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-11-24T08:00:14.121 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-11-24T08:00:14.122 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-11-24T08:00:14.281 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T08:00:14.281 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T08:00:14.281 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T08:00:14.281 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T08:00:14.281 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T08:00:14.282 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T08:00:14.282 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T08:00:14.285 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-11-24T08:00:14.285 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-24T08:00:14.285 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-24T08:00:14.285 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-24T08:00:14.286 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T08:00:14.287 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout: socat xmlstarlet 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-24T08:00:14.288 INFO:teuthology.orchestra.run.smithi057.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-24T08:00:14.289 INFO:teuthology.orchestra.run.smithi057.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-24T08:00:14.289 INFO:teuthology.orchestra.run.smithi057.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-24T08:00:14.289 INFO:teuthology.orchestra.run.smithi057.stdout: python3-watchdog 2023-11-24T08:00:14.289 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2023-11-24T08:00:14.289 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2023-11-24T08:00:14.434 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-11-24T08:00:14.434 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-24T08:00:14.435 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-24T08:00:14.436 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-24T08:00:14.437 INFO:teuthology.orchestra.run.smithi057.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-24T08:00:14.605 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-ga13ea5ff-1jammy [6,900 kB] 2023-11-24T08:00:14.829 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-ga13ea5ff-1jammy [238 kB] 2023-11-24T08:00:14.835 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [124 kB] 2023-11-24T08:00:14.841 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-ga13ea5ff-1jammy [1,496 kB] 2023-11-24T08:00:14.857 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-24T08:00:14.857 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 186 MB of archives. 2023-11-24T08:00:14.857 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-24T08:00:14.857 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,458 kB] 2023-11-24T08:00:14.891 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-ga13ea5ff-1jammy [9,955 kB] 2023-11-24T08:00:15.254 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-ga13ea5ff-1jammy [31.8 MB] 2023-11-24T08:00:15.444 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-24T08:00:15.462 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-24T08:00:15.471 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-24T08:00:15.514 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-24T08:00:15.535 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-24T08:00:15.537 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-24T08:00:15.549 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-24T08:00:15.586 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-24T08:00:15.588 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-24T08:00:15.595 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-24T08:00:15.598 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-24T08:00:15.599 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-24T08:00:15.605 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-24T08:00:15.605 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-24T08:00:15.606 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-24T08:00:15.607 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-24T08:00:15.607 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-24T08:00:15.621 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-24T08:00:15.622 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-24T08:00:15.622 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-24T08:00:15.622 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-24T08:00:15.638 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-24T08:00:15.640 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-24T08:00:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-24T08:00:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-24T08:00:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-24T08:00:15.644 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-24T08:00:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-24T08:00:15.655 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-24T08:00:15.656 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-24T08:00:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-24T08:00:15.671 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-24T08:00:15.676 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-24T08:00:15.676 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-24T08:00:15.677 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-24T08:00:15.677 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-24T08:00:15.678 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-24T08:00:15.688 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-24T08:00:15.689 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-24T08:00:15.690 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-24T08:00:15.691 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-24T08:00:15.705 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-24T08:00:15.706 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-24T08:00:15.708 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-24T08:00:15.754 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-24T08:00:15.755 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-24T08:00:15.756 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-24T08:00:15.757 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-24T08:00:15.757 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-24T08:00:15.758 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-24T08:00:15.778 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-24T08:00:15.780 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-24T08:00:15.781 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-24T08:00:15.797 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-24T08:00:15.798 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-24T08:00:15.798 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-24T08:00:15.799 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-24T08:00:15.799 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-24T08:00:15.800 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-24T08:00:15.807 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-24T08:00:15.807 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-24T08:00:15.810 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-24T08:00:15.824 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-24T08:00:15.825 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-24T08:00:15.825 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-24T08:00:15.829 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-24T08:00:15.832 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-24T08:00:15.832 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-24T08:00:15.837 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-24T08:00:15.840 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-24T08:00:15.840 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-24T08:00:15.841 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-24T08:00:15.856 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-24T08:00:15.858 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-24T08:00:15.859 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-24T08:00:15.866 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-24T08:00:15.867 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-24T08:00:15.867 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-24T08:00:15.873 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-24T08:00:15.874 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-24T08:00:15.957 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-ga13ea5ff-1jammy [3,112 kB] 2023-11-24T08:00:16.481 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [14.0 kB] 2023-11-24T08:00:16.481 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [839 kB] 2023-11-24T08:00:16.495 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-ga13ea5ff-1jammy [690 kB] 2023-11-24T08:00:16.514 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-ga13ea5ff-1jammy [2,144 kB] 2023-11-24T08:00:16.601 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-ga13ea5ff-1jammy [799 kB] 2023-11-24T08:00:16.627 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-ga13ea5ff-1jammy [139 kB] 2023-11-24T08:00:16.631 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-ga13ea5ff-1jammy [1,900 kB] 2023-11-24T08:00:16.646 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-ga13ea5ff-1jammy [356 kB] 2023-11-24T08:00:16.657 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-ga13ea5ff-1jammy [32.8 kB] 2023-11-24T08:00:16.658 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-ga13ea5ff-1jammy [180 kB] 2023-11-24T08:00:16.711 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-ga13ea5ff-1jammy [8,625 kB] 2023-11-24T08:00:16.731 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-ga13ea5ff-1jammy [63.5 kB] 2023-11-24T08:00:16.733 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-ga13ea5ff-1jammy [330 kB] 2023-11-24T08:00:16.744 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-ga13ea5ff-1jammy [6,230 kB] 2023-11-24T08:00:17.075 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-ga13ea5ff-1jammy [14.2 kB] 2023-11-24T08:00:17.075 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-ga13ea5ff-1jammy [48.6 MB] 2023-11-24T08:00:17.560 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-ga13ea5ff-1jammy [112 kB] 2023-11-24T08:00:17.561 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-ga13ea5ff-1jammy [439 kB] 2023-11-24T08:00:17.606 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-24T08:00:17.625 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-ga13ea5ff-1jammy [22.6 MB] 2023-11-24T08:00:17.627 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-24T08:00:17.638 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-24T08:00:17.688 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-24T08:00:17.711 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-24T08:00:17.715 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-24T08:00:17.728 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-24T08:00:17.772 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-24T08:00:17.774 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-24T08:00:17.782 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-24T08:00:17.785 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-24T08:00:17.785 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-24T08:00:17.792 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-24T08:00:17.792 INFO:teuthology.orchestra.run.smithi132.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-24T08:00:17.793 INFO:teuthology.orchestra.run.smithi132.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-24T08:00:17.794 INFO:teuthology.orchestra.run.smithi132.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-24T08:00:17.795 INFO:teuthology.orchestra.run.smithi132.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-24T08:00:17.814 INFO:teuthology.orchestra.run.smithi132.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-24T08:00:17.815 INFO:teuthology.orchestra.run.smithi132.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-24T08:00:17.815 INFO:teuthology.orchestra.run.smithi132.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-24T08:00:17.815 INFO:teuthology.orchestra.run.smithi132.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-24T08:00:17.816 INFO:teuthology.orchestra.run.smithi132.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-24T08:00:17.818 INFO:teuthology.orchestra.run.smithi132.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-24T08:00:17.818 INFO:teuthology.orchestra.run.smithi132.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-24T08:00:17.819 INFO:teuthology.orchestra.run.smithi132.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-24T08:00:17.819 INFO:teuthology.orchestra.run.smithi132.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-24T08:00:17.834 INFO:teuthology.orchestra.run.smithi132.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-24T08:00:17.840 INFO:teuthology.orchestra.run.smithi132.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-24T08:00:17.840 INFO:teuthology.orchestra.run.smithi132.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-24T08:00:17.841 INFO:teuthology.orchestra.run.smithi132.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-24T08:00:17.842 INFO:teuthology.orchestra.run.smithi132.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-24T08:00:17.842 INFO:teuthology.orchestra.run.smithi132.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-24T08:00:17.847 INFO:teuthology.orchestra.run.smithi132.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-24T08:00:17.847 INFO:teuthology.orchestra.run.smithi132.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-24T08:00:17.848 INFO:teuthology.orchestra.run.smithi132.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-24T08:00:17.853 INFO:teuthology.orchestra.run.smithi132.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-24T08:00:17.868 INFO:teuthology.orchestra.run.smithi132.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-24T08:00:17.870 INFO:teuthology.orchestra.run.smithi132.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-24T08:00:17.870 INFO:teuthology.orchestra.run.smithi132.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-24T08:00:17.872 INFO:teuthology.orchestra.run.smithi132.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-24T08:00:17.872 INFO:teuthology.orchestra.run.smithi132.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-24T08:00:17.874 INFO:teuthology.orchestra.run.smithi132.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-24T08:00:17.875 INFO:teuthology.orchestra.run.smithi132.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-24T08:00:17.877 INFO:teuthology.orchestra.run.smithi132.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-24T08:00:17.934 INFO:teuthology.orchestra.run.smithi132.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-24T08:00:17.934 INFO:teuthology.orchestra.run.smithi132.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-24T08:00:17.936 INFO:teuthology.orchestra.run.smithi132.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-24T08:00:17.936 INFO:teuthology.orchestra.run.smithi132.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-24T08:00:17.937 INFO:teuthology.orchestra.run.smithi132.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-24T08:00:17.938 INFO:teuthology.orchestra.run.smithi132.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-24T08:00:17.960 INFO:teuthology.orchestra.run.smithi132.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-24T08:00:17.962 INFO:teuthology.orchestra.run.smithi132.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-24T08:00:17.962 INFO:teuthology.orchestra.run.smithi132.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-24T08:00:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-24T08:00:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-24T08:00:17.988 INFO:teuthology.orchestra.run.smithi132.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-24T08:00:17.989 INFO:teuthology.orchestra.run.smithi132.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-24T08:00:17.989 INFO:teuthology.orchestra.run.smithi132.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-24T08:00:17.990 INFO:teuthology.orchestra.run.smithi132.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-24T08:00:18.005 INFO:teuthology.orchestra.run.smithi132.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-24T08:00:18.006 INFO:teuthology.orchestra.run.smithi132.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-24T08:00:18.010 INFO:teuthology.orchestra.run.smithi132.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-24T08:00:18.025 INFO:teuthology.orchestra.run.smithi132.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-24T08:00:18.030 INFO:teuthology.orchestra.run.smithi132.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-24T08:00:18.030 INFO:teuthology.orchestra.run.smithi132.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-24T08:00:18.034 INFO:teuthology.orchestra.run.smithi132.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-24T08:00:18.037 INFO:teuthology.orchestra.run.smithi132.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-24T08:00:18.037 INFO:teuthology.orchestra.run.smithi132.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-24T08:00:18.042 INFO:teuthology.orchestra.run.smithi132.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-24T08:00:18.045 INFO:teuthology.orchestra.run.smithi132.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-24T08:00:18.045 INFO:teuthology.orchestra.run.smithi132.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-24T08:00:18.046 INFO:teuthology.orchestra.run.smithi132.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-24T08:00:18.064 INFO:teuthology.orchestra.run.smithi132.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-24T08:00:18.066 INFO:teuthology.orchestra.run.smithi132.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-24T08:00:18.067 INFO:teuthology.orchestra.run.smithi132.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-24T08:00:18.075 INFO:teuthology.orchestra.run.smithi132.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-24T08:00:18.075 INFO:teuthology.orchestra.run.smithi132.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-24T08:00:18.075 INFO:teuthology.orchestra.run.smithi132.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-24T08:00:18.084 INFO:teuthology.orchestra.run.smithi132.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-24T08:00:18.085 INFO:teuthology.orchestra.run.smithi132.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-24T08:00:19.335 INFO:teuthology.orchestra.run.smithi132.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-ga13ea5ff-1jammy [121 kB] 2023-11-24T08:00:19.343 INFO:teuthology.orchestra.run.smithi132.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-ga13ea5ff-1jammy [226 kB] 2023-11-24T08:00:19.352 INFO:teuthology.orchestra.run.smithi132.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-ga13ea5ff-1jammy [34.0 kB] 2023-11-24T08:00:19.353 INFO:teuthology.orchestra.run.smithi132.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-ga13ea5ff-1jammy [23.4 kB] 2023-11-24T08:00:19.354 INFO:teuthology.orchestra.run.smithi132.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-ga13ea5ff-1jammy [38.3 kB] 2023-11-24T08:00:19.355 INFO:teuthology.orchestra.run.smithi132.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-ga13ea5ff-1jammy [12.3 MB] 2023-11-24T08:00:19.917 INFO:teuthology.orchestra.run.smithi132.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [91.3 kB] 2023-11-24T08:00:20.031 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-ga13ea5ff-1jammy [6,900 kB] 2023-11-24T08:00:20.356 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-ga13ea5ff-1jammy [238 kB] 2023-11-24T08:00:20.358 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [124 kB] 2023-11-24T08:00:20.362 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-ga13ea5ff-1jammy [1,496 kB] 2023-11-24T08:00:20.434 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-ga13ea5ff-1jammy [9,955 kB] 2023-11-24T08:00:20.479 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 186 MB in 7s (25.6 MB/s) 2023-11-24T08:00:20.628 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-24T08:00:20.697 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-24T08:00:20.701 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-24T08:00:20.744 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-24T08:00:20.900 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-ga13ea5ff-1jammy [31.8 MB] 2023-11-24T08:00:21.097 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-24T08:00:21.110 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-24T08:00:21.164 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T08:00:21.542 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cmd2. 2023-11-24T08:00:21.555 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-24T08:00:21.608 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-24T08:00:22.028 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-24T08:00:22.043 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-24T08:00:22.145 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T08:00:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-ga13ea5ff-1jammy [14.0 kB] 2023-11-24T08:00:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [839 kB] 2023-11-24T08:00:22.407 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-ga13ea5ff-1jammy [2,144 kB] 2023-11-24T08:00:22.482 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-24T08:00:22.497 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-24T08:00:22.499 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-ga13ea5ff-1jammy [799 kB] 2023-11-24T08:00:22.535 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-ga13ea5ff-1jammy [139 kB] 2023-11-24T08:00:22.536 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-ga13ea5ff-1jammy [1,900 kB] 2023-11-24T08:00:22.548 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T08:00:22.623 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-ga13ea5ff-1jammy [8,625 kB] 2023-11-24T08:00:22.910 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-24T08:00:22.925 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-24T08:00:22.968 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T08:00:23.026 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-ga13ea5ff-1jammy [14.2 kB] 2023-11-24T08:00:23.026 INFO:teuthology.orchestra.run.smithi057.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-ga13ea5ff-1jammy [48.6 MB] 2023-11-24T08:00:23.447 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-24T08:00:23.462 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T08:00:23.514 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:00:23.917 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-24T08:00:23.932 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T08:00:23.975 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:00:24.346 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-24T08:00:24.360 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T08:00:24.404 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:00:24.999 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-24T08:00:25.014 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-24T08:00:25.049 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T08:00:25.191 INFO:teuthology.orchestra.run.smithi057.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-ga13ea5ff-1jammy [121 kB] 2023-11-24T08:00:25.192 INFO:teuthology.orchestra.run.smithi057.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-ga13ea5ff-1jammy [226 kB] 2023-11-24T08:00:25.194 INFO:teuthology.orchestra.run.smithi057.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-ga13ea5ff-1jammy [34.0 kB] 2023-11-24T08:00:25.195 INFO:teuthology.orchestra.run.smithi057.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-ga13ea5ff-1jammy [23.4 kB] 2023-11-24T08:00:25.195 INFO:teuthology.orchestra.run.smithi057.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-ga13ea5ff-1jammy [38.3 kB] 2023-11-24T08:00:25.196 INFO:teuthology.orchestra.run.smithi057.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-ga13ea5ff-1jammy [12.3 MB] 2023-11-24T08:00:25.377 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librados2. 2023-11-24T08:00:25.392 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:25.461 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:25.747 INFO:teuthology.orchestra.run.smithi057.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-ga13ea5ff-1jammy [91.3 kB] 2023-11-24T08:00:25.905 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librbd1. 2023-11-24T08:00:25.920 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:25.963 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:26.349 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 186 MB in 11s (16.4 MB/s) 2023-11-24T08:00:26.391 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs2. 2023-11-24T08:00:26.406 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:26.441 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:26.556 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-24T08:00:26.627 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-24T08:00:26.631 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-24T08:00:26.688 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-24T08:00:26.710 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rados. 2023-11-24T08:00:26.725 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:26.769 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:26.999 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-24T08:00:27.012 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-24T08:00:27.057 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T08:00:27.097 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-24T08:00:27.111 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:27.155 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:27.424 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cephfs. 2023-11-24T08:00:27.435 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cmd2. 2023-11-24T08:00:27.439 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:27.449 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-24T08:00:27.482 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:27.502 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-24T08:00:27.819 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-24T08:00:27.834 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:27.877 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:27.963 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-24T08:00:27.978 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-24T08:00:28.080 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T08:00:28.213 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-prettytable. 2023-11-24T08:00:28.228 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-24T08:00:28.272 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-24T08:00:28.484 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-24T08:00:28.499 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-24T08:00:28.524 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rbd. 2023-11-24T08:00:28.539 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:28.550 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T08:00:28.583 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:28.919 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-24T08:00:28.934 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-24T08:00:28.946 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-24T08:00:28.961 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-24T08:00:28.978 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T08:00:29.004 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T08:00:29.339 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librgw2. 2023-11-24T08:00:29.354 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:29.397 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:29.466 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-24T08:00:29.482 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T08:00:29.541 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:00:29.867 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rgw. 2023-11-24T08:00:29.881 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:29.925 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:30.036 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-24T08:00:30.051 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T08:00:30.103 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:00:30.270 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-24T08:00:30.284 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-24T08:00:30.328 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T08:00:30.491 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-24T08:00:30.506 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-24T08:00:30.672 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libradosstriper1. 2023-11-24T08:00:30.687 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:30.731 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:30.741 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:00:31.134 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-common. 2023-11-24T08:00:31.149 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:31.169 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-24T08:00:31.184 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-24T08:00:31.192 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:31.227 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T08:00:31.555 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librados2. 2023-11-24T08:00:31.571 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:31.622 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:32.124 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librbd1. 2023-11-24T08:00:32.140 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:32.191 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:32.332 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-base. 2023-11-24T08:00:32.347 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:32.399 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:32.669 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2023-11-24T08:00:32.684 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:32.735 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:33.038 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2023-11-24T08:00:33.053 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:33.103 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-24T08:00:33.112 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:33.117 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-24T08:00:33.162 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-24T08:00:33.423 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cheroot. 2023-11-24T08:00:33.437 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-24T08:00:33.481 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T08:00:33.482 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-24T08:00:33.498 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:33.834 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-24T08:00:33.849 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-24T08:00:33.851 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2023-11-24T08:00:33.867 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:33.893 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:34.196 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-24T08:00:34.211 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-24T08:00:34.279 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-24T08:00:34.337 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-24T08:00:34.353 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:34.403 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-24T08:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-24T08:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-24T08:00:34.790 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2023-11-24T08:00:34.806 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-24T08:00:34.856 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-24T08:00:35.044 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempora. 2023-11-24T08:00:35.059 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-24T08:00:35.093 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-24T08:00:35.117 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2023-11-24T08:00:35.133 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:35.175 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:35.388 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-portend. 2023-11-24T08:00:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-24T08:00:35.447 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-24T08:00:35.678 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-24T08:00:35.694 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-24T08:00:35.737 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T08:00:35.774 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-24T08:00:35.789 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-24T08:00:35.832 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-24T08:00:36.048 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2023-11-24T08:00:36.063 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:36.098 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:36.169 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-24T08:00:36.184 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-24T08:00:36.227 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-24T08:00:36.534 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2023-11-24T08:00:36.548 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:36.592 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:36.598 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-natsort. 2023-11-24T08:00:36.612 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-24T08:00:36.656 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-24T08:00:36.929 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-24T08:00:36.943 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-24T08:00:36.968 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-logutils. 2023-11-24T08:00:36.983 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-24T08:00:36.986 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T08:00:37.051 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-24T08:00:37.288 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2023-11-24T08:00:37.304 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:37.337 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-24T08:00:37.352 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-24T08:00:37.355 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:37.387 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-24T08:00:37.707 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-mako. 2023-11-24T08:00:37.722 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-24T08:00:37.750 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2023-11-24T08:00:37.765 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T08:00:37.765 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:37.800 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:38.136 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-24T08:00:38.151 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-24T08:00:38.194 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-24T08:00:38.505 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-24T08:00:38.520 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-24T08:00:38.563 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-24T08:00:38.866 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webob. 2023-11-24T08:00:38.881 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-24T08:00:38.889 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2023-11-24T08:00:38.903 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:38.918 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-24T08:00:38.965 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:39.219 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-waitress. 2023-11-24T08:00:39.234 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-24T08:00:39.322 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T08:00:39.631 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempita. 2023-11-24T08:00:39.645 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-24T08:00:39.689 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T08:00:39.726 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-24T08:00:39.741 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-24T08:00:39.793 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-24T08:00:40.000 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-paste. 2023-11-24T08:00:40.017 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-24T08:00:40.058 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T08:00:40.104 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cheroot. 2023-11-24T08:00:40.119 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-24T08:00:40.162 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T08:00:40.379 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-24T08:00:40.393 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-24T08:00:40.437 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T08:00:40.482 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-24T08:00:40.497 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-24T08:00:40.540 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-24T08:00:40.765 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-24T08:00:40.780 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-24T08:00:40.826 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-24T08:00:40.868 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-24T08:00:40.905 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-24T08:00:40.926 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-24T08:00:41.118 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webtest. 2023-11-24T08:00:41.133 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-24T08:00:41.194 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-24T08:00:41.229 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-24T08:00:41.244 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-24T08:00:41.287 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-24T08:00:41.463 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pecan. 2023-11-24T08:00:41.478 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-24T08:00:41.513 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T08:00:41.548 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempora. 2023-11-24T08:00:41.563 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-24T08:00:41.598 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-24T08:00:41.876 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-certifi. 2023-11-24T08:00:41.891 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-24T08:00:41.926 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-portend. 2023-11-24T08:00:41.934 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-24T08:00:41.941 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-24T08:00:41.984 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-24T08:00:42.287 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-24T08:00:42.287 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-idna. 2023-11-24T08:00:42.302 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-24T08:00:42.302 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-24T08:00:42.345 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-24T08:00:42.346 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-24T08:00:42.648 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-24T08:00:42.664 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-24T08:00:42.682 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-urllib3. 2023-11-24T08:00:42.698 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-24T08:00:42.698 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-24T08:00:42.740 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T08:00:43.051 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-natsort. 2023-11-24T08:00:43.066 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-24T08:00:43.101 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-24T08:00:43.102 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests. 2023-11-24T08:00:43.117 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-24T08:00:43.160 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T08:00:43.387 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2023-11-24T08:00:43.402 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-24T08:00:43.446 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-24T08:00:43.455 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-24T08:00:43.470 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-24T08:00:43.530 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T08:00:43.748 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-24T08:00:43.764 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-24T08:00:43.833 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-24T08:00:43.848 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:43.891 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:44.118 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2023-11-24T08:00:44.133 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-24T08:00:44.175 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T08:00:44.296 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-24T08:00:44.311 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:44.355 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:44.504 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-24T08:00:44.519 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-24T08:00:44.562 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-24T08:00:44.658 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-openssl. 2023-11-24T08:00:44.672 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-24T08:00:44.716 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-24T08:00:44.832 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-24T08:00:44.847 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-24T08:00:44.881 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-24T08:00:45.053 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr. 2023-11-24T08:00:45.067 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:45.102 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:45.184 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2023-11-24T08:00:45.200 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-24T08:00:45.242 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-24T08:00:45.481 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mon. 2023-11-24T08:00:45.495 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:45.539 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:45.570 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2023-11-24T08:00:45.585 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-24T08:00:45.631 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T08:00:45.939 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2023-11-24T08:00:45.954 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-24T08:00:45.998 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T08:00:46.309 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2023-11-24T08:00:46.324 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-24T08:00:46.369 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T08:00:46.745 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-24T08:00:46.760 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-24T08:00:46.812 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T08:00:47.085 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-osd. 2023-11-24T08:00:47.100 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:47.135 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:47.807 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-24T08:00:47.822 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-24T08:00:47.873 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-24T08:00:48.226 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2023-11-24T08:00:48.242 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-24T08:00:48.292 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-24T08:00:48.389 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph. 2023-11-24T08:00:48.404 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:48.447 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:48.678 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2023-11-24T08:00:48.694 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-24T08:00:48.745 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T08:00:48.775 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-fuse. 2023-11-24T08:00:48.790 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:48.833 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:49.166 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-certifi. 2023-11-24T08:00:49.182 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-24T08:00:49.204 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mds. 2023-11-24T08:00:49.218 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-24T08:00:49.262 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:49.607 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephadm. 2023-11-24T08:00:49.621 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:49.644 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-idna. 2023-11-24T08:00:49.660 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-24T08:00:49.681 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:49.710 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-24T08:00:49.968 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-24T08:00:49.985 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-24T08:00:50.035 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-24T08:00:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-urllib3. 2023-11-24T08:00:50.087 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-24T08:00:50.130 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T08:00:50.475 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests. 2023-11-24T08:00:50.491 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-24T08:00:50.533 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T08:00:50.546 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-24T08:00:50.561 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T08:00:50.613 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T08:00:50.902 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-24T08:00:50.918 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-24T08:00:50.960 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T08:00:51.255 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-24T08:00:51.271 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:51.313 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:51.609 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-babel. 2023-11-24T08:00:51.623 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T08:00:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T08:00:51.885 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-24T08:00:51.901 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:51.943 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:52.172 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jinja2. 2023-11-24T08:00:52.185 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-24T08:00:52.229 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-24T08:00:52.237 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2023-11-24T08:00:52.253 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-24T08:00:52.295 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-24T08:00:52.624 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-24T08:00:52.638 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:52.640 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2023-11-24T08:00:52.656 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:52.683 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:52.698 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:53.045 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-24T08:00:53.058 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-24T08:00:53.101 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2023-11-24T08:00:53.103 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-24T08:00:53.117 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:53.151 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:53.414 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-24T08:00:53.428 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-24T08:00:53.473 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-24T08:00:53.717 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-routes. 2023-11-24T08:00:53.731 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-24T08:00:53.776 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T08:00:54.046 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2023-11-24T08:00:54.062 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:54.088 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-24T08:00:54.101 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:54.104 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:54.146 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:54.541 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-24T08:00:54.555 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-24T08:00:54.600 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T08:00:55.120 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-joblib. 2023-11-24T08:00:55.134 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-24T08:00:55.178 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T08:00:55.316 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2023-11-24T08:00:55.332 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:55.375 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:55.532 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-24T08:00:55.546 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-24T08:00:55.582 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-24T08:00:55.660 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2023-11-24T08:00:55.676 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:55.710 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:55.896 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn. 2023-11-24T08:00:55.909 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-24T08:00:55.954 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T08:00:56.046 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2023-11-24T08:00:56.062 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:56.105 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:56.646 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-24T08:00:56.660 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:56.666 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2023-11-24T08:00:56.683 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:00:56.724 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:56.729 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:57.036 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-24T08:00:57.051 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-24T08:00:57.094 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-24T08:00:57.447 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-24T08:00:57.462 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T08:00:57.496 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T08:00:57.749 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cachetools. 2023-11-24T08:00:57.764 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-24T08:00:57.807 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-24T08:00:58.131 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-24T08:00:58.146 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-24T08:00:58.193 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-24T08:00:58.522 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-24T08:00:58.526 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-babel. 2023-11-24T08:00:58.537 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-24T08:00:58.541 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-24T08:00:58.584 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T08:00:58.605 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T08:00:58.904 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2023-11-24T08:00:58.916 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rsa. 2023-11-24T08:00:58.918 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-24T08:00:58.931 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-24T08:00:58.962 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-24T08:00:58.974 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-24T08:00:59.278 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-google-auth. 2023-11-24T08:00:59.293 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-24T08:00:59.307 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-24T08:00:59.321 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:00:59.327 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-24T08:00:59.366 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:00:59.710 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-24T08:00:59.724 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-24T08:00:59.758 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-24T08:00:59.768 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-24T08:00:59.773 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-24T08:00:59.816 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T08:01:00.029 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-24T08:01:00.044 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-24T08:01:00.088 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-24T08:01:00.127 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-websocket. 2023-11-24T08:01:00.142 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-24T08:01:00.177 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-24T08:01:00.382 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2023-11-24T08:01:00.397 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-24T08:01:00.440 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T08:01:00.506 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-24T08:01:00.521 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-24T08:01:00.564 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T08:01:00.794 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-24T08:01:00.808 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:00.852 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:01.219 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-24T08:01:01.233 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:01.247 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-24T08:01:01.261 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-24T08:01:01.277 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:01.313 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T08:01:01.622 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-24T08:01:01.636 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-24T08:01:01.680 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T08:01:01.792 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2023-11-24T08:01:01.806 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-24T08:01:01.850 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T08:01:02.008 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-24T08:01:02.022 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T08:01:02.066 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T08:01:02.212 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-24T08:01:02.226 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-24T08:01:02.270 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-24T08:01:02.353 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package jq. 2023-11-24T08:01:02.367 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T08:01:02.411 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-24T08:01:02.556 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2023-11-24T08:01:02.570 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-24T08:01:02.606 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T08:01:02.655 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package socat. 2023-11-24T08:01:02.669 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-24T08:01:02.751 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-24T08:01:03.050 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package xmlstarlet. 2023-11-24T08:01:03.064 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-24T08:01:03.108 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-24T08:01:03.289 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-24T08:01:03.304 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:03.347 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:03.479 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-test. 2023-11-24T08:01:03.493 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:03.537 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:04.292 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2023-11-24T08:01:04.308 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-24T08:01:04.350 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-24T08:01:04.678 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-24T08:01:04.695 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-24T08:01:04.728 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-24T08:01:05.056 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-24T08:01:05.073 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-24T08:01:05.114 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T08:01:05.409 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2023-11-24T08:01:05.424 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-24T08:01:05.467 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-24T08:01:05.741 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-volume. 2023-11-24T08:01:05.757 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:05.787 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2023-11-24T08:01:05.800 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:05.803 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-24T08:01:05.845 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-24T08:01:06.229 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-24T08:01:06.244 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:06.268 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-24T08:01:06.283 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-24T08:01:06.296 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:06.325 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T08:01:06.603 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2023-11-24T08:01:06.607 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-colorama. 2023-11-24T08:01:06.619 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-24T08:01:06.623 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-24T08:01:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-24T08:01:06.702 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-24T08:01:06.943 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-shell. 2023-11-24T08:01:06.958 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:06.964 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-24T08:01:06.980 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-24T08:01:06.994 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:07.022 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T08:01:07.297 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-top. 2023-11-24T08:01:07.312 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:07.354 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:07.632 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-24T08:01:07.648 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:07.690 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:07.753 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-24T08:01:07.768 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:07.811 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:08.027 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package nvme-cli. 2023-11-24T08:01:08.042 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-24T08:01:08.102 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T08:01:08.113 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-24T08:01:08.128 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-24T08:01:08.163 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T08:01:08.398 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-24T08:01:08.413 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-24T08:01:08.448 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-24T08:01:08.510 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-24T08:01:08.524 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T08:01:08.568 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T08:01:08.821 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2023-11-24T08:01:08.836 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-24T08:01:08.878 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-24T08:01:08.909 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-24T08:01:08.924 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-24T08:01:08.992 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-24T08:01:09.114 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2023-11-24T08:01:09.129 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-24T08:01:09.164 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-24T08:01:09.254 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastescript. 2023-11-24T08:01:09.268 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-24T08:01:09.303 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-24T08:01:09.468 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2023-11-24T08:01:09.483 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-24T08:01:09.526 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-24T08:01:09.649 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pluggy. 2023-11-24T08:01:09.663 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-24T08:01:09.707 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-24T08:01:09.863 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2023-11-24T08:01:09.878 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:09.913 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:10.052 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-psutil. 2023-11-24T08:01:10.066 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-24T08:01:10.110 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-24T08:01:10.446 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-py. 2023-11-24T08:01:10.460 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-24T08:01:10.513 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-24T08:01:10.866 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pygments. 2023-11-24T08:01:10.880 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-24T08:01:10.924 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T08:01:11.370 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-24T08:01:11.385 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-24T08:01:11.428 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-24T08:01:11.773 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-toml. 2023-11-24T08:01:11.787 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-24T08:01:11.831 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-24T08:01:11.992 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-volume. 2023-11-24T08:01:12.007 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:12.050 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:12.133 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pytest. 2023-11-24T08:01:12.147 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-24T08:01:12.217 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T08:01:12.396 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-24T08:01:12.412 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:12.520 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplejson. 2023-11-24T08:01:12.534 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-24T08:01:12.578 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-24T08:01:12.773 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-colorama. 2023-11-24T08:01:12.790 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-24T08:01:12.831 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-24T08:01:12.881 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-24T08:01:12.896 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-24T08:01:13.084 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-shell. 2023-11-24T08:01:13.100 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:13.143 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:13.395 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-top. 2023-11-24T08:01:13.411 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-ga13ea5ff-1jammy_all.deb ... 2023-11-24T08:01:13.487 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:13.627 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package radosgw. 2023-11-24T08:01:13.642 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:13.685 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:13.731 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-24T08:01:13.747 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:13.789 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:14.159 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2023-11-24T08:01:14.175 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-24T08:01:14.225 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T08:01:14.330 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package rbd-fuse. 2023-11-24T08:01:14.346 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:14.388 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:14.563 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-24T08:01:14.579 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-24T08:01:14.622 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-24T08:01:14.700 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-24T08:01:14.968 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T08:01:15.049 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-24T08:01:15.064 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-24T08:01:15.107 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-24T08:01:15.144 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T08:01:15.394 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2023-11-24T08:01:15.403 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-24T08:01:15.409 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-24T08:01:15.452 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-24T08:01:15.778 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-24T08:01:15.780 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2023-11-24T08:01:15.796 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-24T08:01:15.860 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-24T08:01:16.133 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2023-11-24T08:01:16.149 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-24T08:01:16.191 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-24T08:01:16.300 INFO:teuthology.orchestra.run.smithi132.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-24T08:01:16.352 INFO:teuthology.orchestra.run.smithi132.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-24T08:01:16.413 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:16.502 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2023-11-24T08:01:16.519 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-24T08:01:16.560 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-24T08:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pygments. 2023-11-24T08:01:16.863 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-24T08:01:16.947 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T08:01:17.016 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user cephadm....done 2023-11-24T08:01:17.177 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T08:01:17.392 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-24T08:01:17.408 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-24T08:01:17.442 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-24T08:01:17.461 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-24T08:01:17.721 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-24T08:01:17.753 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-toml. 2023-11-24T08:01:17.769 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-24T08:01:17.811 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-24T08:01:17.872 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-24T08:01:18.114 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-24T08:01:18.140 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-24T08:01:18.172 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T08:01:18.416 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T08:01:18.459 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2023-11-24T08:01:18.474 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-24T08:01:18.517 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-24T08:01:18.526 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-24T08:01:18.770 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-24T08:01:18.786 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-24T08:01:18.828 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-24T08:01:18.844 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T08:01:19.246 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-24T08:01:19.531 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2023-11-24T08:01:19.558 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:19.589 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:19.799 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-24T08:01:20.091 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-24T08:01:20.251 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2023-11-24T08:01:20.267 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-ga13ea5ff-1jammy_amd64.deb ... 2023-11-24T08:01:20.351 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:20.367 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-24T08:01:20.646 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-24T08:01:20.727 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-24T08:01:20.922 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-24T08:01:20.986 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:21.023 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-24T08:01:21.288 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T08:01:21.291 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-24T08:01:21.439 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-24T08:01:21.731 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-24T08:01:21.749 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T08:01:22.175 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-24T08:01:22.342 INFO:teuthology.orchestra.run.smithi057.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-24T08:01:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-24T08:01:22.400 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:22.551 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T08:01:22.678 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-24T08:01:22.954 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T08:01:23.053 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2023-11-24T08:01:23.214 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-24T08:01:23.247 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-24T08:01:23.490 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-24T08:01:23.606 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T08:01:23.774 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-24T08:01:23.900 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-24T08:01:24.260 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-24T08:01:24.308 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T08:01:24.538 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-24T08:01:24.584 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T08:01:24.678 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-24T08:01:24.752 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-24T08:01:24.878 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T08:01:24.988 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-24T08:01:25.221 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-24T08:01:25.349 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-24T08:01:25.616 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-24T08:01:25.673 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-24T08:01:25.901 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-24T08:01:25.948 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T08:01:26.194 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-24T08:01:26.367 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T08:01:26.520 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-24T08:01:26.685 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-24T08:01:27.052 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T08:01:27.088 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:27.412 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-24T08:01:27.573 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-24T08:01:27.682 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-24T08:01:27.714 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-24T08:01:27.865 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:27.949 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-24T08:01:28.208 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-idna (3.3-1) ... 2023-11-24T08:01:28.234 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-24T08:01:28.360 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-24T08:01:28.550 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T08:01:28.736 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-24T08:01:28.862 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-24T08:01:29.138 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-24T08:01:29.406 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-24T08:01:29.724 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-24T08:01:29.823 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:01:29.999 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-24T08:01:30.293 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T08:01:30.417 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-24T08:01:30.442 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-24T08:01:30.544 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T08:01:30.718 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-24T08:01:30.844 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-24T08:01:30.853 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-24T08:01:30.970 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-24T08:01:31.164 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-24T08:01:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-24T08:01:31.664 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:01:31.705 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-24T08:01:31.815 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-24T08:01:31.956 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-24T08:01:32.167 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-24T08:01:32.350 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-24T08:01:32.443 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-24T08:01:32.668 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-24T08:01:32.719 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-24T08:01:32.987 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-24T08:01:33.002 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-24T08:01:33.296 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-24T08:01:33.393 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-24T08:01:33.589 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T08:01:33.663 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-24T08:01:33.698 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-24T08:01:33.789 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:34.000 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T08:01:34.081 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-idna (3.3-1) ... 2023-11-24T08:01:34.151 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T08:01:34.416 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-24T08:01:34.485 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-24T08:01:34.795 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-24T08:01:35.071 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T08:01:35.478 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-24T08:01:35.721 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:01:35.757 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T08:01:35.834 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-24T08:01:35.925 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T08:01:36.106 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-24T08:01:36.232 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-24T08:01:36.318 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-24T08:01:36.358 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-24T08:01:36.594 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-24T08:01:36.693 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-24T08:01:36.862 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:01:36.969 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-24T08:01:37.013 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-24T08:01:37.245 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:01:37.346 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-24T08:01:37.348 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T08:01:37.639 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-24T08:01:37.683 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T08:01:37.890 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-24T08:01:37.975 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-24T08:01:38.151 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-24T08:01:38.166 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-24T08:01:38.427 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-24T08:01:38.442 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-24T08:01:38.710 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-24T08:01:38.712 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T08:01:38.988 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-24T08:01:38.994 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-24T08:01:39.120 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-24T08:01:39.406 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-24T08:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-24T08:01:39.531 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-24T08:01:39.699 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T08:01:39.824 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-24T08:01:40.060 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T08:01:40.133 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-24T08:01:40.187 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:40.312 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:40.401 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-24T08:01:40.463 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:40.658 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:40.784 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:40.834 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-24T08:01:40.943 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-24T08:01:41.095 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-24T08:01:41.237 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:41.246 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-24T08:01:41.413 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:41.564 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:41.672 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-24T08:01:41.786 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T08:01:41.786 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T08:01:41.932 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-24T08:01:42.216 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-24T08:01:42.351 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-24T08:01:42.432 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:42.583 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:42.693 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-24T08:01:42.734 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:42.901 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T08:01:43.028 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-24T08:01:43.329 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-24T08:01:43.496 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-24T08:01:43.789 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-24T08:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-24T08:01:44.181 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:44.349 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:44.350 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-24T08:01:44.500 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:44.668 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:44.802 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-24T08:01:44.802 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:44.928 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:45.119 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-24T08:01:45.488 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-24T08:01:45.582 INFO:teuthology.orchestra.run.smithi132.stdout:Adding group ceph....done 2023-11-24T08:01:45.639 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:45.765 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:45.891 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:46.016 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user ceph....done 2023-11-24T08:01:46.119 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:46.188 INFO:teuthology.orchestra.run.smithi132.stdout:Setting system user ceph properties....done 2023-11-24T08:01:46.206 INFO:teuthology.orchestra.run.smithi132.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-24T08:01:46.270 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:46.347 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-24T08:01:46.459 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-24T08:01:46.730 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-24T08:01:46.773 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:46.882 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:47.008 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:47.235 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T08:01:47.236 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-24T08:01:47.382 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:47.607 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:01:47.608 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:01:47.868 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:48.019 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:48.170 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-top (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:48.208 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:48.312 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-24T08:01:48.367 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:48.882 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:01:48.882 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:01:49.478 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:49.843 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:49.913 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-24T08:01:49.994 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:50.145 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:50.296 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-shell (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:50.447 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:50.781 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:51.015 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T08:01:51.015 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T08:01:51.084 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2023-11-24T08:01:51.468 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2023-11-24T08:01:51.646 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2023-11-24T08:01:51.664 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-24T08:01:51.667 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:51.815 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-24T08:01:52.213 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-24T08:01:52.448 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T08:01:52.448 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T08:01:52.873 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-mirror (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:53.105 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:01:53.105 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-24T08:01:53.202 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:53.626 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T08:01:53.626 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T08:01:53.750 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:54.292 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:54.443 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:54.602 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:54.778 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:01:54.778 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-24T08:01:54.845 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T08:01:54.845 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T08:01:55.394 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:55.479 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:55.672 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:55.764 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-24T08:01:55.823 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:55.990 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:56.388 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:56.393 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T08:01:56.659 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T08:01:56.660 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-24T08:01:57.243 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T08:01:57.289 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T08:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-24T08:01:58.118 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T08:01:58.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-24T08:01:58.150 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:58.198 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-11-24T08:01:58.365 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2023-11-24T08:01:58.365 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2023-11-24T08:01:58.496 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T08:01:58.496 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-24T08:01:58.517 INFO:teuthology.orchestra.run.smithi132.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-24T08:01:58.517 INFO:teuthology.orchestra.run.smithi132.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-24T08:01:58.517 INFO:teuthology.orchestra.run.smithi132.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-24T08:01:58.517 INFO:teuthology.orchestra.run.smithi132.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi132.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T08:01:58.519 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T08:01:58.519 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T08:01:58.519 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi132.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-24T08:01:58.521 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-24T08:01:58.521 INFO:teuthology.orchestra.run.smithi132.stdout: libengine-pkcs11-openssl 2023-11-24T08:01:58.568 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2023-11-24T08:01:58.569 INFO:teuthology.orchestra.run.smithi132.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-24T08:01:58.569 INFO:teuthology.orchestra.run.smithi132.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-24T08:01:58.569 INFO:teuthology.orchestra.run.smithi132.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-24T08:01:58.569 INFO:teuthology.orchestra.run.smithi132.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-24T08:01:58.570 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-24T08:01:58.570 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-24T08:01:58.570 INFO:teuthology.orchestra.run.smithi132.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T08:01:58.570 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages will be upgraded: 2023-11-24T08:01:58.571 INFO:teuthology.orchestra.run.smithi132.stdout: libssl3 2023-11-24T08:01:58.627 INFO:teuthology.orchestra.run.smithi132.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-24T08:01:58.627 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 54.6 MB of archives. 2023-11-24T08:01:58.627 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-24T08:01:58.627 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-24T08:01:58.729 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-24T08:01:58.785 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-24T08:01:58.791 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-24T08:01:58.792 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-24T08:01:58.793 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-24T08:01:58.794 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-24T08:01:58.795 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-24T08:01:58.796 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-24T08:01:58.797 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-24T08:01:58.797 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-24T08:01:58.803 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-24T08:01:58.815 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-24T08:01:59.030 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-24T08:01:59.031 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-24T08:01:59.032 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-24T08:01:59.035 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-24T08:01:59.035 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-24T08:01:59.040 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-24T08:01:59.041 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-24T08:01:59.048 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-24T08:01:59.049 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-24T08:01:59.070 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-24T08:01:59.070 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-24T08:01:59.080 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-24T08:01:59.101 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-24T08:01:59.105 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-24T08:01:59.105 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-24T08:01:59.106 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-24T08:01:59.106 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-24T08:01:59.118 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-24T08:01:59.120 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-24T08:01:59.160 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:59.265 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-24T08:01:59.265 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-24T08:01:59.265 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-24T08:01:59.266 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-24T08:01:59.266 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-24T08:01:59.266 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-24T08:01:59.279 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-24T08:01:59.279 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-24T08:01:59.285 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:59.428 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:01:59.647 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T08:01:59.647 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-24T08:01:59.653 INFO:teuthology.orchestra.run.smithi132.stdout:Preconfiguring packages ... 2023-11-24T08:01:59.854 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 54.6 MB in 1s (77.9 MB/s) 2023-11-24T08:01:59.995 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package flex. 2023-11-24T08:02:00.069 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-24T08:02:00.072 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-24T08:02:00.110 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-24T08:02:00.296 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:02:00.430 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:02:00.539 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:02:00.691 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-volume (18.0.0-7484-ga13ea5ff-1jammy) ... 2023-11-24T08:02:00.738 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T08:02:00.916 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-24T08:02:01.093 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T08:02:01.330 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T08:02:01.866 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package bison. 2023-11-24T08:02:01.937 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-24T08:02:01.941 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-24T08:02:02.036 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T08:02:02.286 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T08:02:02.537 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-24T08:02:02.551 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-24T08:02:02.595 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T08:02:02.779 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T08:02:02.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-24T08:02:02.861 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-11-24T08:02:02.964 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package dump. 2023-11-24T08:02:02.979 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-24T08:02:03.023 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking dump (0.4b47-3) ... 2023-11-24T08:02:03.032 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-11-24T08:02:03.033 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-11-24T08:02:03.188 INFO:teuthology.orchestra.run.smithi057.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-24T08:02:03.188 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-24T08:02:03.188 INFO:teuthology.orchestra.run.smithi057.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-24T08:02:03.189 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-24T08:02:03.190 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-11-24T08:02:03.190 INFO:teuthology.orchestra.run.smithi057.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-24T08:02:03.191 INFO:teuthology.orchestra.run.smithi057.stdout: libengine-pkcs11-openssl 2023-11-24T08:02:03.240 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-11-24T08:02:03.241 INFO:teuthology.orchestra.run.smithi057.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-24T08:02:03.242 INFO:teuthology.orchestra.run.smithi057.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-24T08:02:03.242 INFO:teuthology.orchestra.run.smithi057.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-24T08:02:03.242 INFO:teuthology.orchestra.run.smithi057.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-24T08:02:03.242 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-24T08:02:03.242 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-24T08:02:03.242 INFO:teuthology.orchestra.run.smithi057.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-24T08:02:03.243 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-11-24T08:02:03.243 INFO:teuthology.orchestra.run.smithi057.stdout: libssl3 2023-11-24T08:02:03.298 INFO:teuthology.orchestra.run.smithi057.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-24T08:02:03.298 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 54.6 MB of archives. 2023-11-24T08:02:03.298 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-24T08:02:03.298 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-24T08:02:03.301 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package indent. 2023-11-24T08:02:03.315 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:03.400 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-24T08:02:03.418 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T08:02:03.455 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-24T08:02:03.462 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-24T08:02:03.463 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-24T08:02:03.465 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-24T08:02:03.466 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-24T08:02:03.466 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-24T08:02:03.467 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-24T08:02:03.468 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-24T08:02:03.468 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-24T08:02:03.474 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-24T08:02:03.486 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-24T08:02:03.645 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-24T08:02:03.660 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-24T08:02:03.703 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-24T08:02:03.707 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-24T08:02:03.708 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-24T08:02:03.711 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-24T08:02:03.715 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-24T08:02:03.717 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-24T08:02:03.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-24T08:02:03.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-24T08:02:03.746 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-24T08:02:03.746 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-24T08:02:03.757 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-24T08:02:03.777 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-24T08:02:03.781 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-24T08:02:03.781 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-24T08:02:03.782 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-24T08:02:03.782 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-24T08:02:03.794 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-24T08:02:03.796 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-24T08:02:03.943 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-24T08:02:03.943 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-24T08:02:03.943 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-24T08:02:03.943 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-24T08:02:03.944 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-24T08:02:03.944 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-24T08:02:03.957 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-24T08:02:03.957 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-24T08:02:04.049 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-24T08:02:04.064 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-24T08:02:04.107 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T08:02:04.354 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2023-11-24T08:02:04.385 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-24T08:02:04.400 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-24T08:02:04.443 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T08:02:04.526 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 54.6 MB in 1s (77.2 MB/s) 2023-11-24T08:02:04.662 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package flex. 2023-11-24T08:02:04.734 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-24T08:02:04.738 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-24T08:02:04.750 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-24T08:02:04.766 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-24T08:02:04.794 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-24T08:02:04.804 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:05.049 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-24T08:02:05.064 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-24T08:02:05.107 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:05.365 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T08:02:05.385 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libjson-perl. 2023-11-24T08:02:05.400 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-24T08:02:05.443 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-24T08:02:05.533 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-24T08:02:05.779 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-24T08:02:05.795 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-24T08:02:05.837 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T08:02:05.950 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T08:02:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package bison. 2023-11-24T08:02:06.602 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-24T08:02:06.606 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-24T08:02:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T08:02:07.071 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-24T08:02:07.086 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-24T08:02:07.130 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T08:02:07.182 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-24T08:02:07.198 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T08:02:07.240 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:07.458 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package dump. 2023-11-24T08:02:07.473 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-24T08:02:07.508 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking dump (0.4b47-3) ... 2023-11-24T08:02:07.534 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-24T08:02:07.550 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T08:02:07.593 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:07.811 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package indent. 2023-11-24T08:02:07.826 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:07.911 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T08:02:07.928 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-24T08:02:07.944 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T08:02:07.987 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:08.274 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-24T08:02:08.289 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-24T08:02:08.323 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T08:02:08.340 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-24T08:02:08.355 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-24T08:02:08.390 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T08:02:08.686 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-24T08:02:08.702 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-24T08:02:08.739 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-24T08:02:08.744 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T08:02:08.754 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T08:02:09.013 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-24T08:02:09.029 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-24T08:02:09.072 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T08:02:09.187 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-24T08:02:09.202 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:09.245 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:09.417 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-24T08:02:09.433 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-24T08:02:09.486 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:09.581 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-24T08:02:09.597 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:09.673 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:09.770 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-24T08:02:09.786 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-24T08:02:09.828 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-24T08:02:09.941 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:09.983 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:10.081 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjson-perl. 2023-11-24T08:02:10.097 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-24T08:02:10.139 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-24T08:02:10.252 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-24T08:02:10.268 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T08:02:10.311 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T08:02:10.442 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-24T08:02:10.458 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-24T08:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T08:02:10.806 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-24T08:02:10.820 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-24T08:02:10.873 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T08:02:11.259 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package modemmanager. 2023-11-24T08:02:11.274 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T08:02:11.317 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:11.837 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-24T08:02:11.853 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T08:02:11.895 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:11.998 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package network-manager. 2023-11-24T08:02:12.014 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T08:02:12.065 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-24T08:02:12.148 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-24T08:02:12.164 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-24T08:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:12.509 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-24T08:02:12.525 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T08:02:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:12.697 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ppp. 2023-11-24T08:02:12.713 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-24T08:02:12.903 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-24T08:02:12.920 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-24T08:02:12.953 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T08:02:13.061 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T08:02:13.324 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-24T08:02:13.340 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T08:02:13.382 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T08:02:13.427 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package pptp-linux. 2023-11-24T08:02:13.441 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-24T08:02:13.485 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-24T08:02:13.754 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-24T08:02:13.768 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-24T08:02:13.768 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-24T08:02:13.784 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:13.804 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-24T08:02:13.851 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:14.099 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-24T08:02:14.113 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-24T08:02:14.163 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-24T08:02:14.179 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:14.191 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client-common (238) ... 2023-11-24T08:02:14.221 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:14.486 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-24T08:02:14.500 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:14.510 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-24T08:02:14.526 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:14.536 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:14.574 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:14.817 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-24T08:02:14.833 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-24T08:02:14.892 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T08:02:15.066 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-common. 2023-11-24T08:02:15.080 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-24T08:02:15.166 INFO:teuthology.orchestra.run.smithi132.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-24T08:02:15.198 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-common (238) ... 2023-11-24T08:02:15.430 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-24T08:02:15.446 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-24T08:02:15.488 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T08:02:15.673 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-14. 2023-11-24T08:02:15.688 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:15.743 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:15.841 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package modemmanager. 2023-11-24T08:02:15.857 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-24T08:02:15.899 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:16.506 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager. 2023-11-24T08:02:16.522 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-24T08:02:16.565 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-24T08:02:16.860 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql. 2023-11-24T08:02:16.875 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-24T08:02:16.909 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql (14+238) ... 2023-11-24T08:02:17.170 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client. 2023-11-24T08:02:17.184 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-24T08:02:17.205 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ppp. 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client (14+238) ... 2023-11-24T08:02:17.221 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-24T08:02:17.497 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-24T08:02:17.512 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-24T08:02:17.556 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-24T08:02:17.566 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T08:02:17.860 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pptp-linux. 2023-11-24T08:02:17.874 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-24T08:02:17.910 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-24T08:02:17.942 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package tcl8.6. 2023-11-24T08:02:17.957 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-24T08:02:18.000 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T08:02:18.154 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-24T08:02:18.169 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-24T08:02:18.229 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-24T08:02:18.252 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package tcl. 2023-11-24T08:02:18.269 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-24T08:02:18.316 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-24T08:02:18.558 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-24T08:02:18.573 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-24T08:02:18.616 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client-common (238) ... 2023-11-24T08:02:18.663 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package wpasupplicant. 2023-11-24T08:02:18.679 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-24T08:02:18.722 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T08:02:18.879 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-24T08:02:18.894 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:18.929 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:19.110 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-24T08:02:19.126 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-24T08:02:19.168 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-24T08:02:19.467 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-common. 2023-11-24T08:02:19.482 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-24T08:02:19.535 INFO:teuthology.orchestra.run.smithi057.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-24T08:02:19.566 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-common (238) ... 2023-11-24T08:02:19.579 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-24T08:02:19.595 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-24T08:02:19.646 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T08:02:19.947 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client-common (238) ... 2023-11-24T08:02:20.025 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-14. 2023-11-24T08:02:20.040 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-24T08:02:20.086 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:20.135 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-24T08:02:20.311 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T08:02:20.437 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:20.563 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T08:02:20.722 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T08:02:20.848 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:21.287 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql. 2023-11-24T08:02:21.303 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-24T08:02:21.346 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql (14+238) ... 2023-11-24T08:02:21.614 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-client. 2023-11-24T08:02:21.630 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-24T08:02:21.673 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-client (14+238) ... 2023-11-24T08:02:21.854 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-24T08:02:21.917 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-24T08:02:21.932 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-24T08:02:21.953 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T08:02:21.975 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-24T08:02:22.277 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package tcl8.6. 2023-11-24T08:02:22.294 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-24T08:02:22.336 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T08:02:22.364 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T08:02:22.365 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T08:02:22.647 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package tcl. 2023-11-24T08:02:22.663 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-24T08:02:22.702 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-24T08:02:23.042 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package wpasupplicant. 2023-11-24T08:02:23.058 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-24T08:02:23.100 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T08:02:23.438 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-24T08:02:23.454 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-24T08:02:23.466 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T08:02:23.590 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T08:02:23.661 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-24T08:02:23.716 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-24T08:02:23.992 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T08:02:24.053 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-24T08:02:24.069 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-24T08:02:24.093 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:24.120 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T08:02:24.219 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T08:02:24.369 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T08:02:24.422 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client-common (238) ... 2023-11-24T08:02:24.609 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-24T08:02:24.768 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-24T08:02:24.895 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:25.021 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-24T08:02:25.050 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T08:02:25.147 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-24T08:02:25.159 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up dump (0.4b47-3) ... 2023-11-24T08:02:25.238 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-24T08:02:25.273 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:25.328 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:25.454 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T08:02:25.580 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-24T08:02:25.731 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-24T08:02:25.857 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T08:02:25.947 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-24T08:02:26.017 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T08:02:26.156 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T08:02:26.297 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-24T08:02:26.319 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T08:02:26.396 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-24T08:02:26.446 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:26.571 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-24T08:02:26.772 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client (14+238) ... 2023-11-24T08:02:26.782 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T08:02:26.782 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-24T08:02:26.898 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-24T08:02:27.449 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-24T08:02:27.562 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:27.562 INFO:teuthology.orchestra.run.smithi132.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-24T08:02:27.562 INFO:teuthology.orchestra.run.smithi132.stdout:which means they are currently configured by ifupdown: 2023-11-24T08:02:27.562 INFO:teuthology.orchestra.run.smithi132.stdout:- enp3s0f1 2023-11-24T08:02:27.562 INFO:teuthology.orchestra.run.smithi132.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-24T08:02:27.563 INFO:teuthology.orchestra.run.smithi132.stdout:remove their configuration from /etc/network/interfaces. 2023-11-24T08:02:27.563 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:27.575 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-24T08:02:27.696 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-24T08:02:27.701 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-24T08:02:27.819 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-24T08:02:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-24T08:02:28.104 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-24T08:02:28.214 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-24T08:02:28.504 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-24T08:02:29.193 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:29.312 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-24T08:02:29.353 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:29.438 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up dump (0.4b47-3) ... 2023-11-24T08:02:29.462 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-24T08:02:29.533 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-24T08:02:29.588 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-common (238) ... 2023-11-24T08:02:29.597 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:29.724 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-24T08:02:29.849 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-24T08:02:29.984 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-24T08:02:30.110 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-24T08:02:30.225 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-24T08:02:30.287 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-24T08:02:30.413 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-24T08:02:30.508 INFO:teuthology.orchestra.run.smithi132.stdout:Adding user postgres to group ssl-cert 2023-11-24T08:02:30.589 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-24T08:02:30.715 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:30.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:30.773 INFO:teuthology.orchestra.run.smithi132.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-24T08:02:30.841 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-24T08:02:31.010 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-client (14+238) ... 2023-11-24T08:02:31.048 INFO:teuthology.orchestra.run.smithi132.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-24T08:02:31.048 INFO:teuthology.orchestra.run.smithi132.stdout:Removing obsolete dictionary files: 2023-11-24T08:02:31.136 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-24T08:02:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:31.729 INFO:teuthology.orchestra.run.smithi057.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-24T08:02:31.729 INFO:teuthology.orchestra.run.smithi057.stdout:which means they are currently configured by ifupdown: 2023-11-24T08:02:31.730 INFO:teuthology.orchestra.run.smithi057.stdout:- ens1f0 2023-11-24T08:02:31.730 INFO:teuthology.orchestra.run.smithi057.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-24T08:02:31.730 INFO:teuthology.orchestra.run.smithi057.stdout:remove their configuration from /etc/network/interfaces. 2023-11-24T08:02:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:31.762 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-24T08:02:31.870 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-24T08:02:32.226 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:32.278 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-24T08:02:32.699 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-24T08:02:32.732 INFO:teuthology.orchestra.run.smithi132.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-24T08:02:32.749 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-24T08:02:32.812 INFO:teuthology.orchestra.run.smithi132.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-24T08:02:32.812 INFO:teuthology.orchestra.run.smithi132.stdout:This user must also own the server process. 2023-11-24T08:02:32.812 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:32.813 INFO:teuthology.orchestra.run.smithi132.stdout:The database cluster will be initialized with locale "en_US". 2023-11-24T08:02:32.813 INFO:teuthology.orchestra.run.smithi132.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-24T08:02:32.813 INFO:teuthology.orchestra.run.smithi132.stdout:The default text search configuration will be set to "english". 2023-11-24T08:02:32.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:32.813 INFO:teuthology.orchestra.run.smithi132.stdout:Data page checksums are disabled. 2023-11-24T08:02:32.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:32.813 INFO:teuthology.orchestra.run.smithi132.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-24T08:02:32.814 INFO:teuthology.orchestra.run.smithi132.stdout:creating subdirectories ... ok 2023-11-24T08:02:32.814 INFO:teuthology.orchestra.run.smithi132.stdout:selecting dynamic shared memory implementation ... posix 2023-11-24T08:02:32.838 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default max_connections ... 100 2023-11-24T08:02:32.874 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default shared_buffers ... 128MB 2023-11-24T08:02:32.887 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default time zone ... Etc/UTC 2023-11-24T08:02:32.888 INFO:teuthology.orchestra.run.smithi132.stdout:creating configuration files ... ok 2023-11-24T08:02:33.058 INFO:teuthology.orchestra.run.smithi132.stdout:running bootstrap script ... ok 2023-11-24T08:02:33.456 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-24T08:02:33.590 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-24T08:02:33.699 INFO:teuthology.orchestra.run.smithi132.stdout:performing post-bootstrap initialization ... ok 2023-11-24T08:02:34.026 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-24T08:02:34.153 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-common (238) ... 2023-11-24T08:02:34.316 INFO:teuthology.orchestra.run.smithi132.stdout:syncing data to disk ... ok 2023-11-24T08:02:34.833 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-24T08:02:35.093 INFO:teuthology.orchestra.run.smithi057.stdout:Adding user postgres to group ssl-cert 2023-11-24T08:02:35.363 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:35.363 INFO:teuthology.orchestra.run.smithi057.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-24T08:02:35.617 INFO:teuthology.orchestra.run.smithi057.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-24T08:02:35.617 INFO:teuthology.orchestra.run.smithi057.stdout:Removing obsolete dictionary files: 2023-11-24T08:02:36.314 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-24T08:02:36.837 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-24T08:02:37.189 INFO:teuthology.orchestra.run.smithi057.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-24T08:02:37.206 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-24T08:02:37.249 INFO:teuthology.orchestra.run.smithi057.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-24T08:02:37.249 INFO:teuthology.orchestra.run.smithi057.stdout:This user must also own the server process. 2023-11-24T08:02:37.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:37.250 INFO:teuthology.orchestra.run.smithi057.stdout:The database cluster will be initialized with locale "en_US". 2023-11-24T08:02:37.250 INFO:teuthology.orchestra.run.smithi057.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-24T08:02:37.250 INFO:teuthology.orchestra.run.smithi057.stdout:The default text search configuration will be set to "english". 2023-11-24T08:02:37.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:37.250 INFO:teuthology.orchestra.run.smithi057.stdout:Data page checksums are disabled. 2023-11-24T08:02:37.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:37.251 INFO:teuthology.orchestra.run.smithi057.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-24T08:02:37.251 INFO:teuthology.orchestra.run.smithi057.stdout:creating subdirectories ... ok 2023-11-24T08:02:37.251 INFO:teuthology.orchestra.run.smithi057.stdout:selecting dynamic shared memory implementation ... posix 2023-11-24T08:02:37.276 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default max_connections ... 100 2023-11-24T08:02:37.313 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default shared_buffers ... 128MB 2023-11-24T08:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout:selecting default time zone ... Etc/UTC 2023-11-24T08:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout:creating configuration files ... ok 2023-11-24T08:02:37.507 INFO:teuthology.orchestra.run.smithi057.stdout:running bootstrap script ... ok 2023-11-24T08:02:37.917 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:38.043 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-24T08:02:38.157 INFO:teuthology.orchestra.run.smithi057.stdout:performing post-bootstrap initialization ... ok 2023-11-24T08:02:38.161 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql (14+238) ... 2023-11-24T08:02:38.304 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:38.429 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:38.661 INFO:teuthology.orchestra.run.smithi057.stdout:syncing data to disk ... ok 2023-11-24T08:02:38.692 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T08:02:38.692 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T08:02:39.181 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-24T08:02:39.415 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-24T08:02:39.777 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T08:02:39.927 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T08:02:41.363 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-24T08:02:41.496 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-24T08:02:42.220 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T08:02:42.225 DEBUG:teuthology.parallel:result is None 2023-11-24T08:02:42.245 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:42.371 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-24T08:02:42.497 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up postgresql (14+238) ... 2023-11-24T08:02:42.623 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-24T08:02:42.749 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-24T08:02:43.017 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T08:02:43.017 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-24T08:02:43.768 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-24T08:02:44.062 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-24T08:02:44.205 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-24T08:02:45.667 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-24T08:02:45.760 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-24T08:02:46.465 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-24T08:02:46.470 DEBUG:teuthology.parallel:result is None 2023-11-24T08:02:46.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:02:46.689 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2023-11-24T08:02:46.712 INFO:teuthology.orchestra.run.smithi057.stdout:18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:02:46.713 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:02:46.713 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-ga13ea5ff-1jammy is installed. 2023-11-24T08:02:46.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T08:02:46.851 DEBUG:teuthology.orchestra.run.smithi132:> dpkg-query -W -f '${Version}' ceph 2023-11-24T08:02:46.876 INFO:teuthology.orchestra.run.smithi132.stdout:18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:02:46.876 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-ga13ea5ff-1jammy 2023-11-24T08:02:46.877 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-ga13ea5ff-1jammy is installed. 2023-11-24T08:02:46.877 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T08:02:46.877 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:46.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T08:02:46.899 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:46.899 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T08:02:46.938 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T08:02:46.939 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:46.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T08:02:46.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T08:02:47.031 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:47.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T08:02:47.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T08:02:47.121 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T08:02:47.122 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:47.122 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T08:02:47.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T08:02:47.207 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:47.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T08:02:47.229 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T08:02:47.297 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T08:02:47.298 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:47.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T08:02:47.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T08:02:47.383 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:47.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T08:02:47.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T08:02:47.469 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T08:02:47.539 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T08:02:47.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2023-11-24T08:02:47.542 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2023-11-24T08:02:47.563 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T08:02:47.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T08:02:47.610 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T08:02:47.632 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T08:02:47.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T08:02:47.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T08:02:47.706 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T08:02:47.707 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T08:02:47.707 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T08:02:47.708 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:47.708 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T08:02:47.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T08:02:47.842 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:47.842 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T08:02:47.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T08:02:47.949 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T08:02:47.949 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T08:02:47.949 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7465579', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-tests', 'sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9764, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-tests', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCeL7qpF0g8jOSUJk9M3DdZzOZBiSaEjQJplzTLcUp4IbDOp1u0rj4wznLjrsN8DRqMVk/huQCDco4ekQVz6sNs=', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGIe2tkCczRgq6/RDlu4Ojzb+oCLrtYmGgskPGqK3yhm3Y1A4CW64NRWjOpumgD1KT/psl644oFybQ8RZXnuuTc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_07:31:48', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T08:02:47.950 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T08:02:47.954 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T08:02:47.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T08:02:48.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T08:02:48.031 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:48.031 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T08:02:48.079 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T08:02:48.080 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-11-24T08:02:48.131 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T08:02:48.132 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:48.132 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 878 Links: 1 2023-11-24T08:02:48.132 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:48.132 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-11-24 07:56:08.180471007 +0000 2023-11-24T08:02:48.132 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-11-24 07:56:07.788474509 +0000 2023-11-24T08:02:48.132 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-11-24 07:56:07.788474509 +0000 2023-11-24T08:02:48.132 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-11-24 07:56:07.788474509 +0000 2023-11-24T08:02:48.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T08:02:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-11-24T08:02:48.199 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-11-24T08:02:48.199 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000454696 s, 1.1 MB/s 2023-11-24T08:02:48.200 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T08:02:48.258 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-11-24T08:02:48.312 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T08:02:48.312 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:48.312 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 893 Links: 1 2023-11-24T08:02:48.312 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:48.312 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-11-24 07:56:08.820465290 +0000 2023-11-24T08:02:48.313 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-11-24 07:56:08.440468685 +0000 2023-11-24T08:02:48.313 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-11-24 07:56:08.440468685 +0000 2023-11-24T08:02:48.313 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-11-24 07:56:08.440468685 +0000 2023-11-24T08:02:48.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T08:02:48.378 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-11-24T08:02:48.379 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-11-24T08:02:48.379 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000426739 s, 1.2 MB/s 2023-11-24T08:02:48.380 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T08:02:48.438 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-11-24T08:02:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T08:02:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:48.489 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 912 Links: 1 2023-11-24T08:02:48.489 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:48.489 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-11-24 07:56:09.472459467 +0000 2023-11-24T08:02:48.489 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-11-24 07:56:09.092462861 +0000 2023-11-24T08:02:48.489 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-11-24 07:56:09.092462861 +0000 2023-11-24T08:02:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-11-24 07:56:09.092462861 +0000 2023-11-24T08:02:48.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T08:02:48.555 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-11-24T08:02:48.555 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-11-24T08:02:48.556 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000446464 s, 1.1 MB/s 2023-11-24T08:02:48.557 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T08:02:48.610 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-11-24T08:02:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T08:02:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:48.660 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 929 Links: 1 2023-11-24T08:02:48.660 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:48.661 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-11-24 07:56:09.744457037 +0000 2023-11-24T08:02:48.661 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-11-24 07:56:09.740457073 +0000 2023-11-24T08:02:48.661 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-11-24 07:56:09.740457073 +0000 2023-11-24T08:02:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-11-24 07:56:09.740457073 +0000 2023-11-24T08:02:48.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T08:02:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-11-24T08:02:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-11-24T08:02:48.724 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000733017 s, 698 kB/s 2023-11-24T08:02:48.726 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T08:02:48.778 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:02:48.778 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:48.778 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T08:02:48.788 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T08:02:48.788 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2023-11-24T08:02:48.840 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T08:02:48.840 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:48.840 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 896 Links: 1 2023-11-24T08:02:48.841 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:48.841 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-24 07:56:08.147108815 +0000 2023-11-24T08:02:48.841 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-24 07:56:07.751112352 +0000 2023-11-24T08:02:48.841 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-24 07:56:07.751112352 +0000 2023-11-24T08:02:48.841 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-24 07:56:07.751112352 +0000 2023-11-24T08:02:48.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T08:02:48.930 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-24T08:02:48.931 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-24T08:02:48.931 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00039992 s, 1.3 MB/s 2023-11-24T08:02:48.932 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T08:02:48.996 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2023-11-24T08:02:49.053 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T08:02:49.053 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:49.053 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 912 Links: 1 2023-11-24T08:02:49.053 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:49.053 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-24 07:56:08.803102955 +0000 2023-11-24T08:02:49.054 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-24 07:56:08.411106457 +0000 2023-11-24T08:02:49.054 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-24 07:56:08.411106457 +0000 2023-11-24T08:02:49.054 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-24 07:56:08.411106457 +0000 2023-11-24T08:02:49.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T08:02:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-24T08:02:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-24T08:02:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000380155 s, 1.3 MB/s 2023-11-24T08:02:49.121 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T08:02:49.181 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 931 Links: 1 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-24 07:56:09.467097024 +0000 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-24 07:56:09.087100419 +0000 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-24 07:56:09.087100419 +0000 2023-11-24T08:02:49.235 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-24 07:56:09.087100419 +0000 2023-11-24T08:02:49.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T08:02:49.300 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-24T08:02:49.300 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-24T08:02:49.300 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000382734 s, 1.3 MB/s 2023-11-24T08:02:49.302 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T08:02:49.359 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2023-11-24T08:02:49.409 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T08:02:49.409 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T08:02:49.409 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 949 Links: 1 2023-11-24T08:02:49.409 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T08:02:49.410 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-11-24 07:56:10.175090701 +0000 2023-11-24T08:02:49.410 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-11-24 07:56:09.755094452 +0000 2023-11-24T08:02:49.410 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-11-24 07:56:09.755094452 +0000 2023-11-24T08:02:49.410 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-11-24 07:56:09.755094452 +0000 2023-11-24T08:02:49.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T08:02:49.476 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-11-24T08:02:49.476 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-11-24T08:02:49.476 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00040002 s, 1.3 MB/s 2023-11-24T08:02:49.478 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T08:02:49.531 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:02:49.531 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T08:02:49.531 INFO:tasks.ceph:Generating config... 2023-11-24T08:02:49.532 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T08:02:49.533 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T08:02:49.533 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T08:02:49.533 INFO:tasks.ceph:[client] pid file = 2023-11-24T08:02:49.533 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T08:02:49.533 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T08:02:49.533 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-24T08:02:49.533 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T08:02:49.533 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T08:02:49.533 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T08:02:49.533 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T08:02:49.533 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T08:02:49.534 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T08:02:49.535 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T08:02:49.535 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T08:02:49.536 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T08:02:49.536 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T08:02:49.536 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T08:02:49.536 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T08:02:49.536 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T08:02:49.536 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T08:02:49.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T08:02:49.584 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T08:02:49.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T08:02:49.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:02:49.673 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.132'), ('mon.c', '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]')] 2023-11-24T08:02:49.673 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T08:02:49.674 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:49.674 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T08:02:49.723 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.132 --addv c '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:02:49.816 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:02:49.816 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 445cea61-e72c-4da9-979a-02ade002d7d6 2023-11-24T08:02:49.816 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = pacific 2023-11-24T08:02:49.816 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2023-11-24T08:02:49.816 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 445cea61-e72c-4da9-979a-02ade002d7d6 2023-11-24T08:02:49.816 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2023-11-24T08:02:49.817473+0000 2023-11-24T08:02:49.816 INFO:teuthology.orchestra.run.smithi057.stdout:created 2023-11-24T08:02:49.817473+0000 2023-11-24T08:02:49.817 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 16 (pacific) 2023-11-24T08:02:49.817 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2023-11-24T08:02:49.817 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2023-11-24T08:02:49.817 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2023-11-24T08:02:49.817 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] mon.c 2023-11-24T08:02:49.817 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T08:02:49.819 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T08:02:49.831 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 445cea61-e72c-4da9-979a-02ade002d7d6... 2023-11-24T08:02:49.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T08:02:49.878 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.921 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-11-24T08:02:49.922 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 445cea61-e72c-4da9-979a-02ade002d7d6 2023-11-24T08:02:49.924 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.926 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-11-24T08:02:49.926 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-11-24T08:02:49.926 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.926 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-11-24T08:02:49.926 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-11-24T08:02:49.926 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-11-24T08:02:49.926 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.927 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-11-24T08:02:49.928 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-11-24T08:02:49.929 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-11-24T08:02:49.930 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.930 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-11-24T08:02:49.930 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-11-24T08:02:49.930 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-11-24T08:02:49.930 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-11-24T08:02:49.930 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-11-24T08:02:49.930 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: debug finisher = 20 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-11-24T08:02:49.931 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.932 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-11-24T08:02:49.933 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-11-24T08:02:49.934 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-11-24T08:02:49.935 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-11-24T08:02:49.936 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-11-24T08:02:49.936 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2023-11-24T08:02:49.936 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-11-24T08:02:49.936 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-11-24T08:02:49.936 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-11-24T08:02:49.937 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-11-24T08:02:49.937 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-11-24T08:02:49.937 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-11-24T08:02:49.937 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-11-24T08:02:49.937 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-11-24T08:02:49.938 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2023-11-24T08:02:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2023-11-24T08:02:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T08:02:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2023-11-24T08:02:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2023-11-24T08:02:49.939 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.940 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.941 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.57,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-11-24T08:02:49.942 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on skipped message = False 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 445cea61-e72c-4da9-979a-02ade002d7d6 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.943 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2023-11-24T08:02:49.944 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.945 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2023-11-24T08:02:49.946 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2023-11-24T08:02:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-24T08:02:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2023-11-24T08:02:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2023-11-24T08:02:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T08:02:49.947 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-11-24T08:02:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: debug finisher = 20 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-11-24T08:02:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T08:02:49.950 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T08:02:49.951 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = "" 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-11-24T08:02:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-11-24T08:02:49.953 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-11-24T08:02:49.955 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T08:02:49.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T08:02:50.055 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T08:02:50.056 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:50.056 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T08:02:50.065 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:50.065 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T08:02:50.115 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:02:50.115 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:50.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T08:02:50.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:02:50.192 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:02:50.193 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:02:50.243 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:02:50.244 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:50.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T08:02:50.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T08:02:50.281 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:02:50.282 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:02:50.333 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T08:02:50.333 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T08:02:50.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T08:02:50.392 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T08:02:50.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T08:02:50.458 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T08:02:50.480 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T08:02:50.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T08:02:50.539 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T08:02:50.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T08:02:50.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T08:02:50.668 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T08:02:50.672 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T08:02:50.693 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T08:02:50.751 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T08:02:50.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T08:02:50.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T08:02:50.875 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T08:02:50.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T08:02:50.900 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T08:02:50.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T08:02:50.945 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T08:02:50.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T08:02:51.050 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T08:02:51.070 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T08:02:51.114 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T08:02:51.130 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T08:02:51.218 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T08:02:51.236 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T08:02:51.236 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T08:02:51.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T08:02:51.257 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:02:51.257 INFO:tasks.ceph:role: osd.0 2023-11-24T08:02:51.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:02:51.257 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T08:02:51.347 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:02:51.347 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:02:51.347 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:02:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:02:51.348 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:02:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:02:51.348 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:02:51.348 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:02:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:02:51.348 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:02:52.656 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-11-24T08:02:52.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-11-24T08:02:52.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T08:02:52.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T08:02:52.752 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:02:52.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:02:52.753 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T08:02:52.820 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:02:52.820 INFO:tasks.ceph:role: osd.1 2023-11-24T08:02:52.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:02:52.821 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T08:02:52.912 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:02:52.912 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:02:52.912 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:02:52.913 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:02:52.913 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:02:52.913 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:02:52.913 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:02:52.914 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:02:52.914 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:02:52.914 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:02:54.211 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-11-24T08:02:54.214 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-11-24T08:02:54.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T08:02:54.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T08:02:54.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:02:54.314 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:02:54.314 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T08:02:54.376 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:02:54.376 INFO:tasks.ceph:role: osd.2 2023-11-24T08:02:54.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:02:54.377 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T08:02:54.468 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:02:54.469 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:02:55.774 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-11-24T08:02:55.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-11-24T08:02:55.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T08:02:55.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T08:02:55.868 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:02:55.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:02:55.870 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T08:02:55.933 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T08:02:55.933 INFO:tasks.ceph:role: osd.3 2023-11-24T08:02:55.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:02:55.934 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T08:02:56.024 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:02:56.024 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:02:56.024 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:02:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:02:56.025 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:02:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:02:56.025 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:02:56.025 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:02:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:02:56.025 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:02:57.331 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-11-24T08:02:57.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-11-24T08:02:57.334 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T08:02:57.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T08:02:57.428 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:02:57.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:02:57.430 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:02:57.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:02:57.550+0000 7fe96502b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T08:02:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:02:57.550+0000 7fe96502b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T08:02:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:02:57.550+0000 7fe96502b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:02:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:02:57.550+0000 7fe96502b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:02:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:02:57.550+0000 7fe96502b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T08:02:57.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:02:57.554+0000 7fe96502b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T08:03:00.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T08:03:00.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:00.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:00.682+0000 7f7c37920640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T08:03:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:00.682+0000 7f7c37920640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T08:03:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:00.682+0000 7f7c37920640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:03:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:00.682+0000 7f7c37920640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:03:00.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:00.682+0000 7f7c37920640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T08:03:00.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:00.682+0000 7f7c37920640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T08:03:03.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T08:03:03.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:03.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:03.814+0000 7f340e513640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T08:03:03.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:03.814+0000 7f340e513640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T08:03:03.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:03.818+0000 7f340e513640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:03:03.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:03.818+0000 7f340e513640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:03:03.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:03.818+0000 7f340e513640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T08:03:03.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:03.818+0000 7f340e513640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T08:03:06.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T08:03:06.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:06.958+0000 7fdc22d2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T08:03:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:06.962+0000 7fdc22d2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T08:03:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:06.962+0000 7fdc22d2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:03:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:06.962+0000 7fdc22d2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:03:06.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:06.962+0000 7fdc22d2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T08:03:06.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:06.962+0000 7fdc22d2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T08:03:09.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T08:03:09.991 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:10.014 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:10.014 INFO:tasks.ceph:role: osd.4 2023-11-24T08:03:10.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:03:10.015 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T08:03:10.086 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:10.087 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:10.087 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:10.087 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:10.087 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:10.557 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-24T08:03:10.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-24T08:03:10.560 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:10.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:10.719 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:03:10.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:03:10.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:10.791 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:10.791 INFO:tasks.ceph:role: osd.5 2023-11-24T08:03:10.791 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:03:10.791 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T08:03:10.861 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:10.861 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:10.861 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:10.861 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:10.861 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:10.862 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:10.862 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:10.862 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:10.862 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:10.862 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:11.307 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-24T08:03:11.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-24T08:03:11.311 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:11.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:11.429 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:03:11.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:03:11.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:11.493 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:11.493 INFO:tasks.ceph:role: osd.6 2023-11-24T08:03:11.493 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:03:11.493 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T08:03:11.564 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:11.564 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:11.565 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:12.025 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-24T08:03:12.028 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-24T08:03:12.028 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:12.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:12.205 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:03:12.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:03:12.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:12.270 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T08:03:12.271 INFO:tasks.ceph:role: osd.7 2023-11-24T08:03:12.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:03:12.271 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T08:03:12.343 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T08:03:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T08:03:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T08:03:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T08:03:12.343 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T08:03:12.343 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-11-24T08:03:12.344 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T08:03:12.344 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T08:03:12.344 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T08:03:12.344 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T08:03:12.839 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-11-24T08:03:12.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-11-24T08:03:12.842 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:12.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:13.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:03:13.013 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-11-24T08:03:13.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:13.145+0000 7fe73f8b8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T08:03:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:13.145+0000 7fe73f8b8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T08:03:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:13.145+0000 7fe73f8b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:03:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:13.145+0000 7fe73f8b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:03:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:13.145+0000 7fe73f8b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T08:03:13.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:13.149+0000 7fe73f8b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T08:03:16.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T08:03:16.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:16.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:16.252+0000 7fb0c774c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T08:03:16.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:16.252+0000 7fb0c774c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T08:03:16.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:16.252+0000 7fb0c774c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:03:16.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:16.252+0000 7fb0c774c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:03:16.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:16.252+0000 7fb0c774c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T08:03:16.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:16.256+0000 7fb0c774c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T08:03:17.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:17.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:19.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T08:03:19.257 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:19.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:19.356+0000 7fe99edd8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T08:03:19.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:19.356+0000 7fe99edd8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T08:03:19.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:19.356+0000 7fe99edd8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:03:19.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:19.356+0000 7fe99edd8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:03:19.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:19.356+0000 7fe99edd8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T08:03:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:19.360+0000 7fe99edd8640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T08:03:22.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T08:03:22.373 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:22.467+0000 7f1fe6a4a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T08:03:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:22.467+0000 7f1fe6a4a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T08:03:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:22.467+0000 7f1fe6a4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:03:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:22.467+0000 7f1fe6a4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:03:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:22.467+0000 7f1fe6a4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T08:03:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:22.467+0000 7f1fe6a4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T08:03:25.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T08:03:25.510 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T08:03:25.510 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:25.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T08:03:25.534 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:25.534 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T08:03:25.597 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:25.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T08:03:25.661 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:25.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T08:03:25.729 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:25.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T08:03:25.797 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:25.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T08:03:25.865 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:25.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T08:03:25.929 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:25.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T08:03:25.951 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:25.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T08:03:26.015 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:26.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T08:03:26.079 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:26.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T08:03:26.148 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:26.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T08:03:26.210 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:26.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T08:03:26.274 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:26.274 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T08:03:26.338 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:26.338 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T08:03:26.348 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:26.348 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T08:03:26.400 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:26.400 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T08:03:26.409 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:26.409 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T08:03:26.458 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T08:03:26.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T08:03:26.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T08:03:26.506 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2023-11-24T08:03:26.506 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBlAy9zFxAA6XZfIsLKTOoOTouFh2tD9w== 2023-11-24T08:03:26.506 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-11-24T08:03:26.506 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBli5Y5IBAAnvP0ucgaWCMVrPGzxD66SA== 2023-11-24T08:03:26.507 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-11-24T08:03:26.507 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBltsHpJxAA4cXeOlSioW+qpB6iET0JYA== 2023-11-24T08:03:26.507 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2023-11-24T08:03:26.507 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCxWGBlL0EOIRAAGl5XgP5YNoKHFXcAZ7x8Dw== 2023-11-24T08:03:26.507 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2023-11-24T08:03:26.507 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC0WGBllgHlKBAAs4PpDKC95e8EbMikLNYamg== 2023-11-24T08:03:26.507 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2023-11-24T08:03:26.508 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC3WGBl0BHZMBAAO9QEi1GOOfCUoxneHsmMtQ== 2023-11-24T08:03:26.508 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2023-11-24T08:03:26.508 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC6WGBl7854ORAAjYNCXFSYc+rSJHmK5WNuBQ== 2023-11-24T08:03:26.508 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2023-11-24T08:03:26.509 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBlE12EGxAAnyGvPcM8AfeaVmxsl+MaBg== 2023-11-24T08:03:26.509 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-11-24T08:03:26.509 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBlIvACLRAA3GBFpw4471E7VMC1v83uKw== 2023-11-24T08:03:26.509 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-11-24T08:03:26.510 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBlMAZmNBAAJ764yAUaJrB0C/NMgccnIQ== 2023-11-24T08:03:26.510 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2023-11-24T08:03:26.510 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDBWGBlOWLlCBAAn/3woUG2ZUM65EvKQ/plBg== 2023-11-24T08:03:26.510 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2023-11-24T08:03:26.510 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDEWGBlbNduDxAABASB690ioHFg1QYgfbclaA== 2023-11-24T08:03:26.511 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2023-11-24T08:03:26.511 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDHWGBlpKlsFRAAIIo9fYbozro/Zf40wo7pqg== 2023-11-24T08:03:26.511 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2023-11-24T08:03:26.511 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDKWGBlVZj5GxAAkCx/Ev5UjrAu+8MKzlZrWw== 2023-11-24T08:03:26.511 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-11-24T08:03:26.512 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg== 2023-11-24T08:03:26.512 INFO:teuthology.orchestra.run.smithi057.stdout:[client.2] 2023-11-24T08:03:26.512 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCrWGBlzP4XAxAAgbiVgyWCJo76uqBghI1FOw== 2023-11-24T08:03:26.512 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2023-11-24T08:03:26.512 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCrWGBl+4YCBxAAKfb7t9BjuhCDnWDrdkswdA== 2023-11-24T08:03:26.512 INFO:teuthology.orchestra.run.smithi057.stdout:[client.3] 2023-11-24T08:03:26.512 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCrWGBlm45BDRAAv46vHB8X5TFKK0XqdxA1tQ== 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqWGBlAy9zFxAA6XZfIsLKTOoOTouFh2tD9w== 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqWGBli5Y5IBAAnvP0ucgaWCMVrPGzxD66SA== 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqWGBltsHpJxAA4cXeOlSioW+qpB6iET0JYA== 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2023-11-24T08:03:26.520 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCxWGBlL0EOIRAAGl5XgP5YNoKHFXcAZ7x8Dw== 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQC0WGBllgHlKBAAs4PpDKC95e8EbMikLNYamg== 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQC3WGBl0BHZMBAAO9QEi1GOOfCUoxneHsmMtQ== 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQC6WGBl7854ORAAjYNCXFSYc+rSJHmK5WNuBQ== 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqWGBlE12EGxAAnyGvPcM8AfeaVmxsl+MaBg== 2023-11-24T08:03:26.521 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqWGBlIvACLRAA3GBFpw4471E7VMC1v83uKw== 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqWGBlMAZmNBAAJ764yAUaJrB0C/NMgccnIQ== 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDBWGBlOWLlCBAAn/3woUG2ZUM65EvKQ/plBg== 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDEWGBlbNduDxAABASB690ioHFg1QYgfbclaA== 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2023-11-24T08:03:26.522 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDHWGBlpKlsFRAAIIo9fYbozro/Zf40wo7pqg== 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDKWGBlVZj5GxAAkCx/Ev5UjrAu+8MKzlZrWw== 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg== 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout:[client.2] 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrWGBlzP4XAxAAgbiVgyWCJo76uqBghI1FOw== 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrWGBl+4YCBxAAKfb7t9BjuhCDnWDrdkswdA== 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout:[client.3] 2023-11-24T08:03:26.523 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrWGBlm45BDRAAv46vHB8X5TFKK0XqdxA1tQ== 2023-11-24T08:03:26.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:26.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:26.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:26.630 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:26.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:26.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:26.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:26.981 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:26.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T08:03:27.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:27.042 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:27.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:27.104 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T08:03:27.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.275 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.336 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T08:03:27.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.454 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.515 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.572 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T08:03:27.631 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T08:03:27.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T08:03:27.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:03:27.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T08:03:27.794 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T08:03:27.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:03:27.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T08:03:27.958 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T08:03:28.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T08:03:28.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T08:03:28.157 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:28.161 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T08:03:28.210 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T08:03:28.210 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T08:03:28.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T08:03:28.214 INFO:tasks.ceph.mon.a:Started 2023-11-24T08:03:28.214 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T08:03:28.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T08:03:28.261 INFO:tasks.ceph.mon.b:Started 2023-11-24T08:03:28.261 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T08:03:28.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T08:03:28.265 INFO:tasks.ceph.mon.c:Started 2023-11-24T08:03:28.265 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T08:03:28.265 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T08:03:28.265 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T08:03:28.269 INFO:tasks.ceph.mgr.y:Started 2023-11-24T08:03:28.269 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T08:03:28.269 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T08:03:28.272 INFO:tasks.ceph.mgr.x:Started 2023-11-24T08:03:28.272 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T08:03:28.273 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T08:03:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdfcc9640 1 Processor -- start 2023-11-24T08:03:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdfcc9640 1 -- start start 2023-11-24T08:03:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdfcc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdfcc9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdfcc9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd80723c0 con 0x7f7bd80ccef0 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdfcc9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd8072980 con 0x7f7bd80cd350 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdfcc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80726a0 con 0x7f7bd81624f0 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bde266640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdda65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdda65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:38396/0 (socket says 172.21.15.57:38396) 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 learned_addr learned my addr 172.21.15.57:0/1910704452 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdd264640 1 --1- 172.21.15.57:0/1910704452 >> v1:172.21.15.57:6789/0 conn(0x7f7bd80ccef0 0x7f7bd8071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58704/0 (socket says 172.21.15.57:58704) 2023-11-24T08:03:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:03:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.413+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:28.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:28.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:28.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:03:28.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:28.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:28.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:03:28.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:28.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:28.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:28.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:28.617+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:03:29.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:29.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:29.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:29.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:29.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:03:29.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:29.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:03:29.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:29.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:29.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.021+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:03:29.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:29.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:29.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:03:29.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:29.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:29.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:29.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:29.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:03:29.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:29.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:29.825+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:03:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd81628d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd81628d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 msgr2=0x7f7bd80cb9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.57:3300/0 conn(0x7f7bd80cd350 0x7f7bd80cb9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 -- 172.21.15.57:0/1910704452 >> v1:172.21.15.57:6789/0 conn(0x7f7bd80ccef0 legacy=0x7f7bd8071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 -- 172.21.15.57:0/1910704452 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd806c7e0 con 0x7f7bbc006180 2023-11-24T08:03:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bcf7fe640 1 -- 172.21.15.57:0/1910704452 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd8072980 con 0x7f7bbc0036f0 2023-11-24T08:03:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:31.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:31.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:31.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:31.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.413+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:31.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.617+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:31.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.617+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:31.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.617+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:31.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.617+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:31.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:31.617+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T08:03:32.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.021+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:32.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.021+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.021+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.021+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.021+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T08:03:32.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.825+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:32.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.825+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:32.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.825+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:32.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.825+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:32.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:32.825+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T08:03:33.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.601+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281807431 0 0) 0x7f7bd806c7e0 con 0x7f7bbc006180 2023-11-24T08:03:33.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.601+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc4003530 con 0x7f7bbc006180 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357496229 0 0) 0x7f7bc4003530 con 0x7f7bbc006180 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 msgr2=0x7f7bbc005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 --2- 172.21.15.57:0/1910704452 >> v2:172.21.15.132:3300/0 conn(0x7f7bbc0036f0 0x7f7bbc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc00af30 con 0x7f7bbc006180 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f7bc8001700 con 0x7f7bbc006180 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 >> v1:172.21.15.132:6789/0 conn(0x7f7bbc006180 legacy=0x7f7bbc008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bde266640 1 -- 172.21.15.57:0/1910704452 reap_dead start 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bc400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8072980 con 0x7f7bc40039d0 2023-11-24T08:03:33.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40055f0 con 0x7f7bc4004e30 2023-11-24T08:03:33.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc400bed0 con 0x7f7bd81624f0 2023-11-24T08:03:33.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bc400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.605+0000 7f7bdd264640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdd264640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdd264640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdd264640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdd264640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bc40047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bc40047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bc40047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 msgr2=0x7f7bc400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bc400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bdda65640 1 -- 172.21.15.57:0/1910704452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4003530 con 0x7f7bc40039d0 2023-11-24T08:03:33.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.609+0000 7f7bde266640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bc400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:33.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.613+0000 7f7bdda65640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bc4003dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4019b00 tx=0x7f7bd401de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83254185794e9328 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:33.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.613+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40a6d30 con 0x7f7bc40039d0 2023-11-24T08:03:33.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.613+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd400c040 con 0x7f7bc40039d0 2023-11-24T08:03:33.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.613+0000 7f7bdca63640 1 -- 172.21.15.57:0/1910704452 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40ae660 con 0x7f7bc40039d0 2023-11-24T08:03:33.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/1910704452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 msgr2=0x7f7bc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bc4003dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4019b00 tx=0x7f7bd401de70 comp rx=0 tx=0).stop 2023-11-24T08:03:33.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/1910704452 shutdown_connections 2023-11-24T08:03:33.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bc400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bc40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/1910704452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bc4003dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/1910704452 >> 172.21.15.57:0/1910704452 conn(0x7f7bd80b0c80 msgr2=0x7f7bd80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:33.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/1910704452 shutdown_connections 2023-11-24T08:03:33.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/1910704452 wait complete. 2023-11-24T08:03:33.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 Processor -- start 2023-11-24T08:03:33.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.617+0000 7f7bdfcc9640 1 -- start start 2023-11-24T08:03:33.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bd81fb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bd815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80b2140 con 0x7f7bc40039d0 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80b2420 con 0x7f7bc4004e30 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80b2700 con 0x7f7bd81624f0 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bd81fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bd81fb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37146/0 (socket says 172.21.15.57:37146) 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 -- 172.21.15.57:0/2028150927 learned_addr learned my addr 172.21.15.57:0/2028150927 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdd264640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bd815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bde266640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bde266640 1 -- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bde266640 1 -- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bde266640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bde266640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd815da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 -- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 msgr2=0x7f7bd815da40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd815da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 -- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 msgr2=0x7f7bd815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bd815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 -- 172.21.15.57:0/2028150927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd80b29e0 con 0x7f7bc40039d0 2023-11-24T08:03:33.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdda65640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bd81fb830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4019470 tx=0x7f7bc4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:33.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bce7fc640 1 -- 172.21.15.57:0/2028150927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4004340 con 0x7f7bc40039d0 2023-11-24T08:03:33.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bce7fc640 1 -- 172.21.15.57:0/2028150927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd40044e0 con 0x7f7bc40039d0 2023-11-24T08:03:33.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bce7fc640 1 -- 172.21.15.57:0/2028150927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4003860 con 0x7f7bc40039d0 2023-11-24T08:03:33.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd80b2cc0 con 0x7f7bc40039d0 2023-11-24T08:03:33.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd80b33b0 con 0x7f7bc40039d0 2023-11-24T08:03:33.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bce7fc640 1 -- 172.21.15.57:0/2028150927 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7bd40b5040 con 0x7f7bc40039d0 2023-11-24T08:03:33.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bce7fc640 1 -- 172.21.15.57:0/2028150927 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7bd40c58c0 con 0x7f7bc40039d0 2023-11-24T08:03:33.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.621+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd804e8c0 con 0x7f7bc40039d0 2023-11-24T08:03:33.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.625+0000 7f7bce7fc640 1 -- 172.21.15.57:0/2028150927 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7bd40b3070 con 0x7f7bc40039d0 2023-11-24T08:03:33.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.689+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7bd804e8c0 con 0x7f7bc40039d0 2023-11-24T08:03:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bce7fc640 1 -- 172.21.15.57:0/2028150927 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7bd40d3090 con 0x7f7bc40039d0 2023-11-24T08:03:33.696 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2023-11-24T08:03:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 msgr2=0x7f7bd81fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bd81fb830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4019470 tx=0x7f7bc4005800 comp rx=0 tx=0).stop 2023-11-24T08:03:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 shutdown_connections 2023-11-24T08:03:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7bd81624f0 0x7f7bd815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bc4004e30 0x7f7bd815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 --2- 172.21.15.57:0/2028150927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bc40039d0 0x7f7bd81fb830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 >> 172.21.15.57:0/2028150927 conn(0x7f7bd80b0c80 msgr2=0x7f7bd8164150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 shutdown_connections 2023-11-24T08:03:33.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:33.693+0000 7f7bdfcc9640 1 -- 172.21.15.57:0/2028150927 wait complete. 2023-11-24T08:03:33.717 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T08:03:33.717 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T08:03:33.718 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:33.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T08:03:33.740 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:33.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T08:03:33.805 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:33.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T08:03:33.825 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:33.821+0000 7f4d3cad3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:03:33.845 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:03:33.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T08:03:33.847 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:33.842+0000 7f6038ddb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:03:33.908 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:33.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T08:03:33.929 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:33.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T08:03:33.991 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:33.991 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T08:03:34.054 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:03:34.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T08:03:34.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new a9469d9a-bc14-483d-a1f7-149f4309d247 0 2023-11-24T08:03:34.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.290+0000 7f5c83832640 1 Processor -- start 2023-11-24T08:03:34.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.290+0000 7f5c83832640 1 -- start start 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c83832640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c7c15d7f0 0x7f5c7c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c83832640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c7c06cce0 0x7f5c7c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c83832640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c0d3c60 con 0x7f5c7c0d37e0 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c83832640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c06b980 con 0x7f5c7c15d7f0 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c83832640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c06d670 con 0x7f5c7c06cce0 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c7c06cce0 0x7f5c7c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c7c06cce0 0x7f5c7c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40504/0 (socket says 172.21.15.132:40504) 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 -- 172.21.15.132:0/1410629737 learned_addr learned my addr 172.21.15.132:0/1410629737 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c815ce640 1 --2- 172.21.15.132:0/1410629737 >> v2:172.21.15.57:3300/0 conn(0x7f5c7c15d7f0 0x7f5c7c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 -- 172.21.15.132:0/1410629737 >> v2:172.21.15.57:3300/0 conn(0x7f5c7c15d7f0 msgr2=0x7f5c7c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:34.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 --2- 172.21.15.132:0/1410629737 >> v2:172.21.15.57:3300/0 conn(0x7f5c7c15d7f0 0x7f5c7c0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 -- 172.21.15.132:0/1410629737 >> v1:172.21.15.57:6789/0 conn(0x7f5c7c0d37e0 legacy=0x7f5c7c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 -- 172.21.15.132:0/1410629737 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c0b0090 con 0x7f5c7c06cce0 2023-11-24T08:03:34.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.294+0000 7f5c81dcf640 1 --2- 172.21.15.132:0/1410629737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c06d130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c08d6b0 tx=0x7f5c7401c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612d512ac7a3e1b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:34.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c73fff640 1 -- 172.21.15.132:0/1410629737 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740a5780 con 0x7f5c7c06cce0 2023-11-24T08:03:34.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c73fff640 1 -- 172.21.15.132:0/1410629737 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c740a58e0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c73fff640 1 -- 172.21.15.132:0/1410629737 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740a5c70 con 0x7f5c7c06cce0 2023-11-24T08:03:34.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- 172.21.15.132:0/1410629737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 msgr2=0x7f5c7c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 --2- 172.21.15.132:0/1410629737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c06d130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c08d6b0 tx=0x7f5c7401c9d0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- 172.21.15.132:0/1410629737 shutdown_connections 2023-11-24T08:03:34.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 --2- 172.21.15.132:0/1410629737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c06d130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 --2- 172.21.15.132:0/1410629737 >> v2:172.21.15.57:3300/0 conn(0x7f5c7c15d7f0 0x7f5c7c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- 172.21.15.132:0/1410629737 >> 172.21.15.132:0/1410629737 conn(0x7f5c7c09c790 msgr2=0x7f5c7c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:34.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- 172.21.15.132:0/1410629737 shutdown_connections 2023-11-24T08:03:34.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- 172.21.15.132:0/1410629737 wait complete. 2023-11-24T08:03:34.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 Processor -- start 2023-11-24T08:03:34.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- start start 2023-11-24T08:03:34.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 0x7f5c7c14c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c7c15d7f0 0x7f5c7c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0cac10 con 0x7f5c7c15d7f0 2023-11-24T08:03:34.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c14bf10 con 0x7f5c7c06cce0 2023-11-24T08:03:34.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.298+0000 7f5c83832640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c14c1f0 con 0x7f5c7c0d37e0 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c80dcd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 0x7f5c7c14c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c14ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40512/0 (socket says 172.21.15.132:40512) 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 -- 172.21.15.132:0/2412337296 learned_addr learned my addr 172.21.15.132:0/2412337296 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c81dcf640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c7c15d7f0 0x7f5c7c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c80dcd640 1 -- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 msgr2=0x7f5c7c14c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c80dcd640 1 -- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 msgr2=0x7f5c7c14c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c80dcd640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 0x7f5c7c14c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c80dcd640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 0x7f5c7c14c7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 -- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 msgr2=0x7f5c7c14c7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 0x7f5c7c14c7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 -- 172.21.15.132:0/2412337296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c7c15d7f0 msgr2=0x7f5c7c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c7c15d7f0 0x7f5c7c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 -- 172.21.15.132:0/2412337296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c74009b30 con 0x7f5c7c06cce0 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c81dcf640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c7c15d7f0 0x7f5c7c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c815ce640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c14ada0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800d5f0 tx=0x7f5c7800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c71ffb640 1 -- 172.21.15.132:0/2412337296 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780125f0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c71ffb640 1 -- 172.21.15.132:0/2412337296 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78012750 con 0x7f5c7c06cce0 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c14c4d0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c71ffb640 1 -- 172.21.15.132:0/2412337296 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78012ae0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c0cdd30 con 0x7f5c7c06cce0 2023-11-24T08:03:34.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c71ffb640 1 -- 172.21.15.132:0/2412337296 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5c7801e460 con 0x7f5c7c06cce0 2023-11-24T08:03:34.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c71ffb640 1 -- 172.21.15.132:0/2412337296 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5c7801e710 con 0x7f5c7c06cce0 2023-11-24T08:03:34.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.302+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c14d3f0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.306+0000 7f5c71ffb640 1 -- 172.21.15.132:0/2412337296 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5c7c14d3f0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.370+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a9469d9a-bc14-483d-a1f7-149f4309d247", "id": 0} v 0) v1 -- 0x7f5c7c04e8c0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c71ffb640 1 -- 172.21.15.132:0/2412337296 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a9469d9a-bc14-483d-a1f7-149f4309d247", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5c7801e9a0 con 0x7f5c7c06cce0 2023-11-24T08:03:34.385 INFO:teuthology.orchestra.run.smithi132.stdout:0 2023-11-24T08:03:34.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 msgr2=0x7f5c7c14ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c14ada0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800d5f0 tx=0x7f5c7800dab0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 shutdown_connections 2023-11-24T08:03:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c7c15d7f0 0x7f5c7c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c7c0d37e0 0x7f5c7c14c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 --2- 172.21.15.132:0/2412337296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c7c06cce0 0x7f5c7c14ada0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 >> 172.21.15.132:0/2412337296 conn(0x7f5c7c09c790 msgr2=0x7f5c7c15c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 shutdown_connections 2023-11-24T08:03:34.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.382+0000 7f5c83832640 1 -- 172.21.15.132:0/2412337296 wait complete. 2023-11-24T08:03:34.397 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:34.394+0000 7f6038ddb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:03:34.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 85a7cd2d-3305-4aa2-8142-9f569374ee37 1 2023-11-24T08:03:34.454 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:34.449+0000 7f4d3cad3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:03:34.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7a301640 1 Processor -- start 2023-11-24T08:03:34.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7a301640 1 -- start start 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7a301640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a7415d710 0x7f7a740ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7a301640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a740d0530 0x7f7a7406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7a301640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7415daf0 con 0x7f7a7415e690 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7a301640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740cf3f0 con 0x7f7a740d0530 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7a301640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740ce560 con 0x7f7a7415d710 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a73fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a7415d710 0x7f7a740ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a737fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7a7415e690 0x7f7a740cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47774/0 (socket says 172.21.15.132:47774) 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a73fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a7415d710 0x7f7a740ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40516/0 (socket says 172.21.15.132:40516) 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a737fe640 1 -- 172.21.15.132:0/1154431481 learned_addr learned my addr 172.21.15.132:0/1154431481 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-24T08:03:34.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a7889e640 1 --2- 172.21.15.132:0/1154431481 >> v2:172.21.15.57:3300/0 conn(0x7f7a740d0530 0x7f7a7406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a73fff640 1 -- 172.21.15.132:0/1154431481 >> v2:172.21.15.57:3300/0 conn(0x7f7a740d0530 msgr2=0x7f7a7406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:34.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a73fff640 1 --2- 172.21.15.132:0/1154431481 >> v2:172.21.15.57:3300/0 conn(0x7f7a740d0530 0x7f7a7406c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a73fff640 1 -- 172.21.15.132:0/1154431481 >> v1:172.21.15.132:6789/0 conn(0x7f7a7415e690 legacy=0x7f7a740cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a73fff640 1 -- 172.21.15.132:0/1154431481 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740ce770 con 0x7f7a7415d710 2023-11-24T08:03:34.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.538+0000 7f7a72ffd640 1 -- 172.21.15.132:0/1154431481 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154366431 0 0) 0x7f7a7415daf0 con 0x7f7a7415e690 2023-11-24T08:03:34.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a73fff640 1 --2- 172.21.15.132:0/1154431481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a740ce020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7a740b5fe0 tx=0x7f7a6401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73080553db0d4485 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:34.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a72ffd640 1 -- 172.21.15.132:0/1154431481 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640a7070 con 0x7f7a7415d710 2023-11-24T08:03:34.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a72ffd640 1 -- 172.21.15.132:0/1154431481 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640ab430 con 0x7f7a7415d710 2023-11-24T08:03:34.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a72ffd640 1 -- 172.21.15.132:0/1154431481 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640ab7c0 con 0x7f7a7415d710 2023-11-24T08:03:34.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 -- 172.21.15.132:0/1154431481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 msgr2=0x7f7a740ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 --2- 172.21.15.132:0/1154431481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a740ce020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7a740b5fe0 tx=0x7f7a6401c430 comp rx=0 tx=0).stop 2023-11-24T08:03:34.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 -- 172.21.15.132:0/1154431481 shutdown_connections 2023-11-24T08:03:34.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 --2- 172.21.15.132:0/1154431481 >> v2:172.21.15.57:3300/0 conn(0x7f7a740d0530 0x7f7a7406c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 --2- 172.21.15.132:0/1154431481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a740ce020 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 -- 172.21.15.132:0/1154431481 >> 172.21.15.132:0/1154431481 conn(0x7f7a7408af70 msgr2=0x7f7a740d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:34.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 -- 172.21.15.132:0/1154431481 shutdown_connections 2023-11-24T08:03:34.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.542+0000 7f7a7a301640 1 -- 172.21.15.132:0/1154431481 wait complete. 2023-11-24T08:03:34.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 Processor -- start 2023-11-24T08:03:34.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 -- start start 2023-11-24T08:03:34.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 0x7f7a74153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a74152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a7415e690 0x7f7a740b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74152b90 con 0x7f7a7415e690 2023-11-24T08:03:34.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a741537d0 con 0x7f7a7415d710 2023-11-24T08:03:34.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740c9190 con 0x7f7a740d0530 2023-11-24T08:03:34.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a737fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a74152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a73fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 0x7f7a74153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a73fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 0x7f7a74153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:45952/0 (socket says 172.21.15.132:45952) 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a73fff640 1 -- 172.21.15.132:0/1330285479 learned_addr learned my addr 172.21.15.132:0/1330285479 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a73fff640 1 -- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 msgr2=0x7f7a74153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a73fff640 1 -- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 msgr2=0x7f7a74153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a73fff640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 0x7f7a74153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7889e640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a7415e690 0x7f7a740b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a73fff640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 0x7f7a74153c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a737fe640 1 -- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 msgr2=0x7f7a74153c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a737fe640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 0x7f7a74153c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a737fe640 1 -- 172.21.15.132:0/1330285479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a7415e690 msgr2=0x7f7a740b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a737fe640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a7415e690 0x7f7a740b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a737fe640 1 -- 172.21.15.132:0/1330285479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64009420 con 0x7f7a7415d710 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a737fe640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a74152290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c410 tx=0x7f7a6800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a70ff9640 1 -- 172.21.15.132:0/1330285479 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680074e0 con 0x7f7a7415d710 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a70ff9640 1 -- 172.21.15.132:0/1330285479 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a68007640 con 0x7f7a7415d710 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a70ff9640 1 -- 172.21.15.132:0/1330285479 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68004a30 con 0x7f7a7415d710 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.546+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a74153180 con 0x7f7a7415d710 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.550+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a740c9470 con 0x7f7a7415d710 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.550+0000 7f7a70ff9640 1 -- 172.21.15.132:0/1330285479 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a6801d3f0 con 0x7f7a7415d710 2023-11-24T08:03:34.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.550+0000 7f7a70ff9640 1 -- 172.21.15.132:0/1330285479 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7a680138a0 con 0x7f7a7415d710 2023-11-24T08:03:34.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.550+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a74161ad0 con 0x7f7a7415d710 2023-11-24T08:03:34.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.554+0000 7f7a70ff9640 1 -- 172.21.15.132:0/1330285479 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7a68013a60 con 0x7f7a7415d710 2023-11-24T08:03:34.608 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:34.606+0000 7f6038ddb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:03:34.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.626+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "85a7cd2d-3305-4aa2-8142-9f569374ee37", "id": 1} v 0) v1 -- 0x7f7a740d0cd0 con 0x7f7a7415d710 2023-11-24T08:03:34.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a70ff9640 1 -- 172.21.15.132:0/1330285479 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "85a7cd2d-3305-4aa2-8142-9f569374ee37", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a68013d30 con 0x7f7a7415d710 2023-11-24T08:03:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-24T08:03:34.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 msgr2=0x7f7a74152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a74152290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c410 tx=0x7f7a6800c8d0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 shutdown_connections 2023-11-24T08:03:34.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a7415e690 0x7f7a740b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7415d710 0x7f7a74152290 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 --2- 172.21.15.132:0/1330285479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a740d0530 0x7f7a74153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 >> 172.21.15.132:0/1330285479 conn(0x7f7a7408af70 msgr2=0x7f7a74155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:34.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 shutdown_connections 2023-11-24T08:03:34.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.630+0000 7f7a7a301640 1 -- 172.21.15.132:0/1330285479 wait complete. 2023-11-24T08:03:34.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 00ddbc4b-5fda-41d5-b7d4-64dff86f7b99 2 2023-11-24T08:03:34.673 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:34.669+0000 7f4d3cad3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:03:34.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe7772c9640 1 Processor -- start 2023-11-24T08:03:34.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe7772c9640 1 -- start start 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe7772c9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe77015a290 0x7fe7700707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe7772c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7700b1f80 0x7fe7700b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe7772c9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe770071170 con 0x7fe77015ec60 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe7772c9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7700cb690 con 0x7fe77015a290 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe7772c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7700cb970 con 0x7fe7700b1f80 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775866640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7700b1f80 0x7fe7700b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775866640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7700b1f80 0x7fe7700b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40532/0 (socket says 172.21.15.132:40532) 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775866640 1 -- 172.21.15.132:0/2224803556 learned_addr learned my addr 172.21.15.132:0/2224803556 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:34.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775065640 1 --2- 172.21.15.132:0/2224803556 >> v2:172.21.15.57:3300/0 conn(0x7fe77015a290 0x7fe7700707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775866640 1 -- 172.21.15.132:0/2224803556 >> v2:172.21.15.57:3300/0 conn(0x7fe77015a290 msgr2=0x7fe7700707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:34.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775866640 1 --2- 172.21.15.132:0/2224803556 >> v2:172.21.15.57:3300/0 conn(0x7fe77015a290 0x7fe7700707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775866640 1 -- 172.21.15.132:0/2224803556 >> v1:172.21.15.57:6789/0 conn(0x7fe77015ec60 legacy=0x7fe7700cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.790+0000 7fe775866640 1 -- 172.21.15.132:0/2224803556 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700cbc50 con 0x7fe7700b1f80 2023-11-24T08:03:34.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe775866640 1 --2- 172.21.15.132:0/2224803556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7700b1f80 0x7fe7700b23f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe77006e670 tx=0x7fe76001eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14067cd79bc2b2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:34.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe767fff640 1 -- 172.21.15.132:0/2224803556 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600a7b20 con 0x7fe7700b1f80 2023-11-24T08:03:34.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe767fff640 1 -- 172.21.15.132:0/2224803556 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7600a7c80 con 0x7fe7700b1f80 2023-11-24T08:03:34.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe767fff640 1 -- 172.21.15.132:0/2224803556 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600af440 con 0x7fe7700b1f80 2023-11-24T08:03:34.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 -- 172.21.15.132:0/2224803556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7700b1f80 msgr2=0x7fe7700b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 --2- 172.21.15.132:0/2224803556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7700b1f80 0x7fe7700b23f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe77006e670 tx=0x7fe76001eb40 comp rx=0 tx=0).stop 2023-11-24T08:03:34.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 -- 172.21.15.132:0/2224803556 shutdown_connections 2023-11-24T08:03:34.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 --2- 172.21.15.132:0/2224803556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7700b1f80 0x7fe7700b23f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 --2- 172.21.15.132:0/2224803556 >> v2:172.21.15.57:3300/0 conn(0x7fe77015a290 0x7fe7700707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 -- 172.21.15.132:0/2224803556 >> 172.21.15.132:0/2224803556 conn(0x7fe7700b0c80 msgr2=0x7fe7700b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:34.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 -- 172.21.15.132:0/2224803556 shutdown_connections 2023-11-24T08:03:34.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.794+0000 7fe7772c9640 1 -- 172.21.15.132:0/2224803556 wait complete. 2023-11-24T08:03:34.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 Processor -- start 2023-11-24T08:03:34.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 -- start start 2023-11-24T08:03:34.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 0x7fe770099930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe77015a290 0x7fe77014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe77015ec60 0x7fe77015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77015cb60 con 0x7fe77015ec60 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe770099e70 con 0x7fe77015a290 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77009c8d0 con 0x7fe7700b1f80 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775065640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 0x7fe770099930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775065640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 0x7fe770099930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:45954/0 (socket says 172.21.15.132:45954) 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe774864640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe77015a290 0x7fe77014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775065640 1 -- 172.21.15.132:0/1538862330 learned_addr learned my addr 172.21.15.132:0/1538862330 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:34.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775866640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe77015ec60 0x7fe77015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775065640 1 -- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 msgr2=0x7fe770099930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775065640 1 -- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 msgr2=0x7fe770099930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775065640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 0x7fe770099930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775065640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 0x7fe770099930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe774864640 1 -- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 msgr2=0x7fe770099930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe774864640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 0x7fe770099930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe774864640 1 -- 172.21.15.132:0/1538862330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe77015ec60 msgr2=0x7fe77015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe774864640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe77015ec60 0x7fe77015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe774864640 1 -- 172.21.15.132:0/1538862330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76000b770 con 0x7fe77015a290 2023-11-24T08:03:34.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe775866640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe77015ec60 0x7fe77015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:34.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe774864640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe77015a290 0x7fe77014f760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe76c000f70 tx=0x7fe76c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:34.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe765ffb640 1 -- 172.21.15.132:0/1538862330 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0052d0 con 0x7fe77015a290 2023-11-24T08:03:34.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe765ffb640 1 -- 172.21.15.132:0/1538862330 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c005430 con 0x7fe77015a290 2023-11-24T08:03:34.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe770070f40 con 0x7fe77015a290 2023-11-24T08:03:34.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe765ffb640 1 -- 172.21.15.132:0/1538862330 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c003840 con 0x7fe77015a290 2023-11-24T08:03:34.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe765ffb640 1 -- 172.21.15.132:0/1538862330 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe76c003ca0 con 0x7fe77015a290 2023-11-24T08:03:34.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77014e7b0 con 0x7fe77015a290 2023-11-24T08:03:34.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe765ffb640 1 -- 172.21.15.132:0/1538862330 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe76c011a50 con 0x7fe77015a290 2023-11-24T08:03:34.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.798+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77004e8c0 con 0x7fe77015a290 2023-11-24T08:03:34.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.802+0000 7fe765ffb640 1 -- 172.21.15.132:0/1538862330 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe76c017070 con 0x7fe77015a290 2023-11-24T08:03:34.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.870+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00ddbc4b-5fda-41d5-b7d4-64dff86f7b99", "id": 2} v 0) v1 -- 0x7fe7700cdee0 con 0x7fe77015a290 2023-11-24T08:03:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe765ffb640 1 -- 172.21.15.132:0/1538862330 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00ddbc4b-5fda-41d5-b7d4-64dff86f7b99", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe76c011630 con 0x7fe77015a290 2023-11-24T08:03:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:2 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe77015a290 msgr2=0x7fe77014f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe7772c9640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe77015a290 0x7fe77014f760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe76c000f70 tx=0x7fe76c00c820 comp rx=0 tx=0).stop 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 shutdown_connections 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe7772c9640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe77015ec60 0x7fe77015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe7772c9640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe77015a290 0x7fe77014f760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe7772c9640 1 --2- 172.21.15.132:0/1538862330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7700b1f80 0x7fe770099930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.874+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 >> 172.21.15.132:0/1538862330 conn(0x7fe7700b0c80 msgr2=0x7fe7700b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.878+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 shutdown_connections 2023-11-24T08:03:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:34.878+0000 7fe7772c9640 1 -- 172.21.15.132:0/1538862330 wait complete. 2023-11-24T08:03:34.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 3611d22c-11a0-481b-8be3-1cd71bea97a1 3 2023-11-24T08:03:35.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.030+0000 7f60dd12a640 1 Processor -- start 2023-11-24T08:03:35.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.030+0000 7f60dd12a640 1 -- start start 2023-11-24T08:03:35.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.030+0000 7f60dd12a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60d815d7f0 0x7f60d80d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.030+0000 7f60dd12a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60d806cce0 0x7f60d806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.030+0000 7f60dd12a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d80d3c60 con 0x7f60d80d37e0 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.030+0000 7f60dd12a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d806b980 con 0x7f60d806cce0 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.030+0000 7f60dd12a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d806d670 con 0x7f60d815d7f0 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60d815d7f0 0x7f60d80d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60d815d7f0 0x7f60d80d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40552/0 (socket says 172.21.15.132:40552) 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 -- 172.21.15.132:0/848065379 learned_addr learned my addr 172.21.15.132:0/848065379 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d659c640 1 --1- 172.21.15.132:0/848065379 >> v1:172.21.15.132:6789/0 conn(0x7f60d80d37e0 0x7f60d80b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47784/0 (socket says 172.21.15.132:47784) 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d759e640 1 --2- 172.21.15.132:0/848065379 >> v2:172.21.15.57:3300/0 conn(0x7f60d806cce0 0x7f60d806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 -- 172.21.15.132:0/848065379 >> v2:172.21.15.57:3300/0 conn(0x7f60d806cce0 msgr2=0x7f60d806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 --2- 172.21.15.132:0/848065379 >> v2:172.21.15.57:3300/0 conn(0x7f60d806cce0 0x7f60d806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 -- 172.21.15.132:0/848065379 >> v1:172.21.15.132:6789/0 conn(0x7f60d80d37e0 legacy=0x7f60d80b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 -- 172.21.15.132:0/848065379 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d80b0090 con 0x7f60d815d7f0 2023-11-24T08:03:35.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d6d9d640 1 --2- 172.21.15.132:0/848065379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d815d7f0 0x7f60d80d32a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f60d808ce00 tx=0x7f60c801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b9f8b1aa0601d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.034+0000 7f60d5d9b640 1 -- 172.21.15.132:0/848065379 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80ab5f0 con 0x7f60d815d7f0 2023-11-24T08:03:35.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60d5d9b640 1 -- 172.21.15.132:0/848065379 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c80ab750 con 0x7f60d815d7f0 2023-11-24T08:03:35.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60d5d9b640 1 -- 172.21.15.132:0/848065379 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80abae0 con 0x7f60d815d7f0 2023-11-24T08:03:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- 172.21.15.132:0/848065379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d815d7f0 msgr2=0x7f60d80d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 --2- 172.21.15.132:0/848065379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d815d7f0 0x7f60d80d32a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f60d808ce00 tx=0x7f60c801c500 comp rx=0 tx=0).stop 2023-11-24T08:03:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- 172.21.15.132:0/848065379 shutdown_connections 2023-11-24T08:03:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 --2- 172.21.15.132:0/848065379 >> v2:172.21.15.57:3300/0 conn(0x7f60d806cce0 0x7f60d806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 --2- 172.21.15.132:0/848065379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d815d7f0 0x7f60d80d32a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- 172.21.15.132:0/848065379 >> 172.21.15.132:0/848065379 conn(0x7f60d809c790 msgr2=0x7f60d808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- 172.21.15.132:0/848065379 shutdown_connections 2023-11-24T08:03:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- 172.21.15.132:0/848065379 wait complete. 2023-11-24T08:03:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 Processor -- start 2023-11-24T08:03:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- start start 2023-11-24T08:03:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d806cce0 0x7f60d814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d80d37e0 0x7f60d80b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 0x7f60d81f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80a0280 con 0x7f60d806cce0 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d814db30 con 0x7f60d80d37e0 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.038+0000 7f60dd12a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d809e9a0 con 0x7f60d815d7f0 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d80d37e0 0x7f60d80b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d80d37e0 0x7f60d80b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40564/0 (socket says 172.21.15.132:40564) 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 -- 172.21.15.132:0/780123818 learned_addr learned my addr 172.21.15.132:0/780123818 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d759e640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 0x7f60d81f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d6d9d640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d806cce0 0x7f60d814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d759e640 1 -- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 msgr2=0x7f60d81f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d759e640 1 -- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 msgr2=0x7f60d81f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d759e640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 0x7f60d81f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d759e640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 0x7f60d81f62e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 -- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 msgr2=0x7f60d81f62e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 0x7f60d81f62e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 -- 172.21.15.132:0/780123818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d806cce0 msgr2=0x7f60d814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d806cce0 0x7f60d814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 -- 172.21.15.132:0/780123818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c80094d0 con 0x7f60d80d37e0 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d6d9d640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d806cce0 0x7f60d814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60d659c640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d80d37e0 0x7f60d80b7420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00c4c0 tx=0x7f60cc00c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60bf7fe640 1 -- 172.21.15.132:0/780123818 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc007480 con 0x7f60d80d37e0 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60bf7fe640 1 -- 172.21.15.132:0/780123818 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc0075e0 con 0x7f60d80d37e0 2023-11-24T08:03:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d81f6e50 con 0x7f60d80d37e0 2023-11-24T08:03:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60bf7fe640 1 -- 172.21.15.132:0/780123818 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc004a10 con 0x7f60d80d37e0 2023-11-24T08:03:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d814de50 con 0x7f60d80d37e0 2023-11-24T08:03:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60bf7fe640 1 -- 172.21.15.132:0/780123818 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f60cc01c3b0 con 0x7f60d80d37e0 2023-11-24T08:03:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60bf7fe640 1 -- 172.21.15.132:0/780123818 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f60cc01caf0 con 0x7f60d80d37e0 2023-11-24T08:03:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.042+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d80a03c0 con 0x7f60d80d37e0 2023-11-24T08:03:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.046+0000 7f60bf7fe640 1 -- 172.21.15.132:0/780123818 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f60d80a03c0 con 0x7f60d80d37e0 2023-11-24T08:03:35.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.110+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3611d22c-11a0-481b-8be3-1cd71bea97a1", "id": 3} v 0) v1 -- 0x7f60d804e8c0 con 0x7f60d80d37e0 2023-11-24T08:03:35.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60bf7fe640 1 -- 172.21.15.132:0/780123818 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3611d22c-11a0-481b-8be3-1cd71bea97a1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f60cc018070 con 0x7f60d80d37e0 2023-11-24T08:03:35.120 INFO:teuthology.orchestra.run.smithi132.stdout:3 2023-11-24T08:03:35.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d80d37e0 msgr2=0x7f60d80b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d80d37e0 0x7f60d80b7420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00c4c0 tx=0x7f60cc00c980 comp rx=0 tx=0).stop 2023-11-24T08:03:35.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 shutdown_connections 2023-11-24T08:03:35.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d815d7f0 0x7f60d81f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60d80d37e0 0x7f60d80b7420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 --2- 172.21.15.132:0/780123818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d806cce0 0x7f60d814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 >> 172.21.15.132:0/780123818 conn(0x7f60d809c790 msgr2=0x7f60d80cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 shutdown_connections 2023-11-24T08:03:35.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.118+0000 7f60dd12a640 1 -- 172.21.15.132:0/780123818 wait complete. 2023-11-24T08:03:35.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190 4 2023-11-24T08:03:35.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.274+0000 7fa5c5ba0640 1 Processor -- start 2023-11-24T08:03:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.274+0000 7fa5c5ba0640 1 -- start start 2023-11-24T08:03:35.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c5ba0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c5ba0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5c00b1330 0x7fa5c00b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c5ba0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00d3bb0 con 0x7fa5c015d360 2023-11-24T08:03:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c5ba0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c00b0290 con 0x7fa5c00b1330 2023-11-24T08:03:35.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c5ba0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00b0570 con 0x7fa5c00d3210 2023-11-24T08:03:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c539f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5c00b1330 0x7fa5c00b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00d3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:45976/0 (socket says 172.21.15.132:45976) 2023-11-24T08:03:35.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bffff640 1 -- 172.21.15.132:0/1460529544 learned_addr learned my addr 172.21.15.132:0/1460529544 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c4b9e640 1 --1- 172.21.15.132:0/1460529544 >> v1:172.21.15.132:6789/0 conn(0x7fa5c015d360 0x7fa5c00d1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47800/0 (socket says 172.21.15.132:47800) 2023-11-24T08:03:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bffff640 1 -- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 msgr2=0x7fa5c00d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T08:03:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bffff640 1 -- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 msgr2=0x7fa5c00d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bffff640 1 --2- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:35.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bffff640 1 --2- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00d3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c539f640 1 -- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 msgr2=0x7fa5c00d3670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c539f640 1 --2- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00d3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c539f640 1 -- 172.21.15.132:0/1460529544 >> v1:172.21.15.132:6789/0 conn(0x7fa5c015d360 legacy=0x7fa5c00d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5c539f640 1 -- 172.21.15.132:0/1460529544 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c00b0850 con 0x7fa5c00b1330 2023-11-24T08:03:35.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.278+0000 7fa5bf7fe640 1 -- 172.21.15.132:0/1460529544 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396125154 0 0) 0x7fa5c00d3bb0 con 0x7fa5c015d360 2023-11-24T08:03:35.283 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.278+0000 7f6038ddb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c539f640 1 --2- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c00b17c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c3ef34f60c02df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5bf7fe640 1 -- 172.21.15.132:0/1460529544 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80a5a10 con 0x7fa5c00b1330 2023-11-24T08:03:35.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5bf7fe640 1 -- 172.21.15.132:0/1460529544 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80a5b70 con 0x7fa5c00b1330 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5bf7fe640 1 -- 172.21.15.132:0/1460529544 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80ad440 con 0x7fa5c00b1330 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 msgr2=0x7fa5c00b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 --2- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c00b17c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b801c950 comp rx=0 tx=0).stop 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/1460529544 shutdown_connections 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 --2- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c00b17c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 --2- 172.21.15.132:0/1460529544 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/1460529544 >> 172.21.15.132:0/1460529544 conn(0x7fa5c008cca0 msgr2=0x7fa5c009c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/1460529544 shutdown_connections 2023-11-24T08:03:35.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/1460529544 wait complete. 2023-11-24T08:03:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 Processor -- start 2023-11-24T08:03:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.282+0000 7fa5c5ba0640 1 -- start start 2023-11-24T08:03:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c015fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c015d360 0x7fa5c00c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0160400 con 0x7fa5c015d360 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00c78d0 con 0x7fa5c00b1330 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00c7bb0 con 0x7fa5c00d3210 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c015fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c015fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40574/0 (socket says 172.21.15.132:40574) 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 -- 172.21.15.132:0/3688160448 learned_addr learned my addr 172.21.15.132:0/3688160448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:45980/0 (socket says 172.21.15.132:45980) 2023-11-24T08:03:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c539f640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c015d360 0x7fa5c00c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bffff640 1 -- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 msgr2=0x7fa5c00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bffff640 1 -- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 msgr2=0x7fa5c00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bffff640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bffff640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00c87d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 -- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 msgr2=0x7fa5c00c87d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00c87d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 -- 172.21.15.132:0/3688160448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c015d360 msgr2=0x7fa5c00c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c015d360 0x7fa5c00c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 -- 172.21.15.132:0/3688160448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009a70 con 0x7fa5c00b1330 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c4b9e640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c015fec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c480 tx=0x7fa5b400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bd7fa640 1 -- 172.21.15.132:0/3688160448 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40074e0 con 0x7fa5c00b1330 2023-11-24T08:03:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bd7fa640 1 -- 172.21.15.132:0/3688160448 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b4007660 con 0x7fa5c00b1330 2023-11-24T08:03:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bd7fa640 1 -- 172.21.15.132:0/3688160448 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4004a30 con 0x7fa5c00b1330 2023-11-24T08:03:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c00c7e90 con 0x7fa5c00b1330 2023-11-24T08:03:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c015dae0 con 0x7fa5c00b1330 2023-11-24T08:03:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bd7fa640 1 -- 172.21.15.132:0/3688160448 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa5b4012400 con 0x7fa5c00b1330 2023-11-24T08:03:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5bd7fa640 1 -- 172.21.15.132:0/3688160448 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa5b401b870 con 0x7fa5c00b1330 2023-11-24T08:03:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.286+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c004e850 con 0x7fa5c00b1330 2023-11-24T08:03:35.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.290+0000 7fa5bd7fa640 1 -- 172.21.15.132:0/3688160448 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa5b4018070 con 0x7fa5c00b1330 2023-11-24T08:03:35.346 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.342+0000 7f6038ddb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:03:35.354 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.349+0000 7f4d3cad3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:35.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.354+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190", "id": 4} v 0) v1 -- 0x7fa5c0070a30 con 0x7fa5c00b1330 2023-11-24T08:03:35.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5bd7fa640 1 -- 172.21.15.132:0/3688160448 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa5b401bb10 con 0x7fa5c00b1330 2023-11-24T08:03:35.363 INFO:teuthology.orchestra.run.smithi132.stdout:4 2023-11-24T08:03:35.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 msgr2=0x7fa5c015fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c015fec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c480 tx=0x7fa5b400c940 comp rx=0 tx=0).stop 2023-11-24T08:03:35.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 shutdown_connections 2023-11-24T08:03:35.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c015d360 0x7fa5c00c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5c00d3210 0x7fa5c00c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 --2- 172.21.15.132:0/3688160448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5c00b1330 0x7fa5c015fec0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 >> 172.21.15.132:0/3688160448 conn(0x7fa5c008cca0 msgr2=0x7fa5c0070220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 shutdown_connections 2023-11-24T08:03:35.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.362+0000 7fa5c5ba0640 1 -- 172.21.15.132:0/3688160448 wait complete. 2023-11-24T08:03:35.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 60484af5-12a5-4267-b118-17b87225c38a 5 2023-11-24T08:03:35.413 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.410+0000 7f6038ddb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:03:35.420 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.417+0000 7f4d3cad3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:03:35.484 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.481+0000 7f4d3cad3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:03:35.504 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.502+0000 7f6038ddb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:03:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590f51c640 1 Processor -- start 2023-11-24T08:03:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590f51c640 1 -- start start 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590f51c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f590815d7f0 0x7f59080d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590f51c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59080d3c60 con 0x7f59080d37e0 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590f51c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59080b0090 con 0x7f590806cce0 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590f51c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590806b980 con 0x7f590815d7f0 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590d2b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f590815d7f0 0x7f59080d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590dab9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f590806cce0 0x7f590806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47812/0 (socket says 172.21.15.132:47812) 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590d2b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f590815d7f0 0x7f59080d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40590/0 (socket says 172.21.15.132:40590) 2023-11-24T08:03:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590dab9640 1 -- 172.21.15.132:0/3211338927 learned_addr learned my addr 172.21.15.132:0/3211338927 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-11-24T08:03:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590d2b8640 1 -- 172.21.15.132:0/3211338927 >> v1:172.21.15.132:6789/0 conn(0x7f590806cce0 legacy=0x7f590806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590d2b8640 1 -- 172.21.15.132:0/3211338927 >> v1:172.21.15.57:6789/0 conn(0x7f59080d37e0 legacy=0x7f59080b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.518+0000 7f590d2b8640 1 -- 172.21.15.132:0/3211338927 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59080b0330 con 0x7f590815d7f0 2023-11-24T08:03:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590d2b8640 1 --2- 172.21.15.132:0/3211338927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f590815d7f0 0x7f59080d32a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59040097c0 tx=0x7f590401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1889cf5b9cf21dc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f58fffff640 1 -- 172.21.15.132:0/3211338927 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59040ab600 con 0x7f590815d7f0 2023-11-24T08:03:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f58fffff640 1 -- 172.21.15.132:0/3211338927 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59040a7050 con 0x7f590815d7f0 2023-11-24T08:03:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f58fffff640 1 -- 172.21.15.132:0/3211338927 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59040ab980 con 0x7f590815d7f0 2023-11-24T08:03:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590f51c640 1 -- 172.21.15.132:0/3211338927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f590815d7f0 msgr2=0x7f59080d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590f51c640 1 --2- 172.21.15.132:0/3211338927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f590815d7f0 0x7f59080d32a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59040097c0 tx=0x7f590401c480 comp rx=0 tx=0).stop 2023-11-24T08:03:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590f51c640 1 -- 172.21.15.132:0/3211338927 shutdown_connections 2023-11-24T08:03:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590f51c640 1 --2- 172.21.15.132:0/3211338927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f590815d7f0 0x7f59080d32a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590f51c640 1 -- 172.21.15.132:0/3211338927 >> 172.21.15.132:0/3211338927 conn(0x7f590809c790 msgr2=0x7f590808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590f51c640 1 -- 172.21.15.132:0/3211338927 shutdown_connections 2023-11-24T08:03:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.522+0000 7f590f51c640 1 -- 172.21.15.132:0/3211338927 wait complete. 2023-11-24T08:03:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 Processor -- start 2023-11-24T08:03:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 -- start start 2023-11-24T08:03:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f590806cce0 0x7f59080b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59080d37e0 0x7f59080b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 0x7f59080b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b4210 con 0x7f590806cce0 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b3590 con 0x7f59080d37e0 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b3870 con 0x7f590815d7f0 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59080d37e0 0x7f59080b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590dab9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 0x7f59080b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59080d37e0 0x7f59080b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40600/0 (socket says 172.21.15.132:40600) 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 -- 172.21.15.132:0/2222243532 learned_addr learned my addr 172.21.15.132:0/2222243532 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590d2b8640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f590806cce0 0x7f59080b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590dab9640 1 -- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 msgr2=0x7f59080b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590dab9640 1 -- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 msgr2=0x7f59080b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590dab9640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 0x7f59080b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590dab9640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 0x7f59080b7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 -- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 msgr2=0x7f59080b7780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 0x7f59080b7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 -- 172.21.15.132:0/2222243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f590806cce0 msgr2=0x7f59080b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f590806cce0 0x7f59080b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 -- 172.21.15.132:0/2222243532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904009420 con 0x7f59080d37e0 2023-11-24T08:03:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590d2b8640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f590806cce0 0x7f59080b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590cab7640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59080d37e0 0x7f59080b7240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c500 tx=0x7f58f800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f58fdffb640 1 -- 172.21.15.132:0/2222243532 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8005220 con 0x7f59080d37e0 2023-11-24T08:03:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f58fdffb640 1 -- 172.21.15.132:0/2222243532 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8005380 con 0x7f59080d37e0 2023-11-24T08:03:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f58fdffb640 1 -- 172.21.15.132:0/2222243532 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8007270 con 0x7f59080d37e0 2023-11-24T08:03:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080b3b50 con 0x7f59080d37e0 2023-11-24T08:03:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f58fdffb640 1 -- 172.21.15.132:0/2222243532 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58f80067e0 con 0x7f59080d37e0 2023-11-24T08:03:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.526+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59080b32a0 con 0x7f59080d37e0 2023-11-24T08:03:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.530+0000 7f58fdffb640 1 -- 172.21.15.132:0/2222243532 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f58f8012630 con 0x7f59080d37e0 2023-11-24T08:03:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.530+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59080b4350 con 0x7f59080d37e0 2023-11-24T08:03:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.530+0000 7f58fdffb640 1 -- 172.21.15.132:0/2222243532 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f59080b4350 con 0x7f59080d37e0 2023-11-24T08:03:35.567 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.566+0000 7f6038ddb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:03:35.578 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.573+0000 7f4d3cad3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:03:35.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.598+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "60484af5-12a5-4267-b118-17b87225c38a", "id": 5} v 0) v1 -- 0x7f590804e8c0 con 0x7f59080d37e0 2023-11-24T08:03:35.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f58fdffb640 1 -- 172.21.15.132:0/2222243532 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60484af5-12a5-4267-b118-17b87225c38a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58f802a0b0 con 0x7f59080d37e0 2023-11-24T08:03:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:5 2023-11-24T08:03:35.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59080d37e0 msgr2=0x7f59080b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59080d37e0 0x7f59080b7240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c500 tx=0x7f58f800c9c0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 shutdown_connections 2023-11-24T08:03:35.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f590815d7f0 0x7f59080b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59080d37e0 0x7f59080b7240 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 --2- 172.21.15.132:0/2222243532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f590806cce0 0x7f59080b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 >> 172.21.15.132:0/2222243532 conn(0x7f590809c790 msgr2=0x7f590814d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 shutdown_connections 2023-11-24T08:03:35.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.602+0000 7f590f51c640 1 -- 172.21.15.132:0/2222243532 wait complete. 2023-11-24T08:03:35.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 12154951-8b72-4730-bc4b-1fb6d04c075a 6 2023-11-24T08:03:35.641 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.637+0000 7f4d3cad3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:03:35.660 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.658+0000 7f6038ddb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:03:35.722 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.718+0000 7f6038ddb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:03:35.734 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.729+0000 7f4d3cad3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:03:35.797 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.793+0000 7f4d3cad3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:03:35.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.794+0000 7fcfad09c640 1 Processor -- start 2023-11-24T08:03:35.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.794+0000 7fcfad09c640 1 -- start start 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.794+0000 7fcfad09c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa80ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.794+0000 7fcfad09c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcfa815e690 0x7fcfa80cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfad09c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcfa80d0360 0x7fcfa806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfad09c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80cf3f0 con 0x7fcfa80d0360 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfad09c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80d07f0 con 0x7fcfa815e690 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfad09c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80ce560 con 0x7fcfa815d710 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa6d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa80ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa6d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa80ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:46000/0 (socket says 172.21.15.132:46000) 2023-11-24T08:03:35.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa6d9d640 1 -- 172.21.15.132:0/1578437083 learned_addr learned my addr 172.21.15.132:0/1578437083 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa659c640 1 --2- 172.21.15.132:0/1578437083 >> v2:172.21.15.132:3300/0 conn(0x7fcfa815e690 0x7fcfa80cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa759e640 1 --2- 172.21.15.132:0/1578437083 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80d0360 0x7fcfa806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa6d9d640 1 -- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 msgr2=0x7fcfa80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa6d9d640 1 -- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 msgr2=0x7fcfa80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa6d9d640 1 --2- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa80ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa6d9d640 1 --2- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa80ce020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa659c640 1 -- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 msgr2=0x7fcfa80ce020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa659c640 1 --2- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa80ce020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa659c640 1 -- 172.21.15.132:0/1578437083 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80d0360 msgr2=0x7fcfa806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa659c640 1 --2- 172.21.15.132:0/1578437083 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80d0360 0x7fcfa806c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa659c640 1 -- 172.21.15.132:0/1578437083 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa815daf0 con 0x7fcfa815e690 2023-11-24T08:03:35.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.798+0000 7fcfa659c640 1 --2- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa815e690 0x7fcfa80cfe20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfa808ba60 tx=0x7fcf9c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153885820eab473 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfa5d9b640 1 -- 172.21.15.132:0/1578437083 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0ab5f0 con 0x7fcfa815e690 2023-11-24T08:03:35.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfa5d9b640 1 -- 172.21.15.132:0/1578437083 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c0ab750 con 0x7fcfa815e690 2023-11-24T08:03:35.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfa5d9b640 1 -- 172.21.15.132:0/1578437083 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0abae0 con 0x7fcfa815e690 2023-11-24T08:03:35.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa815e690 msgr2=0x7fcfa80cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 --2- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa815e690 0x7fcfa80cfe20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfa808ba60 tx=0x7fcf9c01c430 comp rx=0 tx=0).stop 2023-11-24T08:03:35.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- 172.21.15.132:0/1578437083 shutdown_connections 2023-11-24T08:03:35.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 --2- 172.21.15.132:0/1578437083 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80d0360 0x7fcfa806c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 --2- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa815e690 0x7fcfa80cfe20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 --2- 172.21.15.132:0/1578437083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa80ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- 172.21.15.132:0/1578437083 >> 172.21.15.132:0/1578437083 conn(0x7fcfa808af70 msgr2=0x7fcfa80d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- 172.21.15.132:0/1578437083 shutdown_connections 2023-11-24T08:03:35.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- 172.21.15.132:0/1578437083 wait complete. 2023-11-24T08:03:35.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 Processor -- start 2023-11-24T08:03:35.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- start start 2023-11-24T08:03:35.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80d0360 0x7fcfa8155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa815e690 0x7fcfa815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8156880 con 0x7fcfa815e690 2023-11-24T08:03:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa815cb10 con 0x7fcfa80d0360 2023-11-24T08:03:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.802+0000 7fcfad09c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81561e0 con 0x7fcfa815d710 2023-11-24T08:03:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80d0360 0x7fcfa8155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa659c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80d0360 0x7fcfa8155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40608/0 (socket says 172.21.15.132:40608) 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 -- 172.21.15.132:0/281688594 learned_addr learned my addr 172.21.15.132:0/281688594 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa759e640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa815e690 0x7fcfa815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa659c640 1 -- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 msgr2=0x7fcfa815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa659c640 1 -- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 msgr2=0x7fcfa815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa659c640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa659c640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa815c5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 -- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 msgr2=0x7fcfa815c5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa815c5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 -- 172.21.15.132:0/281688594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa815e690 msgr2=0x7fcfa815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa815e690 0x7fcfa815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 -- 172.21.15.132:0/281688594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c009420 con 0x7fcfa80d0360 2023-11-24T08:03:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa759e640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa815e690 0x7fcfa815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfa6d9d640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80d0360 0x7fcfa8155410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800e840 tx=0x7fcf9800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcf8f7fe640 1 -- 172.21.15.132:0/281688594 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98004020 con 0x7fcfa80d0360 2023-11-24T08:03:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcf8f7fe640 1 -- 172.21.15.132:0/281688594 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98004180 con 0x7fcfa80d0360 2023-11-24T08:03:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa8155af0 con 0x7fcfa80d0360 2023-11-24T08:03:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcf8f7fe640 1 -- 172.21.15.132:0/281688594 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800c6d0 con 0x7fcfa80d0360 2023-11-24T08:03:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80c6eb0 con 0x7fcfa80d0360 2023-11-24T08:03:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcf8f7fe640 1 -- 172.21.15.132:0/281688594 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf9800cb30 con 0x7fcfa80d0360 2023-11-24T08:03:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcf8f7fe640 1 -- 172.21.15.132:0/281688594 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcf9800cde0 con 0x7fcfa80d0360 2023-11-24T08:03:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.806+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa804e8c0 con 0x7fcfa80d0360 2023-11-24T08:03:35.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.810+0000 7fcf8f7fe640 1 -- 172.21.15.132:0/281688594 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcf98020060 con 0x7fcfa80d0360 2023-11-24T08:03:35.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.894+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12154951-8b72-4730-bc4b-1fb6d04c075a", "id": 6} v 0) v1 -- 0x7fcfa80d0cd0 con 0x7fcfa80d0360 2023-11-24T08:03:35.901 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.898+0000 7f6038ddb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:03:35.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.898+0000 7fcf8f7fe640 1 -- 172.21.15.132:0/281688594 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12154951-8b72-4730-bc4b-1fb6d04c075a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf98017070 con 0x7fcfa80d0360 2023-11-24T08:03:35.902 INFO:teuthology.orchestra.run.smithi132.stdout:6 2023-11-24T08:03:35.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80d0360 msgr2=0x7fcfa8155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:35.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80d0360 0x7fcfa8155410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800e840 tx=0x7fcf9800ed00 comp rx=0 tx=0).stop 2023-11-24T08:03:35.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 shutdown_connections 2023-11-24T08:03:35.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa815e690 0x7fcfa815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfa815d710 0x7fcfa815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 --2- 172.21.15.132:0/281688594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80d0360 0x7fcfa8155410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:35.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 >> 172.21.15.132:0/281688594 conn(0x7fcfa808af70 msgr2=0x7fcfa815ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:35.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 shutdown_connections 2023-11-24T08:03:35.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:35.902+0000 7fcfad09c640 1 -- 172.21.15.132:0/281688594 wait complete. 2023-11-24T08:03:35.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 42e706a8-a315-4cbe-bf0d-20ff30f3719a 7 2023-11-24T08:03:35.962 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:35.957+0000 7f4d3cad3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:03:35.973 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:35.970+0000 7f6038ddb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:03:36.034 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:36.029+0000 7f4d3cad3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:03:36.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.054+0000 7f033c65a640 1 Processor -- start 2023-11-24T08:03:36.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.054+0000 7f033c65a640 1 -- start start 2023-11-24T08:03:36.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033c65a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 0x7f03340d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033c65a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03340d37e0 0x7f03340b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033c65a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03340d3c60 con 0x7f03340b1630 2023-11-24T08:03:36.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033c65a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033406b980 con 0x7f03340d37e0 2023-11-24T08:03:36.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033c65a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340b0090 con 0x7f033415d7f0 2023-11-24T08:03:36.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033a3f6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 0x7f03340d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033a3f6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 0x7f03340d32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:46016/0 (socket says 172.21.15.132:46016) 2023-11-24T08:03:36.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033a3f6640 1 -- 172.21.15.132:0/4069014440 learned_addr learned my addr 172.21.15.132:0/4069014440 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:36.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f0339bf5640 1 --2- 172.21.15.132:0/4069014440 >> v2:172.21.15.57:3300/0 conn(0x7f03340d37e0 0x7f03340b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033a3f6640 1 -- 172.21.15.132:0/4069014440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 msgr2=0x7f03340d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T08:03:36.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033a3f6640 1 -- 172.21.15.132:0/4069014440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 msgr2=0x7f03340d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T08:03:36.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033a3f6640 1 --2- 172.21.15.132:0/4069014440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 0x7f03340d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:36.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f033a3f6640 1 --2- 172.21.15.132:0/4069014440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 0x7f03340d32a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:36.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f0339bf5640 1 -- 172.21.15.132:0/4069014440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 msgr2=0x7f03340d32a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:03:36.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f0339bf5640 1 --2- 172.21.15.132:0/4069014440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 0x7f03340d32a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f0339bf5640 1 -- 172.21.15.132:0/4069014440 >> v1:172.21.15.57:6789/0 conn(0x7f03340b1630 legacy=0x7f03340b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.058+0000 7f0339bf5640 1 -- 172.21.15.132:0/4069014440 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03340b0330 con 0x7f03340d37e0 2023-11-24T08:03:36.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f0339bf5640 1 --2- 172.21.15.132:0/4069014440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03340d37e0 0x7f03340b10f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03240097c0 tx=0x7f032401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4409791483b3c9d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:36.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f03393f4640 1 -- 172.21.15.132:0/4069014440 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240ab600 con 0x7f03340d37e0 2023-11-24T08:03:36.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f03393f4640 1 -- 172.21.15.132:0/4069014440 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03240a7050 con 0x7f03340d37e0 2023-11-24T08:03:36.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f03393f4640 1 -- 172.21.15.132:0/4069014440 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240ab980 con 0x7f03340d37e0 2023-11-24T08:03:36.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 -- 172.21.15.132:0/4069014440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03340d37e0 msgr2=0x7f03340b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 --2- 172.21.15.132:0/4069014440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03340d37e0 0x7f03340b10f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03240097c0 tx=0x7f032401c480 comp rx=0 tx=0).stop 2023-11-24T08:03:36.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 -- 172.21.15.132:0/4069014440 shutdown_connections 2023-11-24T08:03:36.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 --2- 172.21.15.132:0/4069014440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03340d37e0 0x7f03340b10f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 --2- 172.21.15.132:0/4069014440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f033415d7f0 0x7f03340d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 -- 172.21.15.132:0/4069014440 >> 172.21.15.132:0/4069014440 conn(0x7f033409c790 msgr2=0x7f033408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:36.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 -- 172.21.15.132:0/4069014440 shutdown_connections 2023-11-24T08:03:36.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 -- 172.21.15.132:0/4069014440 wait complete. 2023-11-24T08:03:36.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 Processor -- start 2023-11-24T08:03:36.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.062+0000 7f033c65a640 1 -- start start 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 0x7f0334154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03340d37e0 0x7f033414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f033415d7f0 0x7f033414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340cdd30 con 0x7f033415d7f0 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340b6000 con 0x7f03340d37e0 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340ce590 con 0x7f03340b1630 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033a3f6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 0x7f0334154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f0339bf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03340d37e0 0x7f033414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033a3f6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 0x7f0334154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:46030/0 (socket says 172.21.15.132:46030) 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033a3f6640 1 -- 172.21.15.132:0/1949056421 learned_addr learned my addr 172.21.15.132:0/1949056421 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033abf7640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f033415d7f0 0x7f033414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033a3f6640 1 -- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 msgr2=0x7f0334154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033a3f6640 1 -- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 msgr2=0x7f0334154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033a3f6640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 0x7f0334154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033a3f6640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 0x7f0334154cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f0339bf5640 1 -- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 msgr2=0x7f0334154cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:36.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f0339bf5640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 0x7f0334154cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f0339bf5640 1 -- 172.21.15.132:0/1949056421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f033415d7f0 msgr2=0x7f033414cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f0339bf5640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f033415d7f0 0x7f033414cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f0339bf5640 1 -- 172.21.15.132:0/1949056421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009420 con 0x7f03340d37e0 2023-11-24T08:03:36.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f0339bf5640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03340d37e0 0x7f033414c580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03240ab000 tx=0x7f0324019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f032affd640 1 -- 172.21.15.132:0/1949056421 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240b4840 con 0x7f03340d37e0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f032affd640 1 -- 172.21.15.132:0/1949056421 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03240b49e0 con 0x7f03340d37e0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f032affd640 1 -- 172.21.15.132:0/1949056421 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240b4d90 con 0x7f03340d37e0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033414de10 con 0x7f03340d37e0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03340cdf40 con 0x7f03340d37e0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f032affd640 1 -- 172.21.15.132:0/1949056421 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f03240b2040 con 0x7f03340d37e0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f032affd640 1 -- 172.21.15.132:0/1949056421 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f03240bea20 con 0x7f03340d37e0 2023-11-24T08:03:36.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.066+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03340d3280 con 0x7f03340d37e0 2023-11-24T08:03:36.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.070+0000 7f032affd640 1 -- 172.21.15.132:0/1949056421 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f03240b0070 con 0x7f03340d37e0 2023-11-24T08:03:36.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.134+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42e706a8-a315-4cbe-bf0d-20ff30f3719a", "id": 7} v 0) v1 -- 0x7f033404e8c0 con 0x7f03340d37e0 2023-11-24T08:03:36.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f032affd640 1 -- 172.21.15.132:0/1949056421 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42e706a8-a315-4cbe-bf0d-20ff30f3719a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f03240bec70 con 0x7f03340d37e0 2023-11-24T08:03:36.143 INFO:teuthology.orchestra.run.smithi132.stdout:7 2023-11-24T08:03:36.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03340d37e0 msgr2=0x7f033414c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03340d37e0 0x7f033414c580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03240ab000 tx=0x7f0324019220 comp rx=0 tx=0).stop 2023-11-24T08:03:36.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 shutdown_connections 2023-11-24T08:03:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f033415d7f0 0x7f033414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03340d37e0 0x7f033414c580 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 --2- 172.21.15.132:0/1949056421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03340b1630 0x7f0334154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 >> 172.21.15.132:0/1949056421 conn(0x7f033409c790 msgr2=0x7f033406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 shutdown_connections 2023-11-24T08:03:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-11-24T08:03:36.142+0000 7f033c65a640 1 -- 172.21.15.132:0/1949056421 wait complete. 2023-11-24T08:03:36.162 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T08:03:36.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T08:03:36.166 INFO:tasks.ceph.osd.0:Started 2023-11-24T08:03:36.167 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T08:03:36.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T08:03:36.171 INFO:tasks.ceph.osd.1:Started 2023-11-24T08:03:36.171 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T08:03:36.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T08:03:36.175 INFO:tasks.ceph.osd.2:Started 2023-11-24T08:03:36.175 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T08:03:36.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T08:03:36.180 INFO:tasks.ceph.osd.3:Started 2023-11-24T08:03:36.180 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T08:03:36.181 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T08:03:36.185 INFO:tasks.ceph.osd.4:Started 2023-11-24T08:03:36.185 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T08:03:36.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T08:03:36.188 INFO:tasks.ceph.osd.5:Started 2023-11-24T08:03:36.188 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T08:03:36.189 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T08:03:36.192 INFO:tasks.ceph.osd.6:Started 2023-11-24T08:03:36.192 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T08:03:36.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T08:03:36.195 INFO:tasks.ceph.osd.7:Started 2023-11-24T08:03:36.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:36.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.365+0000 7ff63d8dc640 1 Processor -- start 2023-11-24T08:03:36.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.365+0000 7ff63d8dc640 1 -- start start 2023-11-24T08:03:36.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d8dc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff630054080 0x7ff630006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d8dc640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63003bfa0 con 0x7ff630053bf0 2023-11-24T08:03:36.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d8dc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63003ef30 con 0x7ff6300e32b0 2023-11-24T08:03:36.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d8dc640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff630058660 con 0x7ff630054080 2023-11-24T08:03:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d0db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff630054080 0x7ff630006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d0db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff630054080 0x7ff630006ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:57120/0 (socket says 172.21.15.57:57120) 2023-11-24T08:03:36.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d0db640 1 -- 172.21.15.57:0/1982470754 learned_addr learned my addr 172.21.15.57:0/1982470754 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff6377fe640 1 -- 172.21.15.57:0/1982470754 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050547630 0 0) 0x7ff63003ef30 con 0x7ff6300e32b0 2023-11-24T08:03:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff6377fe640 1 -- 172.21.15.57:0/1982470754 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff628003530 con 0x7ff6300e32b0 2023-11-24T08:03:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d0db640 1 -- 172.21.15.57:0/1982470754 >> v1:172.21.15.132:6789/0 conn(0x7ff6300e32b0 legacy=0x7ff63003e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d0db640 1 -- 172.21.15.57:0/1982470754 >> v1:172.21.15.57:6789/0 conn(0x7ff630053bf0 legacy=0x7ff6300067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.369+0000 7ff63d0db640 1 -- 172.21.15.57:0/1982470754 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630057dc0 con 0x7ff630054080 2023-11-24T08:03:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.373+0000 7ff63d0db640 1 --2- 172.21.15.57:0/1982470754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630054080 0x7ff630006ee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff638062150 tx=0x7ff638097020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ddc6b8e2cc1c572 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:36.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff6377fe640 1 -- 172.21.15.57:0/1982470754 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63811fe00 con 0x7ff630054080 2023-11-24T08:03:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff6377fe640 1 -- 172.21.15.57:0/1982470754 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638127440 con 0x7ff630054080 2023-11-24T08:03:36.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff6377fe640 1 -- 172.21.15.57:0/1982470754 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638127870 con 0x7ff630054080 2023-11-24T08:03:36.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff63d8dc640 1 -- 172.21.15.57:0/1982470754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630054080 msgr2=0x7ff630006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff63d8dc640 1 --2- 172.21.15.57:0/1982470754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630054080 0x7ff630006ee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff638062150 tx=0x7ff638097020 comp rx=0 tx=0).stop 2023-11-24T08:03:36.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff63d8dc640 1 -- 172.21.15.57:0/1982470754 shutdown_connections 2023-11-24T08:03:36.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff63d8dc640 1 --2- 172.21.15.57:0/1982470754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630054080 0x7ff630006ee0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff63d8dc640 1 -- 172.21.15.57:0/1982470754 >> 172.21.15.57:0/1982470754 conn(0x7ff6300559c0 msgr2=0x7ff630055dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:36.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff63d8dc640 1 -- 172.21.15.57:0/1982470754 shutdown_connections 2023-11-24T08:03:36.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.377+0000 7ff63d8dc640 1 -- 172.21.15.57:0/1982470754 wait complete. 2023-11-24T08:03:36.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.381+0000 7ff63d8dc640 1 Processor -- start 2023-11-24T08:03:36.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.381+0000 7ff63d8dc640 1 -- start start 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d8dc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630053bf0 0x7ff63018c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d8dc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff630054080 0x7ff6300df5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d8dc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 0x7ff63004af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d8dc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff630188f40 con 0x7ff630054080 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d8dc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff630189220 con 0x7ff630053bf0 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d8dc640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff630189500 con 0x7ff63004aaa0 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63c8da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630053bf0 0x7ff63018c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d0db640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 0x7ff63004af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:36.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d0db640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 0x7ff63004af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:39868/0 (socket says 172.21.15.57:39868) 2023-11-24T08:03:36.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d0db640 1 -- 172.21.15.57:0/611535762 learned_addr learned my addr 172.21.15.57:0/611535762 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:36.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d0db640 1 -- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 msgr2=0x7ff63004af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-24T08:03:36.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d0db640 1 -- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 msgr2=0x7ff63004af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d0db640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 0x7ff63004af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63d0db640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 0x7ff63004af50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63c8da640 1 -- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 msgr2=0x7ff63004af50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63c8da640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 0x7ff63004af50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63c8da640 1 -- 172.21.15.57:0/611535762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff630054080 msgr2=0x7ff6300df5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63c8da640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff630054080 0x7ff6300df5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63c8da640 1 -- 172.21.15.57:0/611535762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63804f7e0 con 0x7ff630053bf0 2023-11-24T08:03:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff63c8da640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630053bf0 0x7ff63018c840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00c3c0 tx=0x7ff62c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:36.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff6357fa640 1 -- 172.21.15.57:0/611535762 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0052d0 con 0x7ff630053bf0 2023-11-24T08:03:36.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff6357fa640 1 -- 172.21.15.57:0/611535762 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c005430 con 0x7ff630053bf0 2023-11-24T08:03:36.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.385+0000 7ff6357fa640 1 -- 172.21.15.57:0/611535762 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c003840 con 0x7ff630053bf0 2023-11-24T08:03:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.389+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6300e1650 con 0x7ff630053bf0 2023-11-24T08:03:36.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.389+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6300dfaf0 con 0x7ff630053bf0 2023-11-24T08:03:36.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.389+0000 7ff6357fa640 1 -- 172.21.15.57:0/611535762 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff62c003ca0 con 0x7ff630053bf0 2023-11-24T08:03:36.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.389+0000 7ff6357fa640 1 -- 172.21.15.57:0/611535762 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff62c012420 con 0x7ff630053bf0 2023-11-24T08:03:36.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.393+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6300e1840 con 0x7ff630053bf0 2023-11-24T08:03:36.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.397+0000 7ff6357fa640 1 -- 172.21.15.57:0/611535762 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff62c021060 con 0x7ff630053bf0 2023-11-24T08:03:36.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6300057c0 con 0x7ff630053bf0 2023-11-24T08:03:36.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff6357fa640 1 -- 172.21.15.57:0/611535762 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff62c021060 con 0x7ff630053bf0 2023-11-24T08:03:36.466 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:03:36.466 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:36.140062+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630053bf0 msgr2=0x7ff63018c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630053bf0 0x7ff63018c840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00c3c0 tx=0x7ff62c00c880 comp rx=0 tx=0).stop 2023-11-24T08:03:36.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 shutdown_connections 2023-11-24T08:03:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff63004aaa0 0x7ff63004af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff630054080 0x7ff6300df5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 --2- 172.21.15.57:0/611535762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff630053bf0 0x7ff63018c840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 >> 172.21.15.57:0/611535762 conn(0x7ff6300559c0 msgr2=0x7ff63003a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 shutdown_connections 2023-11-24T08:03:36.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:36.461+0000 7ff63d8dc640 1 -- 172.21.15.57:0/611535762 wait complete. 2023-11-24T08:03:36.486 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T08:03:36.486 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T08:03:36.629 INFO:tasks.ceph.mgr.x.smithi132.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-24T08:03:36.629 INFO:tasks.ceph.mgr.x.smithi132.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-24T08:03:36.629 INFO:tasks.ceph.mgr.x.smithi132.stderr: from numpy import show_config as show_numpy_config 2023-11-24T08:03:36.671 INFO:tasks.ceph.mgr.y.smithi057.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-24T08:03:36.672 INFO:tasks.ceph.mgr.y.smithi057.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-24T08:03:36.672 INFO:tasks.ceph.mgr.y.smithi057.stderr: from numpy import show_config as show_numpy_config 2023-11-24T08:03:36.684 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:36.682+0000 7f6038ddb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:03:36.724 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:36.721+0000 7f4d3cad3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:03:36.804 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-11-24T08:03:36.801+0000 7fb74eac9640 -1 Falling back to public interface 2023-11-24T08:03:36.819 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:36.814+0000 7f6038ddb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:36.821 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-11-24T08:03:36.817+0000 7f04b094e640 -1 Falling back to public interface 2023-11-24T08:03:36.828 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-11-24T08:03:36.826+0000 7f9bfe7e1640 -1 Falling back to public interface 2023-11-24T08:03:36.836 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-11-24T08:03:36.834+0000 7f7927ca9640 -1 Falling back to public interface 2023-11-24T08:03:36.844 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-11-24T08:03:36.842+0000 7f8c6d97c640 -1 Falling back to public interface 2023-11-24T08:03:36.852 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-11-24T08:03:36.850+0000 7fb777ea4640 -1 Falling back to public interface 2023-11-24T08:03:36.860 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-11-24T08:03:36.857+0000 7f8f86ba2640 -1 Falling back to public interface 2023-11-24T08:03:36.873 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:36.869+0000 7f4d3cad3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:36.884 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-11-24T08:03:36.881+0000 7f7e9d765640 -1 Falling back to public interface 2023-11-24T08:03:37.008 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:37.006+0000 7f6038ddb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:37.051 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:37.045+0000 7f4d3cad3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:03:37.080 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:37.078+0000 7f6038ddb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:03:37.127 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:37.121+0000 7f4d3cad3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:03:37.219 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:37.214+0000 7f6038ddb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:37.274 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:37.269+0000 7f4d3cad3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:03:37.292 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:37.425 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f1231c32640 1 Processor -- start 2023-11-24T08:03:37.425 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f1231c32640 1 -- start start 2023-11-24T08:03:37.427 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f1231c32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f122c0b4e30 0x7f122c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:37.427 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f1231c32640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f122c0b8c80 0x7f122c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:37.427 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f1231c32640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c0b5750 con 0x7f122c0b90e0 2023-11-24T08:03:37.428 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f1231c32640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c0b7a10 con 0x7f122c0b8c80 2023-11-24T08:03:37.428 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f1231c32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c0b7cf0 con 0x7f122c0b4e30 2023-11-24T08:03:37.428 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f122c0b8c80 0x7f122c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:37.428 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f122c0b8c80 0x7f122c0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39360/0 (socket says 172.21.15.57:39360) 2023-11-24T08:03:37.429 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122affd640 1 -- 172.21.15.57:0/2344891920 learned_addr learned my addr 172.21.15.57:0/2344891920 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:37.429 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122b7fe640 1 --2- 172.21.15.57:0/2344891920 >> v2:172.21.15.132:3300/0 conn(0x7f122c0b4e30 0x7f122c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:37.429 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122a7fc640 1 -- 172.21.15.57:0/2344891920 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724288191 0 0) 0x7f122c0b5750 con 0x7f122c0b90e0 2023-11-24T08:03:37.429 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122affd640 1 -- 172.21.15.57:0/2344891920 >> v2:172.21.15.132:3300/0 conn(0x7f122c0b4e30 msgr2=0x7f122c0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:37.429 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122affd640 1 --2- 172.21.15.57:0/2344891920 >> v2:172.21.15.132:3300/0 conn(0x7f122c0b4e30 0x7f122c0b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.430 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122affd640 1 -- 172.21.15.57:0/2344891920 >> v1:172.21.15.132:6789/0 conn(0x7f122c0b90e0 legacy=0x7f122c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:37.430 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122affd640 1 -- 172.21.15.57:0/2344891920 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c0b7fd0 con 0x7f122c0b8c80 2023-11-24T08:03:37.430 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.421+0000 7f122b7fe640 1 --2- 172.21.15.57:0/2344891920 >> v2:172.21.15.132:3300/0 conn(0x7f122c0b4e30 0x7f122c0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:37.432 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f122affd640 1 --2- 172.21.15.57:0/2344891920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b8c80 0x7f122c0d14d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f122c06c5b0 tx=0x7f122001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cbb69935546271 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:37.432 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f122a7fc640 1 -- 172.21.15.57:0/2344891920 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200a89f0 con 0x7f122c0b8c80 2023-11-24T08:03:37.432 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f122a7fc640 1 -- 172.21.15.57:0/2344891920 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12200a8b50 con 0x7f122c0b8c80 2023-11-24T08:03:37.432 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f122a7fc640 1 -- 172.21.15.57:0/2344891920 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200b0440 con 0x7f122c0b8c80 2023-11-24T08:03:37.432 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 -- 172.21.15.57:0/2344891920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b8c80 msgr2=0x7f122c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:37.432 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 --2- 172.21.15.57:0/2344891920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b8c80 0x7f122c0d14d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f122c06c5b0 tx=0x7f122001ecf0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.433 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 -- 172.21.15.57:0/2344891920 shutdown_connections 2023-11-24T08:03:37.433 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 --2- 172.21.15.57:0/2344891920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b8c80 0x7f122c0d14d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.433 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 --2- 172.21.15.57:0/2344891920 >> v2:172.21.15.132:3300/0 conn(0x7f122c0b4e30 0x7f122c0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.433 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 -- 172.21.15.57:0/2344891920 >> 172.21.15.57:0/2344891920 conn(0x7f122c072070 msgr2=0x7f122c072480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:37.433 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 -- 172.21.15.57:0/2344891920 shutdown_connections 2023-11-24T08:03:37.433 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.425+0000 7f1231c32640 1 -- 172.21.15.57:0/2344891920 wait complete. 2023-11-24T08:03:37.436 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 Processor -- start 2023-11-24T08:03:37.436 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 -- start start 2023-11-24T08:03:37.436 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f122c0b4e30 0x7f122c15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:37.436 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 0x7f122c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:37.436 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b90e0 0x7f122c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:37.436 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0caee0 con 0x7f122c0b90e0 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c1563e0 con 0x7f122c0b4e30 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f1231c32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0ca5b0 con 0x7f122c0b8c80 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b90e0 0x7f122c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b90e0 0x7f122c156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39366/0 (socket says 172.21.15.57:39366) 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 -- 172.21.15.57:0/2460276611 learned_addr learned my addr 172.21.15.57:0/2460276611 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122b7fe640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f122c0b4e30 0x7f122c15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122affd640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 0x7f122c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122affd640 1 -- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 msgr2=0x7f122c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122affd640 1 -- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 msgr2=0x7f122c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-24T08:03:37.437 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122affd640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 0x7f122c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122affd640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 0x7f122c0c9650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 -- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 msgr2=0x7f122c0c9650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 0x7f122c0c9650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 -- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f122c0b4e30 msgr2=0x7f122c15e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f122c0b4e30 0x7f122c15e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 -- 172.21.15.57:0/2460276611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c009420 con 0x7f122c0b90e0 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.429+0000 7f122bfff640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b90e0 0x7f122c156b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f122400c780 tx=0x7f122400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:37.438 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1213fff640 1 -- 172.21.15.57:0/2460276611 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224003ba0 con 0x7f122c0b90e0 2023-11-24T08:03:37.439 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1213fff640 1 -- 172.21.15.57:0/2460276611 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224003d00 con 0x7f122c0b90e0 2023-11-24T08:03:37.439 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12200094d0 con 0x7f122c0b90e0 2023-11-24T08:03:37.439 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1213fff640 1 -- 172.21.15.57:0/2460276611 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400aa90 con 0x7f122c0b90e0 2023-11-24T08:03:37.439 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c0cab70 con 0x7f122c0b90e0 2023-11-24T08:03:37.439 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1213fff640 1 -- 172.21.15.57:0/2460276611 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f12240050d0 con 0x7f122c0b90e0 2023-11-24T08:03:37.439 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1213fff640 1 -- 172.21.15.57:0/2460276611 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1224012b40 con 0x7f122c0b90e0 2023-11-24T08:03:37.440 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c0cb050 con 0x7f122c0b90e0 2023-11-24T08:03:37.440 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.433+0000 7f1213fff640 1 -- 172.21.15.57:0/2460276611 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1224012de0 con 0x7f122c0b90e0 2023-11-24T08:03:37.499 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.493+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f122c0749a0 con 0x7f122c0b90e0 2023-11-24T08:03:37.499 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1213fff640 1 -- 172.21.15.57:0/2460276611 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1224005380 con 0x7f122c0b90e0 2023-11-24T08:03:37.500 INFO:teuthology.misc.health.smithi057.stdout: 2023-11-24T08:03:37.500 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:36.140062+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b90e0 msgr2=0x7f122c156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b90e0 0x7f122c156b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f122400c780 tx=0x7f122400cc40 comp rx=0 tx=0).stop 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 shutdown_connections 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f122c0b90e0 0x7f122c156b60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f122c0b8c80 0x7f122c0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 --2- 172.21.15.57:0/2460276611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f122c0b4e30 0x7f122c15e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 >> 172.21.15.57:0/2460276611 conn(0x7f122c072070 msgr2=0x7f122c15ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 shutdown_connections 2023-11-24T08:03:37.501 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:37.497+0000 7f1231c32640 1 -- 172.21.15.57:0/2460276611 wait complete. 2023-11-24T08:03:37.518 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T08:03:37.903 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:37.897+0000 7f6038ddb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:03:37.988 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:37.985+0000 7f6038ddb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:03:37.995 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:37.989+0000 7f4d3cad3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:03:38.086 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:38.081+0000 7f4d3cad3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:03:38.179 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:38.177+0000 7f6038ddb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:03:38.263 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:38.257+0000 7f6038ddb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:03:38.287 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:38.281+0000 7f4d3cad3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:03:38.379 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:38.373+0000 7f4d3cad3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:03:38.591 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:38.589+0000 7f6038ddb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:03:38.659 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:38.657+0000 7f6038ddb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:03:38.736 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:38.733+0000 7f4d3cad3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:03:38.809 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-11-24T08:03:38.805+0000 7f4d3cad3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:03:39.686 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:39.681+0000 7f5fe045f640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T08:03:39.686 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:03:39.681+0000 7f5fe045f640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T08:03:40.659 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-11-24T08:03:40.653+0000 7fb74eac9640 -1 osd.0 0 log_to_monitors true 2023-11-24T08:03:40.668 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-11-24T08:03:40.665+0000 7f9bfe7e1640 -1 osd.4 0 log_to_monitors true 2023-11-24T08:03:40.715 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-11-24T08:03:40.713+0000 7f8f86ba2640 -1 osd.3 0 log_to_monitors true 2023-11-24T08:03:40.753 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-11-24T08:03:40.749+0000 7f7927ca9640 -1 osd.5 0 log_to_monitors true 2023-11-24T08:03:40.855 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-11-24T08:03:40.849+0000 7fb777ea4640 -1 osd.6 0 log_to_monitors true 2023-11-24T08:03:40.866 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-11-24T08:03:40.861+0000 7f7e9d765640 -1 osd.2 0 log_to_monitors true 2023-11-24T08:03:40.881 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-11-24T08:03:40.877+0000 7f8c6d97c640 -1 osd.7 0 log_to_monitors true 2023-11-24T08:03:41.011 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-11-24T08:03:41.005+0000 7f04b094e640 -1 osd.1 0 log_to_monitors true 2023-11-24T08:03:43.179 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-11-24T08:03:43.173+0000 7fb74a250640 -1 osd.0 0 waiting for initial osdmap 2023-11-24T08:03:43.455 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-11-24T08:03:43.449+0000 7fb74289d640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:44.325 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:44.535 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.529+0000 7f583a101640 1 Processor -- start 2023-11-24T08:03:44.535 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.529+0000 7f583a101640 1 -- start start 2023-11-24T08:03:44.537 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f583a101640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f58340b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.537 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f583a101640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58340b8c80 0x7f58340d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.537 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f583a101640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58340b5750 con 0x7f58340b90e0 2023-11-24T08:03:44.537 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f583a101640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58340b7a10 con 0x7f58340b8c80 2023-11-24T08:03:44.537 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f583a101640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58340b7cf0 con 0x7f58340b4e30 2023-11-24T08:03:44.538 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f5833fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f58340b90e0 0x7f58340d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:59932/0 (socket says 172.21.15.57:59932) 2023-11-24T08:03:44.539 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f5833fff640 1 -- 172.21.15.57:0/3093554790 learned_addr learned my addr 172.21.15.57:0/3093554790 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:03:44.539 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f58337fe640 1 --2- 172.21.15.57:0/3093554790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f58340b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.539 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f5832ffd640 1 --2- 172.21.15.57:0/3093554790 >> v2:172.21.15.57:3300/0 conn(0x7f58340b8c80 0x7f58340d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.539 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f58337fe640 1 -- 172.21.15.57:0/3093554790 >> v2:172.21.15.57:3300/0 conn(0x7f58340b8c80 msgr2=0x7f58340d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:44.539 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f58337fe640 1 --2- 172.21.15.57:0/3093554790 >> v2:172.21.15.57:3300/0 conn(0x7f58340b8c80 0x7f58340d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.539 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f58337fe640 1 -- 172.21.15.57:0/3093554790 >> v1:172.21.15.132:6789/0 conn(0x7f58340b90e0 legacy=0x7f58340d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.539 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.533+0000 7f58337fe640 1 -- 172.21.15.57:0/3093554790 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340b7fd0 con 0x7f58340b4e30 2023-11-24T08:03:44.543 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.537+0000 7f58337fe640 1 --2- 172.21.15.57:0/3093554790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f58340b5210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58240097c0 tx=0x7f582401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa257f97ff257ca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:44.543 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f58327fc640 1 -- 172.21.15.57:0/3093554790 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240ab600 con 0x7f58340b4e30 2023-11-24T08:03:44.543 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f58327fc640 1 -- 172.21.15.57:0/3093554790 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58240a7050 con 0x7f58340b4e30 2023-11-24T08:03:44.543 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f58327fc640 1 -- 172.21.15.57:0/3093554790 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240ab980 con 0x7f58340b4e30 2023-11-24T08:03:44.544 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 -- 172.21.15.57:0/3093554790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 msgr2=0x7f58340b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.544 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 --2- 172.21.15.57:0/3093554790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f58340b5210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58240097c0 tx=0x7f582401c3c0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.545 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 -- 172.21.15.57:0/3093554790 shutdown_connections 2023-11-24T08:03:44.545 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 --2- 172.21.15.57:0/3093554790 >> v2:172.21.15.57:3300/0 conn(0x7f58340b8c80 0x7f58340d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.545 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 --2- 172.21.15.57:0/3093554790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f58340b5210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.546 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 -- 172.21.15.57:0/3093554790 >> 172.21.15.57:0/3093554790 conn(0x7f5834072070 msgr2=0x7f5834072480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:44.546 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 -- 172.21.15.57:0/3093554790 shutdown_connections 2023-11-24T08:03:44.546 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.541+0000 7f583a101640 1 -- 172.21.15.57:0/3093554790 wait complete. 2023-11-24T08:03:44.548 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 Processor -- start 2023-11-24T08:03:44.550 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 -- start start 2023-11-24T08:03:44.550 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f583406d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.551 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58340b8c80 0x7f58341eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.551 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58340b90e0 0x7f58341ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.551 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5834160a70 con 0x7f58340b90e0 2023-11-24T08:03:44.551 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58341efd40 con 0x7f58340b8c80 2023-11-24T08:03:44.551 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f583a101640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583406f150 con 0x7f58340b4e30 2023-11-24T08:03:44.552 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f5833fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58340b90e0 0x7f58341ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.552 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f5833fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58340b90e0 0x7f58341ef2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39432/0 (socket says 172.21.15.57:39432) 2023-11-24T08:03:44.552 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f5833fff640 1 -- 172.21.15.57:0/1629241067 learned_addr learned my addr 172.21.15.57:0/1629241067 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:44.552 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.545+0000 7f58337fe640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f583406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.552 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f5833fff640 1 -- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 msgr2=0x7f583406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.552 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f5833fff640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f583406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.552 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f5833fff640 1 -- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58340b8c80 msgr2=0x7f58341eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.553 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f5833fff640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58340b8c80 0x7f58341eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.553 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f5833fff640 1 -- 172.21.15.57:0/1629241067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824009420 con 0x7f58340b90e0 2023-11-24T08:03:44.553 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f5833fff640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58340b90e0 0x7f58341ef2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f582c00e550 tx=0x7f582c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:44.553 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f581bfff640 1 -- 172.21.15.57:0/1629241067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c012810 con 0x7f58340b90e0 2023-11-24T08:03:44.554 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f581bfff640 1 -- 172.21.15.57:0/1629241067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c012970 con 0x7f58340b90e0 2023-11-24T08:03:44.554 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f581bfff640 1 -- 172.21.15.57:0/1629241067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c012d20 con 0x7f58340b90e0 2023-11-24T08:03:44.554 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5834160790 con 0x7f58340b90e0 2023-11-24T08:03:44.554 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58341f02c0 con 0x7f58340b90e0 2023-11-24T08:03:44.555 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.549+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58341efba0 con 0x7f58340b90e0 2023-11-24T08:03:44.556 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.553+0000 7f581bfff640 1 -- 172.21.15.57:0/1629241067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f582c01b400 con 0x7f58340b90e0 2023-11-24T08:03:44.556 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.553+0000 7f581bfff640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f58200663e0 0x7f58200688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.557 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.553+0000 7f581bfff640 1 -- 172.21.15.57:0/1629241067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f582c058780 con 0x7f58340b90e0 2023-11-24T08:03:44.557 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.553+0000 7f58337fe640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f58200663e0 0x7f58200688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.558 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.553+0000 7f58337fe640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f58200663e0 0x7f58200688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58240ad000 tx=0x7f58240a4f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:44.564 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.561+0000 7f581bfff640 1 -- 172.21.15.57:0/1629241067 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f582c054b50 con 0x7f58340b90e0 2023-11-24T08:03:44.824 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-11-24T08:03:44.821+0000 7f8f82329640 -1 osd.3 0 waiting for initial osdmap 2023-11-24T08:03:44.854 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-11-24T08:03:44.849+0000 7f8f7a976640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:44.888 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.885+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58341efba0 con 0x7f58340b90e0 2023-11-24T08:03:44.889 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.885+0000 7f581bfff640 1 -- 172.21.15.57:0/1629241067 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7518 (secure 0 0 0) 0x7f58341efba0 con 0x7f58340b90e0 2023-11-24T08:03:44.890 INFO:teuthology.misc.health.smithi057.stdout: 2023-11-24T08:03:44.890 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":14,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:44.471688+0000","last_up_change":"2023-11-24T08:03:44.471688+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:44.890 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-11-24T08:03:44.885+0000 7f7e9a722640 -1 osd.2 0 waiting for initial osdmap 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f58200663e0 msgr2=0x7f58200688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f58200663e0 0x7f58200688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58240ad000 tx=0x7f58240a4f90 comp rx=0 tx=0).stop 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58340b90e0 msgr2=0x7f58341ef2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58340b90e0 0x7f58341ef2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f582c00e550 tx=0x7f582c00ea10 comp rx=0 tx=0).stop 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 shutdown_connections 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f58200663e0 0x7f58200688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58340b90e0 0x7f58341ef2d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58340b8c80 0x7f58341eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.893 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 --2- 172.21.15.57:0/1629241067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58340b4e30 0x7f583406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.894 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 >> 172.21.15.57:0/1629241067 conn(0x7f5834072070 msgr2=0x7f58340ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:44.894 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 shutdown_connections 2023-11-24T08:03:44.894 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:44.889+0000 7f583a101640 1 -- 172.21.15.57:0/1629241067 wait complete. 2023-11-24T08:03:44.920 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-24T08:03:44.928 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-11-24T08:03:44.925+0000 7f04ad90b640 -1 osd.1 0 waiting for initial osdmap 2023-11-24T08:03:44.945 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-11-24T08:03:44.941+0000 7f7e91539640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:44.964 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-11-24T08:03:44.961+0000 7f04a4722640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:44.993 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-11-24T08:03:44.989+0000 7f7923430640 -1 osd.5 0 waiting for initial osdmap 2023-11-24T08:03:45.029 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-11-24T08:03:45.025+0000 7f791ba7d640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:45.100 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-11-24T08:03:45.097+0000 7f9bf9f6a640 -1 osd.4 0 waiting for initial osdmap 2023-11-24T08:03:45.120 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-11-24T08:03:45.117+0000 7f8c69103640 -1 osd.7 0 waiting for initial osdmap 2023-11-24T08:03:45.129 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-11-24T08:03:45.125+0000 7f9bf25b7640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:45.148 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-11-24T08:03:45.145+0000 7f8c61750640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:45.160 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-11-24T08:03:45.157+0000 7fb774e61640 -1 osd.6 0 waiting for initial osdmap 2023-11-24T08:03:45.205 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-11-24T08:03:45.201+0000 7fb76bc78640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:03:48.348 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:48.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:51.727 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:51.870 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.865+0000 7f01b5372640 1 Processor -- start 2023-11-24T08:03:51.870 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.865+0000 7f01b5372640 1 -- start start 2023-11-24T08:03:51.872 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.865+0000 7f01b5372640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01b015a550 0x7f01b00b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:51.872 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01b5372640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b00b4c40 0x7f01b00b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:51.872 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01b5372640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b00aea00 con 0x7f01b015a170 2023-11-24T08:03:51.872 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01b5372640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b00b50f0 con 0x7f01b015a550 2023-11-24T08:03:51.872 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01b5372640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b015ee20 con 0x7f01b00b4c40 2023-11-24T08:03:51.872 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01b015a550 0x7f01b00b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:51.873 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01b015a550 0x7f01b00b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42192/0 (socket says 172.21.15.57:42192) 2023-11-24T08:03:51.873 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 -- 172.21.15.57:0/1758140590 learned_addr learned my addr 172.21.15.57:0/1758140590 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:51.873 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01af7fe640 1 --2- 172.21.15.57:0/1758140590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b00b4c40 0x7f01b00b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:51.873 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 -- 172.21.15.57:0/1758140590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b00b4c40 msgr2=0x7f01b00b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:51.873 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 --2- 172.21.15.57:0/1758140590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b00b4c40 0x7f01b00b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:51.873 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 -- 172.21.15.57:0/1758140590 >> v1:172.21.15.132:6789/0 conn(0x7f01b015a170 legacy=0x7f01b00ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:51.873 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 -- 172.21.15.57:0/1758140590 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b00b2e00 con 0x7f01b015a550 2023-11-24T08:03:51.875 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01a7fff640 1 --2- 172.21.15.57:0/1758140590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b015a550 0x7f01b00b4700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0198009870 tx=0x7f019801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa2d8ec48157fe7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:51.875 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.869+0000 7f01ae7fc640 1 -- 172.21.15.57:0/1758140590 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980aa670 con 0x7f01b015a550 2023-11-24T08:03:51.875 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01ae7fc640 1 -- 172.21.15.57:0/1758140590 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980aa7d0 con 0x7f01b015a550 2023-11-24T08:03:51.875 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01ae7fc640 1 -- 172.21.15.57:0/1758140590 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980aab60 con 0x7f01b015a550 2023-11-24T08:03:51.876 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- 172.21.15.57:0/1758140590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b015a550 msgr2=0x7f01b00b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:51.876 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 --2- 172.21.15.57:0/1758140590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b015a550 0x7f01b00b4700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0198009870 tx=0x7f019801c510 comp rx=0 tx=0).stop 2023-11-24T08:03:51.877 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- 172.21.15.57:0/1758140590 shutdown_connections 2023-11-24T08:03:51.877 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 --2- 172.21.15.57:0/1758140590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b00b4c40 0x7f01b00b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:51.877 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 --2- 172.21.15.57:0/1758140590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b015a550 0x7f01b00b4700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:51.877 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- 172.21.15.57:0/1758140590 >> 172.21.15.57:0/1758140590 conn(0x7f01b00cba90 msgr2=0x7f01b00cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:51.877 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- 172.21.15.57:0/1758140590 shutdown_connections 2023-11-24T08:03:51.877 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- 172.21.15.57:0/1758140590 wait complete. 2023-11-24T08:03:51.878 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 Processor -- start 2023-11-24T08:03:51.878 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- start start 2023-11-24T08:03:51.880 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b00b4c40 0x7f01b0158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b015a170 0x7f01b014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b015a550 0x7f01b0154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01592e0 con 0x7f01b00b4c40 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b0154ad0 con 0x7f01b015a550 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01b5372640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01540b0 con 0x7f01b015a170 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01aeffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b00b4c40 0x7f01b0158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01aeffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b00b4c40 0x7f01b0158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42208/0 (socket says 172.21.15.57:42208) 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.873+0000 7f01aeffd640 1 -- 172.21.15.57:0/891340138 learned_addr learned my addr 172.21.15.57:0/891340138 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01a7fff640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b015a170 0x7f01b014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01af7fe640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b015a550 0x7f01b0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:51.881 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01aeffd640 1 -- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b015a170 msgr2=0x7f01b014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01aeffd640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b015a170 0x7f01b014f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01aeffd640 1 -- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b015a550 msgr2=0x7f01b0154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01aeffd640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b015a550 0x7f01b0154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01aeffd640 1 -- 172.21.15.57:0/891340138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980094d0 con 0x7f01b00b4c40 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01af7fe640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b015a550 0x7f01b0154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01aeffd640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b00b4c40 0x7f01b0158c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c500 tx=0x7f01a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01a77fe640 1 -- 172.21.15.57:0/891340138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0005220 con 0x7f01b00b4c40 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01a77fe640 1 -- 172.21.15.57:0/891340138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0005380 con 0x7f01b00b4c40 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b014d5b0 con 0x7f01b00b4c40 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01a77fe640 1 -- 172.21.15.57:0/891340138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0007270 con 0x7f01b00b4c40 2023-11-24T08:03:51.882 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b014db70 con 0x7f01b00b4c40 2023-11-24T08:03:51.883 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b0154270 con 0x7f01b00b4c40 2023-11-24T08:03:51.883 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.877+0000 7f01a77fe640 1 -- 172.21.15.57:0/891340138 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01a00073d0 con 0x7f01b00b4c40 2023-11-24T08:03:51.884 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.881+0000 7f01a77fe640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:51.884 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.881+0000 7f01a77fe640 1 -- 172.21.15.57:0/891340138 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01a0083100 con 0x7f01b00b4c40 2023-11-24T08:03:51.884 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.881+0000 7f01a7fff640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:51.885 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.881+0000 7f01a7fff640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0190066470 0x7f0190068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01980ae000 tx=0x7f01980a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:51.888 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:51.885+0000 7f01a77fe640 1 -- 172.21.15.57:0/891340138 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01a0050840 con 0x7f01b00b4c40 2023-11-24T08:03:52.047 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01b00749a0 con 0x7f01b00b4c40 2023-11-24T08:03:52.048 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01a77fe640 1 -- 172.21.15.57:0/891340138 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f01a0053e60 con 0x7f01b00b4c40 2023-11-24T08:03:52.048 INFO:teuthology.misc.health.smithi057.stdout: 2023-11-24T08:03:52.049 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":19,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:49.500255+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:52.050 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0190066470 msgr2=0x7f0190068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.050 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0190066470 0x7f0190068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01980ae000 tx=0x7f01980a7000 comp rx=0 tx=0).stop 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b00b4c40 msgr2=0x7f01b0158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b00b4c40 0x7f01b0158c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01a000c500 tx=0x7f01a000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 shutdown_connections 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b015a550 0x7f01b0154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01b015a170 0x7f01b014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 --2- 172.21.15.57:0/891340138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01b00b4c40 0x7f01b0158c00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 >> 172.21.15.57:0/891340138 conn(0x7f01b00cba90 msgr2=0x7f01b0155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 shutdown_connections 2023-11-24T08:03:52.051 INFO:teuthology.misc.health.smithi057.stderr:2023-11-24T08:03:52.045+0000 7f01b5372640 1 -- 172.21.15.57:0/891340138 wait complete. 2023-11-24T08:03:52.069 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T08:03:52.069 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T08:03:52.069 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:03:52.069 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:03:52.073 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:03:52.073 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:03:52.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:03:52.076 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:03:52.077 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:03:52.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:03:52.081 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:03:52.081 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:03:52.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:03:52.085 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:03:52.085 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T08:03:52.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:52.172 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-11-24T08:03:52.174 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-11-24T08:03:52.185 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-11-24T08:03:52.186 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-11-24T08:03:52.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f224db2a640 1 Processor -- start 2023-11-24T08:03:52.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f224db2a640 1 -- start start 2023-11-24T08:03:52.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f224db2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f224806de50 0x7f2248159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f224db2a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22480ae950 con 0x7f224806c650 2023-11-24T08:03:52.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f224db2a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22480b1ef0 con 0x7f22480ad5e0 2023-11-24T08:03:52.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f224db2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2248159fc0 con 0x7f224806de50 2023-11-24T08:03:52.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f2246ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f224806c650 0x7f224806cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52544/0 (socket says 172.21.15.57:52544) 2023-11-24T08:03:52.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f2246ffd640 1 -- 172.21.15.57:0/1817149072 learned_addr learned my addr 172.21.15.57:0/1817149072 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:03:52.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22477fe640 1 --2- 172.21.15.57:0/1817149072 >> v2:172.21.15.132:3300/0 conn(0x7f224806de50 0x7f2248159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22467fc640 1 -- 172.21.15.57:0/1817149072 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218175519 0 0) 0x7f22480ae950 con 0x7f224806c650 2023-11-24T08:03:52.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22467fc640 1 -- 172.21.15.57:0/1817149072 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2230003530 con 0x7f224806c650 2023-11-24T08:03:52.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22467fc640 1 -- 172.21.15.57:0/1817149072 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104041097 0 0) 0x7f22480b1ef0 con 0x7f22480ad5e0 2023-11-24T08:03:52.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22467fc640 1 -- 172.21.15.57:0/1817149072 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22480ae950 con 0x7f22480ad5e0 2023-11-24T08:03:52.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22477fe640 1 -- 172.21.15.57:0/1817149072 >> v1:172.21.15.132:6789/0 conn(0x7f22480ad5e0 legacy=0x7f224806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22477fe640 1 -- 172.21.15.57:0/1817149072 >> v1:172.21.15.57:6789/0 conn(0x7f224806c650 legacy=0x7f224806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.233+0000 7f22477fe640 1 -- 172.21.15.57:0/1817149072 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480ada50 con 0x7f224806de50 2023-11-24T08:03:52.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f22477fe640 1 --2- 172.21.15.57:0/1817149072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806de50 0x7f2248159a80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22380097c0 tx=0x7f223801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60e95b266d1a76a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f22467fc640 1 -- 172.21.15.57:0/1817149072 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380ab600 con 0x7f224806de50 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f22467fc640 1 -- 172.21.15.57:0/1817149072 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22380a7050 con 0x7f224806de50 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f22467fc640 1 -- 172.21.15.57:0/1817149072 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380ab980 con 0x7f224806de50 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f224db2a640 1 -- 172.21.15.57:0/1817149072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806de50 msgr2=0x7f2248159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f224db2a640 1 --2- 172.21.15.57:0/1817149072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806de50 0x7f2248159a80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22380097c0 tx=0x7f223801c480 comp rx=0 tx=0).stop 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f224db2a640 1 -- 172.21.15.57:0/1817149072 shutdown_connections 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f224db2a640 1 --2- 172.21.15.57:0/1817149072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806de50 0x7f2248159a80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f224db2a640 1 -- 172.21.15.57:0/1817149072 >> 172.21.15.57:0/1817149072 conn(0x7f22480b0bf0 msgr2=0x7f22480b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f224db2a640 1 -- 172.21.15.57:0/1817149072 shutdown_connections 2023-11-24T08:03:52.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.237+0000 7f224db2a640 1 -- 172.21.15.57:0/1817149072 wait complete. 2023-11-24T08:03:52.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 Processor -- start 2023-11-24T08:03:52.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 -- start start 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806c650 0x7f2248146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f224806de50 0x7f224813fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480ad5e0 0x7f2248144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248146990 con 0x7f22480ad5e0 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22481400c0 con 0x7f224806c650 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22481453b0 con 0x7f224806de50 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480ad5e0 0x7f2248144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480ad5e0 0x7f2248144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42250/0 (socket says 172.21.15.57:42250) 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 -- 172.21.15.57:0/1579964660 learned_addr learned my addr 172.21.15.57:0/1579964660 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f22477fe640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806c650 0x7f2248146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2246ffd640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f224806de50 0x7f224813fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 -- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f224806de50 msgr2=0x7f224813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f224806de50 0x7f224813fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 -- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806c650 msgr2=0x7f2248146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806c650 0x7f2248146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 -- 172.21.15.57:0/1579964660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2238009420 con 0x7f22480ad5e0 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f2247fff640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480ad5e0 0x7f2248144960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f224000c730 tx=0x7f224000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f222ffff640 1 -- 172.21.15.57:0/1579964660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240003b80 con 0x7f22480ad5e0 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f222ffff640 1 -- 172.21.15.57:0/1579964660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240003ce0 con 0x7f22480ad5e0 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2248145690 con 0x7f22480ad5e0 2023-11-24T08:03:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f222ffff640 1 -- 172.21.15.57:0/1579964660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000aa90 con 0x7f22480ad5e0 2023-11-24T08:03:52.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.241+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2248145c50 con 0x7f22480ad5e0 2023-11-24T08:03:52.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.245+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2248067520 con 0x7f22480ad5e0 2023-11-24T08:03:52.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.245+0000 7f222ffff640 1 -- 172.21.15.57:0/1579964660 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f224000abf0 con 0x7f22480ad5e0 2023-11-24T08:03:52.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.245+0000 7f222ffff640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2234066470 0x7f2234068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.245+0000 7f222ffff640 1 -- 172.21.15.57:0/1579964660 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2240083810 con 0x7f22480ad5e0 2023-11-24T08:03:52.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.245+0000 7f22477fe640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2234066470 0x7f2234068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.245+0000 7f22477fe640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2234066470 0x7f2234068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22380ad000 tx=0x7f2238008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.249+0000 7f222ffff640 1 -- 172.21.15.57:0/1579964660 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2240051080 con 0x7f22480ad5e0 2023-11-24T08:03:52.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.409+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22480aee40 con 0x7f22480ad5e0 2023-11-24T08:03:52.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.409+0000 7f222ffff640 1 -- 172.21.15.57:0/1579964660 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f22400546a0 con 0x7f22480ad5e0 2023-11-24T08:03:52.414 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:03:52.414 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:49.500255+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.409+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2234066470 msgr2=0x7f2234068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.409+0000 7f224db2a640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2234066470 0x7f2234068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22380ad000 tx=0x7f2238008040 comp rx=0 tx=0).stop 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.409+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480ad5e0 msgr2=0x7f2248144960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.409+0000 7f224db2a640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480ad5e0 0x7f2248144960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f224000c730 tx=0x7f224000cbf0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 shutdown_connections 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2234066470 0x7f2234068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480ad5e0 0x7f2248144960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f224806de50 0x7f224813fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 --2- 172.21.15.57:0/1579964660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224806c650 0x7f2248146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 >> 172.21.15.57:0/1579964660 conn(0x7f22480b0bf0 msgr2=0x7f2248151070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 shutdown_connections 2023-11-24T08:03:52.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.413+0000 7f224db2a640 1 -- 172.21.15.57:0/1579964660 wait complete. 2023-11-24T08:03:52.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:03:52.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:03:52.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.577+0000 7fed6658d640 1 Processor -- start 2023-11-24T08:03:52.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.577+0000 7fed6658d640 1 -- start start 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.577+0000 7fed6658d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed600ae4a0 0x7fed6015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.577+0000 7fed6658d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed600ce420 0x7fed6006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.577+0000 7fed6658d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600b3510 con 0x7fed600cd850 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.577+0000 7fed6658d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed600b37f0 con 0x7fed600ae4a0 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.577+0000 7fed6658d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed600b3ad0 con 0x7fed600ce420 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed600ae4a0 0x7fed6015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed600ae4a0 0x7fed6015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42254/0 (socket says 172.21.15.57:42254) 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 -- 172.21.15.57:0/2198712627 learned_addr learned my addr 172.21.15.57:0/2198712627 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5f7fe640 1 --1- 172.21.15.57:0/2198712627 >> v1:172.21.15.57:6789/0 conn(0x7fed600cd850 0x7fed600cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52556/0 (socket says 172.21.15.57:52556) 2023-11-24T08:03:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed64b2a640 1 --2- 172.21.15.57:0/2198712627 >> v2:172.21.15.132:3300/0 conn(0x7fed600ce420 0x7fed6006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 -- 172.21.15.57:0/2198712627 >> v2:172.21.15.132:3300/0 conn(0x7fed600ce420 msgr2=0x7fed6006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 --2- 172.21.15.57:0/2198712627 >> v2:172.21.15.132:3300/0 conn(0x7fed600ce420 0x7fed6006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 -- 172.21.15.57:0/2198712627 >> v1:172.21.15.57:6789/0 conn(0x7fed600cd850 legacy=0x7fed600cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 -- 172.21.15.57:0/2198712627 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600b3db0 con 0x7fed600ae4a0 2023-11-24T08:03:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed64b2a640 1 --2- 172.21.15.57:0/2198712627 >> v2:172.21.15.132:3300/0 conn(0x7fed600ce420 0x7fed6006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5ffff640 1 --2- 172.21.15.57:0/2198712627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600ae4a0 0x7fed6015ba00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fed600b45b0 tx=0x7fed5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e13bfbcccd38423 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5effd640 1 -- 172.21.15.57:0/2198712627 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500aa650 con 0x7fed600ae4a0 2023-11-24T08:03:52.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5effd640 1 -- 172.21.15.57:0/2198712627 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500aa7b0 con 0x7fed600ae4a0 2023-11-24T08:03:52.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.581+0000 7fed5effd640 1 -- 172.21.15.57:0/2198712627 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500aab40 con 0x7fed600ae4a0 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- 172.21.15.57:0/2198712627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600ae4a0 msgr2=0x7fed6015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 --2- 172.21.15.57:0/2198712627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600ae4a0 0x7fed6015ba00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fed600b45b0 tx=0x7fed5001c4d0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- 172.21.15.57:0/2198712627 shutdown_connections 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 --2- 172.21.15.57:0/2198712627 >> v2:172.21.15.132:3300/0 conn(0x7fed600ce420 0x7fed6006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 --2- 172.21.15.57:0/2198712627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600ae4a0 0x7fed6015ba00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- 172.21.15.57:0/2198712627 >> 172.21.15.57:0/2198712627 conn(0x7fed600b0c80 msgr2=0x7fed600b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- 172.21.15.57:0/2198712627 shutdown_connections 2023-11-24T08:03:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- 172.21.15.57:0/2198712627 wait complete. 2023-11-24T08:03:52.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 Processor -- start 2023-11-24T08:03:52.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- start start 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed600ae4a0 0x7fed601fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600cd850 0x7fed60099790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600ce420 0x7fed601f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed601fac40 con 0x7fed600cd850 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed601fe190 con 0x7fed600ce420 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed6658d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed60099cd0 con 0x7fed600ae4a0 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600cd850 0x7fed60099790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600cd850 0x7fed60099790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42264/0 (socket says 172.21.15.57:42264) 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 -- 172.21.15.57:0/3590178082 learned_addr learned my addr 172.21.15.57:0/3590178082 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed64b2a640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600ce420 0x7fed601f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5ffff640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed600ae4a0 0x7fed601fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 -- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed600ae4a0 msgr2=0x7fed601fdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed600ae4a0 0x7fed601fdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 -- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600ce420 msgr2=0x7fed601f9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600ce420 0x7fed601f9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5f7fe640 1 -- 172.21.15.57:0/3590178082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500094d0 con 0x7fed600cd850 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed64b2a640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600ce420 0x7fed601f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.585+0000 7fed5ffff640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed600ae4a0 0x7fed601fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5f7fe640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600cd850 0x7fed60099790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c460 tx=0x7fed5400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5cff9640 1 -- 172.21.15.57:0/3590178082 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54007480 con 0x7fed600cd850 2023-11-24T08:03:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5cff9640 1 -- 172.21.15.57:0/3590178082 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540075e0 con 0x7fed600cd850 2023-11-24T08:03:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5cff9640 1 -- 172.21.15.57:0/3590178082 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54004a10 con 0x7fed600cd850 2023-11-24T08:03:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed601fa140 con 0x7fed600cd850 2023-11-24T08:03:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed601fa3a0 con 0x7fed600cd850 2023-11-24T08:03:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6004e8c0 con 0x7fed600cd850 2023-11-24T08:03:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5cff9640 1 -- 172.21.15.57:0/3590178082 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed54004b70 con 0x7fed600cd850 2023-11-24T08:03:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5cff9640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fed4c066470 0x7fed4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5cff9640 1 -- 172.21.15.57:0/3590178082 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed54082be0 con 0x7fed600cd850 2023-11-24T08:03:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.589+0000 7fed5ffff640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fed4c066470 0x7fed4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.593+0000 7fed5ffff640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fed4c066470 0x7fed4c068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed500ae000 tx=0x7fed500a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.593+0000 7fed5cff9640 1 -- 172.21.15.57:0/3590178082 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed540503c0 con 0x7fed600cd850 2023-11-24T08:03:52.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed6006b5c0 con 0x7fed600cd850 2023-11-24T08:03:52.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed5cff9640 1 -- 172.21.15.57:0/3590178082 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed540180a0 con 0x7fed600cd850 2023-11-24T08:03:52.757 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:03:52.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fed4c066470 msgr2=0x7fed4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fed4c066470 0x7fed4c068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fed500ae000 tx=0x7fed500a7000 comp rx=0 tx=0).stop 2023-11-24T08:03:52.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600cd850 msgr2=0x7fed60099790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600cd850 0x7fed60099790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c460 tx=0x7fed5400c920 comp rx=0 tx=0).stop 2023-11-24T08:03:52.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 shutdown_connections 2023-11-24T08:03:52.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fed4c066470 0x7fed4c068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed600ce420 0x7fed601f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed600cd850 0x7fed60099790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 --2- 172.21.15.57:0/3590178082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed600ae4a0 0x7fed601fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 >> 172.21.15.57:0/3590178082 conn(0x7fed600b0c80 msgr2=0x7fed60155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:52.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 shutdown_connections 2023-11-24T08:03:52.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.753+0000 7fed6658d640 1 -- 172.21.15.57:0/3590178082 wait complete. 2023-11-24T08:03:52.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 Processor -- start 2023-11-24T08:03:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 -- start start 2023-11-24T08:03:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faa200b2e50 0x7faa2013e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faa200b3230 0x7faa200cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa20140c40 0x7faa201410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2015ee50 con 0x7faa200b3230 2023-11-24T08:03:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2015f060 con 0x7faa200b2e50 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa28225640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2015f340 con 0x7faa20140c40 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faa200b3230 0x7faa200cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faa200b3230 0x7faa200cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42272/0 (socket says 172.21.15.57:42272) 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 -- 172.21.15.57:0/4018766138 learned_addr learned my addr 172.21.15.57:0/4018766138 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa25fc1640 1 --2- 172.21.15.57:0/4018766138 >> v2:172.21.15.132:3300/0 conn(0x7faa200b2e50 0x7faa2013e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa267c2640 1 --2- 172.21.15.57:0/4018766138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa20140c40 0x7faa201410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 -- 172.21.15.57:0/4018766138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa20140c40 msgr2=0x7faa201410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 --2- 172.21.15.57:0/4018766138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa20140c40 0x7faa201410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 -- 172.21.15.57:0/4018766138 >> v2:172.21.15.132:3300/0 conn(0x7faa200b2e50 msgr2=0x7faa2013e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 --2- 172.21.15.57:0/4018766138 >> v2:172.21.15.132:3300/0 conn(0x7faa200b2e50 0x7faa2013e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa257c0640 1 -- 172.21.15.57:0/4018766138 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2015f620 con 0x7faa200b3230 2023-11-24T08:03:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.917+0000 7faa25fc1640 1 --2- 172.21.15.57:0/4018766138 >> v2:172.21.15.132:3300/0 conn(0x7faa200b2e50 0x7faa2013e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:52.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa257c0640 1 --2- 172.21.15.57:0/4018766138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa200cf2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa200d11f0 tx=0x7faa1001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e9e16e4bfa35de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa24fbf640 1 -- 172.21.15.57:0/4018766138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100ac410 con 0x7faa200b3230 2023-11-24T08:03:52.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa24fbf640 1 -- 172.21.15.57:0/4018766138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa100ac570 con 0x7faa200b3230 2023-11-24T08:03:52.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa24fbf640 1 -- 172.21.15.57:0/4018766138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100ac900 con 0x7faa200b3230 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 -- 172.21.15.57:0/4018766138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 msgr2=0x7faa200cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 --2- 172.21.15.57:0/4018766138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa200cf2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa200d11f0 tx=0x7faa1001c500 comp rx=0 tx=0).stop 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 -- 172.21.15.57:0/4018766138 shutdown_connections 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 --2- 172.21.15.57:0/4018766138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa20140c40 0x7faa201410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 --2- 172.21.15.57:0/4018766138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa200cf2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 --2- 172.21.15.57:0/4018766138 >> v2:172.21.15.132:3300/0 conn(0x7faa200b2e50 0x7faa2013e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 -- 172.21.15.57:0/4018766138 >> 172.21.15.57:0/4018766138 conn(0x7faa20060fd0 msgr2=0x7faa200613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 -- 172.21.15.57:0/4018766138 shutdown_connections 2023-11-24T08:03:52.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.921+0000 7faa28225640 1 -- 172.21.15.57:0/4018766138 wait complete. 2023-11-24T08:03:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 Processor -- start 2023-11-24T08:03:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 -- start start 2023-11-24T08:03:52.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa200b2e50 0x7faa200c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa20138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa20140c40 0x7faa200c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2013cac0 con 0x7faa200b3230 2023-11-24T08:03:52.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa200c92b0 con 0x7faa20140c40 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2013ddb0 con 0x7faa200b2e50 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa20138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa20138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42286/0 (socket says 172.21.15.57:42286) 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 -- 172.21.15.57:0/3237456324 learned_addr learned my addr 172.21.15.57:0/3237456324 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa267c2640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa20140c40 0x7faa200c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa25fc1640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa200b2e50 0x7faa200c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 -- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa200b2e50 msgr2=0x7faa200c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa200b2e50 0x7faa200c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 -- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa20140c40 msgr2=0x7faa200c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa20140c40 0x7faa200c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 -- 172.21.15.57:0/3237456324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100094d0 con 0x7faa200b3230 2023-11-24T08:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa267c2640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa20140c40 0x7faa200c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa25fc1640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa200b2e50 0x7faa200c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa257c0640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa20138c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa100af040 tx=0x7faa100192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa167fc640 1 -- 172.21.15.57:0/3237456324 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100ac410 con 0x7faa200b3230 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa167fc640 1 -- 172.21.15.57:0/3237456324 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa100ace90 con 0x7faa200b3230 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa167fc640 1 -- 172.21.15.57:0/3237456324 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100b4800 con 0x7faa200b3230 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.925+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2013cd10 con 0x7faa200b3230 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.929+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2013d2d0 con 0x7faa200b3230 2023-11-24T08:03:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.929+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa20067520 con 0x7faa200b3230 2023-11-24T08:03:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.929+0000 7faa167fc640 1 -- 172.21.15.57:0/3237456324 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa100b4960 con 0x7faa200b3230 2023-11-24T08:03:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.929+0000 7faa167fc640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faa04066470 0x7faa04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.929+0000 7faa167fc640 1 -- 172.21.15.57:0/3237456324 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa1011e0f0 con 0x7faa200b3230 2023-11-24T08:03:52.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.929+0000 7faa25fc1640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faa04066470 0x7faa04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:52.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.933+0000 7faa25fc1640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faa04066470 0x7faa04068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00ba50 tx=0x7faa1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:52.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:52.933+0000 7faa167fc640 1 -- 172.21.15.57:0/3237456324 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa100eb8e0 con 0x7faa200b3230 2023-11-24T08:03:53.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa2013f970 con 0x7faa200b3230 2023-11-24T08:03:53.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa167fc640 1 -- 172.21.15.57:0/3237456324 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7faa100b1540 con 0x7faa200b3230 2023-11-24T08:03:53.129 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:03:53.129 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":54167,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T08:03:53.129 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2023-11-24T08:03:53.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faa04066470 msgr2=0x7faa04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:53.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faa04066470 0x7faa04068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00ba50 tx=0x7faa1c008040 comp rx=0 tx=0).stop 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 msgr2=0x7faa20138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa20138c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa100af040 tx=0x7faa100192a0 comp rx=0 tx=0).stop 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 shutdown_connections 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faa04066470 0x7faa04068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa20140c40 0x7faa200c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa200b3230 0x7faa20138c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 --2- 172.21.15.57:0/3237456324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa200b2e50 0x7faa200c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 >> 172.21.15.57:0/3237456324 conn(0x7faa20060fd0 msgr2=0x7faa2013e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 shutdown_connections 2023-11-24T08:03:53.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:53.125+0000 7faa28225640 1 -- 172.21.15.57:0/3237456324 wait complete. 2023-11-24T08:03:55.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:55.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f23708e3640 1 Processor -- start 2023-11-24T08:03:55.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f23708e3640 1 -- start start 2023-11-24T08:03:55.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f23708e3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f236c0d3020 0x7f236c0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f23708e3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c06c0e0 con 0x7f236c15d570 2023-11-24T08:03:55.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f23708e3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c0d39f0 con 0x7f236c0ce8b0 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f23708e3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236c0d1cc0 con 0x7f236c0d3020 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f236a59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f236c15d570 0x7f236c06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52558/0 (socket says 172.21.15.57:52558) 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f236a59c640 1 -- 172.21.15.57:0/4137022622 learned_addr learned my addr 172.21.15.57:0/4137022622 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2363fff640 1 --2- 172.21.15.57:0/4137022622 >> v2:172.21.15.132:3300/0 conn(0x7f236c0d3020 0x7f236c0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344272343 0 0) 0x7f236c06c0e0 con 0x7f236c15d570 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2358003530 con 0x7f236c15d570 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2889949006 0 0) 0x7f2358003530 con 0x7f236c15d570 2023-11-24T08:03:55.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 >> v2:172.21.15.132:3300/0 conn(0x7f236c0d3020 msgr2=0x7f236c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 --2- 172.21.15.57:0/4137022622 >> v2:172.21.15.132:3300/0 conn(0x7f236c0d3020 0x7f236c0d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 >> v1:172.21.15.132:6789/0 conn(0x7f236c0ce8b0 legacy=0x7f236c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0d1fa0 con 0x7f236c15d570 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.301+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f235c001680 con 0x7f236c15d570 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 >> v1:172.21.15.57:6789/0 conn(0x7f236c15d570 legacy=0x7f236c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580039d0 0x7f2358003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23580047d0 0x7f2358004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2358005190 0x7f235800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0d1cc0 con 0x7f2358005190 2023-11-24T08:03:55.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235800c090 con 0x7f23580047d0 2023-11-24T08:03:55.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235800c250 con 0x7f23580039d0 2023-11-24T08:03:55.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2358005190 0x7f235800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2363fff640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23580047d0 0x7f2358004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236a59c640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580039d0 0x7f2358003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 -- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580039d0 msgr2=0x7f2358003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580039d0 0x7f2358003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 -- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23580047d0 msgr2=0x7f2358004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23580047d0 0x7f2358004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 -- 172.21.15.57:0/4137022622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358003530 con 0x7f2358005190 2023-11-24T08:03:55.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236a59c640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580039d0 0x7f2358003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:55.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 -- 172.21.15.57:0/4137022622 reap_dead start 2023-11-24T08:03:55.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f236ad9d640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2358005190 0x7f235800b990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2364001e70 tx=0x7f236401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a15e1649cd7c7a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364003b80 con 0x7f2358005190 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2364003d20 con 0x7f2358005190 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.305+0000 7f2369d9b640 1 -- 172.21.15.57:0/4137022622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364005260 con 0x7f2358005190 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- 172.21.15.57:0/4137022622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2358005190 msgr2=0x7f235800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2358005190 0x7f235800b990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2364001e70 tx=0x7f236401c760 comp rx=0 tx=0).stop 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- 172.21.15.57:0/4137022622 shutdown_connections 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 --2- 172.21.15.57:0/4137022622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2358005190 0x7f235800b990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- 172.21.15.57:0/4137022622 >> 172.21.15.57:0/4137022622 conn(0x7f236c08ceb0 msgr2=0x7f236c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- 172.21.15.57:0/4137022622 shutdown_connections 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- 172.21.15.57:0/4137022622 wait complete. 2023-11-24T08:03:55.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 Processor -- start 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- start start 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2358005190 0x7f236c152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f236c0c6f30 0x7f236c0c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f236c0c78f0 0x7f236c0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c7d70 con 0x7f236c0c78f0 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c9d20 con 0x7f2358005190 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f23708e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0c9110 con 0x7f236c0c6f30 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f236ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f236c0c78f0 0x7f236c0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f236a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2358005190 0x7f236c152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f236ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f236c0c78f0 0x7f236c0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42306/0 (socket says 172.21.15.57:42306) 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f236ad9d640 1 -- 172.21.15.57:0/385706496 learned_addr learned my addr 172.21.15.57:0/385706496 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.309+0000 7f2363fff640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f236c0c6f30 0x7f236c0c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f236ad9d640 1 -- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f236c0c6f30 msgr2=0x7f236c0c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f236ad9d640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f236c0c6f30 0x7f236c0c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f236ad9d640 1 -- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2358005190 msgr2=0x7f236c152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f236ad9d640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2358005190 0x7f236c152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f236ad9d640 1 -- 172.21.15.57:0/385706496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0c93f0 con 0x7f236c0c78f0 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f236ad9d640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f236c0c78f0 0x7f236c0ca7b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f236401c590 tx=0x7f2358005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f2362ffd640 1 -- 172.21.15.57:0/385706496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23640ac070 con 0x7f236c0c78f0 2023-11-24T08:03:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f2362ffd640 1 -- 172.21.15.57:0/385706496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2364007dc0 con 0x7f236c0c78f0 2023-11-24T08:03:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f2362ffd640 1 -- 172.21.15.57:0/385706496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364006d60 con 0x7f236c0c78f0 2023-11-24T08:03:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c0c96d0 con 0x7f236c0c78f0 2023-11-24T08:03:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c152dc0 con 0x7f236c0c78f0 2023-11-24T08:03:55.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c067520 con 0x7f236c0c78f0 2023-11-24T08:03:55.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.313+0000 7f2362ffd640 1 -- 172.21.15.57:0/385706496 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2364007030 con 0x7f236c0c78f0 2023-11-24T08:03:55.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.317+0000 7f2362ffd640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f234c066470 0x7f234c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.317+0000 7f2362ffd640 1 -- 172.21.15.57:0/385706496 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f236411c860 con 0x7f236c0c78f0 2023-11-24T08:03:55.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.317+0000 7f236a59c640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f234c066470 0x7f234c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.317+0000 7f236a59c640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f234c066470 0x7f234c068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f235c0017b0 tx=0x7f235c007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.321+0000 7f2362ffd640 1 -- 172.21.15.57:0/385706496 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23640ea040 con 0x7f236c0c78f0 2023-11-24T08:03:55.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.509+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f236c0ca290 con 0x7f236c0c78f0 2023-11-24T08:03:55.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.509+0000 7f2362ffd640 1 -- 172.21.15.57:0/385706496 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3701 (secure 0 0 0) 0x7f23640b5020 con 0x7f236c0c78f0 2023-11-24T08:03:55.515 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:03:55.515 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":54167,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T08:03:55.516 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2023-11-24T08:03:55.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f234c066470 msgr2=0x7f234c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f234c066470 0x7f234c068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f235c0017b0 tx=0x7f235c007040 comp rx=0 tx=0).stop 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f236c0c78f0 msgr2=0x7f236c0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f236c0c78f0 0x7f236c0ca7b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f236401c590 tx=0x7f2358005800 comp rx=0 tx=0).stop 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 shutdown_connections 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f234c066470 0x7f234c068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f236c0c78f0 0x7f236c0ca7b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f236c0c6f30 0x7f236c0c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 --2- 172.21.15.57:0/385706496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2358005190 0x7f236c152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 >> 172.21.15.57:0/385706496 conn(0x7f236c08ceb0 msgr2=0x7f236c0d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 shutdown_connections 2023-11-24T08:03:55.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.513+0000 7f23708e3640 1 -- 172.21.15.57:0/385706496 wait complete. 2023-11-24T08:03:55.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:55.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.672+0000 7f9943879640 1 Processor -- start 2023-11-24T08:03:55.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.672+0000 7f9943879640 1 -- start start 2023-11-24T08:03:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9943879640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f993c13e970 0x7f993c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9943879640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c140c40 0x7f993c1410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9943879640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c13edd0 con 0x7f993c0b2e50 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9943879640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c15ee50 con 0x7f993c13e970 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9943879640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c15f060 con 0x7f993c140c40 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9941615640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f993c0b2e50 0x7f993c0b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52560/0 (socket says 172.21.15.57:52560) 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9941615640 1 -- 172.21.15.57:0/4244129738 learned_addr learned my addr 172.21.15.57:0/4244129738 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9941e16640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c140c40 0x7f993c1410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9940e14640 1 --2- 172.21.15.57:0/4244129738 >> v2:172.21.15.132:3300/0 conn(0x7f993c13e970 0x7f993c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140496778 0 0) 0x7f993c13edd0 con 0x7f993c0b2e50 2023-11-24T08:03:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9928003530 con 0x7f993c0b2e50 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4155493406 0 0) 0x7f9928003530 con 0x7f993c0b2e50 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c140c40 msgr2=0x7f993c1410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c140c40 0x7f993c1410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 >> v2:172.21.15.132:3300/0 conn(0x7f993c13e970 msgr2=0x7f993c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 --2- 172.21.15.57:0/4244129738 >> v2:172.21.15.132:3300/0 conn(0x7f993c13e970 0x7f993c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c15f340 con 0x7f993c0b2e50 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f9938001680 con 0x7f993c0b2e50 2023-11-24T08:03:55.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 >> v1:172.21.15.57:6789/0 conn(0x7f993c0b2e50 legacy=0x7f993c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9928003980 0x7f9928003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f9928004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9928005190 0x7f992800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c15ee50 con 0x7f99280047d0 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c15f060 con 0x7f9928005190 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992800bed0 con 0x7f9928003980 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9940e14640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f9928004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9941615640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9928003980 0x7f9928003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9941e16640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9928005190 0x7f992800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9940e14640 1 -- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9928003980 msgr2=0x7f9928003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9940e14640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9928003980 0x7f9928003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9940e14640 1 -- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9928005190 msgr2=0x7f992800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9940e14640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9928005190 0x7f992800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9940e14640 1 -- 172.21.15.57:0/4244129738 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9928003530 con 0x7f99280047d0 2023-11-24T08:03:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.676+0000 7f9941e16640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9928005190 0x7f992800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9940e14640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f9928004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f992c009b10 tx=0x7f992c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711a3eeb1fca2d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0a5680 con 0x7f99280047d0 2023-11-24T08:03:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c0a57e0 con 0x7f99280047d0 2023-11-24T08:03:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9933fff640 1 -- 172.21.15.57:0/4244129738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0a5b90 con 0x7f99280047d0 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9943879640 1 -- 172.21.15.57:0/4244129738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 msgr2=0x7f9928004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9943879640 1 --2- 172.21.15.57:0/4244129738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f9928004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f992c009b10 tx=0x7f992c01ca90 comp rx=0 tx=0).stop 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9941e16640 1 -- 172.21.15.57:0/4244129738 reap_dead start 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9943879640 1 -- 172.21.15.57:0/4244129738 shutdown_connections 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9943879640 1 -- 172.21.15.57:0/4244129738 >> 172.21.15.57:0/4244129738 conn(0x7f993c060fd0 msgr2=0x7f993c0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9943879640 1 -- 172.21.15.57:0/4244129738 shutdown_connections 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.680+0000 7f9943879640 1 -- 172.21.15.57:0/4244129738 wait complete. 2023-11-24T08:03:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 Processor -- start 2023-11-24T08:03:55.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 -- start start 2023-11-24T08:03:55.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f993c13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c0b4f60 0x7f993c13d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993c0b6570 0x7f993c15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0b54d0 con 0x7f99280047d0 2023-11-24T08:03:55.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0b57b0 con 0x7f993c0b6570 2023-11-24T08:03:55.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0b5a90 con 0x7f993c0b4f60 2023-11-24T08:03:55.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f993c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f993c13dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42314/0 (socket says 172.21.15.57:42314) 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 -- 172.21.15.57:0/1733778257 learned_addr learned my addr 172.21.15.57:0/1733778257 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941e16640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993c0b6570 0x7f993c15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9940e14640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c0b4f60 0x7f993c13d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 -- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c0b4f60 msgr2=0x7f993c13d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c0b4f60 0x7f993c13d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 -- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993c0b6570 msgr2=0x7f993c15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993c0b6570 0x7f993c15c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 -- 172.21.15.57:0/1733778257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c0b5d70 con 0x7f99280047d0 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941e16640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993c0b6570 0x7f993c15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9941615640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f993c13dc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9938001870 tx=0x7f99380129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9931ffb640 1 -- 172.21.15.57:0/1733778257 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938014810 con 0x7f99280047d0 2023-11-24T08:03:55.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9931ffb640 1 -- 172.21.15.57:0/1733778257 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9938014990 con 0x7f99280047d0 2023-11-24T08:03:55.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c0b6050 con 0x7f99280047d0 2023-11-24T08:03:55.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9931ffb640 1 -- 172.21.15.57:0/1733778257 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938014d40 con 0x7f99280047d0 2023-11-24T08:03:55.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c15c8e0 con 0x7f99280047d0 2023-11-24T08:03:55.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.684+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c067520 con 0x7f99280047d0 2023-11-24T08:03:55.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.688+0000 7f9931ffb640 1 -- 172.21.15.57:0/1733778257 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99380153e0 con 0x7f99280047d0 2023-11-24T08:03:55.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.688+0000 7f9931ffb640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9920066470 0x7f9920068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:55.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.688+0000 7f9931ffb640 1 -- 172.21.15.57:0/1733778257 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9938086870 con 0x7f99280047d0 2023-11-24T08:03:55.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.688+0000 7f9940e14640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9920066470 0x7f9920068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:55.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.688+0000 7f9940e14640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9920066470 0x7f9920068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f992c0af000 tx=0x7f992c0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.692+0000 7f9931ffb640 1 -- 172.21.15.57:0/1733778257 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9938054030 con 0x7f99280047d0 2023-11-24T08:03:55.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f993c0ce660 con 0x7f99280047d0 2023-11-24T08:03:55.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9931ffb640 1 -- 172.21.15.57:0/1733778257 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f9938057650 con 0x7f99280047d0 2023-11-24T08:03:55.857 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:03:55.857 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:49.500255+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:55.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9920066470 msgr2=0x7f9920068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9920066470 0x7f9920068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f992c0af000 tx=0x7f992c0046d0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 msgr2=0x7f993c13dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:55.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f993c13dc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9938001870 tx=0x7f99380129a0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 shutdown_connections 2023-11-24T08:03:55.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9920066470 0x7f9920068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f993c0b6570 0x7f993c15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f993c0b4f60 0x7f993c13d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 --2- 172.21.15.57:0/1733778257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99280047d0 0x7f993c13dc00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:55.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 >> 172.21.15.57:0/1733778257 conn(0x7f993c060fd0 msgr2=0x7f993c0c6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:55.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 shutdown_connections 2023-11-24T08:03:55.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:55.852+0000 7f9943879640 1 -- 172.21.15.57:0/1733778257 wait complete. 2023-11-24T08:03:55.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:03:55.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:03:56.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4f5be7640 1 Processor -- start 2023-11-24T08:03:56.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4f5be7640 1 -- start start 2023-11-24T08:03:56.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4f5be7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f015a290 0x7fb4f00707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4f5be7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4f00b1f80 0x7fb4f00b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4f5be7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00b28c0 con 0x7fb4f015ec60 2023-11-24T08:03:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4f5be7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f0071170 con 0x7fb4f00b1f80 2023-11-24T08:03:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4f5be7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00cb690 con 0x7fb4f015a290 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4effff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4f00b1f80 0x7fb4f00b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4effff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4f00b1f80 0x7fb4f00b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42486/0 (socket says 172.21.15.57:42486) 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4effff640 1 -- 172.21.15.57:0/558174953 learned_addr learned my addr 172.21.15.57:0/558174953 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.020+0000 7fb4ef7fe640 1 --2- 172.21.15.57:0/558174953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f015a290 0x7fb4f00707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4effff640 1 -- 172.21.15.57:0/558174953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f015a290 msgr2=0x7fb4f00707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4effff640 1 --2- 172.21.15.57:0/558174953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f015a290 0x7fb4f00707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4effff640 1 -- 172.21.15.57:0/558174953 >> v1:172.21.15.132:6789/0 conn(0x7fb4f015ec60 legacy=0x7fb4f00cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4effff640 1 -- 172.21.15.57:0/558174953 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00cb970 con 0x7fb4f00b1f80 2023-11-24T08:03:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4ef7fe640 1 --2- 172.21.15.57:0/558174953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f015a290 0x7fb4f00707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4effff640 1 --2- 172.21.15.57:0/558174953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f00b1f80 0x7fb4f00b2380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009e50 tx=0x7fb4e801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46373eea112b3c43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4ee7fc640 1 -- 172.21.15.57:0/558174953 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80a5830 con 0x7fb4f00b1f80 2023-11-24T08:03:56.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4ee7fc640 1 -- 172.21.15.57:0/558174953 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e80a5990 con 0x7fb4f00b1f80 2023-11-24T08:03:56.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4ee7fc640 1 -- 172.21.15.57:0/558174953 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80a5d20 con 0x7fb4f00b1f80 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 -- 172.21.15.57:0/558174953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f00b1f80 msgr2=0x7fb4f00b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/558174953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f00b1f80 0x7fb4f00b2380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009e50 tx=0x7fb4e801c950 comp rx=0 tx=0).stop 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 -- 172.21.15.57:0/558174953 shutdown_connections 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/558174953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f00b1f80 0x7fb4f00b2380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/558174953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f015a290 0x7fb4f00707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 -- 172.21.15.57:0/558174953 >> 172.21.15.57:0/558174953 conn(0x7fb4f00b0c80 msgr2=0x7fb4f00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 -- 172.21.15.57:0/558174953 shutdown_connections 2023-11-24T08:03:56.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.024+0000 7fb4f5be7640 1 -- 172.21.15.57:0/558174953 wait complete. 2023-11-24T08:03:56.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 Processor -- start 2023-11-24T08:03:56.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 -- start start 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f00b1f80 0x7fb4f00b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f015a290 0x7fb4f0164c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f015ec60 0x7fb4f00afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01492e0 con 0x7fb4f015ec60 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01651a0 con 0x7fb4f015a290 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4f5be7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00ad430 con 0x7fb4f00b1f80 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f015ec60 0x7fb4f00afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f015ec60 0x7fb4f00afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42496/0 (socket says 172.21.15.57:42496) 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 -- 172.21.15.57:0/223715583 learned_addr learned my addr 172.21.15.57:0/223715583 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4eeffd640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f015a290 0x7fb4f0164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4ef7fe640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f00b1f80 0x7fb4f00b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 -- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f00b1f80 msgr2=0x7fb4f00b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f00b1f80 0x7fb4f00b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 -- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f015a290 msgr2=0x7fb4f0164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f015a290 0x7fb4f0164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 -- 172.21.15.57:0/223715583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009420 con 0x7fb4f015ec60 2023-11-24T08:03:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.028+0000 7fb4effff640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f015ec60 0x7fb4f00afc20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4e801a580 tx=0x7fb4e80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4d7fff640 1 -- 172.21.15.57:0/223715583 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80b8670 con 0x7fb4f015ec60 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4d7fff640 1 -- 172.21.15.57:0/223715583 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e80b87d0 con 0x7fb4f015ec60 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4d7fff640 1 -- 172.21.15.57:0/223715583 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80b8b80 con 0x7fb4f015ec60 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e8009b30 con 0x7fb4f015ec60 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f00ad9b0 con 0x7fb4f015ec60 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f0149450 con 0x7fb4f015ec60 2023-11-24T08:03:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4d7fff640 1 -- 172.21.15.57:0/223715583 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4e80b8ce0 con 0x7fb4f015ec60 2023-11-24T08:03:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4d7fff640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb4dc066470 0x7fb4dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4d7fff640 1 -- 172.21.15.57:0/223715583 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4e811f150 con 0x7fb4f015ec60 2023-11-24T08:03:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.032+0000 7fb4ef7fe640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb4dc066470 0x7fb4dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.036+0000 7fb4ef7fe640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb4dc066470 0x7fb4dc068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009c50 tx=0x7fb4e0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.036+0000 7fb4d7fff640 1 -- 172.21.15.57:0/223715583 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4f0149450 con 0x7fb4f015ec60 2023-11-24T08:03:56.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4f0149420 con 0x7fb4f015ec60 2023-11-24T08:03:56.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4d7fff640 1 -- 172.21.15.57:0/223715583 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4e80ecb10 con 0x7fb4f015ec60 2023-11-24T08:03:56.201 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:03:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb4dc066470 msgr2=0x7fb4dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb4dc066470 0x7fb4dc068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009c50 tx=0x7fb4e0009190 comp rx=0 tx=0).stop 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f015ec60 msgr2=0x7fb4f00afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f015ec60 0x7fb4f00afc20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4e801a580 tx=0x7fb4e80196f0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 shutdown_connections 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb4dc066470 0x7fb4dc068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4f015ec60 0x7fb4f00afc20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f015a290 0x7fb4f0164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 --2- 172.21.15.57:0/223715583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb4f00b1f80 0x7fb4f00b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 >> 172.21.15.57:0/223715583 conn(0x7fb4f00b0c80 msgr2=0x7fb4f006d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 shutdown_connections 2023-11-24T08:03:56.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.196+0000 7fb4f5be7640 1 -- 172.21.15.57:0/223715583 wait complete. 2023-11-24T08:03:56.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:03:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff32a8e3640 1 Processor -- start 2023-11-24T08:03:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff32a8e3640 1 -- start start 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff32a8e3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff324158a50 0x7ff32406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff32a8e3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff32406cb90 0x7ff3240b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff32a8e3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32406dc20 con 0x7ff32406e340 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff32a8e3640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32406e0b0 con 0x7ff32406cb90 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff32a8e3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3240b3620 con 0x7ff324158a50 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff328e80640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff32406cb90 0x7ff3240b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff3237fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff32406e340 0x7ff3240707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51098/0 (socket says 172.21.15.57:51098) 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff328e80640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff32406cb90 0x7ff3240b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42500/0 (socket says 172.21.15.57:42500) 2023-11-24T08:03:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff3237fe640 1 -- 172.21.15.57:0/3158609810 learned_addr learned my addr 172.21.15.57:0/3158609810 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:03:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff323fff640 1 --2- 172.21.15.57:0/3158609810 >> v2:172.21.15.132:3300/0 conn(0x7ff324158a50 0x7ff32406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff328e80640 1 -- 172.21.15.57:0/3158609810 >> v2:172.21.15.132:3300/0 conn(0x7ff324158a50 msgr2=0x7ff32406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff328e80640 1 --2- 172.21.15.57:0/3158609810 >> v2:172.21.15.132:3300/0 conn(0x7ff324158a50 0x7ff32406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff328e80640 1 -- 172.21.15.57:0/3158609810 >> v1:172.21.15.57:6789/0 conn(0x7ff32406e340 legacy=0x7ff3240707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.360+0000 7ff328e80640 1 -- 172.21.15.57:0/3158609810 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324158e30 con 0x7ff32406cb90 2023-11-24T08:03:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff328e80640 1 --2- 172.21.15.57:0/3158609810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3240b24c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3240d00d0 tx=0x7ff31c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c90f4adef1c2340 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff322ffd640 1 -- 172.21.15.57:0/3158609810 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0a59a0 con 0x7ff32406cb90 2023-11-24T08:03:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff322ffd640 1 -- 172.21.15.57:0/3158609810 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c0a5b00 con 0x7ff32406cb90 2023-11-24T08:03:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff322ffd640 1 -- 172.21.15.57:0/3158609810 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0a5e90 con 0x7ff32406cb90 2023-11-24T08:03:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 -- 172.21.15.57:0/3158609810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 msgr2=0x7ff3240b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/3158609810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3240b24c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3240d00d0 tx=0x7ff31c01c8e0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 -- 172.21.15.57:0/3158609810 shutdown_connections 2023-11-24T08:03:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/3158609810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3240b24c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/3158609810 >> v2:172.21.15.132:3300/0 conn(0x7ff324158a50 0x7ff32406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 -- 172.21.15.57:0/3158609810 >> 172.21.15.57:0/3158609810 conn(0x7ff3240b0bf0 msgr2=0x7ff3240b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 -- 172.21.15.57:0/3158609810 shutdown_connections 2023-11-24T08:03:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.364+0000 7ff32a8e3640 1 -- 172.21.15.57:0/3158609810 wait complete. 2023-11-24T08:03:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 Processor -- start 2023-11-24T08:03:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 -- start start 2023-11-24T08:03:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3241568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff32406e340 0x7ff32415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff324158a50 0x7ff32415f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32415e890 con 0x7ff32406cb90 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240999e0 con 0x7ff324158a50 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff324099cc0 con 0x7ff32406e340 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3241568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3241568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42506/0 (socket says 172.21.15.57:42506) 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 -- 172.21.15.57:0/1802518008 learned_addr learned my addr 172.21.15.57:0/1802518008 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 -- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff32406e340 msgr2=0x7ff32415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff32406e340 0x7ff32415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 -- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff324158a50 msgr2=0x7ff32415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff328e80640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff324158a50 0x7ff32415f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff324158a50 0x7ff32415f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 -- 172.21.15.57:0/1802518008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c009a70 con 0x7ff32406cb90 2023-11-24T08:03:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff328e80640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff324158a50 0x7ff32415f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff323fff640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3241568e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff31400d800 tx=0x7ff31400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff320ff9640 1 -- 172.21.15.57:0/1802518008 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400b6c0 con 0x7ff32406cb90 2023-11-24T08:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff320ff9640 1 -- 172.21.15.57:0/1802518008 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400b820 con 0x7ff32406cb90 2023-11-24T08:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff320ff9640 1 -- 172.21.15.57:0/1802518008 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400bb90 con 0x7ff32406cb90 2023-11-24T08:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324099fa0 con 0x7ff32406cb90 2023-11-24T08:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.368+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32409a7a0 con 0x7ff32406cb90 2023-11-24T08:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.372+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324067520 con 0x7ff32406cb90 2023-11-24T08:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.372+0000 7ff320ff9640 1 -- 172.21.15.57:0/1802518008 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff31400bcf0 con 0x7ff32406cb90 2023-11-24T08:03:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.372+0000 7ff320ff9640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff310066470 0x7ff310068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.372+0000 7ff320ff9640 1 -- 172.21.15.57:0/1802518008 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3140840c0 con 0x7ff32406cb90 2023-11-24T08:03:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.372+0000 7ff3237fe640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff310066470 0x7ff310068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.372+0000 7ff3237fe640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff310066470 0x7ff310068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff32415df40 tx=0x7ff318007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.376+0000 7ff320ff9640 1 -- 172.21.15.57:0/1802518008 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff314051890 con 0x7ff32406cb90 2023-11-24T08:03:56.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.536+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff32415e9d0 con 0x7ff32406cb90 2023-11-24T08:03:56.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.536+0000 7ff320ff9640 1 -- 172.21.15.57:0/1802518008 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff314011340 con 0x7ff32406cb90 2023-11-24T08:03:56.543 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:03:56.544 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-11-24T08:03:56.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:03:56.544 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-11-24T08:03:56.544 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-11-24T08:03:56.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:03:56.544 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff310066470 msgr2=0x7ff310068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff310066470 0x7ff310068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff32415df40 tx=0x7ff318007a50 comp rx=0 tx=0).stop 2023-11-24T08:03:56.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 msgr2=0x7ff3241568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3241568e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff31400d800 tx=0x7ff31400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 shutdown_connections 2023-11-24T08:03:56.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff310066470 0x7ff310068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff324158a50 0x7ff32415f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff32406e340 0x7ff32415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 --2- 172.21.15.57:0/1802518008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32406cb90 0x7ff3241568e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 >> 172.21.15.57:0/1802518008 conn(0x7ff3240b0bf0 msgr2=0x7ff3240b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 shutdown_connections 2023-11-24T08:03:56.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.540+0000 7ff32a8e3640 1 -- 172.21.15.57:0/1802518008 wait complete. 2023-11-24T08:03:56.565 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:03:56.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:03:56.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb7311ec640 1 Processor -- start 2023-11-24T08:03:56.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb7311ec640 1 -- start start 2023-11-24T08:03:56.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb7311ec640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb72c06de50 0x7fb72c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb7311ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb7311ec640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72c0ae950 con 0x7fb72c06cff0 2023-11-24T08:03:56.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb7311ec640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c159fc0 con 0x7fb72c06de50 2023-11-24T08:03:56.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb7311ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c0b1ef0 con 0x7fb72c06c650 2023-11-24T08:03:56.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72ad9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb72c06de50 0x7fb72c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72ad9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb72c06de50 0x7fb72c159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42522/0 (socket says 172.21.15.57:42522) 2023-11-24T08:03:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72ad9d640 1 -- 172.21.15.57:0/2206110328 learned_addr learned my addr 172.21.15.57:0/2206110328 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72b59e640 1 --1- 172.21.15.57:0/2206110328 >> v1:172.21.15.57:6789/0 conn(0x7fb72c06cff0 0x7fb72c0ac5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51100/0 (socket says 172.21.15.57:51100) 2023-11-24T08:03:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72ad9d640 1 -- 172.21.15.57:0/2206110328 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 msgr2=0x7fb72c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72ad9d640 1 --2- 172.21.15.57:0/2206110328 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72ad9d640 1 -- 172.21.15.57:0/2206110328 >> v1:172.21.15.57:6789/0 conn(0x7fb72c06cff0 legacy=0x7fb72c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.708+0000 7fb72ad9d640 1 -- 172.21.15.57:0/2206110328 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c06e230 con 0x7fb72c06de50 2023-11-24T08:03:56.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb72ad9d640 1 --2- 172.21.15.57:0/2206110328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06de50 0x7fb72c159a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009870 tx=0x7fb71c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613de1fc4688f2d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb72a59c640 1 -- 172.21.15.57:0/2206110328 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0ab620 con 0x7fb72c06de50 2023-11-24T08:03:56.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb72a59c640 1 -- 172.21.15.57:0/2206110328 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c0ab780 con 0x7fb72c06de50 2023-11-24T08:03:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb72a59c640 1 -- 172.21.15.57:0/2206110328 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0abb10 con 0x7fb72c06de50 2023-11-24T08:03:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 -- 172.21.15.57:0/2206110328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06de50 msgr2=0x7fb72c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 --2- 172.21.15.57:0/2206110328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06de50 0x7fb72c159a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009870 tx=0x7fb71c01c510 comp rx=0 tx=0).stop 2023-11-24T08:03:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 -- 172.21.15.57:0/2206110328 shutdown_connections 2023-11-24T08:03:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 --2- 172.21.15.57:0/2206110328 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 --2- 172.21.15.57:0/2206110328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06de50 0x7fb72c159a80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 -- 172.21.15.57:0/2206110328 >> 172.21.15.57:0/2206110328 conn(0x7fb72c0b0bf0 msgr2=0x7fb72c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 -- 172.21.15.57:0/2206110328 shutdown_connections 2023-11-24T08:03:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.712+0000 7fb7311ec640 1 -- 172.21.15.57:0/2206110328 wait complete. 2023-11-24T08:03:56.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 Processor -- start 2023-11-24T08:03:56.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 -- start start 2023-11-24T08:03:56.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06cff0 0x7fb72c14a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72c06de50 0x7fb72c0af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c151b80 con 0x7fb72c06cff0 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c15bd90 con 0x7fb72c06de50 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c15c070 con 0x7fb72c06c650 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06cff0 0x7fb72c14a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06cff0 0x7fb72c14a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42538/0 (socket says 172.21.15.57:42538) 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 -- 172.21.15.57:0/4121911193 learned_addr learned my addr 172.21.15.57:0/4121911193 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:56.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb72b59e640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72c06de50 0x7fb72c0af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb72ad9d640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 -- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 msgr2=0x7fb72c161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 -- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72c06de50 msgr2=0x7fb72c0af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72c06de50 0x7fb72c0af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 -- 172.21.15.57:0/4121911193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0094d0 con 0x7fb72c06cff0 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb72ad9d640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb72b59e640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72c06de50 0x7fb72c0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:56.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb723fff640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06cff0 0x7fb72c14a1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb71400b550 tx=0x7fb71400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7237fe640 1 -- 172.21.15.57:0/4121911193 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714010870 con 0x7fb72c06cff0 2023-11-24T08:03:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7237fe640 1 -- 172.21.15.57:0/4121911193 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7140109f0 con 0x7fb72c06cff0 2023-11-24T08:03:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72c15c350 con 0x7fb72c06cff0 2023-11-24T08:03:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7237fe640 1 -- 172.21.15.57:0/4121911193 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714010da0 con 0x7fb72c06cff0 2023-11-24T08:03:56.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.716+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c161f90 con 0x7fb72c06cff0 2023-11-24T08:03:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.720+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72c067520 con 0x7fb72c06cff0 2023-11-24T08:03:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.720+0000 7fb7237fe640 1 -- 172.21.15.57:0/4121911193 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb71400f3c0 con 0x7fb72c06cff0 2023-11-24T08:03:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.720+0000 7fb7237fe640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb70c066470 0x7fb70c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.720+0000 7fb7237fe640 1 -- 172.21.15.57:0/4121911193 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb714083b60 con 0x7fb72c06cff0 2023-11-24T08:03:56.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.720+0000 7fb72ad9d640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb70c066470 0x7fb70c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.720+0000 7fb72ad9d640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb70c066470 0x7fb70c068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0af000 tx=0x7fb71c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.724+0000 7fb7237fe640 1 -- 172.21.15.57:0/4121911193 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7140512a0 con 0x7fb72c06cff0 2023-11-24T08:03:56.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:56.880+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb72c06e690 con 0x7fb72c06cff0 2023-11-24T08:03:57.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.544+0000 7fb7237fe640 1 -- 172.21.15.57:0/4121911193 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb7140548c0 con 0x7fb72c06cff0 2023-11-24T08:03:57.551 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-11-24T08:03:57.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb70c066470 msgr2=0x7fb70c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb70c066470 0x7fb70c068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0af000 tx=0x7fb71c008040 comp rx=0 tx=0).stop 2023-11-24T08:03:57.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06cff0 msgr2=0x7fb72c14a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06cff0 0x7fb72c14a1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb71400b550 tx=0x7fb71400ba10 comp rx=0 tx=0).stop 2023-11-24T08:03:57.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 shutdown_connections 2023-11-24T08:03:57.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb70c066470 0x7fb70c068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72c06de50 0x7fb72c0af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb72c06cff0 0x7fb72c14a1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 --2- 172.21.15.57:0/4121911193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72c06c650 0x7fb72c161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 >> 172.21.15.57:0/4121911193 conn(0x7fb72c0b0bf0 msgr2=0x7fb72c15aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 shutdown_connections 2023-11-24T08:03:57.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.548+0000 7fb7311ec640 1 -- 172.21.15.57:0/4121911193 wait complete. 2023-11-24T08:03:57.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:03:57.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.728+0000 7f9f00708640 1 Processor -- start 2023-11-24T08:03:57.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.728+0000 7f9f00708640 1 -- start start 2023-11-24T08:03:57.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9f00708640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ef8147020 0x7f9ef80d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9f00708640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ef80d01e0 0x7f9ef80b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9f00708640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80cee60 con 0x7f9ef80d0640 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9f00708640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80cf140 con 0x7f9ef80d01e0 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9f00708640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80cf420 con 0x7f9ef8147020 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efdca3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ef80d01e0 0x7f9ef80b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efdca3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ef80d01e0 0x7f9ef80b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42548/0 (socket says 172.21.15.57:42548) 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efdca3640 1 -- 172.21.15.57:0/2495925840 learned_addr learned my addr 172.21.15.57:0/2495925840 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efe4a4640 1 --2- 172.21.15.57:0/2495925840 >> v2:172.21.15.132:3300/0 conn(0x7f9ef8147020 0x7f9ef80d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efdca3640 1 -- 172.21.15.57:0/2495925840 >> v2:172.21.15.132:3300/0 conn(0x7f9ef8147020 msgr2=0x7f9ef80d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:57.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efdca3640 1 --2- 172.21.15.57:0/2495925840 >> v2:172.21.15.132:3300/0 conn(0x7f9ef8147020 0x7f9ef80d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efdca3640 1 -- 172.21.15.57:0/2495925840 >> v1:172.21.15.132:6789/0 conn(0x7f9ef80d0640 legacy=0x7f9ef806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:57.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.732+0000 7f9efdca3640 1 -- 172.21.15.57:0/2495925840 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80cf700 con 0x7f9ef80d01e0 2023-11-24T08:03:57.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9efdca3640 1 --2- 172.21.15.57:0/2495925840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef80b2e50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80b3f80 tx=0x7f9ee801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6335d9e6bc139e23 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:57.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9efd4a2640 1 -- 172.21.15.57:0/2495925840 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80aa5f0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9efd4a2640 1 -- 172.21.15.57:0/2495925840 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80aa750 con 0x7f9ef80d01e0 2023-11-24T08:03:57.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9efd4a2640 1 -- 172.21.15.57:0/2495925840 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80aaae0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 -- 172.21.15.57:0/2495925840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 msgr2=0x7f9ef80b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 --2- 172.21.15.57:0/2495925840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef80b2e50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80b3f80 tx=0x7f9ee801c490 comp rx=0 tx=0).stop 2023-11-24T08:03:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 -- 172.21.15.57:0/2495925840 shutdown_connections 2023-11-24T08:03:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 --2- 172.21.15.57:0/2495925840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef80b2e50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 --2- 172.21.15.57:0/2495925840 >> v2:172.21.15.132:3300/0 conn(0x7f9ef8147020 0x7f9ef80d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 -- 172.21.15.57:0/2495925840 >> 172.21.15.57:0/2495925840 conn(0x7f9ef8060fd0 msgr2=0x7f9ef80613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:57.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 -- 172.21.15.57:0/2495925840 shutdown_connections 2023-11-24T08:03:57.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 -- 172.21.15.57:0/2495925840 wait complete. 2023-11-24T08:03:57.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 Processor -- start 2023-11-24T08:03:57.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.736+0000 7f9f00708640 1 -- start start 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef81460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef80d0640 0x7f9ef80ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef8147020 0x7f9ef815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80b40b0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef815fdd0 con 0x7f9ef80d0640 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef815f530 con 0x7f9ef8147020 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef81460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef81460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42562/0 (socket says 172.21.15.57:42562) 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 -- 172.21.15.57:0/1996374774 learned_addr learned my addr 172.21.15.57:0/1996374774 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efeca5640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef8147020 0x7f9ef815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efdca3640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef80d0640 0x7f9ef80ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 -- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef8147020 msgr2=0x7f9ef815c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef8147020 0x7f9ef815c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 -- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef80d0640 msgr2=0x7f9ef80ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef80d0640 0x7f9ef80ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 -- 172.21.15.57:0/1996374774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80094d0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efeca5640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef8147020 0x7f9ef815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9efe4a4640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef81460a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400d5f0 tx=0x7f9ef400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9eeeffd640 1 -- 172.21.15.57:0/1996374774 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40125f0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9eeeffd640 1 -- 172.21.15.57:0/1996374774 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4012750 con 0x7f9ef80d01e0 2023-11-24T08:03:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9eeeffd640 1 -- 172.21.15.57:0/1996374774 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4012ae0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef815f810 con 0x7f9ef80d01e0 2023-11-24T08:03:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef81465e0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef81467d0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.740+0000 7f9eeeffd640 1 -- 172.21.15.57:0/1996374774 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ef4012c40 con 0x7f9ef80d01e0 2023-11-24T08:03:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.744+0000 7f9eeeffd640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9edc0664a0 0x7f9edc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.744+0000 7f9eeeffd640 1 -- 172.21.15.57:0/1996374774 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9ef40841b0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.744+0000 7f9efdca3640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9edc0664a0 0x7f9edc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:57.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.744+0000 7f9efdca3640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9edc0664a0 0x7f9edc068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80ae000 tx=0x7f9ee80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:57.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.748+0000 7f9eeeffd640 1 -- 172.21.15.57:0/1996374774 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ef81467d0 con 0x7f9ef80d01e0 2023-11-24T08:03:57.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:57.904+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9ef81467d0 con 0x7f9ef80d01e0 2023-11-24T08:03:58.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.552+0000 7f9eeeffd640 1 -- 172.21.15.57:0/1996374774 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9ef81467d0 con 0x7f9ef80d01e0 2023-11-24T08:03:58.558 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-11-24T08:03:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9edc0664a0 msgr2=0x7f9edc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9edc0664a0 0x7f9edc068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80ae000 tx=0x7f9ee80a7000 comp rx=0 tx=0).stop 2023-11-24T08:03:58.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 msgr2=0x7f9ef81460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef81460a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400d5f0 tx=0x7f9ef400dab0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 shutdown_connections 2023-11-24T08:03:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9edc0664a0 0x7f9edc068960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef8147020 0x7f9ef815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef80d0640 0x7f9ef80ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 --2- 172.21.15.57:0/1996374774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef80d01e0 0x7f9ef81460a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 >> 172.21.15.57:0/1996374774 conn(0x7f9ef8060fd0 msgr2=0x7f9ef8073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:58.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 shutdown_connections 2023-11-24T08:03:58.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.556+0000 7f9f00708640 1 -- 172.21.15.57:0/1996374774 wait complete. 2023-11-24T08:03:58.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:03:58.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 Processor -- start 2023-11-24T08:03:58.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 -- start start 2023-11-24T08:03:58.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f27200ae4a0 0x7f272015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f27200cd850 0x7f27200cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200ce250 0x7f272015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200ce700 con 0x7f27200ae4a0 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200b3510 con 0x7f27200cd850 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f2725d2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200b37f0 con 0x7f27200ce250 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f27200ae4a0 0x7f272015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f27200ae4a0 0x7f272015ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42566/0 (socket says 172.21.15.57:42566) 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 -- 172.21.15.57:0/1330302913 learned_addr learned my addr 172.21.15.57:0/1330302913 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271ffff640 1 --2- 172.21.15.57:0/1330302913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200ce250 0x7f272015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271effd640 1 --2- 172.21.15.57:0/1330302913 >> v2:172.21.15.132:3300/0 conn(0x7f27200cd850 0x7f27200cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 -- 172.21.15.57:0/1330302913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200ce250 msgr2=0x7f272015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 --2- 172.21.15.57:0/1330302913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200ce250 0x7f272015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 -- 172.21.15.57:0/1330302913 >> v2:172.21.15.132:3300/0 conn(0x7f27200cd850 msgr2=0x7f27200cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 --2- 172.21.15.57:0/1330302913 >> v2:172.21.15.132:3300/0 conn(0x7f27200cd850 0x7f27200cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271f7fe640 1 -- 172.21.15.57:0/1330302913 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200b3ad0 con 0x7f27200ae4a0 2023-11-24T08:03:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.744+0000 7f271effd640 1 --2- 172.21.15.57:0/1330302913 >> v2:172.21.15.132:3300/0 conn(0x7f27200cd850 0x7f27200cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:58.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f271f7fe640 1 --2- 172.21.15.57:0/1330302913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f272015ba00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f272006e670 tx=0x7f271001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f50ae1eb66d4845 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:58.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f271e7fc640 1 -- 172.21.15.57:0/1330302913 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab600 con 0x7f27200ae4a0 2023-11-24T08:03:58.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f271e7fc640 1 -- 172.21.15.57:0/1330302913 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100a7050 con 0x7f27200ae4a0 2023-11-24T08:03:58.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f271e7fc640 1 -- 172.21.15.57:0/1330302913 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab980 con 0x7f27200ae4a0 2023-11-24T08:03:58.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 -- 172.21.15.57:0/1330302913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 msgr2=0x7f272015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 --2- 172.21.15.57:0/1330302913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f272015ba00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f272006e670 tx=0x7f271001c210 comp rx=0 tx=0).stop 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 -- 172.21.15.57:0/1330302913 shutdown_connections 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 --2- 172.21.15.57:0/1330302913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200ce250 0x7f272015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 --2- 172.21.15.57:0/1330302913 >> v2:172.21.15.132:3300/0 conn(0x7f27200cd850 0x7f27200cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 --2- 172.21.15.57:0/1330302913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f272015ba00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 -- 172.21.15.57:0/1330302913 >> 172.21.15.57:0/1330302913 conn(0x7f27200b0c80 msgr2=0x7f27200b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 -- 172.21.15.57:0/1330302913 shutdown_connections 2023-11-24T08:03:58.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.748+0000 7f2725d2a640 1 -- 172.21.15.57:0/1330302913 wait complete. 2023-11-24T08:03:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 Processor -- start 2023-11-24T08:03:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 -- start start 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f2720154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200cd850 0x7f272014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27200ce250 0x7f27201489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272014f230 con 0x7f27200ae4a0 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272014f490 con 0x7f27200ce250 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2725d2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272014f770 con 0x7f27200cd850 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f2720154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f2720154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42576/0 (socket says 172.21.15.57:42576) 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 -- 172.21.15.57:0/942210461 learned_addr learned my addr 172.21.15.57:0/942210461 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271ffff640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27200ce250 0x7f27201489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271effd640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200cd850 0x7f272014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 -- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200cd850 msgr2=0x7f272014ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200cd850 0x7f272014ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 -- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27200ce250 msgr2=0x7f27201489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27200ce250 0x7f27201489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 -- 172.21.15.57:0/942210461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100094d0 con 0x7f27200ae4a0 2023-11-24T08:03:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f271f7fe640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f2720154110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae040 tx=0x7f271001aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2707fff640 1 -- 172.21.15.57:0/942210461 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100b6620 con 0x7f27200ae4a0 2023-11-24T08:03:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.752+0000 7f2707fff640 1 -- 172.21.15.57:0/942210461 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100abe90 con 0x7f27200ae4a0 2023-11-24T08:03:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272014fa50 con 0x7f27200ae4a0 2023-11-24T08:03:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f2707fff640 1 -- 172.21.15.57:0/942210461 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100b69e0 con 0x7f27200ae4a0 2023-11-24T08:03:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2720148ef0 con 0x7f27200ae4a0 2023-11-24T08:03:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272006c5c0 con 0x7f27200ae4a0 2023-11-24T08:03:58.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f2707fff640 1 -- 172.21.15.57:0/942210461 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27100b2040 con 0x7f27200ae4a0 2023-11-24T08:03:58.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f2707fff640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f270c066470 0x7f270c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:58.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f2707fff640 1 -- 172.21.15.57:0/942210461 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f271011dfe0 con 0x7f27200ae4a0 2023-11-24T08:03:58.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.756+0000 7f271effd640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f270c066470 0x7f270c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:58.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.760+0000 7f271effd640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f270c066470 0x7f270c068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f272006db60 tx=0x7f2714008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:58.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.760+0000 7f2707fff640 1 -- 172.21.15.57:0/942210461 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27100eb440 con 0x7f27200ae4a0 2023-11-24T08:03:58.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:58.952+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f272004e8c0 con 0x7f27200ae4a0 2023-11-24T08:03:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.576+0000 7f2707fff640 1 -- 172.21.15.57:0/942210461 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f27100b00c0 con 0x7f27200ae4a0 2023-11-24T08:03:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T08:03:59.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f270c066470 msgr2=0x7f270c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f270c066470 0x7f270c068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f272006db60 tx=0x7f2714008040 comp rx=0 tx=0).stop 2023-11-24T08:03:59.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 msgr2=0x7f2720154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f2720154110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae040 tx=0x7f271001aa50 comp rx=0 tx=0).stop 2023-11-24T08:03:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 shutdown_connections 2023-11-24T08:03:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f270c066470 0x7f270c068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27200ce250 0x7f27201489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27200cd850 0x7f272014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 --2- 172.21.15.57:0/942210461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27200ae4a0 0x7f2720154110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.588+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 >> 172.21.15.57:0/942210461 conn(0x7f27200b0c80 msgr2=0x7f272015d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:59.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.592+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 shutdown_connections 2023-11-24T08:03:59.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.592+0000 7f2725d2a640 1 -- 172.21.15.57:0/942210461 wait complete. 2023-11-24T08:03:59.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:03:59.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe5a616640 1 Processor -- start 2023-11-24T08:03:59.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe5a616640 1 -- start start 2023-11-24T08:03:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe5a616640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe540d3020 0x7fbe540d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe5a616640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe540ce8b0 0x7fbe540ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe5a616640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5406c0e0 con 0x7fbe5415d570 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe5a616640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe540d39f0 con 0x7fbe540d3020 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe5a616640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe540d1cc0 con 0x7fbe540ce8b0 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe537fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe540d3020 0x7fbe540d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe537fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe540d3020 0x7fbe540d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42582/0 (socket says 172.21.15.57:42582) 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe53fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe5415d570 0x7fbe5406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51102/0 (socket says 172.21.15.57:51102) 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe537fe640 1 -- 172.21.15.57:0/3267589897 learned_addr learned my addr 172.21.15.57:0/3267589897 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe58bb3640 1 --2- 172.21.15.57:0/3267589897 >> v2:172.21.15.132:3300/0 conn(0x7fbe540ce8b0 0x7fbe540ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe537fe640 1 -- 172.21.15.57:0/3267589897 >> v2:172.21.15.132:3300/0 conn(0x7fbe540ce8b0 msgr2=0x7fbe540ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe537fe640 1 --2- 172.21.15.57:0/3267589897 >> v2:172.21.15.132:3300/0 conn(0x7fbe540ce8b0 0x7fbe540ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe537fe640 1 -- 172.21.15.57:0/3267589897 >> v1:172.21.15.57:6789/0 conn(0x7fbe5415d570 legacy=0x7fbe5406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe537fe640 1 -- 172.21.15.57:0/3267589897 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540d1fa0 con 0x7fbe540d3020 2023-11-24T08:03:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.772+0000 7fbe52ffd640 1 -- 172.21.15.57:0/3267589897 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995645191 0 0) 0x7fbe5406c0e0 con 0x7fbe5415d570 2023-11-24T08:03:59.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe537fe640 1 --2- 172.21.15.57:0/3267589897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540d3020 0x7fbe540d34b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbe5406d730 tx=0x7fbe4801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb1d7a480c54a07 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:59.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe52ffd640 1 -- 172.21.15.57:0/3267589897 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480aa430 con 0x7fbe540d3020 2023-11-24T08:03:59.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe52ffd640 1 -- 172.21.15.57:0/3267589897 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe480aa590 con 0x7fbe540d3020 2023-11-24T08:03:59.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe52ffd640 1 -- 172.21.15.57:0/3267589897 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480aa920 con 0x7fbe540d3020 2023-11-24T08:03:59.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 -- 172.21.15.57:0/3267589897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540d3020 msgr2=0x7fbe540d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 --2- 172.21.15.57:0/3267589897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540d3020 0x7fbe540d34b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbe5406d730 tx=0x7fbe4801c4d0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 -- 172.21.15.57:0/3267589897 shutdown_connections 2023-11-24T08:03:59.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 --2- 172.21.15.57:0/3267589897 >> v2:172.21.15.132:3300/0 conn(0x7fbe540ce8b0 0x7fbe540ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 --2- 172.21.15.57:0/3267589897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540d3020 0x7fbe540d34b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 -- 172.21.15.57:0/3267589897 >> 172.21.15.57:0/3267589897 conn(0x7fbe5408ceb0 msgr2=0x7fbe5409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:59.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 -- 172.21.15.57:0/3267589897 shutdown_connections 2023-11-24T08:03:59.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.776+0000 7fbe5a616640 1 -- 172.21.15.57:0/3267589897 wait complete. 2023-11-24T08:03:59.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 Processor -- start 2023-11-24T08:03:59.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 -- start start 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540ce8b0 0x7fbe54147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe540d3020 0x7fbe540c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5415d570 0x7fbe540ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe541478c0 con 0x7fbe540ce8b0 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c95c0 con 0x7fbe5415d570 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c89b0 con 0x7fbe540d3020 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540ce8b0 0x7fbe54147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540ce8b0 0x7fbe54147380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42588/0 (socket says 172.21.15.57:42588) 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 -- 172.21.15.57:0/2769256663 learned_addr learned my addr 172.21.15.57:0/2769256663 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe58bb3640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5415d570 0x7fbe540ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe537fe640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe540d3020 0x7fbe540c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 -- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe540d3020 msgr2=0x7fbe540c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe540d3020 0x7fbe540c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 -- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5415d570 msgr2=0x7fbe540ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5415d570 0x7fbe540ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 -- 172.21.15.57:0/2769256663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480094d0 con 0x7fbe540ce8b0 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe58bb3640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5415d570 0x7fbe540ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe53fff640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540ce8b0 0x7fbe54147380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c480 tx=0x7fbe4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe50ff9640 1 -- 172.21.15.57:0/2769256663 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440074e0 con 0x7fbe540ce8b0 2023-11-24T08:03:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe50ff9640 1 -- 172.21.15.57:0/2769256663 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44007660 con 0x7fbe540ce8b0 2023-11-24T08:03:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe50ff9640 1 -- 172.21.15.57:0/2769256663 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44004a30 con 0x7fbe540ce8b0 2023-11-24T08:03:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe540c8c90 con 0x7fbe540ce8b0 2023-11-24T08:03:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.780+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe540c9250 con 0x7fbe540ce8b0 2023-11-24T08:03:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.784+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe54067520 con 0x7fbe540ce8b0 2023-11-24T08:03:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.784+0000 7fbe50ff9640 1 -- 172.21.15.57:0/2769256663 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe44004b90 con 0x7fbe540ce8b0 2023-11-24T08:03:59.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.784+0000 7fbe50ff9640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbe400664a0 0x7fbe40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:59.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.784+0000 7fbe50ff9640 1 -- 172.21.15.57:0/2769256663 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe44082fe0 con 0x7fbe540ce8b0 2023-11-24T08:03:59.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.784+0000 7fbe537fe640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbe400664a0 0x7fbe40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:59.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.788+0000 7fbe537fe640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbe400664a0 0x7fbe40068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ae000 tx=0x7fbe480a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:59.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.788+0000 7fbe50ff9640 1 -- 172.21.15.57:0/2769256663 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe44050450 con 0x7fbe540ce8b0 2023-11-24T08:03:59.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.948+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe54071ac0 con 0x7fbe540ce8b0 2023-11-24T08:03:59.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.948+0000 7fbe50ff9640 1 -- 172.21.15.57:0/2769256663 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16458 (secure 0 0 0) 0x7fbe44053a70 con 0x7fbe540ce8b0 2023-11-24T08:03:59.954 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:03:59.955 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:58.958902+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbe400664a0 msgr2=0x7fbe40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbe400664a0 0x7fbe40068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ae000 tx=0x7fbe480a7000 comp rx=0 tx=0).stop 2023-11-24T08:03:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540ce8b0 msgr2=0x7fbe54147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:59.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540ce8b0 0x7fbe54147380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c480 tx=0x7fbe4400c940 comp rx=0 tx=0).stop 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 shutdown_connections 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbe400664a0 0x7fbe40068960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5415d570 0x7fbe540ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe540d3020 0x7fbe540c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 --2- 172.21.15.57:0/2769256663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe540ce8b0 0x7fbe54147380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 >> 172.21.15.57:0/2769256663 conn(0x7fbe5408ceb0 msgr2=0x7fbe5406c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 shutdown_connections 2023-11-24T08:03:59.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:03:59.952+0000 7fbe5a616640 1 -- 172.21.15.57:0/2769256663 wait complete. 2023-11-24T08:03:59.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:00.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.112+0000 7f6bbf4ad640 1 Processor -- start 2023-11-24T08:04:00.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbf4ad640 1 -- start start 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbf4ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bb815d570 0x7f6bb806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbf4ad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb80d1cc0 con 0x7f6bb80d3020 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbf4ad640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb80d1fa0 con 0x7f6bb80ce8b0 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbf4ad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb80ce0b0 con 0x7f6bb815d570 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbd249640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bb815d570 0x7f6bb806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbca48640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6bb80d3020 0x7f6bb80d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51106/0 (socket says 172.21.15.57:51106) 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbd249640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bb815d570 0x7f6bb806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42602/0 (socket says 172.21.15.57:42602) 2023-11-24T08:04:00.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbca48640 1 -- 172.21.15.57:0/3680204615 learned_addr learned my addr 172.21.15.57:0/3680204615 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:00.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbd249640 1 -- 172.21.15.57:0/3680204615 >> v1:172.21.15.132:6789/0 conn(0x7f6bb80ce8b0 legacy=0x7f6bb80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbd249640 1 -- 172.21.15.57:0/3680204615 >> v1:172.21.15.57:6789/0 conn(0x7f6bb80d3020 legacy=0x7f6bb80d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.116+0000 7f6bbd249640 1 -- 172.21.15.57:0/3680204615 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80ce390 con 0x7f6bb815d570 2023-11-24T08:04:00.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbd249640 1 --2- 172.21.15.57:0/3680204615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb815d570 0x7f6bb806b9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40097c0 tx=0x7f6bb401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c1212ff1d0eaf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:00.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6baffff640 1 -- 172.21.15.57:0/3680204615 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40a8050 con 0x7f6bb815d570 2023-11-24T08:04:00.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6baffff640 1 -- 172.21.15.57:0/3680204615 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb40ac5f0 con 0x7f6bb815d570 2023-11-24T08:04:00.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6baffff640 1 -- 172.21.15.57:0/3680204615 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40ac980 con 0x7f6bb815d570 2023-11-24T08:04:00.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3680204615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb815d570 msgr2=0x7f6bb806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3680204615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb815d570 0x7f6bb806b9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40097c0 tx=0x7f6bb401c480 comp rx=0 tx=0).stop 2023-11-24T08:04:00.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3680204615 shutdown_connections 2023-11-24T08:04:00.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3680204615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb815d570 0x7f6bb806b9d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3680204615 >> 172.21.15.57:0/3680204615 conn(0x7f6bb808ceb0 msgr2=0x7f6bb809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:00.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3680204615 shutdown_connections 2023-11-24T08:04:00.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3680204615 wait complete. 2023-11-24T08:04:00.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 Processor -- start 2023-11-24T08:04:00.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.120+0000 7f6bbf4ad640 1 -- start start 2023-11-24T08:04:00.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bb80ce8b0 0x7f6bb80c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb80d3020 0x7f6bb80b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bb815d570 0x7f6bb815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80c9de0 con 0x7f6bb80d3020 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb815f100 con 0x7f6bb815d570 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8154d80 con 0x7f6bb80ce8b0 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb80d3020 0x7f6bb80b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb80d3020 0x7f6bb80b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42604/0 (socket says 172.21.15.57:42604) 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 -- 172.21.15.57:0/3374740407 learned_addr learned my addr 172.21.15.57:0/3374740407 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbd249640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bb80ce8b0 0x7f6bb80c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbda4a640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bb815d570 0x7f6bb815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 -- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bb80ce8b0 msgr2=0x7f6bb80c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bb80ce8b0 0x7f6bb80c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 -- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bb815d570 msgr2=0x7f6bb815fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bb815d570 0x7f6bb815fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 -- 172.21.15.57:0/3374740407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009420 con 0x7f6bb80d3020 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbda4a640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bb815d570 0x7f6bb815fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbca48640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb80d3020 0x7f6bb80b6020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c4d0 tx=0x7f6ba800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6badffb640 1 -- 172.21.15.57:0/3374740407 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8005cf0 con 0x7f6bb80d3020 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6badffb640 1 -- 172.21.15.57:0/3374740407 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba8005e50 con 0x7f6bb80d3020 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6badffb640 1 -- 172.21.15.57:0/3374740407 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8007270 con 0x7f6bb80d3020 2023-11-24T08:04:00.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb80c9b00 con 0x7f6bb80d3020 2023-11-24T08:04:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb815f680 con 0x7f6bb80d3020 2023-11-24T08:04:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.124+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb8067520 con 0x7f6bb80d3020 2023-11-24T08:04:00.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.128+0000 7f6badffb640 1 -- 172.21.15.57:0/3374740407 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ba80073d0 con 0x7f6bb80d3020 2023-11-24T08:04:00.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.128+0000 7f6badffb640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b9c066470 0x7f6b9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.128+0000 7f6badffb640 1 -- 172.21.15.57:0/3374740407 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ba80832a0 con 0x7f6bb80d3020 2023-11-24T08:04:00.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.128+0000 7f6bbd249640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b9c066470 0x7f6b9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.128+0000 7f6bbd249640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b9c066470 0x7f6b9c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40ae000 tx=0x7f6bb40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:00.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.132+0000 7f6badffb640 1 -- 172.21.15.57:0/3374740407 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ba80507d0 con 0x7f6bb80d3020 2023-11-24T08:04:00.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb806b7b0 con 0x7f6bb80d3020 2023-11-24T08:04:00.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6badffb640 1 -- 172.21.15.57:0/3374740407 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16458 (secure 0 0 0) 0x7f6ba8053df0 con 0x7f6bb80d3020 2023-11-24T08:04:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:00.298 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:03:58.958902+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:00.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b9c066470 msgr2=0x7f6b9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b9c066470 0x7f6b9c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40ae000 tx=0x7f6bb40a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:00.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb80d3020 msgr2=0x7f6bb80b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb80d3020 0x7f6bb80b6020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c4d0 tx=0x7f6ba800c990 comp rx=0 tx=0).stop 2023-11-24T08:04:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 shutdown_connections 2023-11-24T08:04:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b9c066470 0x7f6b9c068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bb815d570 0x7f6bb815fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb80d3020 0x7f6bb80b6020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 --2- 172.21.15.57:0/3374740407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bb80ce8b0 0x7f6bb80c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.292+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 >> 172.21.15.57:0/3374740407 conn(0x7f6bb808ceb0 msgr2=0x7f6bb80b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.296+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 shutdown_connections 2023-11-24T08:04:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.296+0000 7f6bbf4ad640 1 -- 172.21.15.57:0/3374740407 wait complete. 2023-11-24T08:04:00.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:04:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.460+0000 7f7984701640 1 Processor -- start 2023-11-24T08:04:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.460+0000 7f7984701640 1 -- start start 2023-11-24T08:04:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.460+0000 7f7984701640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f797c15d7f0 0x7f797c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.460+0000 7f7984701640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f797c0d37e0 0x7f797c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7984701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0b1630 0x7f797c0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7984701640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c06b980 con 0x7f797c0d37e0 2023-11-24T08:04:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7984701640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0d3c60 con 0x7f797c15d7f0 2023-11-24T08:04:00.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7984701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0b0090 con 0x7f797c0b1630 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f797c0d37e0 0x7f797c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f797c0d37e0 0x7f797c0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42620/0 (socket says 172.21.15.57:42620) 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 -- 172.21.15.57:0/4159552076 learned_addr learned my addr 172.21.15.57:0/4159552076 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7982c9e640 1 --2- 172.21.15.57:0/4159552076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0b1630 0x7f797c0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f798249d640 1 --2- 172.21.15.57:0/4159552076 >> v2:172.21.15.132:3300/0 conn(0x7f797c15d7f0 0x7f797c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 -- 172.21.15.57:0/4159552076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0b1630 msgr2=0x7f797c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 --2- 172.21.15.57:0/4159552076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0b1630 0x7f797c0b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 -- 172.21.15.57:0/4159552076 >> v2:172.21.15.132:3300/0 conn(0x7f797c15d7f0 msgr2=0x7f797c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 --2- 172.21.15.57:0/4159552076 >> v2:172.21.15.132:3300/0 conn(0x7f797c15d7f0 0x7f797c0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 -- 172.21.15.57:0/4159552076 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0b0330 con 0x7f797c0d37e0 2023-11-24T08:04:00.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f798249d640 1 --2- 172.21.15.57:0/4159552076 >> v2:172.21.15.132:3300/0 conn(0x7f797c15d7f0 0x7f797c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:00.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f7981c9c640 1 --2- 172.21.15.57:0/4159552076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c0d37e0 0x7f797c0b10f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f797c08ce00 tx=0x7f796c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1edd91704db3f88 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:00.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.464+0000 7f798149b640 1 -- 172.21.15.57:0/4159552076 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0ab600 con 0x7f797c0d37e0 2023-11-24T08:04:00.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f798149b640 1 -- 172.21.15.57:0/4159552076 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0a7050 con 0x7f797c0d37e0 2023-11-24T08:04:00.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f798149b640 1 -- 172.21.15.57:0/4159552076 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0ab980 con 0x7f797c0d37e0 2023-11-24T08:04:00.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- 172.21.15.57:0/4159552076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c0d37e0 msgr2=0x7f797c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 --2- 172.21.15.57:0/4159552076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c0d37e0 0x7f797c0b10f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f797c08ce00 tx=0x7f796c01c500 comp rx=0 tx=0).stop 2023-11-24T08:04:00.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- 172.21.15.57:0/4159552076 shutdown_connections 2023-11-24T08:04:00.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 --2- 172.21.15.57:0/4159552076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0b1630 0x7f797c0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 --2- 172.21.15.57:0/4159552076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c0d37e0 0x7f797c0b10f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 --2- 172.21.15.57:0/4159552076 >> v2:172.21.15.132:3300/0 conn(0x7f797c15d7f0 0x7f797c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- 172.21.15.57:0/4159552076 >> 172.21.15.57:0/4159552076 conn(0x7f797c09c790 msgr2=0x7f797c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:00.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- 172.21.15.57:0/4159552076 shutdown_connections 2023-11-24T08:04:00.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- 172.21.15.57:0/4159552076 wait complete. 2023-11-24T08:04:00.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 Processor -- start 2023-11-24T08:04:00.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- start start 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f797c0b1630 0x7f797c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0d37e0 0x7f797c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c15d7f0 0x7f797c1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0b5d00 con 0x7f797c15d7f0 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0cb6a0 con 0x7f797c0b1630 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7984701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0cbb30 con 0x7f797c0d37e0 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f798249d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f797c0b1630 0x7f797c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7981c9c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0d37e0 0x7f797c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f798249d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f797c0b1630 0x7f797c14d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44588/0 (socket says 172.21.15.57:44588) 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f798249d640 1 -- 172.21.15.57:0/2660559389 learned_addr learned my addr 172.21.15.57:0/2660559389 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.468+0000 7f7982c9e640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c15d7f0 0x7f797c1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f798249d640 1 -- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0d37e0 msgr2=0x7f797c153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f798249d640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0d37e0 0x7f797c153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f798249d640 1 -- 172.21.15.57:0/2660559389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c15d7f0 msgr2=0x7f797c1544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f798249d640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c15d7f0 0x7f797c1544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f798249d640 1 -- 172.21.15.57:0/2660559389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0094d0 con 0x7f797c0b1630 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7981c9c640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0d37e0 0x7f797c153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:00.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f798249d640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f797c0b1630 0x7f797c14d590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f797800d800 tx=0x7f797800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7972ffd640 1 -- 172.21.15.57:0/2660559389 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800b6c0 con 0x7f797c0b1630 2023-11-24T08:04:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7972ffd640 1 -- 172.21.15.57:0/2660559389 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797800b820 con 0x7f797c0b1630 2023-11-24T08:04:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7972ffd640 1 -- 172.21.15.57:0/2660559389 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800bbd0 con 0x7f797c0b1630 2023-11-24T08:04:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c0caa90 con 0x7f797c0b1630 2023-11-24T08:04:00.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c0cb050 con 0x7f797c0b1630 2023-11-24T08:04:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c04e8c0 con 0x7f797c0b1630 2023-11-24T08:04:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7972ffd640 1 -- 172.21.15.57:0/2660559389 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f797800bd30 con 0x7f797c0b1630 2023-11-24T08:04:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.472+0000 7f7972ffd640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f79600664a0 0x7f7960068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:00.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.476+0000 7f7972ffd640 1 -- 172.21.15.57:0/2660559389 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7978084f90 con 0x7f797c0b1630 2023-11-24T08:04:00.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.476+0000 7f7981c9c640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f79600664a0 0x7f7960068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:00.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.476+0000 7f7981c9c640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f79600664a0 0x7f7960068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ad000 tx=0x7f796c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:00.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.480+0000 7f7972ffd640 1 -- 172.21.15.57:0/2660559389 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79780524a0 con 0x7f797c0b1630 2023-11-24T08:04:00.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:00.676+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f797c0ccfe0 con 0x7f797c0b1630 2023-11-24T08:04:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7972ffd640 1 -- 172.21.15.57:0/2660559389 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7978055ac0 con 0x7f797c0b1630 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f79600664a0 msgr2=0x7f7960068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f79600664a0 0x7f7960068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ad000 tx=0x7f796c008040 comp rx=0 tx=0).stop 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f797c0b1630 msgr2=0x7f797c14d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f797c0b1630 0x7f797c14d590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f797800d800 tx=0x7f797800dcc0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 shutdown_connections 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f79600664a0 0x7f7960068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f797c15d7f0 0x7f797c1544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f797c0d37e0 0x7f797c153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 --2- 172.21.15.57:0/2660559389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f797c0b1630 0x7f797c14d590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 >> 172.21.15.57:0/2660559389 conn(0x7f797c09c790 msgr2=0x7f797c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:01.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 shutdown_connections 2023-11-24T08:04:01.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.608+0000 7f7984701640 1 -- 172.21.15.57:0/2660559389 wait complete. 2023-11-24T08:04:01.636 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:04:01.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:04:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f582b068640 1 Processor -- start 2023-11-24T08:04:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f582b068640 1 -- start start 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f582b068640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f582415a290 0x7f58240707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f582b068640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f58240b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f582b068640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5824071170 con 0x7f582415ec60 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f582b068640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58240cb690 con 0x7f582415a290 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f582b068640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58240cb970 con 0x7f58240b1f80 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5823fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f582415ec60 0x7f58240cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51120/0 (socket says 172.21.15.57:51120) 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5823fff640 1 -- 172.21.15.57:0/3869528790 learned_addr learned my addr 172.21.15.57:0/3869528790 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5828e04640 1 --2- 172.21.15.57:0/3869528790 >> v2:172.21.15.57:3300/0 conn(0x7f582415a290 0x7f58240707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5829605640 1 --2- 172.21.15.57:0/3869528790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f58240b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5828e04640 1 -- 172.21.15.57:0/3869528790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 msgr2=0x7f58240b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5828e04640 1 --2- 172.21.15.57:0/3869528790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f58240b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5828e04640 1 -- 172.21.15.57:0/3869528790 >> v1:172.21.15.57:6789/0 conn(0x7f582415ec60 legacy=0x7f58240cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f58237fe640 1 -- 172.21.15.57:0/3869528790 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126865135 0 0) 0x7f5824071170 con 0x7f582415ec60 2023-11-24T08:04:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.784+0000 7f5828e04640 1 -- 172.21.15.57:0/3869528790 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240cbc50 con 0x7f582415a290 2023-11-24T08:04:01.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f5828e04640 1 --2- 172.21.15.57:0/3869528790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415a290 0x7f58240707f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58180097c0 tx=0x7f581801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca173ede501bf99 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:01.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f58237fe640 1 -- 172.21.15.57:0/3869528790 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180ab600 con 0x7f582415a290 2023-11-24T08:04:01.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f58237fe640 1 -- 172.21.15.57:0/3869528790 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58180a7050 con 0x7f582415a290 2023-11-24T08:04:01.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f58237fe640 1 -- 172.21.15.57:0/3869528790 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180ab980 con 0x7f582415a290 2023-11-24T08:04:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 -- 172.21.15.57:0/3869528790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415a290 msgr2=0x7f58240707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 --2- 172.21.15.57:0/3869528790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415a290 0x7f58240707f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58180097c0 tx=0x7f581801c3f0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 -- 172.21.15.57:0/3869528790 shutdown_connections 2023-11-24T08:04:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 --2- 172.21.15.57:0/3869528790 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f58240b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 --2- 172.21.15.57:0/3869528790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415a290 0x7f58240707f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 -- 172.21.15.57:0/3869528790 >> 172.21.15.57:0/3869528790 conn(0x7f58240b0c80 msgr2=0x7f58240b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 -- 172.21.15.57:0/3869528790 shutdown_connections 2023-11-24T08:04:01.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 -- 172.21.15.57:0/3869528790 wait complete. 2023-11-24T08:04:01.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 Processor -- start 2023-11-24T08:04:01.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.788+0000 7f582b068640 1 -- start start 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f5824149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f582415a290 0x7f58241f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415ec60 0x7f582414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58240ac4e0 con 0x7f582415ec60 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58241f83c0 con 0x7f582415a290 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58241f86a0 con 0x7f58240b1f80 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415ec60 0x7f582414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5828e04640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f5824149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5828e04640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f5824149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:39340/0 (socket says 172.21.15.57:39340) 2023-11-24T08:04:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415ec60 0x7f582414ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42654/0 (socket says 172.21.15.57:42654) 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5828e04640 1 -- 172.21.15.57:0/93723066 learned_addr learned my addr 172.21.15.57:0/93723066 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5823fff640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f582415a290 0x7f58241f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 -- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 msgr2=0x7f5824149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f5824149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 -- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f582415a290 msgr2=0x7f58241f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f582415a290 0x7f58241f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 -- 172.21.15.57:0/93723066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818009420 con 0x7f582415ec60 2023-11-24T08:04:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f5829605640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415ec60 0x7f582414ead0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f581c00efc0 tx=0x7f581c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f58217fa640 1 -- 172.21.15.57:0/93723066 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c009c00 con 0x7f582415ec60 2023-11-24T08:04:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f58217fa640 1 -- 172.21.15.57:0/93723066 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c00f040 con 0x7f582415ec60 2023-11-24T08:04:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f58217fa640 1 -- 172.21.15.57:0/93723066 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0146c0 con 0x7f582415ec60 2023-11-24T08:04:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5824070f40 con 0x7f582415ec60 2023-11-24T08:04:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5824149960 con 0x7f582415ec60 2023-11-24T08:04:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.792+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58240abf60 con 0x7f582415ec60 2023-11-24T08:04:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.796+0000 7f58217fa640 1 -- 172.21.15.57:0/93723066 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f581c014820 con 0x7f582415ec60 2023-11-24T08:04:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.796+0000 7f58217fa640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5808066470 0x7f5808068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.796+0000 7f58217fa640 1 -- 172.21.15.57:0/93723066 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f581c084b10 con 0x7f582415ec60 2023-11-24T08:04:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.796+0000 7f5828e04640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5808066470 0x7f5808068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:01.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.796+0000 7f5828e04640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5808066470 0x7f5808068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f581801aaa0 tx=0x7f58180a4f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:01.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.800+0000 7f58217fa640 1 -- 172.21.15.57:0/93723066 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58240abf60 con 0x7f582415ec60 2023-11-24T08:04:01.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:01.992+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58240ac620 con 0x7f582415ec60 2023-11-24T08:04:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.604+0000 7f58217fa640 1 -- 172.21.15.57:0/93723066 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58240ac620 con 0x7f582415ec60 2023-11-24T08:04:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5808066470 msgr2=0x7f5808068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5808066470 0x7f5808068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f581801aaa0 tx=0x7f58180a4f90 comp rx=0 tx=0).stop 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415ec60 msgr2=0x7f582414ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415ec60 0x7f582414ead0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f581c00efc0 tx=0x7f581c00c490 comp rx=0 tx=0).stop 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 shutdown_connections 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5808066470 0x7f5808068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f582415ec60 0x7f582414ead0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f582415a290 0x7f58241f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 --2- 172.21.15.57:0/93723066 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58240b1f80 0x7f5824149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 >> 172.21.15.57:0/93723066 conn(0x7f58240b0c80 msgr2=0x7f58240b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 shutdown_connections 2023-11-24T08:04:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.608+0000 7f582b068640 1 -- 172.21.15.57:0/93723066 wait complete. 2023-11-24T08:04:02.636 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:04:02.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:02.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02dae59640 1 Processor -- start 2023-11-24T08:04:02.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02dae59640 1 -- start start 2023-11-24T08:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02dae59640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02d40d3e80 0x7f02d40ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02dae59640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d40d21c0 con 0x7f02d40cfc10 2023-11-24T08:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02dae59640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d40cdcd0 con 0x7f02d415d500 2023-11-24T08:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02dae59640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d40d1ef0 con 0x7f02d40d3e80 2023-11-24T08:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02d9656640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02d40d3e80 0x7f02d40ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02da658640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f02d40cfc10 0x7f02d40c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51122/0 (socket says 172.21.15.57:51122) 2023-11-24T08:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02da658640 1 -- 172.21.15.57:0/3488616728 learned_addr learned my addr 172.21.15.57:0/3488616728 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:02.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02d9656640 1 -- 172.21.15.57:0/3488616728 >> v1:172.21.15.132:6789/0 conn(0x7f02d415d500 legacy=0x7f02d40d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02d9656640 1 -- 172.21.15.57:0/3488616728 >> v1:172.21.15.57:6789/0 conn(0x7f02d40cfc10 legacy=0x7f02d40c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.780+0000 7f02d9656640 1 -- 172.21.15.57:0/3488616728 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d40cdf70 con 0x7f02d40d3e80 2023-11-24T08:04:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02d9656640 1 --2- 172.21.15.57:0/3488616728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d40d3e80 0x7f02d40ced30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097c0 tx=0x7f02c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b80e76d69e2d0d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02d8e55640 1 -- 172.21.15.57:0/3488616728 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40ab650 con 0x7f02d40d3e80 2023-11-24T08:04:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02d8e55640 1 -- 172.21.15.57:0/3488616728 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40ab7b0 con 0x7f02d40d3e80 2023-11-24T08:04:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02d8e55640 1 -- 172.21.15.57:0/3488616728 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40abb40 con 0x7f02d40d3e80 2023-11-24T08:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02dae59640 1 -- 172.21.15.57:0/3488616728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d40d3e80 msgr2=0x7f02d40ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02dae59640 1 --2- 172.21.15.57:0/3488616728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d40d3e80 0x7f02d40ced30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097c0 tx=0x7f02c401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02dae59640 1 -- 172.21.15.57:0/3488616728 shutdown_connections 2023-11-24T08:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02dae59640 1 --2- 172.21.15.57:0/3488616728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d40d3e80 0x7f02d40ced30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02dae59640 1 -- 172.21.15.57:0/3488616728 >> 172.21.15.57:0/3488616728 conn(0x7f02d409c540 msgr2=0x7f02d40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02dae59640 1 -- 172.21.15.57:0/3488616728 shutdown_connections 2023-11-24T08:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.784+0000 7f02dae59640 1 -- 172.21.15.57:0/3488616728 wait complete. 2023-11-24T08:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 Processor -- start 2023-11-24T08:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 -- start start 2023-11-24T08:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02d40cfc10 0x7f02d40ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02d40d3e80 0x7f02d41604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d415d500 0x7f02d41572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d40cd010 con 0x7f02d415d500 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d40cc640 con 0x7f02d40cfc10 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d41609f0 con 0x7f02d40d3e80 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d415d500 0x7f02d41572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d415d500 0x7f02d41572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42684/0 (socket says 172.21.15.57:42684) 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 -- 172.21.15.57:0/947776365 learned_addr learned my addr 172.21.15.57:0/947776365 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02d9e57640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02d40cfc10 0x7f02d40ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02d9656640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02d40d3e80 0x7f02d41604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 -- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02d40d3e80 msgr2=0x7f02d41604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02d40d3e80 0x7f02d41604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 -- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02d40cfc10 msgr2=0x7f02d40ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02d40cfc10 0x7f02d40ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 -- 172.21.15.57:0/947776365 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4009420 con 0x7f02d415d500 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02da658640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d415d500 0x7f02d41572b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00ca70 tx=0x7f02cc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02ca7fc640 1 -- 172.21.15.57:0/947776365 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00abd0 con 0x7f02d415d500 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02ca7fc640 1 -- 172.21.15.57:0/947776365 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00ad30 con 0x7f02d415d500 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02ca7fc640 1 -- 172.21.15.57:0/947776365 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00aea0 con 0x7f02d415d500 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d40d05b0 con 0x7f02d415d500 2023-11-24T08:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d40cbd10 con 0x7f02d415d500 2023-11-24T08:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.788+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d40cc7d0 con 0x7f02d415d500 2023-11-24T08:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.796+0000 7f02ca7fc640 1 -- 172.21.15.57:0/947776365 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02cc007070 con 0x7f02d415d500 2023-11-24T08:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.796+0000 7f02ca7fc640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f02b80664a0 0x7f02b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.796+0000 7f02ca7fc640 1 -- 172.21.15.57:0/947776365 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02cc083be0 con 0x7f02d415d500 2023-11-24T08:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.796+0000 7f02d9e57640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f02b80664a0 0x7f02b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.796+0000 7f02d9e57640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f02b80664a0 0x7f02b8068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02d40ceba0 tx=0x7f02d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.796+0000 7f02ca7fc640 1 -- 172.21.15.57:0/947776365 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02cc051100 con 0x7f02d415d500 2023-11-24T08:04:02.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.984+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02d404e850 con 0x7f02d415d500 2023-11-24T08:04:02.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.984+0000 7f02ca7fc640 1 -- 172.21.15.57:0/947776365 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f02cc017090 con 0x7f02d415d500 2023-11-24T08:04:02.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:02.991 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:02.991 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f02b80664a0 msgr2=0x7f02b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f02b80664a0 0x7f02b8068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02d40ceba0 tx=0x7f02d0009040 comp rx=0 tx=0).stop 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d415d500 msgr2=0x7f02d41572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d415d500 0x7f02d41572b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00ca70 tx=0x7f02cc00cf30 comp rx=0 tx=0).stop 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 shutdown_connections 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f02b80664a0 0x7f02b8068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02d415d500 0x7f02d41572b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02d40d3e80 0x7f02d41604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 --2- 172.21.15.57:0/947776365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02d40cfc10 0x7f02d40ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 >> 172.21.15.57:0/947776365 conn(0x7f02d409c540 msgr2=0x7f02d40c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:02.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 shutdown_connections 2023-11-24T08:04:02.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:02.988+0000 7f02dae59640 1 -- 172.21.15.57:0/947776365 wait complete. 2023-11-24T08:04:03.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:03.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f54321a1640 1 Processor -- start 2023-11-24T08:04:03.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f54321a1640 1 -- start start 2023-11-24T08:04:03.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f54321a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f542c15d720 0x7f542c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f54321a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0d3a50 0x7f542c0cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f54321a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c06d050 con 0x7f542c0b25c0 2023-11-24T08:04:03.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f54321a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c0d2240 con 0x7f542c15d720 2023-11-24T08:04:03.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f54321a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c06d4e0 con 0x7f542c0d3a50 2023-11-24T08:04:03.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f542c15d720 0x7f542c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0d3a50 0x7f542c0cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f542c0b25c0 0x7f542c0d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:51590/0 (socket says 172.21.15.57:51590) 2023-11-24T08:04:03.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f542c15d720 0x7f542c0d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44626/0 (socket says 172.21.15.57:44626) 2023-11-24T08:04:03.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542affd640 1 -- 172.21.15.57:0/317899256 learned_addr learned my addr 172.21.15.57:0/317899256 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:03.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542b7fe640 1 -- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0d3a50 msgr2=0x7f542c0cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:03.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542b7fe640 1 --2- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0d3a50 0x7f542c0cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542b7fe640 1 -- 172.21.15.57:0/317899256 >> v1:172.21.15.132:6789/0 conn(0x7f542c0b25c0 legacy=0x7f542c0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542a7fc640 1 -- 172.21.15.57:0/317899256 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410523845 0 0) 0x7f542c06d050 con 0x7f542c0b25c0 2023-11-24T08:04:03.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542b7fe640 1 -- 172.21.15.57:0/317899256 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c06c720 con 0x7f542c15d720 2023-11-24T08:04:03.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.156+0000 7f542bfff640 1 --2- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0d3a50 0x7f542c0cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:03.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f542b7fe640 1 --2- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c15d720 0x7f542c0d1a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f541c009820 tx=0x7f541c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d6b95bd2ef115a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f542a7fc640 1 -- 172.21.15.57:0/317899256 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0a7070 con 0x7f542c15d720 2023-11-24T08:04:03.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f542a7fc640 1 -- 172.21.15.57:0/317899256 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c0ab430 con 0x7f542c15d720 2023-11-24T08:04:03.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f542a7fc640 1 -- 172.21.15.57:0/317899256 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0ab7c0 con 0x7f542c15d720 2023-11-24T08:04:03.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 -- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c15d720 msgr2=0x7f542c0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 --2- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c15d720 0x7f542c0d1a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f541c009820 tx=0x7f541c01c430 comp rx=0 tx=0).stop 2023-11-24T08:04:03.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 -- 172.21.15.57:0/317899256 shutdown_connections 2023-11-24T08:04:03.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 --2- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0d3a50 0x7f542c0cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 --2- 172.21.15.57:0/317899256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c15d720 0x7f542c0d1a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 -- 172.21.15.57:0/317899256 >> 172.21.15.57:0/317899256 conn(0x7f542c08af70 msgr2=0x7f542c09c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:03.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 -- 172.21.15.57:0/317899256 shutdown_connections 2023-11-24T08:04:03.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.160+0000 7f54321a1640 1 -- 172.21.15.57:0/317899256 wait complete. 2023-11-24T08:04:03.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 Processor -- start 2023-11-24T08:04:03.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 -- start start 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0b25c0 0x7f542c0c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0d3a50 0x7f542c0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f542c15d720 0x7f542c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c157be0 con 0x7f542c15d720 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c15c870 con 0x7f542c0d3a50 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c157560 con 0x7f542c0b25c0 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f542c15d720 0x7f542c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f542c15d720 0x7f542c15ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42694/0 (socket says 172.21.15.57:42694) 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 -- 172.21.15.57:0/476332101 learned_addr learned my addr 172.21.15.57:0/476332101 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542b7fe640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0b25c0 0x7f542c0c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542affd640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0d3a50 0x7f542c0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 -- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0b25c0 msgr2=0x7f542c0c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0b25c0 0x7f542c0c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 -- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0d3a50 msgr2=0x7f542c0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0d3a50 0x7f542c0ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 -- 172.21.15.57:0/476332101 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5424009a70 con 0x7f542c15d720 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542affd640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0d3a50 0x7f542c0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f542bfff640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f542c15d720 0x7f542c15ba20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5424009da0 tx=0x7f542400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f5413fff640 1 -- 172.21.15.57:0/476332101 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240039a0 con 0x7f542c15d720 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f5413fff640 1 -- 172.21.15.57:0/476332101 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542400f040 con 0x7f542c15d720 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c009420 con 0x7f542c15d720 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.164+0000 7f5413fff640 1 -- 172.21.15.57:0/476332101 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424003d40 con 0x7f542c15d720 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.168+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c15c590 con 0x7f542c15d720 2023-11-24T08:04:03.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.168+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c1573c0 con 0x7f542c15d720 2023-11-24T08:04:03.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.168+0000 7f5413fff640 1 -- 172.21.15.57:0/476332101 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5424004030 con 0x7f542c15d720 2023-11-24T08:04:03.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.168+0000 7f5413fff640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f54180664a0 0x7f5418068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.168+0000 7f5413fff640 1 -- 172.21.15.57:0/476332101 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5424084ce0 con 0x7f542c15d720 2023-11-24T08:04:03.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.168+0000 7f542b7fe640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f54180664a0 0x7f5418068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.172+0000 7f542b7fe640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f54180664a0 0x7f5418068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f541c0af000 tx=0x7f541c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.172+0000 7f5413fff640 1 -- 172.21.15.57:0/476332101 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f542c1573c0 con 0x7f542c15d720 2023-11-24T08:04:03.195 INFO:tasks.ceph.mds.c.smithi057.stderr:2023-11-24T08:04:03.196+0000 7f8f617d6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:04:03.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.332+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f542c1573c0 con 0x7f542c15d720 2023-11-24T08:04:03.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.332+0000 7f5413fff640 1 -- 172.21.15.57:0/476332101 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f542c1573c0 con 0x7f542c15d720 2023-11-24T08:04:03.334 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:03.334 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:03.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f54180664a0 msgr2=0x7f5418068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f54180664a0 0x7f5418068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f541c0af000 tx=0x7f541c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f542c15d720 msgr2=0x7f542c15ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f542c15d720 0x7f542c15ba20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5424009da0 tx=0x7f542400c490 comp rx=0 tx=0).stop 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 shutdown_connections 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f54180664a0 0x7f5418068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f542c15d720 0x7f542c15ba20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0d3a50 0x7f542c0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 --2- 172.21.15.57:0/476332101 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f542c0b25c0 0x7f542c0c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 >> 172.21.15.57:0/476332101 conn(0x7f542c08af70 msgr2=0x7f542c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 shutdown_connections 2023-11-24T08:04:03.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.336+0000 7f54321a1640 1 -- 172.21.15.57:0/476332101 wait complete. 2023-11-24T08:04:03.357 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:04:03.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:03.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1cd1c640 1 Processor -- start 2023-11-24T08:04:03.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1cd1c640 1 -- start start 2023-11-24T08:04:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1cd1c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a180b36c0 0x7f4a180b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1cd1c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4a18070da0 0x7f4a180711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1cd1c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1815a700 con 0x7f4a1815a320 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1cd1c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a180b2430 con 0x7f4a18070da0 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1cd1c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a180b2620 con 0x7f4a180b36c0 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a16d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4a18070da0 0x7f4a180711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1659c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4a1815a320 0x7f4a18070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51124/0 (socket says 172.21.15.57:51124) 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.500+0000 7f4a1659c640 1 -- 172.21.15.57:0/617820097 learned_addr learned my addr 172.21.15.57:0/617820097 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a15d9b640 1 --2- 172.21.15.57:0/617820097 >> v2:172.21.15.132:3300/0 conn(0x7f4a180b36c0 0x7f4a180b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a16d9d640 1 -- 172.21.15.57:0/617820097 >> v2:172.21.15.132:3300/0 conn(0x7f4a180b36c0 msgr2=0x7f4a180b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a16d9d640 1 --2- 172.21.15.57:0/617820097 >> v2:172.21.15.132:3300/0 conn(0x7f4a180b36c0 0x7f4a180b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a16d9d640 1 -- 172.21.15.57:0/617820097 >> v1:172.21.15.57:6789/0 conn(0x7f4a1815a320 legacy=0x7f4a18070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a16d9d640 1 -- 172.21.15.57:0/617820097 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a180b2900 con 0x7f4a18070da0 2023-11-24T08:04:03.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a16d9d640 1 --2- 172.21.15.57:0/617820097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a18070da0 0x7f4a180711f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4a1806c180 tx=0x7f4a1001eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4dafbb0d6282ef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a1559a640 1 -- 172.21.15.57:0/617820097 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100a7ac0 con 0x7f4a18070da0 2023-11-24T08:04:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a1559a640 1 -- 172.21.15.57:0/617820097 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100a7c20 con 0x7f4a18070da0 2023-11-24T08:04:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a1559a640 1 -- 172.21.15.57:0/617820097 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100af440 con 0x7f4a18070da0 2023-11-24T08:04:03.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/617820097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a18070da0 msgr2=0x7f4a180711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.504+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/617820097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a18070da0 0x7f4a180711f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4a1806c180 tx=0x7f4a1001eaf0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/617820097 shutdown_connections 2023-11-24T08:04:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/617820097 >> v2:172.21.15.132:3300/0 conn(0x7f4a180b36c0 0x7f4a180b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/617820097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a18070da0 0x7f4a180711f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/617820097 >> 172.21.15.57:0/617820097 conn(0x7f4a180b0bf0 msgr2=0x7f4a180b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/617820097 shutdown_connections 2023-11-24T08:04:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/617820097 wait complete. 2023-11-24T08:04:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 Processor -- start 2023-11-24T08:04:03.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- start start 2023-11-24T08:04:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18070da0 0x7f4a18155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180b36c0 0x7f4a18151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a1815a320 0x7f4a1814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1809c850 con 0x7f4a1815a320 2023-11-24T08:04:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1809b3d0 con 0x7f4a180b36c0 2023-11-24T08:04:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1cd1c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1814bc00 con 0x7f4a18070da0 2023-11-24T08:04:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a1815a320 0x7f4a1814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a1815a320 0x7f4a1814c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42716/0 (socket says 172.21.15.57:42716) 2023-11-24T08:04:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 -- 172.21.15.57:0/936235889 learned_addr learned my addr 172.21.15.57:0/936235889 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a15d9b640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180b36c0 0x7f4a18151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1659c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18070da0 0x7f4a18155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 -- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18070da0 msgr2=0x7f4a18155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18070da0 0x7f4a18155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 -- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180b36c0 msgr2=0x7f4a18151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180b36c0 0x7f4a18151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 -- 172.21.15.57:0/936235889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009a70 con 0x7f4a1815a320 2023-11-24T08:04:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a1659c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18070da0 0x7f4a18155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.508+0000 7f4a16d9d640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a1815a320 0x7f4a1814c4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a1001b700 tx=0x7f4a1001b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a06ffd640 1 -- 172.21.15.57:0/936235889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100afe20 con 0x7f4a1815a320 2023-11-24T08:04:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a06ffd640 1 -- 172.21.15.57:0/936235889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10009450 con 0x7f4a1815a320 2023-11-24T08:04:03.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a06ffd640 1 -- 172.21.15.57:0/936235889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100bb690 con 0x7f4a1815a320 2023-11-24T08:04:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a181506e0 con 0x7f4a1815a320 2023-11-24T08:04:03.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a18150400 con 0x7f4a1815a320 2023-11-24T08:04:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1809b540 con 0x7f4a1815a320 2023-11-24T08:04:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a06ffd640 1 -- 172.21.15.57:0/936235889 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a100bb7f0 con 0x7f4a1815a320 2023-11-24T08:04:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a06ffd640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f49f8066470 0x7f49f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a06ffd640 1 -- 172.21.15.57:0/936235889 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a10121780 con 0x7f4a1815a320 2023-11-24T08:04:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.512+0000 7f4a1659c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f49f8066470 0x7f49f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.516+0000 7f4a1659c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f49f8066470 0x7f49f8068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a08007fd0 tx=0x7f4a08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.516+0000 7f4a06ffd640 1 -- 172.21.15.57:0/936235889 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a100eeb60 con 0x7f4a1815a320 2023-11-24T08:04:03.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.676+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a180adcc0 con 0x7f49f8066470 2023-11-24T08:04:03.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.684+0000 7f4a06ffd640 1 -- 172.21.15.57:0/936235889 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264634 (secure 0 0 0) 0x7f4a180adcc0 con 0x7f49f8066470 2023-11-24T08:04:03.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:03.691 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:04:03.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f49f8066470 msgr2=0x7f49f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f49f8066470 0x7f49f8068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a08007fd0 tx=0x7f4a08009040 comp rx=0 tx=0).stop 2023-11-24T08:04:03.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a1815a320 msgr2=0x7f4a1814c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a1815a320 0x7f4a1814c4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a1001b700 tx=0x7f4a1001b890 comp rx=0 tx=0).stop 2023-11-24T08:04:03.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 shutdown_connections 2023-11-24T08:04:03.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f49f8066470 0x7f49f8068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a1815a320 0x7f4a1814c4d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a180b36c0 0x7f4a18151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 --2- 172.21.15.57:0/936235889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a18070da0 0x7f4a18155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 >> 172.21.15.57:0/936235889 conn(0x7f4a180b0bf0 msgr2=0x7f4a180b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:03.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 shutdown_connections 2023-11-24T08:04:03.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.688+0000 7f4a1cd1c640 1 -- 172.21.15.57:0/936235889 wait complete. 2023-11-24T08:04:03.710 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-24T08:04:02.679993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223260,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751460,"statfs":{"total":773094113280,"available":772865495040,"internally_reserved":0,"allocated":2998272,"data_stored":1775127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.122454"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604677+0000","last_change":"2023-11-24T08:03:59.599040+0000","last_active":"2023-11-24T08:03:59.604677+0000","last_peered":"2023-11-24T08:03:59.604677+0000","last_clean":"2023-11-24T08:03:59.604677+0000","last_became_active":"2023-11-24T08:03:59.598731+0000","last_became_peered":"2023-11-24T08:03:59.598731+0000","last_unstale":"2023-11-24T08:03:59.604677+0000","last_undegraded":"2023-11-24T08:03:59.604677+0000","last_fullsized":"2023-11-24T08:03:59.604677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.595462+0000","last_change":"2023-11-24T08:03:59.587668+0000","last_active":"2023-11-24T08:03:59.595462+0000","last_peered":"2023-11-24T08:03:59.595462+0000","last_clean":"2023-11-24T08:03:59.595462+0000","last_became_active":"2023-11-24T08:03:59.585499+0000","last_became_peered":"2023-11-24T08:03:59.585499+0000","last_unstale":"2023-11-24T08:03:59.595462+0000","last_undegraded":"2023-11-24T08:03:59.595462+0000","last_fullsized":"2023-11-24T08:03:59.595462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605188+0000","last_change":"2023-11-24T08:03:59.595671+0000","last_active":"2023-11-24T08:03:59.605188+0000","last_peered":"2023-11-24T08:03:59.605188+0000","last_clean":"2023-11-24T08:03:59.605188+0000","last_became_active":"2023-11-24T08:03:59.595451+0000","last_became_peered":"2023-11-24T08:03:59.595451+0000","last_unstale":"2023-11-24T08:03:59.605188+0000","last_undegraded":"2023-11-24T08:03:59.605188+0000","last_fullsized":"2023-11-24T08:03:59.605188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:26.300456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590692+0000","last_change":"2023-11-24T08:03:59.585093+0000","last_active":"2023-11-24T08:03:59.590692+0000","last_peered":"2023-11-24T08:03:59.590692+0000","last_clean":"2023-11-24T08:03:59.590692+0000","last_became_active":"2023-11-24T08:03:59.584715+0000","last_became_peered":"2023-11-24T08:03:59.584715+0000","last_unstale":"2023-11-24T08:03:59.590692+0000","last_undegraded":"2023-11-24T08:03:59.590692+0000","last_fullsized":"2023-11-24T08:03:59.590692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:41.590643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600223+0000","last_change":"2023-11-24T08:03:59.594763+0000","last_active":"2023-11-24T08:03:59.600223+0000","last_peered":"2023-11-24T08:03:59.600223+0000","last_clean":"2023-11-24T08:03:59.600223+0000","last_became_active":"2023-11-24T08:03:59.594479+0000","last_became_peered":"2023-11-24T08:03:59.594479+0000","last_unstale":"2023-11-24T08:03:59.600223+0000","last_undegraded":"2023-11-24T08:03:59.600223+0000","last_fullsized":"2023-11-24T08:03:59.600223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596021+0000","last_change":"2023-11-24T08:03:59.586577+0000","last_active":"2023-11-24T08:03:59.596021+0000","last_peered":"2023-11-24T08:03:59.596021+0000","last_clean":"2023-11-24T08:03:59.596021+0000","last_became_active":"2023-11-24T08:03:59.586189+0000","last_became_peered":"2023-11-24T08:03:59.586189+0000","last_unstale":"2023-11-24T08:03:59.596021+0000","last_undegraded":"2023-11-24T08:03:59.596021+0000","last_fullsized":"2023-11-24T08:03:59.596021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:39.675569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600141+0000","last_change":"2023-11-24T08:03:59.596712+0000","last_active":"2023-11-24T08:03:59.600141+0000","last_peered":"2023-11-24T08:03:59.600141+0000","last_clean":"2023-11-24T08:03:59.600141+0000","last_became_active":"2023-11-24T08:03:59.596335+0000","last_became_peered":"2023-11-24T08:03:59.596335+0000","last_unstale":"2023-11-24T08:03:59.600141+0000","last_undegraded":"2023-11-24T08:03:59.600141+0000","last_fullsized":"2023-11-24T08:03:59.600141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.602043+0000","last_change":"2023-11-24T08:03:59.588712+0000","last_active":"2023-11-24T08:03:59.602043+0000","last_peered":"2023-11-24T08:03:59.602043+0000","last_clean":"2023-11-24T08:03:59.602043+0000","last_became_active":"2023-11-24T08:03:59.588015+0000","last_became_peered":"2023-11-24T08:03:59.588015+0000","last_unstale":"2023-11-24T08:03:59.602043+0000","last_undegraded":"2023-11-24T08:03:59.602043+0000","last_fullsized":"2023-11-24T08:03:59.602043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:42.010459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604701+0000","last_change":"2023-11-24T08:03:59.600086+0000","last_active":"2023-11-24T08:03:59.604701+0000","last_peered":"2023-11-24T08:03:59.604701+0000","last_clean":"2023-11-24T08:03:59.604701+0000","last_became_active":"2023-11-24T08:03:59.598793+0000","last_became_peered":"2023-11-24T08:03:59.598793+0000","last_unstale":"2023-11-24T08:03:59.604701+0000","last_undegraded":"2023-11-24T08:03:59.604701+0000","last_fullsized":"2023-11-24T08:03:59.604701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592781+0000","last_change":"2023-11-24T08:03:59.587766+0000","last_active":"2023-11-24T08:03:59.592781+0000","last_peered":"2023-11-24T08:03:59.592781+0000","last_clean":"2023-11-24T08:03:59.592781+0000","last_became_active":"2023-11-24T08:03:59.587435+0000","last_became_peered":"2023-11-24T08:03:59.587435+0000","last_unstale":"2023-11-24T08:03:59.592781+0000","last_undegraded":"2023-11-24T08:03:59.592781+0000","last_fullsized":"2023-11-24T08:03:59.592781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592936+0000","last_change":"2023-11-24T08:03:59.587777+0000","last_active":"2023-11-24T08:03:59.592936+0000","last_peered":"2023-11-24T08:03:59.592936+0000","last_clean":"2023-11-24T08:03:59.592936+0000","last_became_active":"2023-11-24T08:03:59.587442+0000","last_became_peered":"2023-11-24T08:03:59.587442+0000","last_unstale":"2023-11-24T08:03:59.592936+0000","last_undegraded":"2023-11-24T08:03:59.592936+0000","last_fullsized":"2023-11-24T08:03:59.592936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595515+0000","last_change":"2023-11-24T08:03:59.595995+0000","last_active":"2023-11-24T08:04:00.595515+0000","last_peered":"2023-11-24T08:04:00.595515+0000","last_clean":"2023-11-24T08:04:00.595515+0000","last_became_active":"2023-11-24T08:03:59.595526+0000","last_became_peered":"2023-11-24T08:03:59.595526+0000","last_unstale":"2023-11-24T08:04:00.595515+0000","last_undegraded":"2023-11-24T08:04:00.595515+0000","last_fullsized":"2023-11-24T08:04:00.595515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605339+0000","last_change":"2023-11-24T08:03:59.591371+0000","last_active":"2023-11-24T08:03:59.605339+0000","last_peered":"2023-11-24T08:03:59.605339+0000","last_clean":"2023-11-24T08:03:59.605339+0000","last_became_active":"2023-11-24T08:03:59.590300+0000","last_became_peered":"2023-11-24T08:03:59.590300+0000","last_unstale":"2023-11-24T08:03:59.605339+0000","last_undegraded":"2023-11-24T08:03:59.605339+0000","last_fullsized":"2023-11-24T08:03:59.605339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599575+0000","last_change":"2023-11-24T08:03:59.592432+0000","last_active":"2023-11-24T08:03:59.599575+0000","last_peered":"2023-11-24T08:03:59.599575+0000","last_clean":"2023-11-24T08:03:59.599575+0000","last_became_active":"2023-11-24T08:03:59.592087+0000","last_became_peered":"2023-11-24T08:03:59.592087+0000","last_unstale":"2023-11-24T08:03:59.599575+0000","last_undegraded":"2023-11-24T08:03:59.599575+0000","last_fullsized":"2023-11-24T08:03:59.599575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:54.959126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603270+0000","last_change":"2023-11-24T08:03:59.594278+0000","last_active":"2023-11-24T08:03:59.603270+0000","last_peered":"2023-11-24T08:03:59.603270+0000","last_clean":"2023-11-24T08:03:59.603270+0000","last_became_active":"2023-11-24T08:03:59.593956+0000","last_became_peered":"2023-11-24T08:03:59.593956+0000","last_unstale":"2023-11-24T08:03:59.603270+0000","last_undegraded":"2023-11-24T08:03:59.603270+0000","last_fullsized":"2023-11-24T08:03:59.603270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.584598+0000","last_change":"2023-11-24T08:03:59.573698+0000","last_active":"2023-11-24T08:03:59.584598+0000","last_peered":"2023-11-24T08:03:59.584598+0000","last_clean":"2023-11-24T08:03:59.584598+0000","last_became_active":"2023-11-24T08:03:59.573383+0000","last_became_peered":"2023-11-24T08:03:59.573383+0000","last_unstale":"2023-11-24T08:03:59.584598+0000","last_undegraded":"2023-11-24T08:03:59.584598+0000","last_fullsized":"2023-11-24T08:03:59.584598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597996+0000","last_change":"2023-11-24T08:03:59.590145+0000","last_active":"2023-11-24T08:03:59.597996+0000","last_peered":"2023-11-24T08:03:59.597996+0000","last_clean":"2023-11-24T08:03:59.597996+0000","last_became_active":"2023-11-24T08:03:59.589840+0000","last_became_peered":"2023-11-24T08:03:59.589840+0000","last_unstale":"2023-11-24T08:03:59.597996+0000","last_undegraded":"2023-11-24T08:03:59.597996+0000","last_fullsized":"2023-11-24T08:03:59.597996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598839+0000","last_change":"2023-11-24T08:03:59.590044+0000","last_active":"2023-11-24T08:04:00.598839+0000","last_peered":"2023-11-24T08:04:00.598839+0000","last_clean":"2023-11-24T08:04:00.598839+0000","last_became_active":"2023-11-24T08:03:59.589664+0000","last_became_peered":"2023-11-24T08:03:59.589664+0000","last_unstale":"2023-11-24T08:04:00.598839+0000","last_undegraded":"2023-11-24T08:04:00.598839+0000","last_fullsized":"2023-11-24T08:04:00.598839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.602431+0000","last_change":"2023-11-24T08:03:59.597467+0000","last_active":"2023-11-24T08:03:59.602431+0000","last_peered":"2023-11-24T08:03:59.602431+0000","last_clean":"2023-11-24T08:03:59.602431+0000","last_became_active":"2023-11-24T08:03:59.596875+0000","last_became_peered":"2023-11-24T08:03:59.596875+0000","last_unstale":"2023-11-24T08:03:59.602431+0000","last_undegraded":"2023-11-24T08:03:59.602431+0000","last_fullsized":"2023-11-24T08:03:59.602431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:24.485625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603758+0000","last_change":"2023-11-24T08:03:59.599402+0000","last_active":"2023-11-24T08:03:59.603758+0000","last_peered":"2023-11-24T08:03:59.603758+0000","last_clean":"2023-11-24T08:03:59.603758+0000","last_became_active":"2023-11-24T08:03:59.598995+0000","last_became_peered":"2023-11-24T08:03:59.598995+0000","last_unstale":"2023-11-24T08:03:59.603758+0000","last_undegraded":"2023-11-24T08:03:59.603758+0000","last_fullsized":"2023-11-24T08:03:59.603758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599523+0000","last_change":"2023-11-24T08:03:59.592092+0000","last_active":"2023-11-24T08:03:59.599523+0000","last_peered":"2023-11-24T08:03:59.599523+0000","last_clean":"2023-11-24T08:03:59.599523+0000","last_became_active":"2023-11-24T08:03:59.591623+0000","last_became_peered":"2023-11-24T08:03:59.591623+0000","last_unstale":"2023-11-24T08:03:59.599523+0000","last_undegraded":"2023-11-24T08:03:59.599523+0000","last_fullsized":"2023-11-24T08:03:59.599523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:56:37.898354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.598081+0000","last_change":"2023-11-24T08:03:59.591087+0000","last_active":"2023-11-24T08:03:59.598081+0000","last_peered":"2023-11-24T08:03:59.598081+0000","last_clean":"2023-11-24T08:03:59.598081+0000","last_became_active":"2023-11-24T08:03:59.590767+0000","last_became_peered":"2023-11-24T08:03:59.590767+0000","last_unstale":"2023-11-24T08:03:59.598081+0000","last_undegraded":"2023-11-24T08:03:59.598081+0000","last_fullsized":"2023-11-24T08:03:59.598081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:04.901296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605497+0000","last_change":"2023-11-24T08:03:59.595583+0000","last_active":"2023-11-24T08:03:59.605497+0000","last_peered":"2023-11-24T08:03:59.605497+0000","last_clean":"2023-11-24T08:03:59.605497+0000","last_became_active":"2023-11-24T08:03:59.595284+0000","last_became_peered":"2023-11-24T08:03:59.595284+0000","last_unstale":"2023-11-24T08:03:59.605497+0000","last_undegraded":"2023-11-24T08:03:59.605497+0000","last_fullsized":"2023-11-24T08:03:59.605497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.586834+0000","last_change":"2023-11-24T08:03:59.579548+0000","last_active":"2023-11-24T08:03:59.586834+0000","last_peered":"2023-11-24T08:03:59.586834+0000","last_clean":"2023-11-24T08:03:59.586834+0000","last_became_active":"2023-11-24T08:03:59.579263+0000","last_became_peered":"2023-11-24T08:03:59.579263+0000","last_unstale":"2023-11-24T08:03:59.586834+0000","last_undegraded":"2023-11-24T08:03:59.586834+0000","last_fullsized":"2023-11-24T08:03:59.586834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.606214+0000","last_change":"2023-11-24T08:03:59.598908+0000","last_active":"2023-11-24T08:03:59.606214+0000","last_peered":"2023-11-24T08:03:59.606214+0000","last_clean":"2023-11-24T08:03:59.606214+0000","last_became_active":"2023-11-24T08:03:59.598657+0000","last_became_peered":"2023-11-24T08:03:59.598657+0000","last_unstale":"2023-11-24T08:03:59.606214+0000","last_undegraded":"2023-11-24T08:03:59.606214+0000","last_fullsized":"2023-11-24T08:03:59.606214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603043+0000","last_change":"2023-11-24T08:03:59.598426+0000","last_active":"2023-11-24T08:03:59.603043+0000","last_peered":"2023-11-24T08:03:59.603043+0000","last_clean":"2023-11-24T08:03:59.603043+0000","last_became_active":"2023-11-24T08:03:59.598155+0000","last_became_peered":"2023-11-24T08:03:59.598155+0000","last_unstale":"2023-11-24T08:03:59.603043+0000","last_undegraded":"2023-11-24T08:03:59.603043+0000","last_fullsized":"2023-11-24T08:03:59.603043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:41.590643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596723+0000","last_change":"2023-11-24T08:03:59.588426+0000","last_active":"2023-11-24T08:03:59.596723+0000","last_peered":"2023-11-24T08:03:59.596723+0000","last_clean":"2023-11-24T08:03:59.596723+0000","last_became_active":"2023-11-24T08:03:59.588118+0000","last_became_peered":"2023-11-24T08:03:59.588118+0000","last_unstale":"2023-11-24T08:03:59.596723+0000","last_undegraded":"2023-11-24T08:03:59.596723+0000","last_fullsized":"2023-11-24T08:03:59.596723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.606244+0000","last_change":"2023-11-24T08:03:59.600156+0000","last_active":"2023-11-24T08:03:59.606244+0000","last_peered":"2023-11-24T08:03:59.606244+0000","last_clean":"2023-11-24T08:03:59.606244+0000","last_became_active":"2023-11-24T08:03:59.599912+0000","last_became_peered":"2023-11-24T08:03:59.599912+0000","last_unstale":"2023-11-24T08:03:59.606244+0000","last_undegraded":"2023-11-24T08:03:59.606244+0000","last_fullsized":"2023-11-24T08:03:59.606244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.583480+0000","last_change":"2023-11-24T08:03:59.581204+0000","last_active":"2023-11-24T08:03:59.583480+0000","last_peered":"2023-11-24T08:03:59.583480+0000","last_clean":"2023-11-24T08:03:59.583480+0000","last_became_active":"2023-11-24T08:03:59.580877+0000","last_became_peered":"2023-11-24T08:03:59.580877+0000","last_unstale":"2023-11-24T08:03:59.583480+0000","last_undegraded":"2023-11-24T08:03:59.583480+0000","last_fullsized":"2023-11-24T08:03:59.583480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:23:23.794371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590619+0000","last_change":"2023-11-24T08:03:59.579863+0000","last_active":"2023-11-24T08:03:59.590619+0000","last_peered":"2023-11-24T08:03:59.590619+0000","last_clean":"2023-11-24T08:03:59.590619+0000","last_became_active":"2023-11-24T08:03:59.579542+0000","last_became_peered":"2023-11-24T08:03:59.579542+0000","last_unstale":"2023-11-24T08:03:59.590619+0000","last_undegraded":"2023-11-24T08:03:59.590619+0000","last_fullsized":"2023-11-24T08:03:59.590619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598575+0000","last_change":"2023-11-24T08:03:59.595768+0000","last_active":"2023-11-24T08:04:00.598575+0000","last_peered":"2023-11-24T08:04:00.598575+0000","last_clean":"2023-11-24T08:04:00.598575+0000","last_became_active":"2023-11-24T08:03:59.594474+0000","last_became_peered":"2023-11-24T08:03:59.594474+0000","last_unstale":"2023-11-24T08:04:00.598575+0000","last_undegraded":"2023-11-24T08:04:00.598575+0000","last_fullsized":"2023-11-24T08:04:00.598575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592894+0000","last_change":"2023-11-24T08:03:59.584924+0000","last_active":"2023-11-24T08:03:59.592894+0000","last_peered":"2023-11-24T08:03:59.592894+0000","last_clean":"2023-11-24T08:03:59.592894+0000","last_became_active":"2023-11-24T08:03:59.584192+0000","last_became_peered":"2023-11-24T08:03:59.584192+0000","last_unstale":"2023-11-24T08:03:59.592894+0000","last_undegraded":"2023-11-24T08:03:59.592894+0000","last_fullsized":"2023-11-24T08:03:59.592894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:23.578718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595270+0000","last_change":"2023-11-24T08:03:59.594108+0000","last_active":"2023-11-24T08:04:00.595270+0000","last_peered":"2023-11-24T08:04:00.595270+0000","last_clean":"2023-11-24T08:04:00.595270+0000","last_became_active":"2023-11-24T08:03:59.593151+0000","last_became_peered":"2023-11-24T08:03:59.593151+0000","last_unstale":"2023-11-24T08:04:00.595270+0000","last_undegraded":"2023-11-24T08:04:00.595270+0000","last_fullsized":"2023-11-24T08:04:00.595270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.620623+0000","last_change":"2023-11-24T08:03:58.595372+0000","last_active":"2023-11-24T08:03:59.620623+0000","last_peered":"2023-11-24T08:03:59.620623+0000","last_clean":"2023-11-24T08:03:59.620623+0000","last_became_active":"2023-11-24T08:03:58.595011+0000","last_became_peered":"2023-11-24T08:03:58.595011+0000","last_unstale":"2023-11-24T08:03:59.620623+0000","last_undegraded":"2023-11-24T08:03:59.620623+0000","last_fullsized":"2023-11-24T08:03:59.620623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.607329+0000","last_change":"2023-11-24T08:03:59.604482+0000","last_active":"2023-11-24T08:03:59.607329+0000","last_peered":"2023-11-24T08:03:59.607329+0000","last_clean":"2023-11-24T08:03:59.607329+0000","last_became_active":"2023-11-24T08:03:59.604180+0000","last_became_peered":"2023-11-24T08:03:59.604180+0000","last_unstale":"2023-11-24T08:03:59.607329+0000","last_undegraded":"2023-11-24T08:03:59.607329+0000","last_fullsized":"2023-11-24T08:03:59.607329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:16.969108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.617113+0000","last_change":"2023-11-24T08:03:58.574383+0000","last_active":"2023-11-24T08:03:59.617113+0000","last_peered":"2023-11-24T08:03:59.617113+0000","last_clean":"2023-11-24T08:03:59.617113+0000","last_became_active":"2023-11-24T08:03:58.574059+0000","last_became_peered":"2023-11-24T08:03:58.574059+0000","last_unstale":"2023-11-24T08:03:59.617113+0000","last_undegraded":"2023-11-24T08:03:59.617113+0000","last_fullsized":"2023-11-24T08:03:59.617113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.578692+0000","last_change":"2023-11-24T08:03:58.591311+0000","last_active":"2023-11-24T08:03:59.578692+0000","last_peered":"2023-11-24T08:03:59.578692+0000","last_clean":"2023-11-24T08:03:59.578692+0000","last_became_active":"2023-11-24T08:03:58.590678+0000","last_became_peered":"2023-11-24T08:03:58.590678+0000","last_unstale":"2023-11-24T08:03:59.578692+0000","last_undegraded":"2023-11-24T08:03:59.578692+0000","last_fullsized":"2023-11-24T08:03:59.578692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596451+0000","last_change":"2023-11-24T08:03:59.584561+0000","last_active":"2023-11-24T08:03:59.596451+0000","last_peered":"2023-11-24T08:03:59.596451+0000","last_clean":"2023-11-24T08:03:59.596451+0000","last_became_active":"2023-11-24T08:03:59.584227+0000","last_became_peered":"2023-11-24T08:03:59.584227+0000","last_unstale":"2023-11-24T08:03:59.596451+0000","last_undegraded":"2023-11-24T08:03:59.596451+0000","last_fullsized":"2023-11-24T08:03:59.596451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.567598+0000","last_change":"2023-11-24T08:03:58.594517+0000","last_active":"2023-11-24T08:03:59.567598+0000","last_peered":"2023-11-24T08:03:59.567598+0000","last_clean":"2023-11-24T08:03:59.567598+0000","last_became_active":"2023-11-24T08:03:58.592799+0000","last_became_peered":"2023-11-24T08:03:58.592799+0000","last_unstale":"2023-11-24T08:03:59.567598+0000","last_undegraded":"2023-11-24T08:03:59.567598+0000","last_fullsized":"2023-11-24T08:03:59.567598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.591167+0000","last_change":"2023-11-24T08:03:59.587401+0000","last_active":"2023-11-24T08:03:59.591167+0000","last_peered":"2023-11-24T08:03:59.591167+0000","last_clean":"2023-11-24T08:03:59.591167+0000","last_became_active":"2023-11-24T08:03:59.587106+0000","last_became_peered":"2023-11-24T08:03:59.587106+0000","last_unstale":"2023-11-24T08:03:59.591167+0000","last_undegraded":"2023-11-24T08:03:59.591167+0000","last_fullsized":"2023-11-24T08:03:59.591167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.572533+0000","last_change":"2023-11-24T08:03:58.593371+0000","last_active":"2023-11-24T08:03:59.572533+0000","last_peered":"2023-11-24T08:03:59.572533+0000","last_clean":"2023-11-24T08:03:59.572533+0000","last_became_active":"2023-11-24T08:03:58.591545+0000","last_became_peered":"2023-11-24T08:03:58.591545+0000","last_unstale":"2023-11-24T08:03:59.572533+0000","last_undegraded":"2023-11-24T08:03:59.572533+0000","last_fullsized":"2023-11-24T08:03:59.572533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603059+0000","last_change":"2023-11-24T08:03:59.598485+0000","last_active":"2023-11-24T08:03:59.603059+0000","last_peered":"2023-11-24T08:03:59.603059+0000","last_clean":"2023-11-24T08:03:59.603059+0000","last_became_active":"2023-11-24T08:03:59.598252+0000","last_became_peered":"2023-11-24T08:03:59.598252+0000","last_unstale":"2023-11-24T08:03:59.603059+0000","last_undegraded":"2023-11-24T08:03:59.603059+0000","last_fullsized":"2023-11-24T08:03:59.603059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.567668+0000","last_change":"2023-11-24T08:03:58.588831+0000","last_active":"2023-11-24T08:03:59.567668+0000","last_peered":"2023-11-24T08:03:59.567668+0000","last_clean":"2023-11-24T08:03:59.567668+0000","last_became_active":"2023-11-24T08:03:58.588494+0000","last_became_peered":"2023-11-24T08:03:58.588494+0000","last_unstale":"2023-11-24T08:03:59.567668+0000","last_undegraded":"2023-11-24T08:03:59.567668+0000","last_fullsized":"2023-11-24T08:03:59.567668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:23.475033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597103+0000","last_change":"2023-11-24T08:03:59.586309+0000","last_active":"2023-11-24T08:03:59.597103+0000","last_peered":"2023-11-24T08:03:59.597103+0000","last_clean":"2023-11-24T08:03:59.597103+0000","last_became_active":"2023-11-24T08:03:59.585998+0000","last_became_peered":"2023-11-24T08:03:59.585998+0000","last_unstale":"2023-11-24T08:03:59.597103+0000","last_undegraded":"2023-11-24T08:03:59.597103+0000","last_fullsized":"2023-11-24T08:03:59.597103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:05.641493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615980+0000","last_change":"2023-11-24T08:03:58.592635+0000","last_active":"2023-11-24T08:03:59.615980+0000","last_peered":"2023-11-24T08:03:59.615980+0000","last_clean":"2023-11-24T08:03:59.615980+0000","last_became_active":"2023-11-24T08:03:58.592339+0000","last_became_peered":"2023-11-24T08:03:58.592339+0000","last_unstale":"2023-11-24T08:03:59.615980+0000","last_undegraded":"2023-11-24T08:03:59.615980+0000","last_fullsized":"2023-11-24T08:03:59.615980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595544+0000","last_change":"2023-11-24T08:03:59.600109+0000","last_active":"2023-11-24T08:04:00.595544+0000","last_peered":"2023-11-24T08:04:00.595544+0000","last_clean":"2023-11-24T08:04:00.595544+0000","last_became_active":"2023-11-24T08:03:59.599837+0000","last_became_peered":"2023-11-24T08:03:59.599837+0000","last_unstale":"2023-11-24T08:04:00.595544+0000","last_undegraded":"2023-11-24T08:04:00.595544+0000","last_fullsized":"2023-11-24T08:04:00.595544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.621912+0000","last_change":"2023-11-24T08:03:58.586653+0000","last_active":"2023-11-24T08:03:59.621912+0000","last_peered":"2023-11-24T08:03:59.621912+0000","last_clean":"2023-11-24T08:03:59.621912+0000","last_became_active":"2023-11-24T08:03:58.586327+0000","last_became_peered":"2023-11-24T08:03:58.586327+0000","last_unstale":"2023-11-24T08:03:59.621912+0000","last_undegraded":"2023-11-24T08:03:59.621912+0000","last_fullsized":"2023-11-24T08:03:59.621912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604423+0000","last_change":"2023-11-24T08:03:59.597689+0000","last_active":"2023-11-24T08:03:59.604423+0000","last_peered":"2023-11-24T08:03:59.604423+0000","last_clean":"2023-11-24T08:03:59.604423+0000","last_became_active":"2023-11-24T08:03:59.597176+0000","last_became_peered":"2023-11-24T08:03:59.597176+0000","last_unstale":"2023-11-24T08:03:59.604423+0000","last_undegraded":"2023-11-24T08:03:59.604423+0000","last_fullsized":"2023-11-24T08:03:59.604423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:49.358334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.620551+0000","last_change":"2023-11-24T08:03:58.577074+0000","last_active":"2023-11-24T08:03:59.620551+0000","last_peered":"2023-11-24T08:03:59.620551+0000","last_clean":"2023-11-24T08:03:59.620551+0000","last_became_active":"2023-11-24T08:03:58.576708+0000","last_became_peered":"2023-11-24T08:03:58.576708+0000","last_unstale":"2023-11-24T08:03:59.620551+0000","last_undegraded":"2023-11-24T08:03:59.620551+0000","last_fullsized":"2023-11-24T08:03:59.620551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:51:21.116952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599597+0000","last_change":"2023-11-24T08:03:59.592620+0000","last_active":"2023-11-24T08:03:59.599597+0000","last_peered":"2023-11-24T08:03:59.599597+0000","last_clean":"2023-11-24T08:03:59.599597+0000","last_became_active":"2023-11-24T08:03:59.592335+0000","last_became_peered":"2023-11-24T08:03:59.592335+0000","last_unstale":"2023-11-24T08:03:59.599597+0000","last_undegraded":"2023-11-24T08:03:59.599597+0000","last_fullsized":"2023-11-24T08:03:59.599597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:25:37.254861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.568329+0000","last_change":"2023-11-24T08:03:58.589858+0000","last_active":"2023-11-24T08:03:59.568329+0000","last_peered":"2023-11-24T08:03:59.568329+0000","last_clean":"2023-11-24T08:03:59.568329+0000","last_became_active":"2023-11-24T08:03:58.589555+0000","last_became_peered":"2023-11-24T08:03:58.589555+0000","last_unstale":"2023-11-24T08:03:59.568329+0000","last_undegraded":"2023-11-24T08:03:59.568329+0000","last_fullsized":"2023-11-24T08:03:59.568329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:42.320735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.607821+0000","last_change":"2023-11-24T08:03:59.602898+0000","last_active":"2023-11-24T08:03:59.607821+0000","last_peered":"2023-11-24T08:03:59.607821+0000","last_clean":"2023-11-24T08:03:59.607821+0000","last_became_active":"2023-11-24T08:03:59.602585+0000","last_became_peered":"2023-11-24T08:03:59.602585+0000","last_unstale":"2023-11-24T08:03:59.607821+0000","last_undegraded":"2023-11-24T08:03:59.607821+0000","last_fullsized":"2023-11-24T08:03:59.607821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.571891+0000","last_change":"2023-11-24T08:03:58.581293+0000","last_active":"2023-11-24T08:03:59.571891+0000","last_peered":"2023-11-24T08:03:59.571891+0000","last_clean":"2023-11-24T08:03:59.571891+0000","last_became_active":"2023-11-24T08:03:58.580548+0000","last_became_peered":"2023-11-24T08:03:58.580548+0000","last_unstale":"2023-11-24T08:03:59.571891+0000","last_undegraded":"2023-11-24T08:03:59.571891+0000","last_fullsized":"2023-11-24T08:03:59.571891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592875+0000","last_change":"2023-11-24T08:03:59.584395+0000","last_active":"2023-11-24T08:03:59.592875+0000","last_peered":"2023-11-24T08:03:59.592875+0000","last_clean":"2023-11-24T08:03:59.592875+0000","last_became_active":"2023-11-24T08:03:59.583808+0000","last_became_peered":"2023-11-24T08:03:59.583808+0000","last_unstale":"2023-11-24T08:03:59.592875+0000","last_undegraded":"2023-11-24T08:03:59.592875+0000","last_fullsized":"2023-11-24T08:03:59.592875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598501+0000","last_change":"2023-11-24T08:03:58.580057+0000","last_active":"2023-11-24T08:04:00.598501+0000","last_peered":"2023-11-24T08:04:00.598501+0000","last_clean":"2023-11-24T08:04:00.598501+0000","last_became_active":"2023-11-24T08:03:58.579752+0000","last_became_peered":"2023-11-24T08:03:58.579752+0000","last_unstale":"2023-11-24T08:04:00.598501+0000","last_undegraded":"2023-11-24T08:04:00.598501+0000","last_fullsized":"2023-11-24T08:04:00.598501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:44.412407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.608421+0000","last_change":"2023-11-24T08:03:59.602642+0000","last_active":"2023-11-24T08:03:59.608421+0000","last_peered":"2023-11-24T08:03:59.608421+0000","last_clean":"2023-11-24T08:03:59.608421+0000","last_became_active":"2023-11-24T08:03:59.602383+0000","last_became_peered":"2023-11-24T08:03:59.602383+0000","last_unstale":"2023-11-24T08:03:59.608421+0000","last_undegraded":"2023-11-24T08:03:59.608421+0000","last_fullsized":"2023-11-24T08:03:59.608421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595740+0000","last_change":"2023-11-24T08:03:58.576485+0000","last_active":"2023-11-24T08:04:00.595740+0000","last_peered":"2023-11-24T08:04:00.595740+0000","last_clean":"2023-11-24T08:04:00.595740+0000","last_became_active":"2023-11-24T08:03:58.576148+0000","last_became_peered":"2023-11-24T08:03:58.576148+0000","last_unstale":"2023-11-24T08:04:00.595740+0000","last_undegraded":"2023-11-24T08:04:00.595740+0000","last_fullsized":"2023-11-24T08:04:00.595740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.608151+0000","last_change":"2023-11-24T08:03:59.605656+0000","last_active":"2023-11-24T08:03:59.608151+0000","last_peered":"2023-11-24T08:03:59.608151+0000","last_clean":"2023-11-24T08:03:59.608151+0000","last_became_active":"2023-11-24T08:03:59.605293+0000","last_became_peered":"2023-11-24T08:03:59.605293+0000","last_unstale":"2023-11-24T08:03:59.608151+0000","last_undegraded":"2023-11-24T08:03:59.608151+0000","last_fullsized":"2023-11-24T08:03:59.608151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598844+0000","last_change":"2023-11-24T08:03:58.590332+0000","last_active":"2023-11-24T08:04:00.598844+0000","last_peered":"2023-11-24T08:04:00.598844+0000","last_clean":"2023-11-24T08:04:00.598844+0000","last_became_active":"2023-11-24T08:03:58.587974+0000","last_became_peered":"2023-11-24T08:03:58.587974+0000","last_unstale":"2023-11-24T08:04:00.598844+0000","last_undegraded":"2023-11-24T08:04:00.598844+0000","last_fullsized":"2023-11-24T08:04:00.598844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.608694+0000","last_change":"2023-11-24T08:03:59.606241+0000","last_active":"2023-11-24T08:03:59.608694+0000","last_peered":"2023-11-24T08:03:59.608694+0000","last_clean":"2023-11-24T08:03:59.608694+0000","last_became_active":"2023-11-24T08:03:59.604149+0000","last_became_peered":"2023-11-24T08:03:59.604149+0000","last_unstale":"2023-11-24T08:03:59.608694+0000","last_undegraded":"2023-11-24T08:03:59.608694+0000","last_fullsized":"2023-11-24T08:03:59.608694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615366+0000","last_change":"2023-11-24T08:03:58.581525+0000","last_active":"2023-11-24T08:03:59.615366+0000","last_peered":"2023-11-24T08:03:59.615366+0000","last_clean":"2023-11-24T08:03:59.615366+0000","last_became_active":"2023-11-24T08:03:58.578531+0000","last_became_peered":"2023-11-24T08:03:58.578531+0000","last_unstale":"2023-11-24T08:03:59.615366+0000","last_undegraded":"2023-11-24T08:03:59.615366+0000","last_fullsized":"2023-11-24T08:03:59.615366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:12.928445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590464+0000","last_change":"2023-11-24T08:03:59.582239+0000","last_active":"2023-11-24T08:03:59.590464+0000","last_peered":"2023-11-24T08:03:59.590464+0000","last_clean":"2023-11-24T08:03:59.590464+0000","last_became_active":"2023-11-24T08:03:59.580468+0000","last_became_peered":"2023-11-24T08:03:59.580468+0000","last_unstale":"2023-11-24T08:03:59.590464+0000","last_undegraded":"2023-11-24T08:03:59.590464+0000","last_fullsized":"2023-11-24T08:03:59.590464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:49.358334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598701+0000","last_change":"2023-11-24T08:03:58.592974+0000","last_active":"2023-11-24T08:04:00.598701+0000","last_peered":"2023-11-24T08:04:00.598701+0000","last_clean":"2023-11-24T08:04:00.598701+0000","last_became_active":"2023-11-24T08:03:58.592300+0000","last_became_peered":"2023-11-24T08:03:58.592300+0000","last_unstale":"2023-11-24T08:04:00.598701+0000","last_undegraded":"2023-11-24T08:04:00.598701+0000","last_fullsized":"2023-11-24T08:04:00.598701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600553+0000","last_change":"2023-11-24T08:03:59.595203+0000","last_active":"2023-11-24T08:03:59.600553+0000","last_peered":"2023-11-24T08:03:59.600553+0000","last_clean":"2023-11-24T08:03:59.600553+0000","last_became_active":"2023-11-24T08:03:59.594780+0000","last_became_peered":"2023-11-24T08:03:59.594780+0000","last_unstale":"2023-11-24T08:03:59.600553+0000","last_undegraded":"2023-11-24T08:03:59.600553+0000","last_fullsized":"2023-11-24T08:03:59.600553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:41.590643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:03:58.580994+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:03:58.580994+0000","last_peered":"2023-11-24T08:03:58.580994+0000","last_clean":"2023-11-24T08:03:58.580994+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:03:58.580994+0000","last_undegraded":"2023-11-24T08:03:58.580994+0000","last_fullsized":"2023-11-24T08:03:58.580994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.567344+0000","last_change":"2023-11-24T08:03:58.590597+0000","last_active":"2023-11-24T08:03:59.567344+0000","last_peered":"2023-11-24T08:03:59.567344+0000","last_clean":"2023-11-24T08:03:59.567344+0000","last_became_active":"2023-11-24T08:03:58.590130+0000","last_became_peered":"2023-11-24T08:03:58.590130+0000","last_unstale":"2023-11-24T08:03:59.567344+0000","last_undegraded":"2023-11-24T08:03:59.567344+0000","last_fullsized":"2023-11-24T08:03:59.567344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.609107+0000","last_change":"2023-11-24T08:03:59.589854+0000","last_active":"2023-11-24T08:03:59.609107+0000","last_peered":"2023-11-24T08:03:59.609107+0000","last_clean":"2023-11-24T08:03:59.609107+0000","last_became_active":"2023-11-24T08:03:59.589630+0000","last_became_peered":"2023-11-24T08:03:59.589630+0000","last_unstale":"2023-11-24T08:03:59.609107+0000","last_undegraded":"2023-11-24T08:03:59.609107+0000","last_fullsized":"2023-11-24T08:03:59.609107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:04.901296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.579750+0000","last_change":"2023-11-24T08:03:58.593106+0000","last_active":"2023-11-24T08:03:59.579750+0000","last_peered":"2023-11-24T08:03:59.579750+0000","last_clean":"2023-11-24T08:03:59.579750+0000","last_became_active":"2023-11-24T08:03:58.592777+0000","last_became_peered":"2023-11-24T08:03:58.592777+0000","last_unstale":"2023-11-24T08:03:59.579750+0000","last_undegraded":"2023-11-24T08:03:59.579750+0000","last_fullsized":"2023-11-24T08:03:59.579750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:59.232039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605335+0000","last_change":"2023-11-24T08:03:59.594009+0000","last_active":"2023-11-24T08:03:59.605335+0000","last_peered":"2023-11-24T08:03:59.605335+0000","last_clean":"2023-11-24T08:03:59.605335+0000","last_became_active":"2023-11-24T08:03:59.593697+0000","last_became_peered":"2023-11-24T08:03:59.593697+0000","last_unstale":"2023-11-24T08:03:59.605335+0000","last_undegraded":"2023-11-24T08:03:59.605335+0000","last_fullsized":"2023-11-24T08:03:59.605335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:24.954870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598642+0000","last_change":"2023-11-24T08:03:58.590726+0000","last_active":"2023-11-24T08:04:00.598642+0000","last_peered":"2023-11-24T08:04:00.598642+0000","last_clean":"2023-11-24T08:04:00.598642+0000","last_became_active":"2023-11-24T08:03:58.590385+0000","last_became_peered":"2023-11-24T08:03:58.590385+0000","last_unstale":"2023-11-24T08:04:00.598642+0000","last_undegraded":"2023-11-24T08:04:00.598642+0000","last_fullsized":"2023-11-24T08:04:00.598642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:19.226023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603256+0000","last_change":"2023-11-24T08:03:59.594256+0000","last_active":"2023-11-24T08:03:59.603256+0000","last_peered":"2023-11-24T08:03:59.603256+0000","last_clean":"2023-11-24T08:03:59.603256+0000","last_became_active":"2023-11-24T08:03:59.593902+0000","last_became_peered":"2023-11-24T08:03:59.593902+0000","last_unstale":"2023-11-24T08:03:59.603256+0000","last_undegraded":"2023-11-24T08:03:59.603256+0000","last_fullsized":"2023-11-24T08:03:59.603256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.568323+0000","last_change":"2023-11-24T08:03:58.589309+0000","last_active":"2023-11-24T08:03:59.568323+0000","last_peered":"2023-11-24T08:03:59.568323+0000","last_clean":"2023-11-24T08:03:59.568323+0000","last_became_active":"2023-11-24T08:03:58.588917+0000","last_became_peered":"2023-11-24T08:03:58.588917+0000","last_unstale":"2023-11-24T08:03:59.568323+0000","last_undegraded":"2023-11-24T08:03:59.568323+0000","last_fullsized":"2023-11-24T08:03:59.568323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595434+0000","last_change":"2023-11-24T08:03:59.597797+0000","last_active":"2023-11-24T08:04:00.595434+0000","last_peered":"2023-11-24T08:04:00.595434+0000","last_clean":"2023-11-24T08:04:00.595434+0000","last_became_active":"2023-11-24T08:03:59.597491+0000","last_became_peered":"2023-11-24T08:03:59.597491+0000","last_unstale":"2023-11-24T08:04:00.595434+0000","last_undegraded":"2023-11-24T08:04:00.595434+0000","last_fullsized":"2023-11-24T08:04:00.595434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580347+0000","last_change":"2023-11-24T08:03:58.581746+0000","last_active":"2023-11-24T08:03:59.580347+0000","last_peered":"2023-11-24T08:03:59.580347+0000","last_clean":"2023-11-24T08:03:59.580347+0000","last_became_active":"2023-11-24T08:03:58.578821+0000","last_became_peered":"2023-11-24T08:03:58.578821+0000","last_unstale":"2023-11-24T08:03:59.580347+0000","last_undegraded":"2023-11-24T08:03:59.580347+0000","last_fullsized":"2023-11-24T08:03:59.580347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590733+0000","last_change":"2023-11-24T08:03:59.584022+0000","last_active":"2023-11-24T08:03:59.590733+0000","last_peered":"2023-11-24T08:03:59.590733+0000","last_clean":"2023-11-24T08:03:59.590733+0000","last_became_active":"2023-11-24T08:03:59.583697+0000","last_became_peered":"2023-11-24T08:03:59.583697+0000","last_unstale":"2023-11-24T08:03:59.590733+0000","last_undegraded":"2023-11-24T08:03:59.590733+0000","last_fullsized":"2023-11-24T08:03:59.590733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.583072+0000","last_change":"2023-11-24T08:03:58.595698+0000","last_active":"2023-11-24T08:03:59.583072+0000","last_peered":"2023-11-24T08:03:59.583072+0000","last_clean":"2023-11-24T08:03:59.583072+0000","last_became_active":"2023-11-24T08:03:58.595445+0000","last_became_peered":"2023-11-24T08:03:58.595445+0000","last_unstale":"2023-11-24T08:03:59.583072+0000","last_undegraded":"2023-11-24T08:03:59.583072+0000","last_fullsized":"2023-11-24T08:03:59.583072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.664977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597608+0000","last_change":"2023-11-24T08:03:59.591006+0000","last_active":"2023-11-24T08:03:59.597608+0000","last_peered":"2023-11-24T08:03:59.597608+0000","last_clean":"2023-11-24T08:03:59.597608+0000","last_became_active":"2023-11-24T08:03:59.590697+0000","last_became_peered":"2023-11-24T08:03:59.590697+0000","last_unstale":"2023-11-24T08:03:59.597608+0000","last_undegraded":"2023-11-24T08:03:59.597608+0000","last_fullsized":"2023-11-24T08:03:59.597608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:04.901296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580990+0000","last_change":"2023-11-24T08:03:58.585471+0000","last_active":"2023-11-24T08:03:59.580990+0000","last_peered":"2023-11-24T08:03:59.580990+0000","last_clean":"2023-11-24T08:03:59.580990+0000","last_became_active":"2023-11-24T08:03:58.584512+0000","last_became_peered":"2023-11-24T08:03:58.584512+0000","last_unstale":"2023-11-24T08:03:59.580990+0000","last_undegraded":"2023-11-24T08:03:59.580990+0000","last_fullsized":"2023-11-24T08:03:59.580990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605550+0000","last_change":"2023-11-24T08:03:59.597245+0000","last_active":"2023-11-24T08:03:59.605550+0000","last_peered":"2023-11-24T08:03:59.605550+0000","last_clean":"2023-11-24T08:03:59.605550+0000","last_became_active":"2023-11-24T08:03:59.596949+0000","last_became_peered":"2023-11-24T08:03:59.596949+0000","last_unstale":"2023-11-24T08:03:59.605550+0000","last_undegraded":"2023-11-24T08:03:59.605550+0000","last_fullsized":"2023-11-24T08:03:59.605550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.614765+0000","last_change":"2023-11-24T08:03:58.587720+0000","last_active":"2023-11-24T08:03:59.614765+0000","last_peered":"2023-11-24T08:03:59.614765+0000","last_clean":"2023-11-24T08:03:59.614765+0000","last_became_active":"2023-11-24T08:03:58.587501+0000","last_became_peered":"2023-11-24T08:03:58.587501+0000","last_unstale":"2023-11-24T08:03:59.614765+0000","last_undegraded":"2023-11-24T08:03:59.614765+0000","last_fullsized":"2023-11-24T08:03:59.614765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:19.371283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599556+0000","last_change":"2023-11-24T08:03:59.592131+0000","last_active":"2023-11-24T08:03:59.599556+0000","last_peered":"2023-11-24T08:03:59.599556+0000","last_clean":"2023-11-24T08:03:59.599556+0000","last_became_active":"2023-11-24T08:03:59.591709+0000","last_became_peered":"2023-11-24T08:03:59.591709+0000","last_unstale":"2023-11-24T08:03:59.599556+0000","last_undegraded":"2023-11-24T08:03:59.599556+0000","last_fullsized":"2023-11-24T08:03:59.599556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:05.870891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580255+0000","last_change":"2023-11-24T08:03:58.592505+0000","last_active":"2023-11-24T08:03:59.580255+0000","last_peered":"2023-11-24T08:03:59.580255+0000","last_clean":"2023-11-24T08:03:59.580255+0000","last_became_active":"2023-11-24T08:03:58.592097+0000","last_became_peered":"2023-11-24T08:03:58.592097+0000","last_unstale":"2023-11-24T08:03:59.580255+0000","last_undegraded":"2023-11-24T08:03:59.580255+0000","last_fullsized":"2023-11-24T08:03:59.580255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595333+0000","last_change":"2023-11-24T08:03:59.590194+0000","last_active":"2023-11-24T08:04:00.595333+0000","last_peered":"2023-11-24T08:04:00.595333+0000","last_clean":"2023-11-24T08:04:00.595333+0000","last_became_active":"2023-11-24T08:03:59.589879+0000","last_became_peered":"2023-11-24T08:03:59.589879+0000","last_unstale":"2023-11-24T08:04:00.595333+0000","last_undegraded":"2023-11-24T08:04:00.595333+0000","last_fullsized":"2023-11-24T08:04:00.595333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580567+0000","last_change":"2023-11-24T08:03:58.593989+0000","last_active":"2023-11-24T08:03:59.580567+0000","last_peered":"2023-11-24T08:03:59.580567+0000","last_clean":"2023-11-24T08:03:59.580567+0000","last_became_active":"2023-11-24T08:03:58.593641+0000","last_became_peered":"2023-11-24T08:03:58.593641+0000","last_unstale":"2023-11-24T08:03:59.580567+0000","last_undegraded":"2023-11-24T08:03:59.580567+0000","last_fullsized":"2023-11-24T08:03:59.580567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605040+0000","last_change":"2023-11-24T08:03:59.588962+0000","last_active":"2023-11-24T08:03:59.605040+0000","last_peered":"2023-11-24T08:03:59.605040+0000","last_clean":"2023-11-24T08:03:59.605040+0000","last_became_active":"2023-11-24T08:03:59.588405+0000","last_became_peered":"2023-11-24T08:03:59.588405+0000","last_unstale":"2023-11-24T08:03:59.605040+0000","last_undegraded":"2023-11-24T08:03:59.605040+0000","last_fullsized":"2023-11-24T08:03:59.605040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:45.422999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.581648+0000","last_change":"2023-11-24T08:03:58.589209+0000","last_active":"2023-11-24T08:03:59.581648+0000","last_peered":"2023-11-24T08:03:59.581648+0000","last_clean":"2023-11-24T08:03:59.581648+0000","last_became_active":"2023-11-24T08:03:58.588034+0000","last_became_peered":"2023-11-24T08:03:58.588034+0000","last_unstale":"2023-11-24T08:03:59.581648+0000","last_undegraded":"2023-11-24T08:03:59.581648+0000","last_fullsized":"2023-11-24T08:03:59.581648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596766+0000","last_change":"2023-11-24T08:03:59.584679+0000","last_active":"2023-11-24T08:03:59.596766+0000","last_peered":"2023-11-24T08:03:59.596766+0000","last_clean":"2023-11-24T08:03:59.596766+0000","last_became_active":"2023-11-24T08:03:59.584311+0000","last_became_peered":"2023-11-24T08:03:59.584311+0000","last_unstale":"2023-11-24T08:03:59.596766+0000","last_undegraded":"2023-11-24T08:03:59.596766+0000","last_fullsized":"2023-11-24T08:03:59.596766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615017+0000","last_change":"2023-11-24T08:03:58.593136+0000","last_active":"2023-11-24T08:03:59.615017+0000","last_peered":"2023-11-24T08:03:59.615017+0000","last_clean":"2023-11-24T08:03:59.615017+0000","last_became_active":"2023-11-24T08:03:58.592737+0000","last_became_peered":"2023-11-24T08:03:58.592737+0000","last_unstale":"2023-11-24T08:03:59.615017+0000","last_undegraded":"2023-11-24T08:03:59.615017+0000","last_fullsized":"2023-11-24T08:03:59.615017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600973+0000","last_change":"2023-11-24T08:03:59.595926+0000","last_active":"2023-11-24T08:03:59.600973+0000","last_peered":"2023-11-24T08:03:59.600973+0000","last_clean":"2023-11-24T08:03:59.600973+0000","last_became_active":"2023-11-24T08:03:59.595576+0000","last_became_peered":"2023-11-24T08:03:59.595576+0000","last_unstale":"2023-11-24T08:03:59.600973+0000","last_undegraded":"2023-11-24T08:03:59.600973+0000","last_fullsized":"2023-11-24T08:03:59.600973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.601340+0000","last_change":"2023-11-24T08:03:59.596718+0000","last_active":"2023-11-24T08:03:59.601340+0000","last_peered":"2023-11-24T08:03:59.601340+0000","last_clean":"2023-11-24T08:03:59.601340+0000","last_became_active":"2023-11-24T08:03:59.596430+0000","last_became_peered":"2023-11-24T08:03:59.596430+0000","last_unstale":"2023-11-24T08:03:59.601340+0000","last_undegraded":"2023-11-24T08:03:59.601340+0000","last_fullsized":"2023-11-24T08:03:59.601340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615697+0000","last_change":"2023-11-24T08:03:58.595326+0000","last_active":"2023-11-24T08:03:59.615697+0000","last_peered":"2023-11-24T08:03:59.615697+0000","last_clean":"2023-11-24T08:03:59.615697+0000","last_became_active":"2023-11-24T08:03:58.593856+0000","last_became_peered":"2023-11-24T08:03:58.593856+0000","last_unstale":"2023-11-24T08:03:59.615697+0000","last_undegraded":"2023-11-24T08:03:59.615697+0000","last_fullsized":"2023-11-24T08:03:59.615697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604206+0000","last_change":"2023-11-24T08:03:59.600352+0000","last_active":"2023-11-24T08:03:59.604206+0000","last_peered":"2023-11-24T08:03:59.604206+0000","last_clean":"2023-11-24T08:03:59.604206+0000","last_became_active":"2023-11-24T08:03:59.599271+0000","last_became_peered":"2023-11-24T08:03:59.599271+0000","last_unstale":"2023-11-24T08:03:59.604206+0000","last_undegraded":"2023-11-24T08:03:59.604206+0000","last_fullsized":"2023-11-24T08:03:59.604206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.612451+0000","last_change":"2023-11-24T08:03:58.595226+0000","last_active":"2023-11-24T08:03:59.612451+0000","last_peered":"2023-11-24T08:03:59.612451+0000","last_clean":"2023-11-24T08:03:59.612451+0000","last_became_active":"2023-11-24T08:03:58.593565+0000","last_became_peered":"2023-11-24T08:03:58.593565+0000","last_unstale":"2023-11-24T08:03:59.612451+0000","last_undegraded":"2023-11-24T08:03:59.612451+0000","last_fullsized":"2023-11-24T08:03:59.612451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597122+0000","last_change":"2023-11-24T08:03:59.586457+0000","last_active":"2023-11-24T08:03:59.597122+0000","last_peered":"2023-11-24T08:03:59.597122+0000","last_clean":"2023-11-24T08:03:59.597122+0000","last_became_active":"2023-11-24T08:03:59.586176+0000","last_became_peered":"2023-11-24T08:03:59.586176+0000","last_unstale":"2023-11-24T08:03:59.597122+0000","last_undegraded":"2023-11-24T08:03:59.597122+0000","last_fullsized":"2023-11-24T08:03:59.597122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:56:35.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.621203+0000","last_change":"2023-11-24T08:03:58.587271+0000","last_active":"2023-11-24T08:03:59.621203+0000","last_peered":"2023-11-24T08:03:59.621203+0000","last_clean":"2023-11-24T08:03:59.621203+0000","last_became_active":"2023-11-24T08:03:58.586888+0000","last_became_peered":"2023-11-24T08:03:58.586888+0000","last_unstale":"2023-11-24T08:03:59.621203+0000","last_undegraded":"2023-11-24T08:03:59.621203+0000","last_fullsized":"2023-11-24T08:03:59.621203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596425+0000","last_change":"2023-11-24T08:03:59.585467+0000","last_active":"2023-11-24T08:03:59.596425+0000","last_peered":"2023-11-24T08:03:59.596425+0000","last_clean":"2023-11-24T08:03:59.596425+0000","last_became_active":"2023-11-24T08:03:59.585159+0000","last_became_peered":"2023-11-24T08:03:59.585159+0000","last_unstale":"2023-11-24T08:03:59.596425+0000","last_undegraded":"2023-11-24T08:03:59.596425+0000","last_fullsized":"2023-11-24T08:03:59.596425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:29.455296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.619450+0000","last_change":"2023-11-24T08:03:58.589593+0000","last_active":"2023-11-24T08:03:59.619450+0000","last_peered":"2023-11-24T08:03:59.619450+0000","last_clean":"2023-11-24T08:03:59.619450+0000","last_became_active":"2023-11-24T08:03:58.588864+0000","last_became_peered":"2023-11-24T08:03:58.588864+0000","last_unstale":"2023-11-24T08:03:59.619450+0000","last_undegraded":"2023-11-24T08:03:59.619450+0000","last_fullsized":"2023-11-24T08:03:59.619450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:11.240162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":665573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":658216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.880000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5830000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3959999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.0299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7839999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:03.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:03.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6184a32640 1 Processor -- start 2023-11-24T08:04:03.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6184a32640 1 -- start start 2023-11-24T08:04:03.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6184a32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f618015a320 0x7f61800b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6184a32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6184a32640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618015a700 con 0x7f61800b36c0 2023-11-24T08:04:03.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6184a32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800b2430 con 0x7f618015a320 2023-11-24T08:04:03.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6184a32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61800b2620 con 0x7f6180070da0 2023-11-24T08:04:03.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6177fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f61800b36c0 0x7f6180070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51126/0 (socket says 172.21.15.57:51126) 2023-11-24T08:04:03.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f6177fff640 1 -- 172.21.15.57:0/1404584298 learned_addr learned my addr 172.21.15.57:0/1404584298 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:03.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f617ed9d640 1 --2- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f617e59c640 1 --2- 172.21.15.57:0/1404584298 >> v2:172.21.15.132:3300/0 conn(0x7f618015a320 0x7f61800b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.896+0000 7f617dd9b640 1 -- 172.21.15.57:0/1404584298 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323237073 0 0) 0x7f618015a700 con 0x7f61800b36c0 2023-11-24T08:04:03.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.900+0000 7f617dd9b640 1 -- 172.21.15.57:0/1404584298 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f616c005740 con 0x7f61800b36c0 2023-11-24T08:04:03.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.900+0000 7f617e59c640 1 -- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 msgr2=0x7f618015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:03.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.900+0000 7f617e59c640 1 --2- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618015ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.900+0000 7f617e59c640 1 -- 172.21.15.57:0/1404584298 >> v1:172.21.15.57:6789/0 conn(0x7f61800b36c0 legacy=0x7f6180070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.900+0000 7f617e59c640 1 -- 172.21.15.57:0/1404584298 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800b2900 con 0x7f618015a320 2023-11-24T08:04:03.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.900+0000 7f617ed9d640 1 --2- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:03.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.900+0000 7f617e59c640 1 --2- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f618015a320 0x7f61800b1ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61700097c0 tx=0x7f617001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6ffc75668f43f1e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f617dd9b640 1 -- 172.21.15.57:0/1404584298 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700ad660 con 0x7f618015a320 2023-11-24T08:04:03.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f617dd9b640 1 -- 172.21.15.57:0/1404584298 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61700ad7c0 con 0x7f618015a320 2023-11-24T08:04:03.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f617dd9b640 1 -- 172.21.15.57:0/1404584298 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700adb50 con 0x7f618015a320 2023-11-24T08:04:03.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f618015a320 msgr2=0x7f61800b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 --2- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f618015a320 0x7f61800b1ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61700097c0 tx=0x7f617001c450 comp rx=0 tx=0).stop 2023-11-24T08:04:03.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- 172.21.15.57:0/1404584298 shutdown_connections 2023-11-24T08:04:03.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 --2- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 --2- 172.21.15.57:0/1404584298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f618015a320 0x7f61800b1ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- 172.21.15.57:0/1404584298 >> 172.21.15.57:0/1404584298 conn(0x7f61800b0bf0 msgr2=0x7f61800b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:03.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- 172.21.15.57:0/1404584298 shutdown_connections 2023-11-24T08:04:03.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- 172.21.15.57:0/1404584298 wait complete. 2023-11-24T08:04:03.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 Processor -- start 2023-11-24T08:04:03.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- start start 2023-11-24T08:04:03.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61800b36c0 0x7f6180143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f618015a320 0x7f618014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180149860 con 0x7f618015a320 2023-11-24T08:04:03.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61801473b0 con 0x7f61800b36c0 2023-11-24T08:04:03.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.904+0000 7f6184a32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6180148f30 con 0x7f6180070da0 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f618015a320 0x7f618014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f618015a320 0x7f618014a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42732/0 (socket says 172.21.15.57:42732) 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 -- 172.21.15.57:0/991922821 learned_addr learned my addr 172.21.15.57:0/991922821 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617e59c640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6177fff640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61800b36c0 0x7f6180143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 -- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 msgr2=0x7f618014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 -- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61800b36c0 msgr2=0x7f6180143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61800b36c0 0x7f6180143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 -- 172.21.15.57:0/991922821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178009a70 con 0x7f618015a320 2023-11-24T08:04:03.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f617ed9d640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f618015a320 0x7f618014a830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6178009f00 tx=0x7f617800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6176ffd640 1 -- 172.21.15.57:0/991922821 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178009d70 con 0x7f618015a320 2023-11-24T08:04:03.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6176ffd640 1 -- 172.21.15.57:0/991922821 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800f040 con 0x7f618015a320 2023-11-24T08:04:03.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6170009420 con 0x7f618015a320 2023-11-24T08:04:03.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6176ffd640 1 -- 172.21.15.57:0/991922821 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178003bc0 con 0x7f618015a320 2023-11-24T08:04:03.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6180150050 con 0x7f618015a320 2023-11-24T08:04:03.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61801499a0 con 0x7f618015a320 2023-11-24T08:04:03.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6176ffd640 1 -- 172.21.15.57:0/991922821 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6178014480 con 0x7f618015a320 2023-11-24T08:04:03.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.908+0000 7f6176ffd640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6160066470 0x7f6160068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:03.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.912+0000 7f6176ffd640 1 -- 172.21.15.57:0/991922821 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6178084b00 con 0x7f618015a320 2023-11-24T08:04:03.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.912+0000 7f617e59c640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6160066470 0x7f6160068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:03.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.912+0000 7f617e59c640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6160066470 0x7f6160068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61700af000 tx=0x7f61700a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:03.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:03.912+0000 7f6176ffd640 1 -- 172.21.15.57:0/991922821 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61801499a0 con 0x7f618015a320 2023-11-24T08:04:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.068+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61801499a0 con 0x7f6160066470 2023-11-24T08:04:04.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.076+0000 7f6176ffd640 1 -- 172.21.15.57:0/991922821 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264634 (secure 0 0 0) 0x7f61801499a0 con 0x7f6160066470 2023-11-24T08:04:04.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:04.080 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:04:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6160066470 msgr2=0x7f6160068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6160066470 0x7f6160068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61700af000 tx=0x7f61700a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f618015a320 msgr2=0x7f618014a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f618015a320 0x7f618014a830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6178009f00 tx=0x7f617800c490 comp rx=0 tx=0).stop 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 shutdown_connections 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6160066470 0x7f6160068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f618015a320 0x7f618014a830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61800b36c0 0x7f6180143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 --2- 172.21.15.57:0/991922821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6180070da0 0x7f618014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 >> 172.21.15.57:0/991922821 conn(0x7f61800b0bf0 msgr2=0x7f61800b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 shutdown_connections 2023-11-24T08:04:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.080+0000 7f6184a32640 1 -- 172.21.15.57:0/991922821 wait complete. 2023-11-24T08:04:04.100 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-24T08:04:02.679993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223260,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751460,"statfs":{"total":773094113280,"available":772865495040,"internally_reserved":0,"allocated":2998272,"data_stored":1775127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.122454"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604677+0000","last_change":"2023-11-24T08:03:59.599040+0000","last_active":"2023-11-24T08:03:59.604677+0000","last_peered":"2023-11-24T08:03:59.604677+0000","last_clean":"2023-11-24T08:03:59.604677+0000","last_became_active":"2023-11-24T08:03:59.598731+0000","last_became_peered":"2023-11-24T08:03:59.598731+0000","last_unstale":"2023-11-24T08:03:59.604677+0000","last_undegraded":"2023-11-24T08:03:59.604677+0000","last_fullsized":"2023-11-24T08:03:59.604677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.595462+0000","last_change":"2023-11-24T08:03:59.587668+0000","last_active":"2023-11-24T08:03:59.595462+0000","last_peered":"2023-11-24T08:03:59.595462+0000","last_clean":"2023-11-24T08:03:59.595462+0000","last_became_active":"2023-11-24T08:03:59.585499+0000","last_became_peered":"2023-11-24T08:03:59.585499+0000","last_unstale":"2023-11-24T08:03:59.595462+0000","last_undegraded":"2023-11-24T08:03:59.595462+0000","last_fullsized":"2023-11-24T08:03:59.595462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605188+0000","last_change":"2023-11-24T08:03:59.595671+0000","last_active":"2023-11-24T08:03:59.605188+0000","last_peered":"2023-11-24T08:03:59.605188+0000","last_clean":"2023-11-24T08:03:59.605188+0000","last_became_active":"2023-11-24T08:03:59.595451+0000","last_became_peered":"2023-11-24T08:03:59.595451+0000","last_unstale":"2023-11-24T08:03:59.605188+0000","last_undegraded":"2023-11-24T08:03:59.605188+0000","last_fullsized":"2023-11-24T08:03:59.605188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:26.300456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590692+0000","last_change":"2023-11-24T08:03:59.585093+0000","last_active":"2023-11-24T08:03:59.590692+0000","last_peered":"2023-11-24T08:03:59.590692+0000","last_clean":"2023-11-24T08:03:59.590692+0000","last_became_active":"2023-11-24T08:03:59.584715+0000","last_became_peered":"2023-11-24T08:03:59.584715+0000","last_unstale":"2023-11-24T08:03:59.590692+0000","last_undegraded":"2023-11-24T08:03:59.590692+0000","last_fullsized":"2023-11-24T08:03:59.590692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:41.590643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600223+0000","last_change":"2023-11-24T08:03:59.594763+0000","last_active":"2023-11-24T08:03:59.600223+0000","last_peered":"2023-11-24T08:03:59.600223+0000","last_clean":"2023-11-24T08:03:59.600223+0000","last_became_active":"2023-11-24T08:03:59.594479+0000","last_became_peered":"2023-11-24T08:03:59.594479+0000","last_unstale":"2023-11-24T08:03:59.600223+0000","last_undegraded":"2023-11-24T08:03:59.600223+0000","last_fullsized":"2023-11-24T08:03:59.600223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596021+0000","last_change":"2023-11-24T08:03:59.586577+0000","last_active":"2023-11-24T08:03:59.596021+0000","last_peered":"2023-11-24T08:03:59.596021+0000","last_clean":"2023-11-24T08:03:59.596021+0000","last_became_active":"2023-11-24T08:03:59.586189+0000","last_became_peered":"2023-11-24T08:03:59.586189+0000","last_unstale":"2023-11-24T08:03:59.596021+0000","last_undegraded":"2023-11-24T08:03:59.596021+0000","last_fullsized":"2023-11-24T08:03:59.596021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:39.675569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600141+0000","last_change":"2023-11-24T08:03:59.596712+0000","last_active":"2023-11-24T08:03:59.600141+0000","last_peered":"2023-11-24T08:03:59.600141+0000","last_clean":"2023-11-24T08:03:59.600141+0000","last_became_active":"2023-11-24T08:03:59.596335+0000","last_became_peered":"2023-11-24T08:03:59.596335+0000","last_unstale":"2023-11-24T08:03:59.600141+0000","last_undegraded":"2023-11-24T08:03:59.600141+0000","last_fullsized":"2023-11-24T08:03:59.600141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.602043+0000","last_change":"2023-11-24T08:03:59.588712+0000","last_active":"2023-11-24T08:03:59.602043+0000","last_peered":"2023-11-24T08:03:59.602043+0000","last_clean":"2023-11-24T08:03:59.602043+0000","last_became_active":"2023-11-24T08:03:59.588015+0000","last_became_peered":"2023-11-24T08:03:59.588015+0000","last_unstale":"2023-11-24T08:03:59.602043+0000","last_undegraded":"2023-11-24T08:03:59.602043+0000","last_fullsized":"2023-11-24T08:03:59.602043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:42.010459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604701+0000","last_change":"2023-11-24T08:03:59.600086+0000","last_active":"2023-11-24T08:03:59.604701+0000","last_peered":"2023-11-24T08:03:59.604701+0000","last_clean":"2023-11-24T08:03:59.604701+0000","last_became_active":"2023-11-24T08:03:59.598793+0000","last_became_peered":"2023-11-24T08:03:59.598793+0000","last_unstale":"2023-11-24T08:03:59.604701+0000","last_undegraded":"2023-11-24T08:03:59.604701+0000","last_fullsized":"2023-11-24T08:03:59.604701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592781+0000","last_change":"2023-11-24T08:03:59.587766+0000","last_active":"2023-11-24T08:03:59.592781+0000","last_peered":"2023-11-24T08:03:59.592781+0000","last_clean":"2023-11-24T08:03:59.592781+0000","last_became_active":"2023-11-24T08:03:59.587435+0000","last_became_peered":"2023-11-24T08:03:59.587435+0000","last_unstale":"2023-11-24T08:03:59.592781+0000","last_undegraded":"2023-11-24T08:03:59.592781+0000","last_fullsized":"2023-11-24T08:03:59.592781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592936+0000","last_change":"2023-11-24T08:03:59.587777+0000","last_active":"2023-11-24T08:03:59.592936+0000","last_peered":"2023-11-24T08:03:59.592936+0000","last_clean":"2023-11-24T08:03:59.592936+0000","last_became_active":"2023-11-24T08:03:59.587442+0000","last_became_peered":"2023-11-24T08:03:59.587442+0000","last_unstale":"2023-11-24T08:03:59.592936+0000","last_undegraded":"2023-11-24T08:03:59.592936+0000","last_fullsized":"2023-11-24T08:03:59.592936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595515+0000","last_change":"2023-11-24T08:03:59.595995+0000","last_active":"2023-11-24T08:04:00.595515+0000","last_peered":"2023-11-24T08:04:00.595515+0000","last_clean":"2023-11-24T08:04:00.595515+0000","last_became_active":"2023-11-24T08:03:59.595526+0000","last_became_peered":"2023-11-24T08:03:59.595526+0000","last_unstale":"2023-11-24T08:04:00.595515+0000","last_undegraded":"2023-11-24T08:04:00.595515+0000","last_fullsized":"2023-11-24T08:04:00.595515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605339+0000","last_change":"2023-11-24T08:03:59.591371+0000","last_active":"2023-11-24T08:03:59.605339+0000","last_peered":"2023-11-24T08:03:59.605339+0000","last_clean":"2023-11-24T08:03:59.605339+0000","last_became_active":"2023-11-24T08:03:59.590300+0000","last_became_peered":"2023-11-24T08:03:59.590300+0000","last_unstale":"2023-11-24T08:03:59.605339+0000","last_undegraded":"2023-11-24T08:03:59.605339+0000","last_fullsized":"2023-11-24T08:03:59.605339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599575+0000","last_change":"2023-11-24T08:03:59.592432+0000","last_active":"2023-11-24T08:03:59.599575+0000","last_peered":"2023-11-24T08:03:59.599575+0000","last_clean":"2023-11-24T08:03:59.599575+0000","last_became_active":"2023-11-24T08:03:59.592087+0000","last_became_peered":"2023-11-24T08:03:59.592087+0000","last_unstale":"2023-11-24T08:03:59.599575+0000","last_undegraded":"2023-11-24T08:03:59.599575+0000","last_fullsized":"2023-11-24T08:03:59.599575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:54.959126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603270+0000","last_change":"2023-11-24T08:03:59.594278+0000","last_active":"2023-11-24T08:03:59.603270+0000","last_peered":"2023-11-24T08:03:59.603270+0000","last_clean":"2023-11-24T08:03:59.603270+0000","last_became_active":"2023-11-24T08:03:59.593956+0000","last_became_peered":"2023-11-24T08:03:59.593956+0000","last_unstale":"2023-11-24T08:03:59.603270+0000","last_undegraded":"2023-11-24T08:03:59.603270+0000","last_fullsized":"2023-11-24T08:03:59.603270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.584598+0000","last_change":"2023-11-24T08:03:59.573698+0000","last_active":"2023-11-24T08:03:59.584598+0000","last_peered":"2023-11-24T08:03:59.584598+0000","last_clean":"2023-11-24T08:03:59.584598+0000","last_became_active":"2023-11-24T08:03:59.573383+0000","last_became_peered":"2023-11-24T08:03:59.573383+0000","last_unstale":"2023-11-24T08:03:59.584598+0000","last_undegraded":"2023-11-24T08:03:59.584598+0000","last_fullsized":"2023-11-24T08:03:59.584598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597996+0000","last_change":"2023-11-24T08:03:59.590145+0000","last_active":"2023-11-24T08:03:59.597996+0000","last_peered":"2023-11-24T08:03:59.597996+0000","last_clean":"2023-11-24T08:03:59.597996+0000","last_became_active":"2023-11-24T08:03:59.589840+0000","last_became_peered":"2023-11-24T08:03:59.589840+0000","last_unstale":"2023-11-24T08:03:59.597996+0000","last_undegraded":"2023-11-24T08:03:59.597996+0000","last_fullsized":"2023-11-24T08:03:59.597996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598839+0000","last_change":"2023-11-24T08:03:59.590044+0000","last_active":"2023-11-24T08:04:00.598839+0000","last_peered":"2023-11-24T08:04:00.598839+0000","last_clean":"2023-11-24T08:04:00.598839+0000","last_became_active":"2023-11-24T08:03:59.589664+0000","last_became_peered":"2023-11-24T08:03:59.589664+0000","last_unstale":"2023-11-24T08:04:00.598839+0000","last_undegraded":"2023-11-24T08:04:00.598839+0000","last_fullsized":"2023-11-24T08:04:00.598839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.602431+0000","last_change":"2023-11-24T08:03:59.597467+0000","last_active":"2023-11-24T08:03:59.602431+0000","last_peered":"2023-11-24T08:03:59.602431+0000","last_clean":"2023-11-24T08:03:59.602431+0000","last_became_active":"2023-11-24T08:03:59.596875+0000","last_became_peered":"2023-11-24T08:03:59.596875+0000","last_unstale":"2023-11-24T08:03:59.602431+0000","last_undegraded":"2023-11-24T08:03:59.602431+0000","last_fullsized":"2023-11-24T08:03:59.602431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:24.485625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603758+0000","last_change":"2023-11-24T08:03:59.599402+0000","last_active":"2023-11-24T08:03:59.603758+0000","last_peered":"2023-11-24T08:03:59.603758+0000","last_clean":"2023-11-24T08:03:59.603758+0000","last_became_active":"2023-11-24T08:03:59.598995+0000","last_became_peered":"2023-11-24T08:03:59.598995+0000","last_unstale":"2023-11-24T08:03:59.603758+0000","last_undegraded":"2023-11-24T08:03:59.603758+0000","last_fullsized":"2023-11-24T08:03:59.603758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599523+0000","last_change":"2023-11-24T08:03:59.592092+0000","last_active":"2023-11-24T08:03:59.599523+0000","last_peered":"2023-11-24T08:03:59.599523+0000","last_clean":"2023-11-24T08:03:59.599523+0000","last_became_active":"2023-11-24T08:03:59.591623+0000","last_became_peered":"2023-11-24T08:03:59.591623+0000","last_unstale":"2023-11-24T08:03:59.599523+0000","last_undegraded":"2023-11-24T08:03:59.599523+0000","last_fullsized":"2023-11-24T08:03:59.599523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:56:37.898354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.598081+0000","last_change":"2023-11-24T08:03:59.591087+0000","last_active":"2023-11-24T08:03:59.598081+0000","last_peered":"2023-11-24T08:03:59.598081+0000","last_clean":"2023-11-24T08:03:59.598081+0000","last_became_active":"2023-11-24T08:03:59.590767+0000","last_became_peered":"2023-11-24T08:03:59.590767+0000","last_unstale":"2023-11-24T08:03:59.598081+0000","last_undegraded":"2023-11-24T08:03:59.598081+0000","last_fullsized":"2023-11-24T08:03:59.598081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:04.901296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605497+0000","last_change":"2023-11-24T08:03:59.595583+0000","last_active":"2023-11-24T08:03:59.605497+0000","last_peered":"2023-11-24T08:03:59.605497+0000","last_clean":"2023-11-24T08:03:59.605497+0000","last_became_active":"2023-11-24T08:03:59.595284+0000","last_became_peered":"2023-11-24T08:03:59.595284+0000","last_unstale":"2023-11-24T08:03:59.605497+0000","last_undegraded":"2023-11-24T08:03:59.605497+0000","last_fullsized":"2023-11-24T08:03:59.605497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.586834+0000","last_change":"2023-11-24T08:03:59.579548+0000","last_active":"2023-11-24T08:03:59.586834+0000","last_peered":"2023-11-24T08:03:59.586834+0000","last_clean":"2023-11-24T08:03:59.586834+0000","last_became_active":"2023-11-24T08:03:59.579263+0000","last_became_peered":"2023-11-24T08:03:59.579263+0000","last_unstale":"2023-11-24T08:03:59.586834+0000","last_undegraded":"2023-11-24T08:03:59.586834+0000","last_fullsized":"2023-11-24T08:03:59.586834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.606214+0000","last_change":"2023-11-24T08:03:59.598908+0000","last_active":"2023-11-24T08:03:59.606214+0000","last_peered":"2023-11-24T08:03:59.606214+0000","last_clean":"2023-11-24T08:03:59.606214+0000","last_became_active":"2023-11-24T08:03:59.598657+0000","last_became_peered":"2023-11-24T08:03:59.598657+0000","last_unstale":"2023-11-24T08:03:59.606214+0000","last_undegraded":"2023-11-24T08:03:59.606214+0000","last_fullsized":"2023-11-24T08:03:59.606214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603043+0000","last_change":"2023-11-24T08:03:59.598426+0000","last_active":"2023-11-24T08:03:59.603043+0000","last_peered":"2023-11-24T08:03:59.603043+0000","last_clean":"2023-11-24T08:03:59.603043+0000","last_became_active":"2023-11-24T08:03:59.598155+0000","last_became_peered":"2023-11-24T08:03:59.598155+0000","last_unstale":"2023-11-24T08:03:59.603043+0000","last_undegraded":"2023-11-24T08:03:59.603043+0000","last_fullsized":"2023-11-24T08:03:59.603043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:41.590643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596723+0000","last_change":"2023-11-24T08:03:59.588426+0000","last_active":"2023-11-24T08:03:59.596723+0000","last_peered":"2023-11-24T08:03:59.596723+0000","last_clean":"2023-11-24T08:03:59.596723+0000","last_became_active":"2023-11-24T08:03:59.588118+0000","last_became_peered":"2023-11-24T08:03:59.588118+0000","last_unstale":"2023-11-24T08:03:59.596723+0000","last_undegraded":"2023-11-24T08:03:59.596723+0000","last_fullsized":"2023-11-24T08:03:59.596723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.606244+0000","last_change":"2023-11-24T08:03:59.600156+0000","last_active":"2023-11-24T08:03:59.606244+0000","last_peered":"2023-11-24T08:03:59.606244+0000","last_clean":"2023-11-24T08:03:59.606244+0000","last_became_active":"2023-11-24T08:03:59.599912+0000","last_became_peered":"2023-11-24T08:03:59.599912+0000","last_unstale":"2023-11-24T08:03:59.606244+0000","last_undegraded":"2023-11-24T08:03:59.606244+0000","last_fullsized":"2023-11-24T08:03:59.606244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.583480+0000","last_change":"2023-11-24T08:03:59.581204+0000","last_active":"2023-11-24T08:03:59.583480+0000","last_peered":"2023-11-24T08:03:59.583480+0000","last_clean":"2023-11-24T08:03:59.583480+0000","last_became_active":"2023-11-24T08:03:59.580877+0000","last_became_peered":"2023-11-24T08:03:59.580877+0000","last_unstale":"2023-11-24T08:03:59.583480+0000","last_undegraded":"2023-11-24T08:03:59.583480+0000","last_fullsized":"2023-11-24T08:03:59.583480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:23:23.794371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590619+0000","last_change":"2023-11-24T08:03:59.579863+0000","last_active":"2023-11-24T08:03:59.590619+0000","last_peered":"2023-11-24T08:03:59.590619+0000","last_clean":"2023-11-24T08:03:59.590619+0000","last_became_active":"2023-11-24T08:03:59.579542+0000","last_became_peered":"2023-11-24T08:03:59.579542+0000","last_unstale":"2023-11-24T08:03:59.590619+0000","last_undegraded":"2023-11-24T08:03:59.590619+0000","last_fullsized":"2023-11-24T08:03:59.590619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598575+0000","last_change":"2023-11-24T08:03:59.595768+0000","last_active":"2023-11-24T08:04:00.598575+0000","last_peered":"2023-11-24T08:04:00.598575+0000","last_clean":"2023-11-24T08:04:00.598575+0000","last_became_active":"2023-11-24T08:03:59.594474+0000","last_became_peered":"2023-11-24T08:03:59.594474+0000","last_unstale":"2023-11-24T08:04:00.598575+0000","last_undegraded":"2023-11-24T08:04:00.598575+0000","last_fullsized":"2023-11-24T08:04:00.598575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592894+0000","last_change":"2023-11-24T08:03:59.584924+0000","last_active":"2023-11-24T08:03:59.592894+0000","last_peered":"2023-11-24T08:03:59.592894+0000","last_clean":"2023-11-24T08:03:59.592894+0000","last_became_active":"2023-11-24T08:03:59.584192+0000","last_became_peered":"2023-11-24T08:03:59.584192+0000","last_unstale":"2023-11-24T08:03:59.592894+0000","last_undegraded":"2023-11-24T08:03:59.592894+0000","last_fullsized":"2023-11-24T08:03:59.592894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:23.578718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595270+0000","last_change":"2023-11-24T08:03:59.594108+0000","last_active":"2023-11-24T08:04:00.595270+0000","last_peered":"2023-11-24T08:04:00.595270+0000","last_clean":"2023-11-24T08:04:00.595270+0000","last_became_active":"2023-11-24T08:03:59.593151+0000","last_became_peered":"2023-11-24T08:03:59.593151+0000","last_unstale":"2023-11-24T08:04:00.595270+0000","last_undegraded":"2023-11-24T08:04:00.595270+0000","last_fullsized":"2023-11-24T08:04:00.595270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.620623+0000","last_change":"2023-11-24T08:03:58.595372+0000","last_active":"2023-11-24T08:03:59.620623+0000","last_peered":"2023-11-24T08:03:59.620623+0000","last_clean":"2023-11-24T08:03:59.620623+0000","last_became_active":"2023-11-24T08:03:58.595011+0000","last_became_peered":"2023-11-24T08:03:58.595011+0000","last_unstale":"2023-11-24T08:03:59.620623+0000","last_undegraded":"2023-11-24T08:03:59.620623+0000","last_fullsized":"2023-11-24T08:03:59.620623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.607329+0000","last_change":"2023-11-24T08:03:59.604482+0000","last_active":"2023-11-24T08:03:59.607329+0000","last_peered":"2023-11-24T08:03:59.607329+0000","last_clean":"2023-11-24T08:03:59.607329+0000","last_became_active":"2023-11-24T08:03:59.604180+0000","last_became_peered":"2023-11-24T08:03:59.604180+0000","last_unstale":"2023-11-24T08:03:59.607329+0000","last_undegraded":"2023-11-24T08:03:59.607329+0000","last_fullsized":"2023-11-24T08:03:59.607329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:00:16.969108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.617113+0000","last_change":"2023-11-24T08:03:58.574383+0000","last_active":"2023-11-24T08:03:59.617113+0000","last_peered":"2023-11-24T08:03:59.617113+0000","last_clean":"2023-11-24T08:03:59.617113+0000","last_became_active":"2023-11-24T08:03:58.574059+0000","last_became_peered":"2023-11-24T08:03:58.574059+0000","last_unstale":"2023-11-24T08:03:59.617113+0000","last_undegraded":"2023-11-24T08:03:59.617113+0000","last_fullsized":"2023-11-24T08:03:59.617113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.578692+0000","last_change":"2023-11-24T08:03:58.591311+0000","last_active":"2023-11-24T08:03:59.578692+0000","last_peered":"2023-11-24T08:03:59.578692+0000","last_clean":"2023-11-24T08:03:59.578692+0000","last_became_active":"2023-11-24T08:03:58.590678+0000","last_became_peered":"2023-11-24T08:03:58.590678+0000","last_unstale":"2023-11-24T08:03:59.578692+0000","last_undegraded":"2023-11-24T08:03:59.578692+0000","last_fullsized":"2023-11-24T08:03:59.578692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596451+0000","last_change":"2023-11-24T08:03:59.584561+0000","last_active":"2023-11-24T08:03:59.596451+0000","last_peered":"2023-11-24T08:03:59.596451+0000","last_clean":"2023-11-24T08:03:59.596451+0000","last_became_active":"2023-11-24T08:03:59.584227+0000","last_became_peered":"2023-11-24T08:03:59.584227+0000","last_unstale":"2023-11-24T08:03:59.596451+0000","last_undegraded":"2023-11-24T08:03:59.596451+0000","last_fullsized":"2023-11-24T08:03:59.596451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.567598+0000","last_change":"2023-11-24T08:03:58.594517+0000","last_active":"2023-11-24T08:03:59.567598+0000","last_peered":"2023-11-24T08:03:59.567598+0000","last_clean":"2023-11-24T08:03:59.567598+0000","last_became_active":"2023-11-24T08:03:58.592799+0000","last_became_peered":"2023-11-24T08:03:58.592799+0000","last_unstale":"2023-11-24T08:03:59.567598+0000","last_undegraded":"2023-11-24T08:03:59.567598+0000","last_fullsized":"2023-11-24T08:03:59.567598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.591167+0000","last_change":"2023-11-24T08:03:59.587401+0000","last_active":"2023-11-24T08:03:59.591167+0000","last_peered":"2023-11-24T08:03:59.591167+0000","last_clean":"2023-11-24T08:03:59.591167+0000","last_became_active":"2023-11-24T08:03:59.587106+0000","last_became_peered":"2023-11-24T08:03:59.587106+0000","last_unstale":"2023-11-24T08:03:59.591167+0000","last_undegraded":"2023-11-24T08:03:59.591167+0000","last_fullsized":"2023-11-24T08:03:59.591167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.572533+0000","last_change":"2023-11-24T08:03:58.593371+0000","last_active":"2023-11-24T08:03:59.572533+0000","last_peered":"2023-11-24T08:03:59.572533+0000","last_clean":"2023-11-24T08:03:59.572533+0000","last_became_active":"2023-11-24T08:03:58.591545+0000","last_became_peered":"2023-11-24T08:03:58.591545+0000","last_unstale":"2023-11-24T08:03:59.572533+0000","last_undegraded":"2023-11-24T08:03:59.572533+0000","last_fullsized":"2023-11-24T08:03:59.572533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603059+0000","last_change":"2023-11-24T08:03:59.598485+0000","last_active":"2023-11-24T08:03:59.603059+0000","last_peered":"2023-11-24T08:03:59.603059+0000","last_clean":"2023-11-24T08:03:59.603059+0000","last_became_active":"2023-11-24T08:03:59.598252+0000","last_became_peered":"2023-11-24T08:03:59.598252+0000","last_unstale":"2023-11-24T08:03:59.603059+0000","last_undegraded":"2023-11-24T08:03:59.603059+0000","last_fullsized":"2023-11-24T08:03:59.603059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.567668+0000","last_change":"2023-11-24T08:03:58.588831+0000","last_active":"2023-11-24T08:03:59.567668+0000","last_peered":"2023-11-24T08:03:59.567668+0000","last_clean":"2023-11-24T08:03:59.567668+0000","last_became_active":"2023-11-24T08:03:58.588494+0000","last_became_peered":"2023-11-24T08:03:58.588494+0000","last_unstale":"2023-11-24T08:03:59.567668+0000","last_undegraded":"2023-11-24T08:03:59.567668+0000","last_fullsized":"2023-11-24T08:03:59.567668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:23.475033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597103+0000","last_change":"2023-11-24T08:03:59.586309+0000","last_active":"2023-11-24T08:03:59.597103+0000","last_peered":"2023-11-24T08:03:59.597103+0000","last_clean":"2023-11-24T08:03:59.597103+0000","last_became_active":"2023-11-24T08:03:59.585998+0000","last_became_peered":"2023-11-24T08:03:59.585998+0000","last_unstale":"2023-11-24T08:03:59.597103+0000","last_undegraded":"2023-11-24T08:03:59.597103+0000","last_fullsized":"2023-11-24T08:03:59.597103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:05.641493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615980+0000","last_change":"2023-11-24T08:03:58.592635+0000","last_active":"2023-11-24T08:03:59.615980+0000","last_peered":"2023-11-24T08:03:59.615980+0000","last_clean":"2023-11-24T08:03:59.615980+0000","last_became_active":"2023-11-24T08:03:58.592339+0000","last_became_peered":"2023-11-24T08:03:58.592339+0000","last_unstale":"2023-11-24T08:03:59.615980+0000","last_undegraded":"2023-11-24T08:03:59.615980+0000","last_fullsized":"2023-11-24T08:03:59.615980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595544+0000","last_change":"2023-11-24T08:03:59.600109+0000","last_active":"2023-11-24T08:04:00.595544+0000","last_peered":"2023-11-24T08:04:00.595544+0000","last_clean":"2023-11-24T08:04:00.595544+0000","last_became_active":"2023-11-24T08:03:59.599837+0000","last_became_peered":"2023-11-24T08:03:59.599837+0000","last_unstale":"2023-11-24T08:04:00.595544+0000","last_undegraded":"2023-11-24T08:04:00.595544+0000","last_fullsized":"2023-11-24T08:04:00.595544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.621912+0000","last_change":"2023-11-24T08:03:58.586653+0000","last_active":"2023-11-24T08:03:59.621912+0000","last_peered":"2023-11-24T08:03:59.621912+0000","last_clean":"2023-11-24T08:03:59.621912+0000","last_became_active":"2023-11-24T08:03:58.586327+0000","last_became_peered":"2023-11-24T08:03:58.586327+0000","last_unstale":"2023-11-24T08:03:59.621912+0000","last_undegraded":"2023-11-24T08:03:59.621912+0000","last_fullsized":"2023-11-24T08:03:59.621912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604423+0000","last_change":"2023-11-24T08:03:59.597689+0000","last_active":"2023-11-24T08:03:59.604423+0000","last_peered":"2023-11-24T08:03:59.604423+0000","last_clean":"2023-11-24T08:03:59.604423+0000","last_became_active":"2023-11-24T08:03:59.597176+0000","last_became_peered":"2023-11-24T08:03:59.597176+0000","last_unstale":"2023-11-24T08:03:59.604423+0000","last_undegraded":"2023-11-24T08:03:59.604423+0000","last_fullsized":"2023-11-24T08:03:59.604423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:49.358334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.620551+0000","last_change":"2023-11-24T08:03:58.577074+0000","last_active":"2023-11-24T08:03:59.620551+0000","last_peered":"2023-11-24T08:03:59.620551+0000","last_clean":"2023-11-24T08:03:59.620551+0000","last_became_active":"2023-11-24T08:03:58.576708+0000","last_became_peered":"2023-11-24T08:03:58.576708+0000","last_unstale":"2023-11-24T08:03:59.620551+0000","last_undegraded":"2023-11-24T08:03:59.620551+0000","last_fullsized":"2023-11-24T08:03:59.620551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:51:21.116952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599597+0000","last_change":"2023-11-24T08:03:59.592620+0000","last_active":"2023-11-24T08:03:59.599597+0000","last_peered":"2023-11-24T08:03:59.599597+0000","last_clean":"2023-11-24T08:03:59.599597+0000","last_became_active":"2023-11-24T08:03:59.592335+0000","last_became_peered":"2023-11-24T08:03:59.592335+0000","last_unstale":"2023-11-24T08:03:59.599597+0000","last_undegraded":"2023-11-24T08:03:59.599597+0000","last_fullsized":"2023-11-24T08:03:59.599597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:25:37.254861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.568329+0000","last_change":"2023-11-24T08:03:58.589858+0000","last_active":"2023-11-24T08:03:59.568329+0000","last_peered":"2023-11-24T08:03:59.568329+0000","last_clean":"2023-11-24T08:03:59.568329+0000","last_became_active":"2023-11-24T08:03:58.589555+0000","last_became_peered":"2023-11-24T08:03:58.589555+0000","last_unstale":"2023-11-24T08:03:59.568329+0000","last_undegraded":"2023-11-24T08:03:59.568329+0000","last_fullsized":"2023-11-24T08:03:59.568329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:42.320735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.607821+0000","last_change":"2023-11-24T08:03:59.602898+0000","last_active":"2023-11-24T08:03:59.607821+0000","last_peered":"2023-11-24T08:03:59.607821+0000","last_clean":"2023-11-24T08:03:59.607821+0000","last_became_active":"2023-11-24T08:03:59.602585+0000","last_became_peered":"2023-11-24T08:03:59.602585+0000","last_unstale":"2023-11-24T08:03:59.607821+0000","last_undegraded":"2023-11-24T08:03:59.607821+0000","last_fullsized":"2023-11-24T08:03:59.607821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.571891+0000","last_change":"2023-11-24T08:03:58.581293+0000","last_active":"2023-11-24T08:03:59.571891+0000","last_peered":"2023-11-24T08:03:59.571891+0000","last_clean":"2023-11-24T08:03:59.571891+0000","last_became_active":"2023-11-24T08:03:58.580548+0000","last_became_peered":"2023-11-24T08:03:58.580548+0000","last_unstale":"2023-11-24T08:03:59.571891+0000","last_undegraded":"2023-11-24T08:03:59.571891+0000","last_fullsized":"2023-11-24T08:03:59.571891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.592875+0000","last_change":"2023-11-24T08:03:59.584395+0000","last_active":"2023-11-24T08:03:59.592875+0000","last_peered":"2023-11-24T08:03:59.592875+0000","last_clean":"2023-11-24T08:03:59.592875+0000","last_became_active":"2023-11-24T08:03:59.583808+0000","last_became_peered":"2023-11-24T08:03:59.583808+0000","last_unstale":"2023-11-24T08:03:59.592875+0000","last_undegraded":"2023-11-24T08:03:59.592875+0000","last_fullsized":"2023-11-24T08:03:59.592875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598501+0000","last_change":"2023-11-24T08:03:58.580057+0000","last_active":"2023-11-24T08:04:00.598501+0000","last_peered":"2023-11-24T08:04:00.598501+0000","last_clean":"2023-11-24T08:04:00.598501+0000","last_became_active":"2023-11-24T08:03:58.579752+0000","last_became_peered":"2023-11-24T08:03:58.579752+0000","last_unstale":"2023-11-24T08:04:00.598501+0000","last_undegraded":"2023-11-24T08:04:00.598501+0000","last_fullsized":"2023-11-24T08:04:00.598501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:44.412407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.608421+0000","last_change":"2023-11-24T08:03:59.602642+0000","last_active":"2023-11-24T08:03:59.608421+0000","last_peered":"2023-11-24T08:03:59.608421+0000","last_clean":"2023-11-24T08:03:59.608421+0000","last_became_active":"2023-11-24T08:03:59.602383+0000","last_became_peered":"2023-11-24T08:03:59.602383+0000","last_unstale":"2023-11-24T08:03:59.608421+0000","last_undegraded":"2023-11-24T08:03:59.608421+0000","last_fullsized":"2023-11-24T08:03:59.608421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595740+0000","last_change":"2023-11-24T08:03:58.576485+0000","last_active":"2023-11-24T08:04:00.595740+0000","last_peered":"2023-11-24T08:04:00.595740+0000","last_clean":"2023-11-24T08:04:00.595740+0000","last_became_active":"2023-11-24T08:03:58.576148+0000","last_became_peered":"2023-11-24T08:03:58.576148+0000","last_unstale":"2023-11-24T08:04:00.595740+0000","last_undegraded":"2023-11-24T08:04:00.595740+0000","last_fullsized":"2023-11-24T08:04:00.595740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.608151+0000","last_change":"2023-11-24T08:03:59.605656+0000","last_active":"2023-11-24T08:03:59.608151+0000","last_peered":"2023-11-24T08:03:59.608151+0000","last_clean":"2023-11-24T08:03:59.608151+0000","last_became_active":"2023-11-24T08:03:59.605293+0000","last_became_peered":"2023-11-24T08:03:59.605293+0000","last_unstale":"2023-11-24T08:03:59.608151+0000","last_undegraded":"2023-11-24T08:03:59.608151+0000","last_fullsized":"2023-11-24T08:03:59.608151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598844+0000","last_change":"2023-11-24T08:03:58.590332+0000","last_active":"2023-11-24T08:04:00.598844+0000","last_peered":"2023-11-24T08:04:00.598844+0000","last_clean":"2023-11-24T08:04:00.598844+0000","last_became_active":"2023-11-24T08:03:58.587974+0000","last_became_peered":"2023-11-24T08:03:58.587974+0000","last_unstale":"2023-11-24T08:04:00.598844+0000","last_undegraded":"2023-11-24T08:04:00.598844+0000","last_fullsized":"2023-11-24T08:04:00.598844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.608694+0000","last_change":"2023-11-24T08:03:59.606241+0000","last_active":"2023-11-24T08:03:59.608694+0000","last_peered":"2023-11-24T08:03:59.608694+0000","last_clean":"2023-11-24T08:03:59.608694+0000","last_became_active":"2023-11-24T08:03:59.604149+0000","last_became_peered":"2023-11-24T08:03:59.604149+0000","last_unstale":"2023-11-24T08:03:59.608694+0000","last_undegraded":"2023-11-24T08:03:59.608694+0000","last_fullsized":"2023-11-24T08:03:59.608694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615366+0000","last_change":"2023-11-24T08:03:58.581525+0000","last_active":"2023-11-24T08:03:59.615366+0000","last_peered":"2023-11-24T08:03:59.615366+0000","last_clean":"2023-11-24T08:03:59.615366+0000","last_became_active":"2023-11-24T08:03:58.578531+0000","last_became_peered":"2023-11-24T08:03:58.578531+0000","last_unstale":"2023-11-24T08:03:59.615366+0000","last_undegraded":"2023-11-24T08:03:59.615366+0000","last_fullsized":"2023-11-24T08:03:59.615366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:12.928445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590464+0000","last_change":"2023-11-24T08:03:59.582239+0000","last_active":"2023-11-24T08:03:59.590464+0000","last_peered":"2023-11-24T08:03:59.590464+0000","last_clean":"2023-11-24T08:03:59.590464+0000","last_became_active":"2023-11-24T08:03:59.580468+0000","last_became_peered":"2023-11-24T08:03:59.580468+0000","last_unstale":"2023-11-24T08:03:59.590464+0000","last_undegraded":"2023-11-24T08:03:59.590464+0000","last_fullsized":"2023-11-24T08:03:59.590464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:49.358334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598701+0000","last_change":"2023-11-24T08:03:58.592974+0000","last_active":"2023-11-24T08:04:00.598701+0000","last_peered":"2023-11-24T08:04:00.598701+0000","last_clean":"2023-11-24T08:04:00.598701+0000","last_became_active":"2023-11-24T08:03:58.592300+0000","last_became_peered":"2023-11-24T08:03:58.592300+0000","last_unstale":"2023-11-24T08:04:00.598701+0000","last_undegraded":"2023-11-24T08:04:00.598701+0000","last_fullsized":"2023-11-24T08:04:00.598701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600553+0000","last_change":"2023-11-24T08:03:59.595203+0000","last_active":"2023-11-24T08:03:59.600553+0000","last_peered":"2023-11-24T08:03:59.600553+0000","last_clean":"2023-11-24T08:03:59.600553+0000","last_became_active":"2023-11-24T08:03:59.594780+0000","last_became_peered":"2023-11-24T08:03:59.594780+0000","last_unstale":"2023-11-24T08:03:59.600553+0000","last_undegraded":"2023-11-24T08:03:59.600553+0000","last_fullsized":"2023-11-24T08:03:59.600553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:41.590643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:03:58.580994+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:03:58.580994+0000","last_peered":"2023-11-24T08:03:58.580994+0000","last_clean":"2023-11-24T08:03:58.580994+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:03:58.580994+0000","last_undegraded":"2023-11-24T08:03:58.580994+0000","last_fullsized":"2023-11-24T08:03:58.580994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.567344+0000","last_change":"2023-11-24T08:03:58.590597+0000","last_active":"2023-11-24T08:03:59.567344+0000","last_peered":"2023-11-24T08:03:59.567344+0000","last_clean":"2023-11-24T08:03:59.567344+0000","last_became_active":"2023-11-24T08:03:58.590130+0000","last_became_peered":"2023-11-24T08:03:58.590130+0000","last_unstale":"2023-11-24T08:03:59.567344+0000","last_undegraded":"2023-11-24T08:03:59.567344+0000","last_fullsized":"2023-11-24T08:03:59.567344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.609107+0000","last_change":"2023-11-24T08:03:59.589854+0000","last_active":"2023-11-24T08:03:59.609107+0000","last_peered":"2023-11-24T08:03:59.609107+0000","last_clean":"2023-11-24T08:03:59.609107+0000","last_became_active":"2023-11-24T08:03:59.589630+0000","last_became_peered":"2023-11-24T08:03:59.589630+0000","last_unstale":"2023-11-24T08:03:59.609107+0000","last_undegraded":"2023-11-24T08:03:59.609107+0000","last_fullsized":"2023-11-24T08:03:59.609107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:04.901296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.579750+0000","last_change":"2023-11-24T08:03:58.593106+0000","last_active":"2023-11-24T08:03:59.579750+0000","last_peered":"2023-11-24T08:03:59.579750+0000","last_clean":"2023-11-24T08:03:59.579750+0000","last_became_active":"2023-11-24T08:03:58.592777+0000","last_became_peered":"2023-11-24T08:03:58.592777+0000","last_unstale":"2023-11-24T08:03:59.579750+0000","last_undegraded":"2023-11-24T08:03:59.579750+0000","last_fullsized":"2023-11-24T08:03:59.579750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:59.232039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605335+0000","last_change":"2023-11-24T08:03:59.594009+0000","last_active":"2023-11-24T08:03:59.605335+0000","last_peered":"2023-11-24T08:03:59.605335+0000","last_clean":"2023-11-24T08:03:59.605335+0000","last_became_active":"2023-11-24T08:03:59.593697+0000","last_became_peered":"2023-11-24T08:03:59.593697+0000","last_unstale":"2023-11-24T08:03:59.605335+0000","last_undegraded":"2023-11-24T08:03:59.605335+0000","last_fullsized":"2023-11-24T08:03:59.605335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:24.954870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598642+0000","last_change":"2023-11-24T08:03:58.590726+0000","last_active":"2023-11-24T08:04:00.598642+0000","last_peered":"2023-11-24T08:04:00.598642+0000","last_clean":"2023-11-24T08:04:00.598642+0000","last_became_active":"2023-11-24T08:03:58.590385+0000","last_became_peered":"2023-11-24T08:03:58.590385+0000","last_unstale":"2023-11-24T08:04:00.598642+0000","last_undegraded":"2023-11-24T08:04:00.598642+0000","last_fullsized":"2023-11-24T08:04:00.598642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:19.226023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.603256+0000","last_change":"2023-11-24T08:03:59.594256+0000","last_active":"2023-11-24T08:03:59.603256+0000","last_peered":"2023-11-24T08:03:59.603256+0000","last_clean":"2023-11-24T08:03:59.603256+0000","last_became_active":"2023-11-24T08:03:59.593902+0000","last_became_peered":"2023-11-24T08:03:59.593902+0000","last_unstale":"2023-11-24T08:03:59.603256+0000","last_undegraded":"2023-11-24T08:03:59.603256+0000","last_fullsized":"2023-11-24T08:03:59.603256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.568323+0000","last_change":"2023-11-24T08:03:58.589309+0000","last_active":"2023-11-24T08:03:59.568323+0000","last_peered":"2023-11-24T08:03:59.568323+0000","last_clean":"2023-11-24T08:03:59.568323+0000","last_became_active":"2023-11-24T08:03:58.588917+0000","last_became_peered":"2023-11-24T08:03:58.588917+0000","last_unstale":"2023-11-24T08:03:59.568323+0000","last_undegraded":"2023-11-24T08:03:59.568323+0000","last_fullsized":"2023-11-24T08:03:59.568323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595434+0000","last_change":"2023-11-24T08:03:59.597797+0000","last_active":"2023-11-24T08:04:00.595434+0000","last_peered":"2023-11-24T08:04:00.595434+0000","last_clean":"2023-11-24T08:04:00.595434+0000","last_became_active":"2023-11-24T08:03:59.597491+0000","last_became_peered":"2023-11-24T08:03:59.597491+0000","last_unstale":"2023-11-24T08:04:00.595434+0000","last_undegraded":"2023-11-24T08:04:00.595434+0000","last_fullsized":"2023-11-24T08:04:00.595434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580347+0000","last_change":"2023-11-24T08:03:58.581746+0000","last_active":"2023-11-24T08:03:59.580347+0000","last_peered":"2023-11-24T08:03:59.580347+0000","last_clean":"2023-11-24T08:03:59.580347+0000","last_became_active":"2023-11-24T08:03:58.578821+0000","last_became_peered":"2023-11-24T08:03:58.578821+0000","last_unstale":"2023-11-24T08:03:59.580347+0000","last_undegraded":"2023-11-24T08:03:59.580347+0000","last_fullsized":"2023-11-24T08:03:59.580347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.590733+0000","last_change":"2023-11-24T08:03:59.584022+0000","last_active":"2023-11-24T08:03:59.590733+0000","last_peered":"2023-11-24T08:03:59.590733+0000","last_clean":"2023-11-24T08:03:59.590733+0000","last_became_active":"2023-11-24T08:03:59.583697+0000","last_became_peered":"2023-11-24T08:03:59.583697+0000","last_unstale":"2023-11-24T08:03:59.590733+0000","last_undegraded":"2023-11-24T08:03:59.590733+0000","last_fullsized":"2023-11-24T08:03:59.590733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:13.939038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.583072+0000","last_change":"2023-11-24T08:03:58.595698+0000","last_active":"2023-11-24T08:03:59.583072+0000","last_peered":"2023-11-24T08:03:59.583072+0000","last_clean":"2023-11-24T08:03:59.583072+0000","last_became_active":"2023-11-24T08:03:58.595445+0000","last_became_peered":"2023-11-24T08:03:58.595445+0000","last_unstale":"2023-11-24T08:03:59.583072+0000","last_undegraded":"2023-11-24T08:03:59.583072+0000","last_fullsized":"2023-11-24T08:03:59.583072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.664977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597608+0000","last_change":"2023-11-24T08:03:59.591006+0000","last_active":"2023-11-24T08:03:59.597608+0000","last_peered":"2023-11-24T08:03:59.597608+0000","last_clean":"2023-11-24T08:03:59.597608+0000","last_became_active":"2023-11-24T08:03:59.590697+0000","last_became_peered":"2023-11-24T08:03:59.590697+0000","last_unstale":"2023-11-24T08:03:59.597608+0000","last_undegraded":"2023-11-24T08:03:59.597608+0000","last_fullsized":"2023-11-24T08:03:59.597608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:04.901296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580990+0000","last_change":"2023-11-24T08:03:58.585471+0000","last_active":"2023-11-24T08:03:59.580990+0000","last_peered":"2023-11-24T08:03:59.580990+0000","last_clean":"2023-11-24T08:03:59.580990+0000","last_became_active":"2023-11-24T08:03:58.584512+0000","last_became_peered":"2023-11-24T08:03:58.584512+0000","last_unstale":"2023-11-24T08:03:59.580990+0000","last_undegraded":"2023-11-24T08:03:59.580990+0000","last_fullsized":"2023-11-24T08:03:59.580990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605550+0000","last_change":"2023-11-24T08:03:59.597245+0000","last_active":"2023-11-24T08:03:59.605550+0000","last_peered":"2023-11-24T08:03:59.605550+0000","last_clean":"2023-11-24T08:03:59.605550+0000","last_became_active":"2023-11-24T08:03:59.596949+0000","last_became_peered":"2023-11-24T08:03:59.596949+0000","last_unstale":"2023-11-24T08:03:59.605550+0000","last_undegraded":"2023-11-24T08:03:59.605550+0000","last_fullsized":"2023-11-24T08:03:59.605550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.614765+0000","last_change":"2023-11-24T08:03:58.587720+0000","last_active":"2023-11-24T08:03:59.614765+0000","last_peered":"2023-11-24T08:03:59.614765+0000","last_clean":"2023-11-24T08:03:59.614765+0000","last_became_active":"2023-11-24T08:03:58.587501+0000","last_became_peered":"2023-11-24T08:03:58.587501+0000","last_unstale":"2023-11-24T08:03:59.614765+0000","last_undegraded":"2023-11-24T08:03:59.614765+0000","last_fullsized":"2023-11-24T08:03:59.614765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:19.371283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.599556+0000","last_change":"2023-11-24T08:03:59.592131+0000","last_active":"2023-11-24T08:03:59.599556+0000","last_peered":"2023-11-24T08:03:59.599556+0000","last_clean":"2023-11-24T08:03:59.599556+0000","last_became_active":"2023-11-24T08:03:59.591709+0000","last_became_peered":"2023-11-24T08:03:59.591709+0000","last_unstale":"2023-11-24T08:03:59.599556+0000","last_undegraded":"2023-11-24T08:03:59.599556+0000","last_fullsized":"2023-11-24T08:03:59.599556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:05.870891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580255+0000","last_change":"2023-11-24T08:03:58.592505+0000","last_active":"2023-11-24T08:03:59.580255+0000","last_peered":"2023-11-24T08:03:59.580255+0000","last_clean":"2023-11-24T08:03:59.580255+0000","last_became_active":"2023-11-24T08:03:58.592097+0000","last_became_peered":"2023-11-24T08:03:58.592097+0000","last_unstale":"2023-11-24T08:03:59.580255+0000","last_undegraded":"2023-11-24T08:03:59.580255+0000","last_fullsized":"2023-11-24T08:03:59.580255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595333+0000","last_change":"2023-11-24T08:03:59.590194+0000","last_active":"2023-11-24T08:04:00.595333+0000","last_peered":"2023-11-24T08:04:00.595333+0000","last_clean":"2023-11-24T08:04:00.595333+0000","last_became_active":"2023-11-24T08:03:59.589879+0000","last_became_peered":"2023-11-24T08:03:59.589879+0000","last_unstale":"2023-11-24T08:04:00.595333+0000","last_undegraded":"2023-11-24T08:04:00.595333+0000","last_fullsized":"2023-11-24T08:04:00.595333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.580567+0000","last_change":"2023-11-24T08:03:58.593989+0000","last_active":"2023-11-24T08:03:59.580567+0000","last_peered":"2023-11-24T08:03:59.580567+0000","last_clean":"2023-11-24T08:03:59.580567+0000","last_became_active":"2023-11-24T08:03:58.593641+0000","last_became_peered":"2023-11-24T08:03:58.593641+0000","last_unstale":"2023-11-24T08:03:59.580567+0000","last_undegraded":"2023-11-24T08:03:59.580567+0000","last_fullsized":"2023-11-24T08:03:59.580567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.605040+0000","last_change":"2023-11-24T08:03:59.588962+0000","last_active":"2023-11-24T08:03:59.605040+0000","last_peered":"2023-11-24T08:03:59.605040+0000","last_clean":"2023-11-24T08:03:59.605040+0000","last_became_active":"2023-11-24T08:03:59.588405+0000","last_became_peered":"2023-11-24T08:03:59.588405+0000","last_unstale":"2023-11-24T08:03:59.605040+0000","last_undegraded":"2023-11-24T08:03:59.605040+0000","last_fullsized":"2023-11-24T08:03:59.605040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:45.422999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.581648+0000","last_change":"2023-11-24T08:03:58.589209+0000","last_active":"2023-11-24T08:03:59.581648+0000","last_peered":"2023-11-24T08:03:59.581648+0000","last_clean":"2023-11-24T08:03:59.581648+0000","last_became_active":"2023-11-24T08:03:58.588034+0000","last_became_peered":"2023-11-24T08:03:58.588034+0000","last_unstale":"2023-11-24T08:03:59.581648+0000","last_undegraded":"2023-11-24T08:03:59.581648+0000","last_fullsized":"2023-11-24T08:03:59.581648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596766+0000","last_change":"2023-11-24T08:03:59.584679+0000","last_active":"2023-11-24T08:03:59.596766+0000","last_peered":"2023-11-24T08:03:59.596766+0000","last_clean":"2023-11-24T08:03:59.596766+0000","last_became_active":"2023-11-24T08:03:59.584311+0000","last_became_peered":"2023-11-24T08:03:59.584311+0000","last_unstale":"2023-11-24T08:03:59.596766+0000","last_undegraded":"2023-11-24T08:03:59.596766+0000","last_fullsized":"2023-11-24T08:03:59.596766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615017+0000","last_change":"2023-11-24T08:03:58.593136+0000","last_active":"2023-11-24T08:03:59.615017+0000","last_peered":"2023-11-24T08:03:59.615017+0000","last_clean":"2023-11-24T08:03:59.615017+0000","last_became_active":"2023-11-24T08:03:58.592737+0000","last_became_peered":"2023-11-24T08:03:58.592737+0000","last_unstale":"2023-11-24T08:03:59.615017+0000","last_undegraded":"2023-11-24T08:03:59.615017+0000","last_fullsized":"2023-11-24T08:03:59.615017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.600973+0000","last_change":"2023-11-24T08:03:59.595926+0000","last_active":"2023-11-24T08:03:59.600973+0000","last_peered":"2023-11-24T08:03:59.600973+0000","last_clean":"2023-11-24T08:03:59.600973+0000","last_became_active":"2023-11-24T08:03:59.595576+0000","last_became_peered":"2023-11-24T08:03:59.595576+0000","last_unstale":"2023-11-24T08:03:59.600973+0000","last_undegraded":"2023-11-24T08:03:59.600973+0000","last_fullsized":"2023-11-24T08:03:59.600973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:20.236615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.601340+0000","last_change":"2023-11-24T08:03:59.596718+0000","last_active":"2023-11-24T08:03:59.601340+0000","last_peered":"2023-11-24T08:03:59.601340+0000","last_clean":"2023-11-24T08:03:59.601340+0000","last_became_active":"2023-11-24T08:03:59.596430+0000","last_became_peered":"2023-11-24T08:03:59.596430+0000","last_unstale":"2023-11-24T08:03:59.601340+0000","last_undegraded":"2023-11-24T08:03:59.601340+0000","last_fullsized":"2023-11-24T08:03:59.601340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.615697+0000","last_change":"2023-11-24T08:03:58.595326+0000","last_active":"2023-11-24T08:03:59.615697+0000","last_peered":"2023-11-24T08:03:59.615697+0000","last_clean":"2023-11-24T08:03:59.615697+0000","last_became_active":"2023-11-24T08:03:58.593856+0000","last_became_peered":"2023-11-24T08:03:58.593856+0000","last_unstale":"2023-11-24T08:03:59.615697+0000","last_undegraded":"2023-11-24T08:03:59.615697+0000","last_fullsized":"2023-11-24T08:03:59.615697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.604206+0000","last_change":"2023-11-24T08:03:59.600352+0000","last_active":"2023-11-24T08:03:59.604206+0000","last_peered":"2023-11-24T08:03:59.604206+0000","last_clean":"2023-11-24T08:03:59.604206+0000","last_became_active":"2023-11-24T08:03:59.599271+0000","last_became_peered":"2023-11-24T08:03:59.599271+0000","last_unstale":"2023-11-24T08:03:59.604206+0000","last_undegraded":"2023-11-24T08:03:59.604206+0000","last_fullsized":"2023-11-24T08:03:59.604206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.612451+0000","last_change":"2023-11-24T08:03:58.595226+0000","last_active":"2023-11-24T08:03:59.612451+0000","last_peered":"2023-11-24T08:03:59.612451+0000","last_clean":"2023-11-24T08:03:59.612451+0000","last_became_active":"2023-11-24T08:03:58.593565+0000","last_became_peered":"2023-11-24T08:03:58.593565+0000","last_unstale":"2023-11-24T08:03:59.612451+0000","last_undegraded":"2023-11-24T08:03:59.612451+0000","last_fullsized":"2023-11-24T08:03:59.612451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.597122+0000","last_change":"2023-11-24T08:03:59.586457+0000","last_active":"2023-11-24T08:03:59.597122+0000","last_peered":"2023-11-24T08:03:59.597122+0000","last_clean":"2023-11-24T08:03:59.597122+0000","last_became_active":"2023-11-24T08:03:59.586176+0000","last_became_peered":"2023-11-24T08:03:59.586176+0000","last_unstale":"2023-11-24T08:03:59.597122+0000","last_undegraded":"2023-11-24T08:03:59.597122+0000","last_fullsized":"2023-11-24T08:03:59.597122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:56:35.740304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.621203+0000","last_change":"2023-11-24T08:03:58.587271+0000","last_active":"2023-11-24T08:03:59.621203+0000","last_peered":"2023-11-24T08:03:59.621203+0000","last_clean":"2023-11-24T08:03:59.621203+0000","last_became_active":"2023-11-24T08:03:58.586888+0000","last_became_peered":"2023-11-24T08:03:58.586888+0000","last_unstale":"2023-11-24T08:03:59.621203+0000","last_undegraded":"2023-11-24T08:03:59.621203+0000","last_fullsized":"2023-11-24T08:03:59.621203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.596425+0000","last_change":"2023-11-24T08:03:59.585467+0000","last_active":"2023-11-24T08:03:59.596425+0000","last_peered":"2023-11-24T08:03:59.596425+0000","last_clean":"2023-11-24T08:03:59.596425+0000","last_became_active":"2023-11-24T08:03:59.585159+0000","last_became_peered":"2023-11-24T08:03:59.585159+0000","last_unstale":"2023-11-24T08:03:59.596425+0000","last_undegraded":"2023-11-24T08:03:59.596425+0000","last_fullsized":"2023-11-24T08:03:59.596425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:29.455296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.619450+0000","last_change":"2023-11-24T08:03:58.589593+0000","last_active":"2023-11-24T08:03:59.619450+0000","last_peered":"2023-11-24T08:03:59.619450+0000","last_clean":"2023-11-24T08:03:59.619450+0000","last_became_active":"2023-11-24T08:03:58.588864+0000","last_became_peered":"2023-11-24T08:03:58.588864+0000","last_unstale":"2023-11-24T08:03:59.619450+0000","last_undegraded":"2023-11-24T08:03:59.619450+0000","last_fullsized":"2023-11-24T08:03:59.619450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:11.240162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":665573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":74783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":658216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.880000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.5830000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3959999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.0299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7839999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:04.105 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:04:04.106 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T08:04:04.106 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T08:04:04.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T08:04:04.108 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T08:04:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25c0b0f640 1 Processor -- start 2023-11-24T08:04:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25c0b0f640 1 -- start start 2023-11-24T08:04:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25c0b0f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc0b36c0 0x7f25bc0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25c0b0f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc15a700 con 0x7f25bc070da0 2023-11-24T08:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25c0b0f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc0b2620 con 0x7f25bc15a320 2023-11-24T08:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25c0b0f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc0b2430 con 0x7f25bc0b36c0 2023-11-24T08:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25bad9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f25bc070da0 0x7f25bc15ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51136/0 (socket says 172.21.15.57:51136) 2023-11-24T08:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.284+0000 7f25bad9d640 1 -- 172.21.15.57:0/1410921670 learned_addr learned my addr 172.21.15.57:0/1410921670 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b3fff640 1 --2- 172.21.15.57:0/1410921670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc0b36c0 0x7f25bc0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637859054 0 0) 0x7f25bc15a700 con 0x7f25bc070da0 2023-11-24T08:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a8005740 con 0x7f25bc070da0 2023-11-24T08:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699361195 0 0) 0x7f25bc0b2620 con 0x7f25bc15a320 2023-11-24T08:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25bc15a700 con 0x7f25bc15a320 2023-11-24T08:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b3fff640 1 -- 172.21.15.57:0/1410921670 >> v1:172.21.15.132:6789/0 conn(0x7f25bc15a320 legacy=0x7f25bc070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b3fff640 1 -- 172.21.15.57:0/1410921670 >> v1:172.21.15.57:6789/0 conn(0x7f25bc070da0 legacy=0x7f25bc15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805088344 0 0) 0x7f25a8005740 con 0x7f25bc070da0 2023-11-24T08:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b3fff640 1 -- 172.21.15.57:0/1410921670 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0b2900 con 0x7f25bc0b36c0 2023-11-24T08:04:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b3fff640 1 --2- 172.21.15.57:0/1410921670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc0b36c0 0x7f25bc0b1ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25a40097f0 tx=0x7f25a401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34dd5f890fe17220 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4001a00 con 0x7f25bc0b36c0 2023-11-24T08:04:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40a7050 con 0x7f25bc0b36c0 2023-11-24T08:04:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.288+0000 7f25b9d9b640 1 -- 172.21.15.57:0/1410921670 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4004250 con 0x7f25bc0b36c0 2023-11-24T08:04:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- 172.21.15.57:0/1410921670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc0b36c0 msgr2=0x7f25bc0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/1410921670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc0b36c0 0x7f25bc0b1ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25a40097f0 tx=0x7f25a401c3b0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- 172.21.15.57:0/1410921670 shutdown_connections 2023-11-24T08:04:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/1410921670 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc0b36c0 0x7f25bc0b1ef0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- 172.21.15.57:0/1410921670 >> 172.21.15.57:0/1410921670 conn(0x7f25bc0b0bf0 msgr2=0x7f25bc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- 172.21.15.57:0/1410921670 shutdown_connections 2023-11-24T08:04:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- 172.21.15.57:0/1410921670 wait complete. 2023-11-24T08:04:04.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 Processor -- start 2023-11-24T08:04:04.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- start start 2023-11-24T08:04:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc070da0 0x7f25bc1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25bc0b36c0 0x7f25bc09ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25bc15a320 0x7f25bc155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc155a60 con 0x7f25bc15a320 2023-11-24T08:04:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc155d00 con 0x7f25bc0b36c0 2023-11-24T08:04:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25c0b0f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc155fe0 con 0x7f25bc070da0 2023-11-24T08:04:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25bc15a320 0x7f25bc155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25bc15a320 0x7f25bc155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42742/0 (socket says 172.21.15.57:42742) 2023-11-24T08:04:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 -- 172.21.15.57:0/3261324180 learned_addr learned my addr 172.21.15.57:0/3261324180 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25ba59c640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc070da0 0x7f25bc1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25b3fff640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25bc0b36c0 0x7f25bc09ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 -- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc070da0 msgr2=0x7f25bc1507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc070da0 0x7f25bc1507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 -- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25bc0b36c0 msgr2=0x7f25bc09ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25bc0b36c0 0x7f25bc09ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.292+0000 7f25bad9d640 1 -- 172.21.15.57:0/3261324180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009420 con 0x7f25bc15a320 2023-11-24T08:04:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25bad9d640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25bc15a320 0x7f25bc155520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25b4001fb0 tx=0x7f25b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25b2ffd640 1 -- 172.21.15.57:0/3261324180 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4012400 con 0x7f25bc15a320 2023-11-24T08:04:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25b2ffd640 1 -- 172.21.15.57:0/3261324180 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4012560 con 0x7f25bc15a320 2023-11-24T08:04:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25b2ffd640 1 -- 172.21.15.57:0/3261324180 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4012910 con 0x7f25bc15a320 2023-11-24T08:04:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc1562c0 con 0x7f25bc15a320 2023-11-24T08:04:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc156880 con 0x7f25bc15a320 2023-11-24T08:04:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc067520 con 0x7f25bc15a320 2023-11-24T08:04:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25b2ffd640 1 -- 172.21.15.57:0/3261324180 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25b4012a70 con 0x7f25bc15a320 2023-11-24T08:04:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25b2ffd640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f259c066470 0x7f259c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.296+0000 7f25b2ffd640 1 -- 172.21.15.57:0/3261324180 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b40846a0 con 0x7f25bc15a320 2023-11-24T08:04:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.300+0000 7f25ba59c640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f259c066470 0x7f259c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.300+0000 7f25ba59c640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f259c066470 0x7f259c068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0011f0 tx=0x7f25ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.300+0000 7f25b2ffd640 1 -- 172.21.15.57:0/3261324180 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25b4051bc0 con 0x7f25bc15a320 2023-11-24T08:04:04.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.496+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f25bc156a70 con 0x7f25bc15a320 2023-11-24T08:04:04.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25b2ffd640 1 -- 172.21.15.57:0/3261324180 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164436 (secure 0 0 0) 0x7f25b40551e0 con 0x7f25bc15a320 2023-11-24T08:04:04.502 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:04.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f259c066470 msgr2=0x7f259c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f259c066470 0x7f259c068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0011f0 tx=0x7f25ac009040 comp rx=0 tx=0).stop 2023-11-24T08:04:04.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25bc15a320 msgr2=0x7f25bc155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25bc15a320 0x7f25bc155520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25b4001fb0 tx=0x7f25b400a430 comp rx=0 tx=0).stop 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 shutdown_connections 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f259c066470 0x7f259c068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25bc15a320 0x7f25bc155520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25bc0b36c0 0x7f25bc09ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 --2- 172.21.15.57:0/3261324180 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25bc070da0 0x7f25bc1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 >> 172.21.15.57:0/3261324180 conn(0x7f25bc0b0bf0 msgr2=0x7f25bc06d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 shutdown_connections 2023-11-24T08:04:04.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.500+0000 7f25c0b0f640 1 -- 172.21.15.57:0/3261324180 wait complete. 2023-11-24T08:04:04.523 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":917156864},{"type":"v1","addr":"172.21.15.132:6833","nonce":917156864}]},"active_addr":"172.21.15.132:6833/917156864","active_change":"2023-11-24T08:03:38.662768+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3501022978}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":2926822436}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3864620539}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":2743871872}]}]} 2023-11-24T08:04:04.526 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T08:04:04.526 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T08:04:04.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:04.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.668+0000 7f20c0868640 1 Processor -- start 2023-11-24T08:04:04.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.668+0000 7f20c0868640 1 -- start start 2023-11-24T08:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20c0868640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20c0868640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20bc0ce8b0 0x7f20bc0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20c0868640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc0d1cc0 con 0x7f20bc0d3020 2023-11-24T08:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20c0868640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc0d1fa0 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20c0868640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0ce0b0 con 0x7f20bc15d570 2023-11-24T08:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20bad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20bc0ce8b0 0x7f20bc0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20ba59c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20bad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20bc0ce8b0 0x7f20bc0ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44688/0 (socket says 172.21.15.57:44688) 2023-11-24T08:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20b3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f20bc0d3020 0x7f20bc0d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:51614/0 (socket says 172.21.15.57:51614) 2023-11-24T08:04:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20bad9d640 1 -- 172.21.15.57:0/1698617391 learned_addr learned my addr 172.21.15.57:0/1698617391 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20ba59c640 1 --2- 172.21.15.57:0/1698617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc06b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:39408/0 (socket says 172.21.15.57:39408) 2023-11-24T08:04:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20ba59c640 1 -- 172.21.15.57:0/1698617391 >> v2:172.21.15.132:3300/0 conn(0x7f20bc0ce8b0 msgr2=0x7f20bc0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20ba59c640 1 --2- 172.21.15.57:0/1698617391 >> v2:172.21.15.132:3300/0 conn(0x7f20bc0ce8b0 0x7f20bc0ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20b9d9b640 1 -- 172.21.15.57:0/1698617391 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439540203 0 0) 0x7f20bc0d1cc0 con 0x7f20bc0d3020 2023-11-24T08:04:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20ba59c640 1 -- 172.21.15.57:0/1698617391 >> v1:172.21.15.132:6789/0 conn(0x7f20bc0d3020 legacy=0x7f20bc0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20ba59c640 1 -- 172.21.15.57:0/1698617391 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc0ce390 con 0x7f20bc15d570 2023-11-24T08:04:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.672+0000 7f20bad9d640 1 --2- 172.21.15.57:0/1698617391 >> v2:172.21.15.132:3300/0 conn(0x7f20bc0ce8b0 0x7f20bc0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20ba59c640 1 --2- 172.21.15.57:0/1698617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc06b9d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0097c0 tx=0x7f20ac01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501b2d8a102a20a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20b9d9b640 1 -- 172.21.15.57:0/1698617391 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0ab660 con 0x7f20bc15d570 2023-11-24T08:04:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20b9d9b640 1 -- 172.21.15.57:0/1698617391 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac0ab7c0 con 0x7f20bc15d570 2023-11-24T08:04:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20b9d9b640 1 -- 172.21.15.57:0/1698617391 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0abb50 con 0x7f20bc15d570 2023-11-24T08:04:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 -- 172.21.15.57:0/1698617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 msgr2=0x7f20bc06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 --2- 172.21.15.57:0/1698617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc06b9d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0097c0 tx=0x7f20ac01c480 comp rx=0 tx=0).stop 2023-11-24T08:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 -- 172.21.15.57:0/1698617391 shutdown_connections 2023-11-24T08:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 --2- 172.21.15.57:0/1698617391 >> v2:172.21.15.132:3300/0 conn(0x7f20bc0ce8b0 0x7f20bc0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 --2- 172.21.15.57:0/1698617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc06b9d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 -- 172.21.15.57:0/1698617391 >> 172.21.15.57:0/1698617391 conn(0x7f20bc08ceb0 msgr2=0x7f20bc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 -- 172.21.15.57:0/1698617391 shutdown_connections 2023-11-24T08:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 -- 172.21.15.57:0/1698617391 wait complete. 2023-11-24T08:04:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 Processor -- start 2023-11-24T08:04:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.676+0000 7f20c0868640 1 -- start start 2023-11-24T08:04:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20bc0ce8b0 0x7f20bc0b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20bc0d3020 0x7f20bc0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc0b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc158230 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0b8e80 con 0x7f20bc0d3020 2023-11-24T08:04:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc157620 con 0x7f20bc15d570 2023-11-24T08:04:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20bc0ce8b0 0x7f20bc0b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20bc0ce8b0 0x7f20bc0b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42752/0 (socket says 172.21.15.57:42752) 2023-11-24T08:04:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 -- 172.21.15.57:0/3128000020 learned_addr learned my addr 172.21.15.57:0/3128000020 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20bad9d640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc0b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20b3fff640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20bc0d3020 0x7f20bc0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 -- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 msgr2=0x7f20bc0b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc0b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 -- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20bc0d3020 msgr2=0x7f20bc0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20bc0d3020 0x7f20bc0b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 -- 172.21.15.57:0/3128000020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4009b30 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20ba59c640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20bc0ce8b0 0x7f20bc0b8940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f20ac01ab30 tx=0x7f20ac019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20b2ffd640 1 -- 172.21.15.57:0/3128000020 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0abd40 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20b2ffd640 1 -- 172.21.15.57:0/3128000020 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac0bf450 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20b2ffd640 1 -- 172.21.15.57:0/3128000020 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0abea0 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac009420 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc157be0 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc067520 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.680+0000 7f20b2ffd640 1 -- 172.21.15.57:0/3128000020 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20ac0a9070 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.684+0000 7f20b2ffd640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f209c066470 0x7f209c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.684+0000 7f20b2ffd640 1 -- 172.21.15.57:0/3128000020 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20ac11dff0 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.684+0000 7f20b3fff640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f209c066470 0x7f209c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.684+0000 7f20b3fff640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f209c066470 0x7f209c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0d05c0 tx=0x7f20a4007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.688+0000 7f20b2ffd640 1 -- 172.21.15.57:0/3128000020 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20ac0eb4a0 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.848+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20bc06b7b0 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.848+0000 7f20b2ffd640 1 -- 172.21.15.57:0/3128000020 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f20ac0eeac0 con 0x7f20bc0ce8b0 2023-11-24T08:04:04.850 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:04.851 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f209c066470 msgr2=0x7f209c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f209c066470 0x7f209c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0d05c0 tx=0x7f20a4007d60 comp rx=0 tx=0).stop 2023-11-24T08:04:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20bc0ce8b0 msgr2=0x7f20bc0b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20bc0ce8b0 0x7f20bc0b8940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f20ac01ab30 tx=0x7f20ac019220 comp rx=0 tx=0).stop 2023-11-24T08:04:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 shutdown_connections 2023-11-24T08:04:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f209c066470 0x7f209c068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20bc15d570 0x7f20bc0b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20bc0d3020 0x7f20bc0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 --2- 172.21.15.57:0/3128000020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20bc0ce8b0 0x7f20bc0b8940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 >> 172.21.15.57:0/3128000020 conn(0x7f20bc08ceb0 msgr2=0x7f20bc0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 shutdown_connections 2023-11-24T08:04:04.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:04.852+0000 7f20c0868640 1 -- 172.21.15.57:0/3128000020 wait complete. 2023-11-24T08:04:04.874 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T08:04:04.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:05.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c9ebb640 1 Processor -- start 2023-11-24T08:04:05.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c9ebb640 1 -- start start 2023-11-24T08:04:05.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c9ebb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c9ebb640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5c4070da0 0x7fc5c415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c9ebb640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c415a700 con 0x7fc5c40b36c0 2023-11-24T08:04:05.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c9ebb640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40b2430 con 0x7fc5c4070da0 2023-11-24T08:04:05.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c9ebb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40b2620 con 0x7fc5c415a320 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5c4070da0 0x7fc5c415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5c4070da0 0x7fc5c415ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42762/0 (socket says 172.21.15.57:42762) 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c3fff640 1 -- 172.21.15.57:0/1635846393 learned_addr learned my addr 172.21.15.57:0/1635846393 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c2ffd640 1 --1- 172.21.15.57:0/1635846393 >> v1:172.21.15.57:6789/0 conn(0x7fc5c40b36c0 0x7fc5c4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51140/0 (socket says 172.21.15.57:51140) 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.016+0000 7fc5c37fe640 1 --2- 172.21.15.57:0/1635846393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c3fff640 1 -- 172.21.15.57:0/1635846393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 msgr2=0x7fc5c40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c3fff640 1 --2- 172.21.15.57:0/1635846393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c3fff640 1 -- 172.21.15.57:0/1635846393 >> v1:172.21.15.57:6789/0 conn(0x7fc5c40b36c0 legacy=0x7fc5c4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c3fff640 1 -- 172.21.15.57:0/1635846393 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40b2900 con 0x7fc5c4070da0 2023-11-24T08:04:05.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c27fc640 1 -- 172.21.15.57:0/1635846393 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277901254 0 0) 0x7fc5c415a700 con 0x7fc5c40b36c0 2023-11-24T08:04:05.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c3fff640 1 --2- 172.21.15.57:0/1635846393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c4070da0 0x7fc5c415ddd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbe6873147fc799 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c27fc640 1 -- 172.21.15.57:0/1635846393 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0a58d0 con 0x7fc5c4070da0 2023-11-24T08:04:05.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c27fc640 1 -- 172.21.15.57:0/1635846393 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0a5a30 con 0x7fc5c4070da0 2023-11-24T08:04:05.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c27fc640 1 -- 172.21.15.57:0/1635846393 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0a5dc0 con 0x7fc5c4070da0 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/1635846393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c4070da0 msgr2=0x7fc5c415ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.020+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/1635846393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c4070da0 0x7fc5c415ddd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc01c9e0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/1635846393 shutdown_connections 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/1635846393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c4070da0 0x7fc5c415ddd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/1635846393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/1635846393 >> 172.21.15.57:0/1635846393 conn(0x7fc5c40b0bf0 msgr2=0x7fc5c40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/1635846393 shutdown_connections 2023-11-24T08:04:05.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/1635846393 wait complete. 2023-11-24T08:04:05.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 Processor -- start 2023-11-24T08:04:05.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- start start 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5c4070da0 0x7fc5c415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c40b36c0 0x7fc5c414be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c4164380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c414c350 con 0x7fc5c40b36c0 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4152370 con 0x7fc5c4070da0 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c9ebb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4152650 con 0x7fc5c415a320 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c40b36c0 0x7fc5c414be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c40b36c0 0x7fc5c414be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42766/0 (socket says 172.21.15.57:42766) 2023-11-24T08:04:05.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 -- 172.21.15.57:0/2718442507 learned_addr learned my addr 172.21.15.57:0/2718442507 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c3fff640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c4164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c37fe640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5c4070da0 0x7fc5c415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 -- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 msgr2=0x7fc5c4164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c4164380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 -- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5c4070da0 msgr2=0x7fc5c415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5c4070da0 0x7fc5c415d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c2ffd640 1 -- 172.21.15.57:0/2718442507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009b30 con 0x7fc5c40b36c0 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.024+0000 7fc5c37fe640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5c4070da0 0x7fc5c415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5c2ffd640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c40b36c0 0x7fc5c414be10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c4b0 tx=0x7fc5b800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5abfff640 1 -- 172.21.15.57:0/2718442507 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80074e0 con 0x7fc5c40b36c0 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5abfff640 1 -- 172.21.15.57:0/2718442507 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b8007660 con 0x7fc5c40b36c0 2023-11-24T08:04:05.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5abfff640 1 -- 172.21.15.57:0/2718442507 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8004a30 con 0x7fc5c40b36c0 2023-11-24T08:04:05.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c4152930 con 0x7fc5c40b36c0 2023-11-24T08:04:05.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c41662e0 con 0x7fc5c40b36c0 2023-11-24T08:04:05.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c41664f0 con 0x7fc5c40b36c0 2023-11-24T08:04:05.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5abfff640 1 -- 172.21.15.57:0/2718442507 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5b8004b90 con 0x7fc5c40b36c0 2023-11-24T08:04:05.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5abfff640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066470 0x7fc5b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5abfff640 1 -- 172.21.15.57:0/2718442507 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5b8083190 con 0x7fc5c40b36c0 2023-11-24T08:04:05.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.028+0000 7fc5c37fe640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066470 0x7fc5b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.032+0000 7fc5c37fe640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066470 0x7fc5b0068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009b10 tx=0x7fc5b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.032+0000 7fc5abfff640 1 -- 172.21.15.57:0/2718442507 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5b8050650 con 0x7fc5c40b36c0 2023-11-24T08:04:05.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.188+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5c4067520 con 0x7fc5c40b36c0 2023-11-24T08:04:05.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5abfff640 1 -- 172.21.15.57:0/2718442507 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fc5b8018020 con 0x7fc5c40b36c0 2023-11-24T08:04:05.192 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:05.192 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066470 msgr2=0x7fc5b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066470 0x7fc5b0068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009b10 tx=0x7fc5b4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c40b36c0 msgr2=0x7fc5c414be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c40b36c0 0x7fc5c414be10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c4b0 tx=0x7fc5b800c970 comp rx=0 tx=0).stop 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 shutdown_connections 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066470 0x7fc5b0068930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5c415a320 0x7fc5c4164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5c40b36c0 0x7fc5c414be10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 --2- 172.21.15.57:0/2718442507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5c4070da0 0x7fc5c415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 >> 172.21.15.57:0/2718442507 conn(0x7fc5c40b0bf0 msgr2=0x7fc5c4070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 shutdown_connections 2023-11-24T08:04:05.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.192+0000 7fc5c9ebb640 1 -- 172.21.15.57:0/2718442507 wait complete. 2023-11-24T08:04:05.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T08:04:05.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T08:04:05.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T08:04:05.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T08:04:05.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T08:04:05.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T08:04:05.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T08:04:05.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T08:04:05.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.460+0000 7f6b6e9e7640 1 Processor -- start 2023-11-24T08:04:05.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.460+0000 7f6b6e9e7640 1 -- start start 2023-11-24T08:04:05.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7efc409d0640 1 Processor -- start 2023-11-24T08:04:05.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7efc409d0640 1 -- start start 2023-11-24T08:04:05.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b6e9e7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b6806c800 0x7f6b68161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b6e9e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b6814b3e0 0x7f6b68162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b6e9e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b68162430 con 0x7f6b68070400 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b6e9e7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b68162710 con 0x7f6b6806c800 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b6e9e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b681629f0 con 0x7f6b6814b3e0 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b67fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b6806c800 0x7f6b68161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b6cf84640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b6814b3e0 0x7f6b68162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b67fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b6806c800 0x7f6b68161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42770/0 (socket says 172.21.15.57:42770) 2023-11-24T08:04:05.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b67fff640 1 -- 172.21.15.57:0/752575779 learned_addr learned my addr 172.21.15.57:0/752575779 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc409d0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 0x7efc3403b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc409d0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc340e7d50 0x7efc34052a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc409d0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efc34039b00 0x7efc34052f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc409d0640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc34056a70 con 0x7efc340e7d50 2023-11-24T08:04:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc409d0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3403bb30 con 0x7efc34039b00 2023-11-24T08:04:05.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc409d0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3403be10 con 0x7efc340e7970 2023-11-24T08:04:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b67fff640 1 -- 172.21.15.57:0/752575779 >> v2:172.21.15.132:3300/0 conn(0x7f6b6814b3e0 msgr2=0x7f6b68162fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.464+0000 7f6b66ffd640 1 -- 172.21.15.57:0/752575779 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116739538 0 0) 0x7f6b68162430 con 0x7f6b68070400 2023-11-24T08:04:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7f6b67fff640 1 --2- 172.21.15.57:0/752575779 >> v2:172.21.15.132:3300/0 conn(0x7f6b6814b3e0 0x7f6b68162fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7f6b67fff640 1 -- 172.21.15.57:0/752575779 >> v1:172.21.15.132:6789/0 conn(0x7f6b68070400 legacy=0x7f6b6814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7f6b67fff640 1 -- 172.21.15.57:0/752575779 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68070b90 con 0x7f6b6806c800 2023-11-24T08:04:05.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7f6b6cf84640 1 --2- 172.21.15.57:0/752575779 >> v2:172.21.15.132:3300/0 conn(0x7f6b6814b3e0 0x7f6b68162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc340e7d50 0x7efc34052a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc340e7d50 0x7efc34052a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42784/0 (socket says 172.21.15.57:42784) 2023-11-24T08:04:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 -- 172.21.15.57:0/4183406900 learned_addr learned my addr 172.21.15.57:0/4183406900 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 -- 172.21.15.57:0/4183406900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 msgr2=0x7efc3403b450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 --2- 172.21.15.57:0/4183406900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 0x7efc3403b450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 -- 172.21.15.57:0/4183406900 >> v2:172.21.15.132:3300/0 conn(0x7efc34039b00 msgr2=0x7efc34052f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:05.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 --2- 172.21.15.57:0/4183406900 >> v2:172.21.15.132:3300/0 conn(0x7efc34039b00 0x7efc34052f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.468+0000 7efc3affd640 1 -- 172.21.15.57:0/4183406900 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3403c0f0 con 0x7efc340e7d50 2023-11-24T08:04:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.472+0000 7f6b67fff640 1 --2- 172.21.15.57:0/752575779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6806c800 0x7f6b68161e00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b680b38b0 tx=0x7f6b5001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958be108ce990c8b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.472+0000 7f09f2765640 1 Processor -- start 2023-11-24T08:04:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.472+0000 7f6b66ffd640 1 -- 172.21.15.57:0/752575779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500ab660 con 0x7f6b6806c800 2023-11-24T08:04:05.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.472+0000 7f6b66ffd640 1 -- 172.21.15.57:0/752575779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b500ab7c0 con 0x7f6b6806c800 2023-11-24T08:04:05.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.472+0000 7f6b66ffd640 1 -- 172.21.15.57:0/752575779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500abb50 con 0x7f6b6806c800 2023-11-24T08:04:05.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.472+0000 7f09f2765640 1 -- start start 2023-11-24T08:04:05.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/752575779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6806c800 msgr2=0x7f6b68161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 --2- 172.21.15.57:0/752575779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6806c800 0x7f6b68161e00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b680b38b0 tx=0x7f6b5001c440 comp rx=0 tx=0).stop 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f2765640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09ec0cab60 0x7f09ec0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f2765640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09ec0ce070 0x7f09ec16b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/752575779 shutdown_connections 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 --2- 172.21.15.57:0/752575779 >> v2:172.21.15.132:3300/0 conn(0x7f6b6814b3e0 0x7f6b68162fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 --2- 172.21.15.57:0/752575779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b6806c800 0x7f6b68161e00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/752575779 >> 172.21.15.57:0/752575779 conn(0x7f6b6806dcc0 msgr2=0x7f6b6806a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7efc3affd640 1 --2- 172.21.15.57:0/4183406900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc340e7d50 0x7efc34052a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc340536e0 tx=0x7efc3001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc84b768683d1e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f2765640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ec0ccbd0 con 0x7f09ec0cb480 2023-11-24T08:04:05.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f2765640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec06dac0 con 0x7f09ec0ce070 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f2765640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec06dda0 con 0x7f09ec0cab60 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f0d02640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09ec0ce070 0x7f09ec16b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09ebfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09ec0cab60 0x7f09ec0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f0d02640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09ec0ce070 0x7f09ec16b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42792/0 (socket says 172.21.15.57:42792) 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f0d02640 1 -- 172.21.15.57:0/4125844867 learned_addr learned my addr 172.21.15.57:0/4125844867 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09eb7fe640 1 --1- 172.21.15.57:0/4125844867 >> v1:172.21.15.132:6789/0 conn(0x7f09ec0cb480 0x7f09ec06cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:51638/0 (socket says 172.21.15.57:51638) 2023-11-24T08:04:05.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/752575779 shutdown_connections 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7efc3a7fc640 1 -- 172.21.15.57:0/4183406900 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300aa610 con 0x7efc340e7d50 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7efc3a7fc640 1 -- 172.21.15.57:0/4183406900 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc300a6040 con 0x7efc340e7d50 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7efc3a7fc640 1 -- 172.21.15.57:0/4183406900 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300aa990 con 0x7efc340e7d50 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/752575779 wait complete. 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09eaffd640 1 -- 172.21.15.57:0/4125844867 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352599855 0 0) 0x7f09ec0ccbd0 con 0x7f09ec0cb480 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f0d02640 1 -- 172.21.15.57:0/4125844867 >> v2:172.21.15.132:3300/0 conn(0x7f09ec0cab60 msgr2=0x7f09ec0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f0d02640 1 --2- 172.21.15.57:0/4125844867 >> v2:172.21.15.132:3300/0 conn(0x7f09ec0cab60 0x7f09ec0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f0d02640 1 -- 172.21.15.57:0/4125844867 >> v1:172.21.15.132:6789/0 conn(0x7f09ec0cb480 legacy=0x7f09ec06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.476+0000 7f09f0d02640 1 -- 172.21.15.57:0/4125844867 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec06e080 con 0x7f09ec0ce070 2023-11-24T08:04:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc1280e3640 1 Processor -- start 2023-11-24T08:04:05.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc1280e3640 1 -- start start 2023-11-24T08:04:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc1280e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b220 0x7fc1200cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc1280e3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc1200c9650 0x7fc1200c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc1280e3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200abed0 con 0x7fc12015b600 2023-11-24T08:04:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc1280e3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc120072710 con 0x7fc1200c9650 2023-11-24T08:04:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc1280e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200ca000 con 0x7fc12015b220 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 Processor -- start 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 -- start start 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b6806c800 0x7f6b6813efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b68070400 0x7f6b68159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b6814b3e0 0x7f6b68143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6815feb0 con 0x7f6b68070400 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68160190 con 0x7f6b6806c800 2023-11-24T08:04:05.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6e9e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68160470 con 0x7f6b6814b3e0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fcae4432640 1 Processor -- start 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6cf84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b6814b3e0 0x7f6b68143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b6cf84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b6814b3e0 0x7f6b68143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:39446/0 (socket says 172.21.15.57:39446) 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b677fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b68070400 0x7f6b68159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b67fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b6806c800 0x7f6b6813efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b67fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b6806c800 0x7f6b6813efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44728/0 (socket says 172.21.15.57:44728) 2023-11-24T08:04:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f6b67fff640 1 -- 172.21.15.57:0/2458018230 learned_addr learned my addr 172.21.15.57:0/2458018230 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7efc409d0640 1 -- 172.21.15.57:0/4183406900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc340e7d50 msgr2=0x7efc34052a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7efc409d0640 1 --2- 172.21.15.57:0/4183406900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc340e7d50 0x7efc34052a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc340536e0 tx=0x7efc3001c4f0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f09f0d02640 1 --2- 172.21.15.57:0/4125844867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0ce070 0x7f09ec16b5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f09ec06eb00 tx=0x7f09e401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d0cc84e906a697 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc126680640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc1200c9650 0x7fc1200c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc126680640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc1200c9650 0x7fc1200c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44744/0 (socket says 172.21.15.57:44744) 2023-11-24T08:04:05.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc126680640 1 -- 172.21.15.57:0/1317221091 learned_addr learned my addr 172.21.15.57:0/1317221091 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fc125e7f640 1 --2- 172.21.15.57:0/1317221091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b220 0x7fc1200cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7fcae4432640 1 -- start start 2023-11-24T08:04:05.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f8a01baa640 1 Processor -- start 2023-11-24T08:04:05.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09eaffd640 1 -- 172.21.15.57:0/4125844867 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40a56f0 con 0x7f09ec0ce070 2023-11-24T08:04:05.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.480+0000 7f8a01baa640 1 -- start start 2023-11-24T08:04:05.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09eaffd640 1 -- 172.21.15.57:0/4125844867 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40a5850 con 0x7f09ec0ce070 2023-11-24T08:04:05.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09eaffd640 1 -- 172.21.15.57:0/4125844867 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40a56f0 con 0x7f09ec0ce070 2023-11-24T08:04:05.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b67fff640 1 -- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b6814b3e0 msgr2=0x7f6b68143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b67fff640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b6814b3e0 0x7f6b68143c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b67fff640 1 -- 172.21.15.57:0/2458018230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b68070400 msgr2=0x7f6b68159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b67fff640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b68070400 0x7f6b68159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b67fff640 1 -- 172.21.15.57:0/2458018230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58009a70 con 0x7f6b6806c800 2023-11-24T08:04:05.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b6cf84640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b6814b3e0 0x7f6b68143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:05.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae4432640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcadc161ce0 0x7fcadc072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b67fff640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b6806c800 0x7f6b6813efb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b5001aaf0 tx=0x7f6b5001ac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 -- 172.21.15.57:0/4125844867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0ce070 msgr2=0x7f09ec16b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 --2- 172.21.15.57:0/4125844867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0ce070 0x7f09ec16b5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f09ec06eb00 tx=0x7f09e401c9f0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae4432640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcadc0d4250 0x7fcadc0d46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f8a01baa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89fc15d950 0x7f89fc0d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae4432640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0d65a0 con 0x7fcadc0d7590 2023-11-24T08:04:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae21ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcadc161ce0 0x7fcadc072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 -- 172.21.15.57:0/4125844867 shutdown_connections 2023-11-24T08:04:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 --2- 172.21.15.57:0/4125844867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0ce070 0x7f09ec16b5b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 --2- 172.21.15.57:0/4125844867 >> v2:172.21.15.132:3300/0 conn(0x7f09ec0cab60 0x7f09ec0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 -- 172.21.15.57:0/4125844867 >> 172.21.15.57:0/4125844867 conn(0x7f09ec0b0bf0 msgr2=0x7f09ec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f8a01baa640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f89fc0d1fb0 0x7f89fc0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500abd40 con 0x7f6b6806c800 2023-11-24T08:04:05.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae21ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcadc161ce0 0x7fcadc072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44752/0 (socket says 172.21.15.57:44752) 2023-11-24T08:04:05.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b500b8070 con 0x7f6b6806c800 2023-11-24T08:04:05.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500abea0 con 0x7f6b6806c800 2023-11-24T08:04:05.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae4432640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0d7170 con 0x7fcadc0d4250 2023-11-24T08:04:05.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae4432640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc072900 con 0x7fcadc161ce0 2023-11-24T08:04:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b500094d0 con 0x7f6b6806c800 2023-11-24T08:04:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 -- 172.21.15.57:0/4125844867 shutdown_connections 2023-11-24T08:04:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae21ce640 1 -- 172.21.15.57:0/1289098148 learned_addr learned my addr 172.21.15.57:0/1289098148 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f8a01baa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0cf100 con 0x7f89fc15d570 2023-11-24T08:04:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f89fb7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f89fc15d570 0x7f89fc0d04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:51652/0 (socket says 172.21.15.57:51652) 2023-11-24T08:04:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b68160a30 con 0x7f6b6806c800 2023-11-24T08:04:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f09f2765640 1 -- 172.21.15.57:0/4125844867 wait complete. 2023-11-24T08:04:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f89fb7fe640 1 -- 172.21.15.57:0/536707751 learned_addr learned my addr 172.21.15.57:0/536707751 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fc125e7f640 1 -- 172.21.15.57:0/1317221091 >> v2:172.21.15.132:3300/0 conn(0x7fc1200c9650 msgr2=0x7fc1200c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fc125e7f640 1 --2- 172.21.15.57:0/1317221091 >> v2:172.21.15.132:3300/0 conn(0x7fc1200c9650 0x7fc1200c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fc125e7f640 1 -- 172.21.15.57:0/1317221091 >> v1:172.21.15.57:6789/0 conn(0x7fc12015b600 legacy=0x7fc12006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fc125e7f640 1 -- 172.21.15.57:0/1317221091 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc120072370 con 0x7fc12015b220 2023-11-24T08:04:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 -- 172.21.15.57:0/4183406900 shutdown_connections 2023-11-24T08:04:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 --2- 172.21.15.57:0/4183406900 >> v2:172.21.15.132:3300/0 conn(0x7efc34039b00 0x7efc34052f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 --2- 172.21.15.57:0/4183406900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc340e7d50 0x7efc34052a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 --2- 172.21.15.57:0/4183406900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 0x7efc3403b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 -- 172.21.15.57:0/4183406900 >> 172.21.15.57:0/4183406900 conn(0x7efc34056cb0 msgr2=0x7efc340570c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 -- 172.21.15.57:0/4183406900 shutdown_connections 2023-11-24T08:04:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 -- 172.21.15.57:0/4183406900 wait complete. 2023-11-24T08:04:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7fcae21ce640 1 -- 172.21.15.57:0/1289098148 >> v2:172.21.15.57:3300/0 conn(0x7fcadc0d4250 msgr2=0x7fcadc0d46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f89faffd640 1 --2- 172.21.15.57:0/536707751 >> v2:172.21.15.132:3300/0 conn(0x7f89fc15d950 0x7f89fc0d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f8a01baa640 1 -- 172.21.15.57:0/536707751 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0d2440 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f8a01baa640 1 -- 172.21.15.57:0/536707751 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0cf590 con 0x7f89fc15d950 2023-11-24T08:04:05.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7feb55572640 1 Processor -- start 2023-11-24T08:04:05.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b6816e560 con 0x7f6b6806c800 2023-11-24T08:04:05.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7feb55572640 1 -- start start 2023-11-24T08:04:05.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f89fbfff640 1 --2- 172.21.15.57:0/536707751 >> v2:172.21.15.57:3300/0 conn(0x7f89fc0d1fb0 0x7f89fc0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 Processor -- start 2023-11-24T08:04:05.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.484+0000 7efc409d0640 1 Processor -- start 2023-11-24T08:04:05.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc409d0640 1 -- start start 2023-11-24T08:04:05.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fcae19cd640 1 --2- 172.21.15.57:0/1289098148 >> v2:172.21.15.57:3300/0 conn(0x7fcadc0d4250 0x7fcadc0d46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fcae21ce640 1 --2- 172.21.15.57:0/1289098148 >> v2:172.21.15.57:3300/0 conn(0x7fcadc0d4250 0x7fcadc0d46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fcae21ce640 1 -- 172.21.15.57:0/1289098148 >> v1:172.21.15.57:6789/0 conn(0x7fcadc0d7590 legacy=0x7fcadc0d7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f89fbfff640 1 -- 172.21.15.57:0/536707751 >> v2:172.21.15.132:3300/0 conn(0x7f89fc15d950 msgr2=0x7f89fc0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f89fbfff640 1 --2- 172.21.15.57:0/536707751 >> v2:172.21.15.132:3300/0 conn(0x7f89fc15d950 0x7f89fc0d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f89fbfff640 1 -- 172.21.15.57:0/536707751 >> v1:172.21.15.132:6789/0 conn(0x7f89fc15d570 legacy=0x7f89fc0d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f89fbfff640 1 -- 172.21.15.57:0/536707751 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0ce4f0 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fcae21ce640 1 -- 172.21.15.57:0/1289098148 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0d4bf0 con 0x7fcadc161ce0 2023-11-24T08:04:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7feb55572640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb500cad20 0x7feb500c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7feb55572640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5015a8b0 con 0x7feb5015a4d0 2023-11-24T08:04:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7feb55572640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb500c9c30 con 0x7feb500cd700 2023-11-24T08:04:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7feb55572640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500c9f60 con 0x7feb500cad20 2023-11-24T08:04:05.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc409d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc34039b00 0x7efc34052540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f1c2766b640 1 Processor -- start 2023-11-24T08:04:05.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc409d0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 0x7efc34052a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc409d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc340e7d50 0x7efc340e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7feb4f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feb500cd700 0x7feb500cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:51658/0 (socket says 172.21.15.57:51658) 2023-11-24T08:04:05.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc409d0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3404f560 con 0x7efc34039b00 2023-11-24T08:04:05.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc409d0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3404e9b0 con 0x7efc340e7d50 2023-11-24T08:04:05.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc409d0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3404ec30 con 0x7efc340e7970 2023-11-24T08:04:05.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc3b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc34039b00 0x7efc34052540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7feb4f7fe640 1 -- 172.21.15.57:0/2366319858 learned_addr learned my addr 172.21.15.57:0/2366319858 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:05.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc3b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc34039b00 0x7efc34052540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42826/0 (socket says 172.21.15.57:42826) 2023-11-24T08:04:05.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc3b7fe640 1 -- 172.21.15.57:0/506304929 learned_addr learned my addr 172.21.15.57:0/506304929 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7feb4e7fc640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb500cad20 0x7feb500c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc3affd640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 0x7efc34052a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 -- start start 2023-11-24T08:04:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7efc3bfff640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc340e7d50 0x7efc340e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ec0cab60 0x7f09ec0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0cb480 0x7f09ec0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09ec0ce070 0x7f09ec15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec15fd60 con 0x7f09ec0cb480 2023-11-24T08:04:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec0b2c00 con 0x7f09ec0cab60 2023-11-24T08:04:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f09f2765640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec15f0e0 con 0x7f09ec0ce070 2023-11-24T08:04:05.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7f1c2766b640 1 -- start start 2023-11-24T08:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b500a9070 con 0x7f6b6806c800 2023-11-24T08:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc3affd640 1 -- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc340e7d50 msgr2=0x7efc340e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc3affd640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc340e7d50 0x7efc340e2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc3affd640 1 -- 172.21.15.57:0/506304929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc34039b00 msgr2=0x7efc34052540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc3affd640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc34039b00 0x7efc34052540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc3affd640 1 -- 172.21.15.57:0/506304929 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc300094d0 con 0x7efc340e7970 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ec0cab60 0x7f09ec0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ec0cab60 0x7f09ec0b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44786/0 (socket says 172.21.15.57:44786) 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 -- 172.21.15.57:0/2220149618 learned_addr learned my addr 172.21.15.57:0/2220149618 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09f0d02640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09ec0ce070 0x7f09ec15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09eb7fe640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0cb480 0x7f09ec0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 -- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09ec0ce070 msgr2=0x7f09ec15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09ec0ce070 0x7f09ec15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 -- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0cb480 msgr2=0x7f09ec0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0cb480 0x7f09ec0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 -- 172.21.15.57:0/2220149618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e4009b30 con 0x7f09ec0cab60 2023-11-24T08:04:05.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09eb7fe640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0cb480 0x7f09ec0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09ebfff640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ec0cab60 0x7f09ec0b26c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09d400d800 tx=0x7f09d400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fc125e7f640 1 --2- 172.21.15.57:0/1317221091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b220 0x7fc1200cada0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1140097c0 tx=0x7fc11401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e0591f94783f1e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fc124e7d640 1 -- 172.21.15.57:0/1317221091 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140ab650 con 0x7fc12015b220 2023-11-24T08:04:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fc124e7d640 1 -- 172.21.15.57:0/1317221091 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1140ab7b0 con 0x7fc12015b220 2023-11-24T08:04:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.488+0000 7fc124e7d640 1 -- 172.21.15.57:0/1317221091 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140abb40 con 0x7fc12015b220 2023-11-24T08:04:05.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7fcae19cd640 1 --2- 172.21.15.57:0/1289098148 >> v2:172.21.15.57:3300/0 conn(0x7fcadc0d4250 0x7fcadc0d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945925156 0 0) 0x7feb5015a8b0 con 0x7feb5015a4d0 2023-11-24T08:04:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb38003530 con 0x7feb5015a4d0 2023-11-24T08:04:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974224577 0 0) 0x7feb500c9c30 con 0x7feb500cd700 2023-11-24T08:04:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb5015a8b0 con 0x7feb500cd700 2023-11-24T08:04:05.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1215134395 0 0) 0x7feb38003530 con 0x7feb5015a4d0 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb500cad20 msgr2=0x7feb500c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb500cad20 0x7feb500c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 >> v1:172.21.15.132:6789/0 conn(0x7feb500cd700 legacy=0x7feb500cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500ca240 con 0x7feb5015a4d0 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7feb40001680 con 0x7feb5015a4d0 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 >> v1:172.21.15.57:6789/0 conn(0x7feb5015a4d0 legacy=0x7feb5015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb38004bd0 0x7feb38004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb38003770 0x7feb38003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb38004130 0x7feb3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44001240 con 0x7feb38003770 2023-11-24T08:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb500c9f60 con 0x7feb38004130 2023-11-24T08:04:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3800c060 con 0x7feb38004bd0 2023-11-24T08:04:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400b6c0 con 0x7f09ec0cab60 2023-11-24T08:04:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400b820 con 0x7f09ec0cab60 2023-11-24T08:04:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400bb90 con 0x7f09ec0cab60 2023-11-24T08:04:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec15f3c0 con 0x7f09ec0cab60 2023-11-24T08:04:05.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4f7fe640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb38004130 0x7feb3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4effd640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb38004bd0 0x7feb38004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c2766b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c2006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c2766b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c200d3020 0x7f1c200d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c2766b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c200ce8b0 0x7f1c200ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c2766b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200d39c0 con 0x7f1c200ce8b0 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c2766b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200d1cc0 con 0x7f1c200d3020 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c2766b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200d1fa0 con 0x7f1c2015d570 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c200ce8b0 0x7f1c200ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c200ce8b0 0x7f1c200ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42842/0 (socket says 172.21.15.57:42842) 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 -- 172.21.15.57:0/521835495 learned_addr learned my addr 172.21.15.57:0/521835495 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b64ff9640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b48066540 0x7f6b48068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b5011e5b0 con 0x7f6b6806c800 2023-11-24T08:04:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b64ff9640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f6b4806e760 0x7f6b48070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 --> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b48071230 con 0x7f6b4806e760 2023-11-24T08:04:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b5011e960 con 0x7f6b6806c800 2023-11-24T08:04:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc3affd640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 0x7efc34052a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc300ab000 tx=0x7efc3001ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4f7fe640 1 -- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb38004bd0 msgr2=0x7feb38004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4f7fe640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb38004bd0 0x7feb38004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4f7fe640 1 -- 172.21.15.57:0/2366319858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb38003770 msgr2=0x7feb38003bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4f7fe640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb38003770 0x7feb38003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b677fe640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b48066540 0x7f6b48068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300b3800 con 0x7efc340e7970 2023-11-24T08:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc300b3960 con 0x7efc340e7970 2023-11-24T08:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300b3d10 con 0x7efc340e7970 2023-11-24T08:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3404ef10 con 0x7efc340e7970 2023-11-24T08:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3404f9f0 con 0x7efc340e7970 2023-11-24T08:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec15f980 con 0x7f09ec0cab60 2023-11-24T08:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7fcae21ce640 1 --2- 172.21.15.57:0/1289098148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc072120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcadc06fc30 tx=0x7fcad801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb732d023f5669c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7feb4f7fe640 1 -- 172.21.15.57:0/2366319858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500ca240 con 0x7feb38004130 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c24c06640 1 --2- 172.21.15.57:0/521835495 >> v2:172.21.15.132:3300/0 conn(0x7f1c200d3020 0x7f1c200d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 -- 172.21.15.57:0/521835495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 msgr2=0x7f1c2006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25407640 1 --2- 172.21.15.57:0/521835495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c2006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 --2- 172.21.15.57:0/521835495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c2006b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 -- 172.21.15.57:0/521835495 >> v2:172.21.15.132:3300/0 conn(0x7f1c200d3020 msgr2=0x7f1c200d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 --2- 172.21.15.57:0/521835495 >> v2:172.21.15.132:3300/0 conn(0x7f1c200d3020 0x7f1c200d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c25c08640 1 -- 172.21.15.57:0/521835495 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c200ce0b0 con 0x7f1c200ce8b0 2023-11-24T08:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f1c24c06640 1 --2- 172.21.15.57:0/521835495 >> v2:172.21.15.132:3300/0 conn(0x7f1c200d3020 0x7f1c200d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7fc1280e3640 1 -- 172.21.15.57:0/1317221091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b220 msgr2=0x7fc1200cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fc1280e3640 1 --2- 172.21.15.57:0/1317221091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b220 0x7fc1200cada0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1140097c0 tx=0x7fc11401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae11cc640 1 -- 172.21.15.57:0/1289098148 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80ab600 con 0x7fcadc161ce0 2023-11-24T08:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae11cc640 1 -- 172.21.15.57:0/1289098148 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad80a7050 con 0x7fcadc161ce0 2023-11-24T08:04:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.492+0000 7f6b6cf84640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f6b4806e760 0x7f6b48070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f6b6cf84640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f6b4806e760 0x7f6b48070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fc1280e3640 1 -- 172.21.15.57:0/1317221091 shutdown_connections 2023-11-24T08:04:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fc1280e3640 1 --2- 172.21.15.57:0/1317221091 >> v2:172.21.15.132:3300/0 conn(0x7fc1200c9650 0x7fc1200c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fc1280e3640 1 --2- 172.21.15.57:0/1317221091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b220 0x7fc1200cada0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1140097c0 tx=0x7fc11401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:05.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fc1280e3640 1 -- 172.21.15.57:0/1317221091 >> 172.21.15.57:0/1317221091 conn(0x7fc1200b0bf0 msgr2=0x7fc1200b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09ec06d860 con 0x7f09ec0cab60 2023-11-24T08:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f6b677fe640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b48066540 0x7f6b48068a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b68144810 tx=0x7f6b60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f09d400bcf0 con 0x7f09ec0cab60 2023-11-24T08:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fc1280e3640 1 -- 172.21.15.57:0/1317221091 shutdown_connections 2023-11-24T08:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fc1280e3640 1 -- 172.21.15.57:0/1317221091 wait complete. 2023-11-24T08:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae11cc640 1 -- 172.21.15.57:0/1289098148 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80ab980 con 0x7fcadc161ce0 2023-11-24T08:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc340e4d20 con 0x7efc340e7970 2023-11-24T08:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== osd.0 v2:172.21.15.57:6800/1902011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6b48071230 con 0x7f6b4806e760 2023-11-24T08:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09e8ff9640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f09cc066470 0x7f09cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09d4085cf0 con 0x7f09ec0cab60 2023-11-24T08:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae4432640 1 -- 172.21.15.57:0/1289098148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 msgr2=0x7fcadc072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae4432640 1 --2- 172.21.15.57:0/1289098148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc072120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcadc06fc30 tx=0x7fcad801c4e0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc300b2380 con 0x7efc340e7970 2023-11-24T08:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f89fbfff640 1 --2- 172.21.15.57:0/536707751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc0b2040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f89fc09cef0 tx=0x7f89f401f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204ec9b828001ba0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09eb7fe640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f09cc066470 0x7f09cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7feb4f7fe640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb38004130 0x7feb3800b990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb4400c110 tx=0x7feb4401cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc8b0fa9a93a5a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae4432640 1 -- 172.21.15.57:0/1289098148 shutdown_connections 2023-11-24T08:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae4432640 1 --2- 172.21.15.57:0/1289098148 >> v2:172.21.15.57:3300/0 conn(0x7fcadc0d4250 0x7fcadc0d46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae4432640 1 --2- 172.21.15.57:0/1289098148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc072120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7fcae4432640 1 -- 172.21.15.57:0/1289098148 >> 172.21.15.57:0/1289098148 conn(0x7fcadc070b60 msgr2=0x7fcadc071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09e8ff9640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7f09cc06e610 0x7f09cc070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 --> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09cc0710e0 con 0x7f09cc06e610 2023-11-24T08:04:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.496+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09d408d420 con 0x7f09ec0cab60 2023-11-24T08:04:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 Processor -- start 2023-11-24T08:04:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb440048b0 con 0x7feb38004130 2023-11-24T08:04:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 -- start start 2023-11-24T08:04:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f89fa7fc640 1 -- 172.21.15.57:0/536707751 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40b0440 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f89fa7fc640 1 -- 172.21.15.57:0/536707751 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f40b05a0 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f89fa7fc640 1 -- 172.21.15.57:0/536707751 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40b0440 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f1c25c08640 1 --2- 172.21.15.57:0/521835495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200ce8b0 0x7f1c200ced40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c200b5ff0 tx=0x7f1c1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ca2b084e782a05 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb44004a10 con 0x7feb38004130 2023-11-24T08:04:05.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb4dffb640 1 -- 172.21.15.57:0/2366319858 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44004dc0 con 0x7feb38004130 2023-11-24T08:04:05.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7efc27fff640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc20066570 0x7efc20068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f09f0d02640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7f09cc06e610 0x7f09cc070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f09eb7fe640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f09cc066470 0x7f09cc068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0cc120 tx=0x7f09dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fcae4432640 1 -- 172.21.15.57:0/1289098148 shutdown_connections 2023-11-24T08:04:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fcae4432640 1 -- 172.21.15.57:0/1289098148 wait complete. 2023-11-24T08:04:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb55572640 1 -- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb38004130 msgr2=0x7feb3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb55572640 1 --2- 172.21.15.57:0/2366319858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb38004130 0x7feb3800b990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb4400c110 tx=0x7feb4401cad0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb4f7fe640 1 -- 172.21.15.57:0/2366319858 reap_dead start 2023-11-24T08:04:05.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f1c17fff640 1 -- 172.21.15.57:0/521835495 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c180a5840 con 0x7f1c200ce8b0 2023-11-24T08:04:05.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f1c17fff640 1 -- 172.21.15.57:0/521835495 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c180a59a0 con 0x7f1c200ce8b0 2023-11-24T08:04:05.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f1c17fff640 1 -- 172.21.15.57:0/521835495 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c180a5d30 con 0x7f1c200ce8b0 2023-11-24T08:04:05.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb55572640 1 -- 172.21.15.57:0/2366319858 shutdown_connections 2023-11-24T08:04:05.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb55572640 1 -- 172.21.15.57:0/2366319858 >> 172.21.15.57:0/2366319858 conn(0x7feb500b0bf0 msgr2=0x7feb500b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 -- 172.21.15.57:0/536707751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89fc0d1fb0 msgr2=0x7f89fc0b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 --2- 172.21.15.57:0/536707751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc0b2040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f89fc09cef0 tx=0x7f89f401f0f0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7efc3b7fe640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc20066570 0x7efc20068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb55572640 1 -- 172.21.15.57:0/2366319858 shutdown_connections 2023-11-24T08:04:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7feb55572640 1 -- 172.21.15.57:0/2366319858 wait complete. 2023-11-24T08:04:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 -- 172.21.15.57:0/536707751 shutdown_connections 2023-11-24T08:04:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 --2- 172.21.15.57:0/536707751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc0b2040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 --2- 172.21.15.57:0/536707751 >> v2:172.21.15.132:3300/0 conn(0x7f89fc15d950 0x7f89fc0d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 -- 172.21.15.57:0/536707751 >> 172.21.15.57:0/536707751 conn(0x7f89fc09c7c0 msgr2=0x7f89fc0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f09f0d02640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7f09cc06e610 0x7f09cc070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1200c9650 0x7fc120147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b600 0x7fc120144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc120159e20 0x7fc1201467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc120146350 con 0x7fc1200c9650 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1201454a0 con 0x7fc120159e20 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc1280e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc120145740 con 0x7fc12015b600 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1200c9650 0x7fc120147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc3011e450 con 0x7efc340e7970 2023-11-24T08:04:05.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1200c9650 0x7fc120147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42856/0 (socket says 172.21.15.57:42856) 2023-11-24T08:04:05.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 -- 172.21.15.57:0/2693743863 learned_addr learned my addr 172.21.15.57:0/2693743863 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7efc3b7fe640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc20066570 0x7efc20068a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc3c073370 tx=0x7efc3c06d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 -- 172.21.15.57:0/536707751 shutdown_connections 2023-11-24T08:04:05.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7efc27fff640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7efc2006e790 0x7efc20070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 --> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc20071260 con 0x7efc2006e790 2023-11-24T08:04:05.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc30120a70 con 0x7efc340e7970 2023-11-24T08:04:05.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc126680640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc120159e20 0x7fc1201467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f8a01baa640 1 -- 172.21.15.57:0/536707751 wait complete. 2023-11-24T08:04:05.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f1c2766b640 1 -- 172.21.15.57:0/521835495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200ce8b0 msgr2=0x7f1c200ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f1c2766b640 1 --2- 172.21.15.57:0/521835495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200ce8b0 0x7f1c200ced40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c200b5ff0 tx=0x7f1c1801c9a0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 -- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b600 msgr2=0x7fc120144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12015b600 0x7fc120144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 -- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc120159e20 msgr2=0x7fc1201467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc120159e20 0x7fc1201467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 -- 172.21.15.57:0/2693743863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114009420 con 0x7fc1200c9650 2023-11-24T08:04:05.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc126680640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc120159e20 0x7fc1201467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:05.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== osd.2 v2:172.21.15.57:6824/3141659691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f09cc0710e0 con 0x7f09cc06e610 2023-11-24T08:04:05.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.500+0000 7fc125e7f640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1200c9650 0x7fc120147bc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1140ad040 tx=0x7fc11401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7efc3bfff640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7efc2006e790 0x7efc20070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7efc3bfff640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7efc2006e790 0x7efc20070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== osd.1 v2:172.21.15.57:6808/197014629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efc20071260 con 0x7efc2006e790 2023-11-24T08:04:05.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140bf610 con 0x7fc1200c9650 2023-11-24T08:04:05.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1140bf770 con 0x7fc1200c9650 2023-11-24T08:04:05.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140bf610 con 0x7fc1200c9650 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc120145a20 con 0x7fc1200c9650 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc120145fe0 con 0x7fc1200c9650 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc12009d250 con 0x7fc1200c9650 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 Processor -- start 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 -- start start 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcadc0d4250 0x7fcadc14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcadc0d7590 0x7fcadc157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc15aab0 con 0x7fcadc0d4250 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc14efc0 con 0x7fcadc161ce0 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae4432640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc164770 con 0x7fcadc0d7590 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 Processor -- start 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 -- start start 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc09d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89fc15d570 0x7f89fc09ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89fc15d950 0x7f89fc148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc15c690 con 0x7f89fc15d570 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc09ef60 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f8a01baa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc148db0 con 0x7f89fc15d950 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc09d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc09d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44810/0 (socket says 172.21.15.57:44810) 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 -- 172.21.15.57:0/683927954 learned_addr learned my addr 172.21.15.57:0/683927954 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fbfff640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89fc15d950 0x7f89fc148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 -- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89fc15d950 msgr2=0x7f89fc148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89fc15d950 0x7f89fc148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 -- 172.21.15.57:0/683927954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89fc15d570 msgr2=0x7f89fc09ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89fc15d570 0x7f89fc09ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f89fb7fe640 1 -- 172.21.15.57:0/683927954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4009a70 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 Processor -- start 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 -- start start 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb38004130 0x7feb500b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5009be30 0x7feb50152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb5009c2b0 0x7feb50152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb50160280 con 0x7feb38004130 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb500b2b80 con 0x7feb5009be30 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb55572640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500b2e60 con 0x7feb5009c2b0 2023-11-24T08:04:05.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb4e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5009be30 0x7feb50152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb4e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5009be30 0x7feb50152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44816/0 (socket says 172.21.15.57:44816) 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb4e7fc640 1 -- 172.21.15.57:0/305202025 learned_addr learned my addr 172.21.15.57:0/305202025 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7feb4f7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb5009c2b0 0x7feb50152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 -- 172.21.15.57:0/521835495 shutdown_connections 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 --2- 172.21.15.57:0/521835495 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200ce8b0 0x7f1c200ced40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 --2- 172.21.15.57:0/521835495 >> v2:172.21.15.132:3300/0 conn(0x7f1c200d3020 0x7f1c200d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 --2- 172.21.15.57:0/521835495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c2006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 -- 172.21.15.57:0/521835495 >> 172.21.15.57:0/521835495 conn(0x7f1c2008ceb0 msgr2=0x7f1c2009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 -- 172.21.15.57:0/521835495 shutdown_connections 2023-11-24T08:04:05.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 -- 172.21.15.57:0/521835495 wait complete. 2023-11-24T08:04:05.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7f1c2766b640 1 Processor -- start 2023-11-24T08:04:05.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae19cd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcadc0d7590 0x7fcadc157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb4e7fc640 1 -- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb5009c2b0 msgr2=0x7feb50152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f89fb7fe640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc09d130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c530 tx=0x7f89ec00c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb4e7fc640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb5009c2b0 0x7feb50152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb4e7fc640 1 -- 172.21.15.57:0/305202025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb38004130 msgr2=0x7feb500b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb4e7fc640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb38004130 0x7feb500b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb4e7fc640 1 -- 172.21.15.57:0/305202025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5006e0e0 con 0x7feb5009be30 2023-11-24T08:04:05.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c2766b640 1 -- start start 2023-11-24T08:04:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb4e7fc640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5009be30 0x7feb50152150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb4800eba0 tx=0x7feb4800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec005cf0 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec005e50 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec007270 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4800cd20 con 0x7feb5009be30 2023-11-24T08:04:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4800f040 con 0x7feb5009be30 2023-11-24T08:04:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48003be0 con 0x7feb5009be30 2023-11-24T08:04:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb500b3140 con 0x7feb5009be30 2023-11-24T08:04:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb500b3700 con 0x7feb5009be30 2023-11-24T08:04:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc149090 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc149650 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb30000fd0 con 0x7feb5009be30 2023-11-24T08:04:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c2766b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c200ce8b0 0x7f1c2014c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c2766b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200d3020 0x7f1c200b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89fc0ced90 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c25407640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c200ce8b0 0x7f1c2014c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c25407640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c200ce8b0 0x7f1c2014c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44848/0 (socket says 172.21.15.57:44848) 2023-11-24T08:04:05.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1140b5400 con 0x7fc1200c9650 2023-11-24T08:04:05.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c24c06640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200d3020 0x7f1c200b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c25407640 1 -- 172.21.15.57:0/1763232267 learned_addr learned my addr 172.21.15.57:0/1763232267 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7f1c2766b640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c200b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae29cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc1584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:44832/0 (socket says 172.21.15.57:44832) 2023-11-24T08:04:05.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 -- 172.21.15.57:0/4089898522 learned_addr learned my addr 172.21.15.57:0/4089898522 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.504+0000 7fcae19cd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcadc0d7590 0x7fcadc157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:39516/0 (socket says 172.21.15.57:39516) 2023-11-24T08:04:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.508+0000 7fcae21ce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcadc0d4250 0x7fcadc14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2015dc50 con 0x7f1c200d3020 2023-11-24T08:04:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2015a7e0 con 0x7f1c200ce8b0 2023-11-24T08:04:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2014cdd0 con 0x7f1c2015d570 2023-11-24T08:04:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c25c08640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c200b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fc1127fc640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc104066500 0x7fc1040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 -- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcadc0d7590 msgr2=0x7fcadc157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcadc0d7590 0x7fcadc157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 -- 172.21.15.57:0/4089898522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcadc0d4250 msgr2=0x7fcadc14ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc11411e800 con 0x7fc1200c9650 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fc1127fc640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7fc10406e6a0 0x7fc104070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 --> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc104071170 con 0x7fc10406e6a0 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1140ebd30 con 0x7fc1200c9650 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcadc0d4250 0x7fcadc14ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 -- 172.21.15.57:0/4089898522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80094d0 con 0x7fcadc161ce0 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae21ce640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcadc0d4250 0x7fcadc14ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae19cd640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcadc0d7590 0x7fcadc157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae29cf640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc1584f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c7b0 tx=0x7fcad400cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4004b70 con 0x7fcadc161ce0 2023-11-24T08:04:05.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4004cd0 con 0x7fcadc161ce0 2023-11-24T08:04:05.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400aa70 con 0x7fcadc161ce0 2023-11-24T08:04:05.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb48003d40 con 0x7feb5009be30 2023-11-24T08:04:05.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c25c08640 1 -- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c200ce8b0 msgr2=0x7f1c2014c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c25c08640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c200ce8b0 0x7f1c2014c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c25c08640 1 -- 172.21.15.57:0/1763232267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200d3020 msgr2=0x7f1c200b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c25c08640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c200d3020 0x7f1c200b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c25c08640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009b30 con 0x7f1c2015d570 2023-11-24T08:04:05.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c25c08640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c200b1b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c180ab000 tx=0x7f1c18019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc164a50 con 0x7fcadc161ce0 2023-11-24T08:04:05.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fc126680640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7fc10406e6a0 0x7fc104070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc15a590 con 0x7fcadc161ce0 2023-11-24T08:04:05.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89ec0073d0 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f89e3fff640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89e8066470 0x7f89e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7fc126680640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7fc10406e6a0 0x7fc104070ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f89faffd640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89e8066470 0x7f89e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7feb377fe640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb3c0664f0 0x7feb3c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89ec0549b0 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f89e3fff640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7f89e806f220 0x7f89e80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 --> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89e8071d90 con 0x7f89e806f220 2023-11-24T08:04:05.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c180b8670 con 0x7f1c2015d570 2023-11-24T08:04:05.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c180b87d0 con 0x7f1c2015d570 2023-11-24T08:04:05.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.512+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c180b8b60 con 0x7f1c2015d570 2023-11-24T08:04:05.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89ec001210 con 0x7f89fc0d1fb0 2023-11-24T08:04:05.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f89fbfff640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7f89e806f220 0x7f89e80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f89faffd640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89e8066470 0x7f89e8068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89f0006aa0 tx=0x7f89f0006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7fc12567e640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc104066500 0x7fc1040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2015de60 con 0x7f1c2015d570 2023-11-24T08:04:05.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcac4000fd0 con 0x7fcadc161ce0 2023-11-24T08:04:05.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7fc12567e640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc104066500 0x7fc1040689c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc11c007fd0 tx=0x7fc11c007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb48055f00 con 0x7feb5009be30 2023-11-24T08:04:05.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb4effd640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb3c0664f0 0x7feb3c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb377fe640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7feb3c06f3f0 0x7feb3c071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 --> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb3c071f60 con 0x7feb3c06f3f0 2023-11-24T08:04:05.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb480555d0 con 0x7feb5009be30 2023-11-24T08:04:05.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f89fbfff640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7f89e806f220 0x7f89e80716c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2015e420 con 0x7f1c2015d570 2023-11-24T08:04:05.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb4f7fe640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7feb3c06f3f0 0x7feb3c071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb4effd640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb3c0664f0 0x7feb3c0689b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb40001ec0 tx=0x7feb40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcad400abd0 con 0x7fcadc161ce0 2023-11-24T08:04:05.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7feb4f7fe640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7feb3c06f3f0 0x7feb3c071890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== osd.5 v2:172.21.15.132:6808/774342191 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f89e8071d90 con 0x7f89e806f220 2023-11-24T08:04:05.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== osd.6 v2:172.21.15.132:6824/4052258235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feb3c071f60 con 0x7feb3c06f3f0 2023-11-24T08:04:05.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== osd.3 v2:172.21.15.57:6816/1395957383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc104071170 con 0x7fc10406e6a0 2023-11-24T08:04:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.516+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c2006bf10 con 0x7f1c2015d570 2023-11-24T08:04:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fcad2ffd640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcac0066470 0x7fcac0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcad4084000 con 0x7fcadc161ce0 2023-11-24T08:04:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fcad2ffd640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7fcac006e690 0x7fcac0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 --> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcac0071160 con 0x7fcac006e690 2023-11-24T08:04:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcad40865c0 con 0x7fcadc161ce0 2023-11-24T08:04:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fcae19cd640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7fcac006e690 0x7fcac0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c180b8cc0 con 0x7f1c2015d570 2023-11-24T08:04:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7f1c15ffb640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1c04066540 0x7f1c04068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c1811f3e0 con 0x7f1c2015d570 2023-11-24T08:04:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.520+0000 7fcae19cd640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7fcac006e690 0x7fcac0070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7f1c15ffb640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7f1c0406e760 0x7f1c04070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7fcae21ce640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcac0066470 0x7fcac0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7f1c25407640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1c04066540 0x7f1c04068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c04071230 con 0x7f1c0406e760 2023-11-24T08:04:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c18121a00 con 0x7f1c2015d570 2023-11-24T08:04:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7f1c24c06640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7f1c0406e760 0x7f1c04070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== osd.4 v2:172.21.15.132:6800/2592632531 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcac0071160 con 0x7fcac006e690 2023-11-24T08:04:05.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7f1c25407640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1c04066540 0x7f1c04068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00a990 tx=0x7f1c1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.524+0000 7fcae21ce640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcac0066470 0x7fcac0068930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcad80ad000 tx=0x7fcad8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.528+0000 7f1c24c06640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7f1c0406e760 0x7f1c04070b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.528+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== osd.7 v2:172.21.15.132:6816/786338062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1c04071230 con 0x7f1c0406e760 2023-11-24T08:04:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.532+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 --> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09ec09d250 con 0x7f09cc06e610 2023-11-24T08:04:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 --> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b68160c50 con 0x7f6b4806e760 2023-11-24T08:04:05.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b64ff9640 1 -- 172.21.15.57:0/2458018230 <== osd.0 v2:172.21.15.57:6800/1902011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6b68160c50 con 0x7f6b4806e760 2023-11-24T08:04:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09e8ff9640 1 -- 172.21.15.57:0/2220149618 <== osd.2 v2:172.21.15.57:6824/3141659691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09ec09d250 con 0x7f09cc06e610 2023-11-24T08:04:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7f09cc06e610 msgr2=0x7f09cc070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7f09cc06e610 0x7f09cc070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f6b4806e760 msgr2=0x7f6b48070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f6b4806e760 0x7f6b48070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f09cc066470 msgr2=0x7f09cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f09cc066470 0x7f09cc068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0cc120 tx=0x7f09dc009040 comp rx=0 tx=0).stop 2023-11-24T08:04:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ec0cab60 msgr2=0x7f09ec0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 --2- 172.21.15.57:0/2220149618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ec0cab60 0x7f09ec0b26c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09d400d800 tx=0x7f09d400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f0d02640 1 -- 172.21.15.57:0/2220149618 reap_dead start 2023-11-24T08:04:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 shutdown_connections 2023-11-24T08:04:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 >> 172.21.15.57:0/2220149618 conn(0x7f09ec0b0bf0 msgr2=0x7f09ec0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b48066540 msgr2=0x7f6b48068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b48066540 0x7f6b48068a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b68144810 tx=0x7f6b60009040 comp rx=0 tx=0).stop 2023-11-24T08:04:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b6806c800 msgr2=0x7f6b6813efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 --2- 172.21.15.57:0/2458018230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b6806c800 0x7f6b6813efb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b5001aaf0 tx=0x7f6b5001ac80 comp rx=0 tx=0).stop 2023-11-24T08:04:05.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6cf84640 1 -- 172.21.15.57:0/2458018230 reap_dead start 2023-11-24T08:04:05.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 shutdown_connections 2023-11-24T08:04:05.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 >> 172.21.15.57:0/2458018230 conn(0x7f6b6806dcc0 msgr2=0x7f6b68146f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.536+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 --> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc3404f3c0 con 0x7efc2006e790 2023-11-24T08:04:05.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 shutdown_connections 2023-11-24T08:04:05.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7f6b6e9e7640 1 -- 172.21.15.57:0/2458018230 wait complete. 2023-11-24T08:04:05.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 shutdown_connections 2023-11-24T08:04:05.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7f09f2765640 1 -- 172.21.15.57:0/2220149618 wait complete. 2023-11-24T08:04:05.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc27fff640 1 -- 172.21.15.57:0/506304929 <== osd.1 v2:172.21.15.57:6808/197014629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc20071260 con 0x7efc2006e790 2023-11-24T08:04:05.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7efc2006e790 msgr2=0x7efc20070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7efc2006e790 0x7efc20070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc20066570 msgr2=0x7efc20068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc20066570 0x7efc20068a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc3c073370 tx=0x7efc3c06d040 comp rx=0 tx=0).stop 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 msgr2=0x7efc34052a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 --2- 172.21.15.57:0/506304929 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc340e7970 0x7efc34052a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc300ab000 tx=0x7efc3001ad30 comp rx=0 tx=0).stop 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc3bfff640 1 -- 172.21.15.57:0/506304929 reap_dead start 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 shutdown_connections 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.540+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 >> 172.21.15.57:0/506304929 conn(0x7efc34056cb0 msgr2=0x7efc340e4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.544+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 shutdown_connections 2023-11-24T08:04:05.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.544+0000 7efc409d0640 1 -- 172.21.15.57:0/506304929 wait complete. 2023-11-24T08:04:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.544+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 --> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb30002cc0 con 0x7feb3c06f3f0 2023-11-24T08:04:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.544+0000 7feb377fe640 1 -- 172.21.15.57:0/305202025 <== osd.6 v2:172.21.15.132:6824/4052258235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb30002cc0 con 0x7feb3c06f3f0 2023-11-24T08:04:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.544+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 --> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f89fc0ceab0 con 0x7f89e806f220 2023-11-24T08:04:05.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.544+0000 7f89e3fff640 1 -- 172.21.15.57:0/683927954 <== osd.5 v2:172.21.15.132:6808/774342191 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f89f40b0710 con 0x7f89e806f220 2023-11-24T08:04:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7f89e806f220 msgr2=0x7f89e80716c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7f89e806f220 0x7f89e80716c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89e8066470 msgr2=0x7f89e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89e8066470 0x7f89e8068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89f0006aa0 tx=0x7f89f0006a30 comp rx=0 tx=0).stop 2023-11-24T08:04:05.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89fc0d1fb0 msgr2=0x7f89fc09d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 --2- 172.21.15.57:0/683927954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89fc0d1fb0 0x7f89fc09d130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c530 tx=0x7f89ec00c9f0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f89fbfff640 1 -- 172.21.15.57:0/683927954 reap_dead start 2023-11-24T08:04:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 shutdown_connections 2023-11-24T08:04:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.548+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 >> 172.21.15.57:0/683927954 conn(0x7f89fc09c7c0 msgr2=0x7f89fc0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 shutdown_connections 2023-11-24T08:04:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7feb3c06f3f0 msgr2=0x7feb3c071890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7feb3c06f3f0 0x7feb3c071890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 --> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcac4002cc0 con 0x7fcac006e690 2023-11-24T08:04:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb3c0664f0 msgr2=0x7feb3c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb3c0664f0 0x7feb3c0689b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb40001ec0 tx=0x7feb40009040 comp rx=0 tx=0).stop 2023-11-24T08:04:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5009be30 msgr2=0x7feb50152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 --2- 172.21.15.57:0/305202025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5009be30 0x7feb50152150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb4800eba0 tx=0x7feb4800c490 comp rx=0 tx=0).stop 2023-11-24T08:04:05.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb4f7fe640 1 -- 172.21.15.57:0/305202025 reap_dead start 2023-11-24T08:04:05.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7f8a01baa640 1 -- 172.21.15.57:0/683927954 wait complete. 2023-11-24T08:04:05.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 shutdown_connections 2023-11-24T08:04:05.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 >> 172.21.15.57:0/305202025 conn(0x7feb500b0bf0 msgr2=0x7feb500cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 --> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc120146490 con 0x7fc10406e6a0 2023-11-24T08:04:05.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 shutdown_connections 2023-11-24T08:04:05.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7feb55572640 1 -- 172.21.15.57:0/305202025 wait complete. 2023-11-24T08:04:05.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1127fc640 1 -- 172.21.15.57:0/2693743863 <== osd.3 v2:172.21.15.57:6816/1395957383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc104071170 con 0x7fc10406e6a0 2023-11-24T08:04:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fcad2ffd640 1 -- 172.21.15.57:0/4089898522 <== osd.4 v2:172.21.15.132:6800/2592632531 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcac4002cc0 con 0x7fcac006e690 2023-11-24T08:04:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7fc10406e6a0 msgr2=0x7fc104070ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1280e3640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7fc10406e6a0 0x7fc104070ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc104066500 msgr2=0x7fc1040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1280e3640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc104066500 0x7fc1040689c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc11c007fd0 tx=0x7fc11c007960 comp rx=0 tx=0).stop 2023-11-24T08:04:05.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1200c9650 msgr2=0x7fc120147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc1280e3640 1 --2- 172.21.15.57:0/2693743863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1200c9650 0x7fc120147bc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1140ad040 tx=0x7fc11401ac90 comp rx=0 tx=0).stop 2023-11-24T08:04:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.552+0000 7fc126680640 1 -- 172.21.15.57:0/2693743863 reap_dead start 2023-11-24T08:04:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7fcac006e690 msgr2=0x7fcac0070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7fcac006e690 0x7fcac0070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 shutdown_connections 2023-11-24T08:04:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 >> 172.21.15.57:0/2693743863 conn(0x7fc1200b0bf0 msgr2=0x7fc1200b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcac0066470 msgr2=0x7fcac0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcac0066470 0x7fcac0068930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcad80ad000 tx=0x7fcad8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 msgr2=0x7fcadc1584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 --2- 172.21.15.57:0/4089898522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcadc161ce0 0x7fcadc1584f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c7b0 tx=0x7fcad400cc70 comp rx=0 tx=0).stop 2023-11-24T08:04:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae29cf640 1 -- 172.21.15.57:0/4089898522 reap_dead start 2023-11-24T08:04:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 shutdown_connections 2023-11-24T08:04:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 shutdown_connections 2023-11-24T08:04:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 >> 172.21.15.57:0/4089898522 conn(0x7fcadc070b60 msgr2=0x7fcadc06d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 --> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c200a13b0 con 0x7f1c0406e760 2023-11-24T08:04:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fc1280e3640 1 -- 172.21.15.57:0/2693743863 wait complete. 2023-11-24T08:04:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 shutdown_connections 2023-11-24T08:04:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7fcae4432640 1 -- 172.21.15.57:0/4089898522 wait complete. 2023-11-24T08:04:05.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7f1c15ffb640 1 -- 172.21.15.57:0/1763232267 <== osd.7 v2:172.21.15.132:6816/786338062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c200a13b0 con 0x7f1c0406e760 2023-11-24T08:04:05.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.556+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7f1c0406e760 msgr2=0x7f1c04070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.560+0000 7f1c2766b640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7f1c0406e760 0x7f1c04070b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1c04066540 msgr2=0x7f1c04068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1c04066540 0x7f1c04068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00a990 tx=0x7f1c1c008040 comp rx=0 tx=0).stop 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 msgr2=0x7f1c200b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 --2- 172.21.15.57:0/1763232267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c2015d570 0x7f1c200b1b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c180ab000 tx=0x7f1c18019740 comp rx=0 tx=0).stop 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c25c08640 1 -- 172.21.15.57:0/1763232267 reap_dead start 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 shutdown_connections 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 >> 172.21.15.57:0/1763232267 conn(0x7f1c2008ceb0 msgr2=0x7f1c20156130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 shutdown_connections 2023-11-24T08:04:05.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.564+0000 7f1c2766b640 1 -- 172.21.15.57:0/1763232267 wait complete. 2023-11-24T08:04:05.589 INFO:teuthology.orchestra.run.smithi057.stdout:60129542152 2023-11-24T08:04:05.589 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:04:05.590 INFO:teuthology.orchestra.run.smithi057.stdout:64424509446 2023-11-24T08:04:05.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:04:05.591 INFO:teuthology.orchestra.run.smithi057.stdout:64424509445 2023-11-24T08:04:05.592 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:04:05.593 INFO:teuthology.orchestra.run.smithi057.stdout:64424509445 2023-11-24T08:04:05.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:04:05.597 INFO:teuthology.orchestra.run.smithi057.stdout:64424509445 2023-11-24T08:04:05.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:04:05.599 INFO:teuthology.orchestra.run.smithi057.stdout:64424509445 2023-11-24T08:04:05.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:04:05.606 INFO:teuthology.orchestra.run.smithi057.stdout:64424509446 2023-11-24T08:04:05.606 INFO:teuthology.orchestra.run.smithi057.stdout:64424509446 2023-11-24T08:04:05.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:04:05.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:04:05.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c90c91640 1 Processor -- start 2023-11-24T08:04:05.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c90c91640 1 -- start start 2023-11-24T08:04:05.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c90c91640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6c8c06d1b0 0x7f6c8c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c90c91640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c90c91640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c06cd20 con 0x7f6c8c0b1710 2023-11-24T08:04:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c90c91640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0cc780 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c90c91640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0ae9a0 con 0x7f6c8c0cc2f0 2023-11-24T08:04:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c8ad9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c8ad9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57828/0 (socket says 172.21.15.57:57828) 2023-11-24T08:04:05.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c8ad9d640 1 -- 172.21.15.57:0/4242077478 learned_addr learned my addr 172.21.15.57:0/4242077478 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7f6c89d9b640 1 --2- 172.21.15.57:0/4242077478 >> v2:172.21.15.57:3300/0 conn(0x7f6c8c06d1b0 0x7f6c8c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.808+0000 7fa0e1ac8640 1 Processor -- start 2023-11-24T08:04:05.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e1ac8640 1 -- start start 2023-11-24T08:04:05.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e1ac8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0dc165de0 0x7fa0dc0c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7f6c8ad9d640 1 -- 172.21.15.57:0/4242077478 >> v2:172.21.15.57:3300/0 conn(0x7f6c8c06d1b0 msgr2=0x7f6c8c0cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7f6c8ad9d640 1 --2- 172.21.15.57:0/4242077478 >> v2:172.21.15.57:3300/0 conn(0x7f6c8c06d1b0 0x7f6c8c0cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7f6c8ad9d640 1 -- 172.21.15.57:0/4242077478 >> v1:172.21.15.57:6789/0 conn(0x7f6c8c0b1710 legacy=0x7f6c8c156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7f6c8ad9d640 1 -- 172.21.15.57:0/4242077478 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c157570 con 0x7f6c8c0cc2f0 2023-11-24T08:04:05.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e1ac8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa0dc0c25e0 0x7fa0dc0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e1ac8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0cd700 con 0x7fa0dc0ce490 2023-11-24T08:04:05.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e1ac8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0c2a70 con 0x7fa0dc165de0 2023-11-24T08:04:05.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e1ac8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc162db0 con 0x7fa0dc0c25e0 2023-11-24T08:04:05.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e0ac6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0dc165de0 0x7fa0dc0c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e0ac6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0dc165de0 0x7fa0dc0c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55662/0 (socket says 172.21.15.57:55662) 2023-11-24T08:04:05.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0e0ac6640 1 -- 172.21.15.57:0/3303800874 learned_addr learned my addr 172.21.15.57:0/3303800874 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.812+0000 7fa0dbfff640 1 --2- 172.21.15.57:0/3303800874 >> v2:172.21.15.132:3300/0 conn(0x7fa0dc0c25e0 0x7fa0dc0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7f6bde965640 1 Processor -- start 2023-11-24T08:04:05.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7f6bde965640 1 -- start start 2023-11-24T08:04:05.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7fa0dbfff640 1 -- 172.21.15.57:0/3303800874 >> v2:172.21.15.57:3300/0 conn(0x7fa0dc165de0 msgr2=0x7fa0dc0c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7fa0dbfff640 1 --2- 172.21.15.57:0/3303800874 >> v2:172.21.15.57:3300/0 conn(0x7fa0dc165de0 0x7fa0dc0c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7fa0dbfff640 1 -- 172.21.15.57:0/3303800874 >> v1:172.21.15.132:6789/0 conn(0x7fa0dc0ce490 legacy=0x7fa0dc0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7fa0dbfff640 1 -- 172.21.15.57:0/3303800874 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0ce900 con 0x7fa0dc0c25e0 2023-11-24T08:04:05.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7f6c8ad9d640 1 --2- 172.21.15.57:0/4242077478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c159b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009870 tx=0x7f6c8001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9010937b2044f1df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7f6bde965640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6bd8157d70 0x7f6bd80715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.816+0000 7f6c8959a640 1 -- 172.21.15.57:0/4242077478 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800a89b0 con 0x7f6c8c0cc2f0 2023-11-24T08:04:05.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6c8959a640 1 -- 172.21.15.57:0/4242077478 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c800a8b10 con 0x7f6c8c0cc2f0 2023-11-24T08:04:05.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6c8959a640 1 -- 172.21.15.57:0/4242077478 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800a8ea0 con 0x7f6c8c0cc2f0 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bd7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6bd8157d70 0x7f6bd80715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bd7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6bd8157d70 0x7f6bd80715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53834/0 (socket says 172.21.15.57:53834) 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bde965640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd806de80 0x7f6bd815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bd7fff640 1 -- 172.21.15.57:0/2021241862 learned_addr learned my addr 172.21.15.57:0/2021241862 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd80cccd0 con 0x7f6bd8071b30 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd80720b0 con 0x7f6bd8157d70 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd80ccf20 con 0x7f6bd806de80 2023-11-24T08:04:05.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bdcf02640 1 --2- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd806de80 0x7f6bd815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bd7fff640 1 -- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd806de80 msgr2=0x7f6bd815a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bd7fff640 1 --2- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd806de80 0x7f6bd815a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bd7fff640 1 -- 172.21.15.57:0/2021241862 >> v1:172.21.15.132:6789/0 conn(0x7f6bd8071b30 legacy=0x7f6bd806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6bd7fff640 1 -- 172.21.15.57:0/2021241862 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80cd200 con 0x7f6bd8157d70 2023-11-24T08:04:05.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7fa0dbfff640 1 --2- 172.21.15.57:0/3303800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc0cdf50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0b1c20 tx=0x7fa0d001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5510134bd414af server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7fa0db7fe640 1 -- 172.21.15.57:0/3303800874 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00a5730 con 0x7fa0dc0c25e0 2023-11-24T08:04:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6509a17640 1 Processor -- start 2023-11-24T08:04:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7fa0db7fe640 1 -- 172.21.15.57:0/3303800874 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00a5890 con 0x7fa0dc0c25e0 2023-11-24T08:04:05.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7fa0db7fe640 1 -- 172.21.15.57:0/3303800874 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00a5c20 con 0x7fa0dc0c25e0 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6c90c91640 1 -- 172.21.15.57:0/4242077478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 msgr2=0x7f6c8c159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6c90c91640 1 --2- 172.21.15.57:0/4242077478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c159b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009870 tx=0x7f6c8001ed10 comp rx=0 tx=0).stop 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 -- 172.21.15.57:0/3303800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc0c25e0 msgr2=0x7fa0dc0cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.820+0000 7f6509a17640 1 -- start start 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 --2- 172.21.15.57:0/3303800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc0cdf50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0b1c20 tx=0x7fa0d001c840 comp rx=0 tx=0).stop 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 -- 172.21.15.57:0/3303800874 shutdown_connections 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 --2- 172.21.15.57:0/3303800874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc0cdf50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6c90c91640 1 -- 172.21.15.57:0/4242077478 shutdown_connections 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 --2- 172.21.15.57:0/3303800874 >> v2:172.21.15.57:3300/0 conn(0x7fa0dc165de0 0x7fa0dc0c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 -- 172.21.15.57:0/3303800874 >> 172.21.15.57:0/3303800874 conn(0x7fa0dc0cbb50 msgr2=0x7fa0dc0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6c90c91640 1 --2- 172.21.15.57:0/4242077478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c159b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6c90c91640 1 --2- 172.21.15.57:0/4242077478 >> v2:172.21.15.57:3300/0 conn(0x7f6c8c06d1b0 0x7f6c8c0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6c90c91640 1 -- 172.21.15.57:0/4242077478 >> 172.21.15.57:0/4242077478 conn(0x7f6c8c0b0bf0 msgr2=0x7f6c8c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6509a17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040b1600 0x7f65040cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 -- 172.21.15.57:0/3303800874 shutdown_connections 2023-11-24T08:04:05.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7fa0e1ac8640 1 -- 172.21.15.57:0/3303800874 wait complete. 2023-11-24T08:04:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6503fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040b1600 0x7f65040cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6503fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040b1600 0x7f65040cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57846/0 (socket says 172.21.15.57:57846) 2023-11-24T08:04:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6509216640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f65040cc670 0x7f65040cd9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:38184/0 (socket says 172.21.15.57:38184) 2023-11-24T08:04:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6509a17640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040ccfd0 con 0x7f6504159600 2023-11-24T08:04:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6509a17640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65041599e0 con 0x7f65040cc670 2023-11-24T08:04:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6509a17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650406cb10 con 0x7f65040b1600 2023-11-24T08:04:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6503fff640 1 -- 172.21.15.57:0/2129638046 learned_addr learned my addr 172.21.15.57:0/2129638046 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f65037fe640 1 -- 172.21.15.57:0/2129638046 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032473937 0 0) 0x7f65041599e0 con 0x7f65040cc670 2023-11-24T08:04:05.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f65037fe640 1 -- 172.21.15.57:0/2129638046 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64ec003530 con 0x7f65040cc670 2023-11-24T08:04:05.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6503fff640 1 -- 172.21.15.57:0/2129638046 >> v1:172.21.15.132:6789/0 conn(0x7f65040cc670 legacy=0x7f65040cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.824+0000 7f6503fff640 1 -- 172.21.15.57:0/2129638046 >> v1:172.21.15.57:6789/0 conn(0x7f6504159600 legacy=0x7f65040b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bd7fff640 1 --2- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd80715f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc401c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4bf740bd7bcc820 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6503fff640 1 -- 172.21.15.57:0/2129638046 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650406cdf0 con 0x7f65040b1600 2023-11-24T08:04:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bd6ffd640 1 -- 172.21.15.57:0/2021241862 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40ab600 con 0x7f6bd8157d70 2023-11-24T08:04:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bd6ffd640 1 -- 172.21.15.57:0/2021241862 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40a7050 con 0x7f6bd8157d70 2023-11-24T08:04:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bd6ffd640 1 -- 172.21.15.57:0/2021241862 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40ab980 con 0x7f6bd8157d70 2023-11-24T08:04:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6c90c91640 1 -- 172.21.15.57:0/4242077478 shutdown_connections 2023-11-24T08:04:05.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7fa0e1ac8640 1 Processor -- start 2023-11-24T08:04:05.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6c90c91640 1 -- 172.21.15.57:0/4242077478 wait complete. 2023-11-24T08:04:05.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7fa0e1ac8640 1 -- start start 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 msgr2=0x7f6bd80715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 --2- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd80715f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc401c500 comp rx=0 tx=0).stop 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 shutdown_connections 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 --2- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd806de80 0x7f6bd815a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 --2- 172.21.15.57:0/2021241862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd80715f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 >> 172.21.15.57:0/2021241862 conn(0x7f6bd80b0b60 msgr2=0x7f6bd80b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 shutdown_connections 2023-11-24T08:04:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7f6bde965640 1 -- 172.21.15.57:0/2021241862 wait complete. 2023-11-24T08:04:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7fa0e1ac8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc1624d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7fa0e1ac8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0dc0ce490 0x7fa0dc0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.828+0000 7fa0e1ac8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc165de0 0x7fa0dc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e1ac8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b0d60 con 0x7fa0dc0c25e0 2023-11-24T08:04:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e1ac8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b3840 con 0x7fa0dc165de0 2023-11-24T08:04:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e1ac8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0b3ae0 con 0x7fa0dc0ce490 2023-11-24T08:04:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 Processor -- start 2023-11-24T08:04:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc165de0 0x7fa0dc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc165de0 0x7fa0dc15aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53846/0 (socket says 172.21.15.57:53846) 2023-11-24T08:04:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 -- 172.21.15.57:0/3340075448 learned_addr learned my addr 172.21.15.57:0/3340075448 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0dbfff640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0dc0ce490 0x7fa0dc0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e0ac6640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc1624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 -- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0dc0ce490 msgr2=0x7fa0dc0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6bde965640 1 Processor -- start 2023-11-24T08:04:05.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0dc0ce490 0x7fa0dc0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 -- 172.21.15.57:0/3340075448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0dc0c25e0 msgr2=0x7fa0dc1624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6bde965640 1 -- start start 2023-11-24T08:04:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 -- start start 2023-11-24T08:04:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc1624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 -- 172.21.15.57:0/3340075448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0009a70 con 0x7fa0dc165de0 2023-11-24T08:04:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6503fff640 1 --2- 172.21.15.57:0/2129638046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040b1600 0x7f65040cd490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f64f40098a0 tx=0x7f64f401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693ec0260878b12f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e0ac6640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8c06d1b0 0x7f6c8c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c8c0b1710 0x7f6c8c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0c8720 con 0x7f6c8c0b1710 2023-11-24T08:04:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0c8a00 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c90c91640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0c8ce0 con 0x7f6c8c0cc2f0 2023-11-24T08:04:05.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6bde965640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd806de80 0x7f6bd8150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f65037fe640 1 -- 172.21.15.57:0/2129638046 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40ab600 con 0x7f65040b1600 2023-11-24T08:04:05.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f65037fe640 1 -- 172.21.15.57:0/2129638046 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f40a7050 con 0x7f65040b1600 2023-11-24T08:04:05.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f65037fe640 1 -- 172.21.15.57:0/2129638046 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40ab980 con 0x7f65040b1600 2023-11-24T08:04:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c8a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8c06d1b0 0x7f6c8c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c8a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8c06d1b0 0x7f6c8c0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53852/0 (socket says 172.21.15.57:53852) 2023-11-24T08:04:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c8a59c640 1 -- 172.21.15.57:0/2687031883 learned_addr learned my addr 172.21.15.57:0/2687031883 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7f6c8ad9d640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.832+0000 7fa0e12c7640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc165de0 0x7fa0dc15aa00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c3c0 tx=0x7fa0cc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c89d9b640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c8c0b1710 0x7f6c8c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c8a59c640 1 -- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 msgr2=0x7f6c8c0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c8a59c640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c8a59c640 1 -- 172.21.15.57:0/2687031883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c8c0b1710 msgr2=0x7f6c8c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c8a59c640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c8c0b1710 0x7f6c8c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c8a59c640 1 -- 172.21.15.57:0/2687031883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c800094d0 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6509a17640 1 -- 172.21.15.57:0/2129638046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040b1600 msgr2=0x7f65040cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6509a17640 1 --2- 172.21.15.57:0/2129638046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040b1600 0x7f65040cd490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f64f40098a0 tx=0x7f64f401c3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7fa0d97fa640 1 -- 172.21.15.57:0/3340075448 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011790 con 0x7fa0dc165de0 2023-11-24T08:04:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7fa0d97fa640 1 -- 172.21.15.57:0/3340075448 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0118f0 con 0x7fa0dc165de0 2023-11-24T08:04:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7fa0d97fa640 1 -- 172.21.15.57:0/3340075448 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011ca0 con 0x7fa0dc165de0 2023-11-24T08:04:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd806de80 0x7f6bd8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bde965640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd8071b30 0x7f6bd81559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bde965640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd8155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c8a59c640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8c06d1b0 0x7f6c8c0b4610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c7c0 tx=0x7f6c7c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6509a17640 1 -- 172.21.15.57:0/2129638046 shutdown_connections 2023-11-24T08:04:05.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6509a17640 1 --2- 172.21.15.57:0/2129638046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040b1600 0x7f65040cd490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6509a17640 1 -- 172.21.15.57:0/2129638046 >> 172.21.15.57:0/2129638046 conn(0x7f65040cbb50 msgr2=0x7f65040cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bde965640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8156510 con 0x7f6bd806de80 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bde965640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81567f0 con 0x7f6bd8157d70 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bde965640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8156ad0 con 0x7f6bd8071b30 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd8155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd8155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53856/0 (socket says 172.21.15.57:53856) 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 -- 172.21.15.57:0/174722777 learned_addr learned my addr 172.21.15.57:0/174722777 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd806de80 0x7f6bd8150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55680/0 (socket says 172.21.15.57:55680) 2023-11-24T08:04:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bd77fe640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd8071b30 0x7f6bd81559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c7affd640 1 -- 172.21.15.57:0/2687031883 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00aa50 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c7affd640 1 -- 172.21.15.57:0/2687031883 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00abb0 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c7affd640 1 -- 172.21.15.57:0/2687031883 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c012420 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c0c8fc0 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c0c83d0 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6509a17640 1 -- 172.21.15.57:0/2129638046 shutdown_connections 2023-11-24T08:04:05.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6509a17640 1 -- 172.21.15.57:0/2129638046 wait complete. 2023-11-24T08:04:05.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7fa0e1ac8640 1 -- 172.21.15.57:0/3340075448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc0b3dc0 con 0x7fa0dc165de0 2023-11-24T08:04:05.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7fa0e1ac8640 1 -- 172.21.15.57:0/3340075448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc0b45c0 con 0x7fa0dc165de0 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 -- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd8071b30 msgr2=0x7f6bd81559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd8071b30 0x7f6bd81559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 -- 172.21.15.57:0/174722777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd806de80 msgr2=0x7f6bd8150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd806de80 0x7f6bd8150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bdcf02640 1 -- 172.21.15.57:0/174722777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40094d0 con 0x7f6bd8157d70 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.836+0000 7f6bd7fff640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd806de80 0x7f6bd8150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6bdcf02640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd8155ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0007de0 tx=0x7f6bd000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6bd4ff9640 1 -- 172.21.15.57:0/174722777 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0014620 con 0x7f6bd8157d70 2023-11-24T08:04:05.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6509a17640 1 Processor -- start 2023-11-24T08:04:05.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6509a17640 1 -- start start 2023-11-24T08:04:05.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6bd4ff9640 1 -- 172.21.15.57:0/174722777 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000ee90 con 0x7f6bd8157d70 2023-11-24T08:04:05.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6bd4ff9640 1 -- 172.21.15.57:0/174722777 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00149c0 con 0x7f6bd8157d70 2023-11-24T08:04:05.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6c7affd640 1 -- 172.21.15.57:0/2687031883 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c7c012580 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6c7affd640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c6c066540 0x7f6c6c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6c7affd640 1 -- 172.21.15.57:0/2687031883 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c7c084000 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6509a17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65040b1600 0x7f6504207550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6509a17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040cc670 0x7f650409b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509a17640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6504159600 0x7f65040b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7fa0d97fa640 1 -- 172.21.15.57:0/3340075448 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0cc01c460 con 0x7fa0dc165de0 2023-11-24T08:04:05.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd8156db0 con 0x7f6bd8157d70 2023-11-24T08:04:05.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd8152340 con 0x7f6bd8157d70 2023-11-24T08:04:05.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd80711d0 con 0x7f6bd8157d70 2023-11-24T08:04:05.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7fa0d97fa640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa0c8066540 0x7fa0c8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509a17640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6504207a90 con 0x7f6504159600 2023-11-24T08:04:05.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509a17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6504158ad0 con 0x7f65040b1600 2023-11-24T08:04:05.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6c89d9b640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c6c066540 0x7f6c6c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509a17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6504158510 con 0x7f65040cc670 2023-11-24T08:04:05.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6504159600 0x7f65040b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6504159600 0x7f65040b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55688/0 (socket says 172.21.15.57:55688) 2023-11-24T08:04:05.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 -- 172.21.15.57:0/995920446 learned_addr learned my addr 172.21.15.57:0/995920446 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6508a15640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65040b1600 0x7f6504207550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.840+0000 7fa0d97fa640 1 -- 172.21.15.57:0/3340075448 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0cc083d90 con 0x7fa0dc165de0 2023-11-24T08:04:05.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6503fff640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040cc670 0x7f650409b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc04e850 con 0x7fa0dc165de0 2023-11-24T08:04:05.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7fa0e0ac6640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa0c8066540 0x7fa0c8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c0c91e0 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 -- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040cc670 msgr2=0x7f650409b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6c89d9b640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c6c066540 0x7f6c6c068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0ae210 tx=0x7f6c84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6bd4ff9640 1 -- 172.21.15.57:0/174722777 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6bd0014b20 con 0x7f6bd8157d70 2023-11-24T08:04:05.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040cc670 0x7f650409b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 -- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65040b1600 msgr2=0x7f6504207550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65040b1600 0x7f6504207550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 -- 172.21.15.57:0/995920446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40094d0 con 0x7f6504159600 2023-11-24T08:04:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7fa0e0ac6640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa0c8066540 0x7fa0c8068a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009ad0 tx=0x7fa0d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509216640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6504159600 0x7f65040b2b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f64f800c450 tx=0x7f64f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6bd4ff9640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6bbc066470 0x7f6bbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f65017fa640 1 -- 172.21.15.57:0/995920446 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8007480 con 0x7f6504159600 2023-11-24T08:04:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65041587f0 con 0x7f6504159600 2023-11-24T08:04:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f65017fa640 1 -- 172.21.15.57:0/995920446 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f80075e0 con 0x7f6504159600 2023-11-24T08:04:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f65017fa640 1 -- 172.21.15.57:0/995920446 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f8004a30 con 0x7f6504159600 2023-11-24T08:04:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65040b2660 con 0x7f6504159600 2023-11-24T08:04:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.844+0000 7f6bd4ff9640 1 -- 172.21.15.57:0/174722777 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bd00848c0 con 0x7f6bd8157d70 2023-11-24T08:04:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.848+0000 7f6bd7fff640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6bbc066470 0x7f6bbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.848+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e4005260 con 0x7f6504159600 2023-11-24T08:04:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.848+0000 7f6bd7fff640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6bbc066470 0x7f6bbc068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40ad000 tx=0x7f6bc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.848+0000 7f65017fa640 1 -- 172.21.15.57:0/995920446 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64f8004b90 con 0x7f6504159600 2023-11-24T08:04:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.848+0000 7f65017fa640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f64f0066470 0x7f64f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.848+0000 7f65017fa640 1 -- 172.21.15.57:0/995920446 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f8082fe0 con 0x7f6504159600 2023-11-24T08:04:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.852+0000 7f6508a15640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f64f0066470 0x7f64f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.852+0000 7fa0d97fa640 1 -- 172.21.15.57:0/3340075448 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0cc0511f0 con 0x7fa0dc165de0 2023-11-24T08:04:05.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.852+0000 7f6508a15640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f64f0066470 0x7f64f0068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0012f0 tx=0x7f64fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.856+0000 7f6bd4ff9640 1 -- 172.21.15.57:0/174722777 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6bd0051d30 con 0x7f6bd8157d70 2023-11-24T08:04:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.856+0000 7f65017fa640 1 -- 172.21.15.57:0/995920446 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64f80504d0 con 0x7f6504159600 2023-11-24T08:04:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.860+0000 7f6c7affd640 1 -- 172.21.15.57:0/2687031883 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c7c0514f0 con 0x7f6c8c06d1b0 2023-11-24T08:04:05.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.904+0000 7f889b596640 1 Processor -- start 2023-11-24T08:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.904+0000 7f889b596640 1 -- start start 2023-11-24T08:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.904+0000 7f889b596640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f889415f180 0x7f8894165d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.904+0000 7f889b596640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f889415f560 0x7f8894161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.904+0000 7f889b596640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8894165310 con 0x7f8894162260 2023-11-24T08:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.904+0000 7f889b596640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88941658d0 con 0x7f889415f180 2023-11-24T08:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.904+0000 7f889b596640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88941662a0 con 0x7f889415f560 2023-11-24T08:04:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f58a5594640 1 Processor -- start 2023-11-24T08:04:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f58a5594640 1 -- start start 2023-11-24T08:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f889a594640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f889415f180 0x7f8894165d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f889a594640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f889415f180 0x7f8894165d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55704/0 (socket says 172.21.15.57:55704) 2023-11-24T08:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f889a594640 1 -- 172.21.15.57:0/411045170 learned_addr learned my addr 172.21.15.57:0/411045170 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f889a594640 1 -- 172.21.15.57:0/411045170 >> v2:172.21.15.132:3300/0 conn(0x7f889415f560 msgr2=0x7f8894161d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f889a594640 1 --2- 172.21.15.57:0/411045170 >> v2:172.21.15.132:3300/0 conn(0x7f889415f560 0x7f8894161d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f889a594640 1 -- 172.21.15.57:0/411045170 >> v1:172.21.15.57:6789/0 conn(0x7f8894162260 legacy=0x7f88940c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f889a594640 1 -- 172.21.15.57:0/411045170 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894162810 con 0x7f889415f180 2023-11-24T08:04:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f58a5594640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f58a5594640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f589804fbe0 0x7f58980e3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f58a5594640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5898006620 con 0x7f58980076c0 2023-11-24T08:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f58a5594640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5898006900 con 0x7f589804fbe0 2023-11-24T08:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f58a5594640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898006be0 con 0x7f58980e3250 2023-11-24T08:04:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f589e7fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f589e7fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898006040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57892/0 (socket says 172.21.15.57:57892) 2023-11-24T08:04:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f589e7fc640 1 -- 172.21.15.57:0/1105236509 learned_addr learned my addr 172.21.15.57:0/1105236509 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f889a594640 1 --2- 172.21.15.57:0/411045170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f8894165d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88940b9860 tx=0x7f888401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cc1ebbd4bb7068 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f8899592640 1 -- 172.21.15.57:0/411045170 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840ab620 con 0x7f889415f180 2023-11-24T08:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f8899592640 1 -- 172.21.15.57:0/411045170 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88840ab780 con 0x7f889415f180 2023-11-24T08:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f8899592640 1 -- 172.21.15.57:0/411045170 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840abb10 con 0x7f889415f180 2023-11-24T08:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f889b596640 1 -- 172.21.15.57:0/411045170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 msgr2=0x7f8894165d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f889b596640 1 --2- 172.21.15.57:0/411045170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f8894165d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88940b9860 tx=0x7f888401c420 comp rx=0 tx=0).stop 2023-11-24T08:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.908+0000 7f589effd640 1 --2- 172.21.15.57:0/1105236509 >> v2:172.21.15.57:3300/0 conn(0x7f589804fbe0 0x7f58980e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f589effd640 1 -- 172.21.15.57:0/1105236509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 msgr2=0x7f5898006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f589effd640 1 --2- 172.21.15.57:0/1105236509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f589effd640 1 -- 172.21.15.57:0/1105236509 >> v1:172.21.15.132:6789/0 conn(0x7f58980076c0 legacy=0x7f589804f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7f589effd640 1 -- 172.21.15.57:0/1105236509 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898006ec0 con 0x7f589804fbe0 2023-11-24T08:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f889b596640 1 -- 172.21.15.57:0/411045170 shutdown_connections 2023-11-24T08:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f889b596640 1 --2- 172.21.15.57:0/411045170 >> v2:172.21.15.132:3300/0 conn(0x7f889415f560 0x7f8894161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.912+0000 7fb56529a640 1 Processor -- start 2023-11-24T08:04:05.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f889b596640 1 --2- 172.21.15.57:0/411045170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f8894165d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f889b596640 1 -- 172.21.15.57:0/411045170 >> 172.21.15.57:0/411045170 conn(0x7f88940cbb50 msgr2=0x7f88940cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f889b596640 1 -- 172.21.15.57:0/411045170 shutdown_connections 2023-11-24T08:04:05.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f889b596640 1 -- 172.21.15.57:0/411045170 wait complete. 2023-11-24T08:04:05.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f589effd640 1 --2- 172.21.15.57:0/1105236509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e3630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f58a0063f10 tx=0x7f58a0096d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bba58337f39fad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f589ffff640 1 -- 172.21.15.57:0/1105236509 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a011fbe0 con 0x7f589804fbe0 2023-11-24T08:04:05.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f589ffff640 1 -- 172.21.15.57:0/1105236509 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a011fd80 con 0x7f589804fbe0 2023-11-24T08:04:05.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f589ffff640 1 -- 172.21.15.57:0/1105236509 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0127640 con 0x7f589804fbe0 2023-11-24T08:04:05.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7fb56529a640 1 -- start start 2023-11-24T08:04:05.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7fb56529a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5580df2b0 0x7fb55804faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7fb56529a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb558007550 0x7fb55804ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f58a5594640 1 -- 172.21.15.57:0/1105236509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 msgr2=0x7f58980e3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.916+0000 7f58a5594640 1 --2- 172.21.15.57:0/1105236509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e3630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f58a0063f10 tx=0x7f58a0096d80 comp rx=0 tx=0).stop 2023-11-24T08:04:05.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889b596640 1 Processor -- start 2023-11-24T08:04:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89b1b1c640 1 Processor -- start 2023-11-24T08:04:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5580df2b0 0x7fb55804faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f58a5594640 1 -- 172.21.15.57:0/1105236509 shutdown_connections 2023-11-24T08:04:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f58a5594640 1 --2- 172.21.15.57:0/1105236509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e3630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f58a5594640 1 --2- 172.21.15.57:0/1105236509 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898006040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f58a5594640 1 -- 172.21.15.57:0/1105236509 >> 172.21.15.57:0/1105236509 conn(0x7f5898054c70 msgr2=0x7f5898055080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb558007550 0x7fb55804ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb558007550 0x7fb55804ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53882/0 (socket says 172.21.15.57:53882) 2023-11-24T08:04:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55f7fe640 1 -- 172.21.15.57:0/625014021 learned_addr learned my addr 172.21.15.57:0/625014021 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89b1b1c640 1 -- start start 2023-11-24T08:04:05.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f58a5594640 1 -- 172.21.15.57:0/1105236509 shutdown_connections 2023-11-24T08:04:05.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb558054120 con 0x7fb558033d00 2023-11-24T08:04:05.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f58a5594640 1 -- 172.21.15.57:0/1105236509 wait complete. 2023-11-24T08:04:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb558038090 con 0x7fb5580df2b0 2023-11-24T08:04:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889b596640 1 -- start start 2023-11-24T08:04:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889b596640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f889414f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889b596640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f889415f560 0x7f88941605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238441675 0 0) 0x7fb558054120 con 0x7fb558033d00 2023-11-24T08:04:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580df690 con 0x7fb558007550 2023-11-24T08:04:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889b596640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8894162260 0x7f8894160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889a594640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f889414f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89b1b1c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89ac06f4a0 0x7f89ac162520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89b1b1c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f89ac0cf250 0x7f89ac0ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89b1b1c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac0b4b50 con 0x7f89ac161a30 2023-11-24T08:04:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89b1b1c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac162a60 con 0x7f89ac0cf250 2023-11-24T08:04:05.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89b1b1c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac06f910 con 0x7f89ac06f4a0 2023-11-24T08:04:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889a594640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f889414f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55728/0 (socket says 172.21.15.57:55728) 2023-11-24T08:04:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f8899d93640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f889415f560 0x7f88941605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f8899d93640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f889415f560 0x7f88941605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57906/0 (socket says 172.21.15.57:57906) 2023-11-24T08:04:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889ad95640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8894162260 0x7f8894160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889ad95640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8894162260 0x7f8894160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53898/0 (socket says 172.21.15.57:53898) 2023-11-24T08:04:05.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb548003530 con 0x7fb558033d00 2023-11-24T08:04:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889a594640 1 -- 172.21.15.57:0/674555338 learned_addr learned my addr 172.21.15.57:0/674555338 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88940adbe0 con 0x7f889415f180 2023-11-24T08:04:05.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514744802 0 0) 0x7fb548003530 con 0x7fb558033d00 2023-11-24T08:04:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 >> v2:172.21.15.132:3300/0 conn(0x7fb558007550 msgr2=0x7fb55804ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 --2- 172.21.15.57:0/625014021 >> v2:172.21.15.132:3300/0 conn(0x7fb558007550 0x7fb55804ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 >> v2:172.21.15.57:3300/0 conn(0x7fb5580df2b0 msgr2=0x7fb55804faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 --2- 172.21.15.57:0/625014021 >> v2:172.21.15.57:3300/0 conn(0x7fb5580df2b0 0x7fb55804faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558054400 con 0x7fb558033d00 2023-11-24T08:04:05.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894163020 con 0x7f8894162260 2023-11-24T08:04:05.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940ad340 con 0x7f889415f560 2023-11-24T08:04:05.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89a2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89ac06f4a0 0x7f89ac162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89a2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89ac06f4a0 0x7f89ac162520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53902/0 (socket says 172.21.15.57:53902) 2023-11-24T08:04:05.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.920+0000 7f89a2ffd640 1 -- 172.21.15.57:0/1320374789 learned_addr learned my addr 172.21.15.57:0/1320374789 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fb554001680 con 0x7fb558033d00 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 >> v1:172.21.15.132:6789/0 conn(0x7fb558033d00 legacy=0x7fb5580e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5480039d0 0x7fb548003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5480047d0 0x7fb548004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480052b0 0x7fb54800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558038090 con 0x7fb5480052b0 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580df690 con 0x7fb5480047d0 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54800c230 con 0x7fb5480039d0 2023-11-24T08:04:05.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55f7fe640 1 --2- 172.21.15.57:0/625014021 >> v2:172.21.15.132:3300/0 conn(0x7fb558007550 0x7fb55804ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:05.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f89a2ffd640 1 -- 172.21.15.57:0/1320374789 >> v2:172.21.15.57:3300/0 conn(0x7f89ac0cf250 msgr2=0x7f89ac0ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f89a2ffd640 1 --2- 172.21.15.57:0/1320374789 >> v2:172.21.15.57:3300/0 conn(0x7f89ac0cf250 0x7f89ac0ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f89a2ffd640 1 -- 172.21.15.57:0/1320374789 >> v1:172.21.15.57:6789/0 conn(0x7f89ac161a30 legacy=0x7f89ac161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f8899d93640 1 -- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8894162260 msgr2=0x7f8894160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f8899d93640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8894162260 0x7f8894160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f8899d93640 1 -- 172.21.15.57:0/674555338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 msgr2=0x7f889414f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f8899d93640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f889414f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f8899d93640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840094d0 con 0x7f889415f560 2023-11-24T08:04:05.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55e7fc640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5480047d0 0x7fb548004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f8899d93640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f889415f560 0x7f88941605a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f888c00be20 tx=0x7f888c009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f889ad95640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8894162260 0x7f8894160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:05.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55effd640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5480039d0 0x7fb548003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f888affd640 1 -- 172.21.15.57:0/674555338 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c014440 con 0x7f889415f560 2023-11-24T08:04:05.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f888affd640 1 -- 172.21.15.57:0/674555338 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0145a0 con 0x7f889415f560 2023-11-24T08:04:05.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f888affd640 1 -- 172.21.15.57:0/674555338 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c014930 con 0x7f889415f560 2023-11-24T08:04:05.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88940ad620 con 0x7f889415f560 2023-11-24T08:04:05.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889414fa80 con 0x7f889415f560 2023-11-24T08:04:05.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f58a5594640 1 Processor -- start 2023-11-24T08:04:05.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f58a5594640 1 -- start start 2023-11-24T08:04:05.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7f89a2ffd640 1 -- 172.21.15.57:0/1320374789 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0cf6e0 con 0x7f89ac06f4a0 2023-11-24T08:04:05.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.924+0000 7fb55f7fe640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480052b0 0x7fb54800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7fb55effd640 1 -- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5480047d0 msgr2=0x7fb548004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7fb55effd640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5480047d0 0x7fb548004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7fb55effd640 1 -- 172.21.15.57:0/625014021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480052b0 msgr2=0x7fb54800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7fb55effd640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480052b0 0x7fb54800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7fb55effd640 1 -- 172.21.15.57:0/625014021 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548003530 con 0x7fb5480039d0 2023-11-24T08:04:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7fb55f7fe640 1 -- 172.21.15.57:0/625014021 reap_dead start 2023-11-24T08:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f58a5594640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58980076c0 0x7f589804bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f58a5594640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f58a5594640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898036300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f58a5594640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980e1dc0 con 0x7f589804fbe0 2023-11-24T08:04:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f58a5594640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589804c3d0 con 0x7f58980076c0 2023-11-24T08:04:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f58a5594640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589804c6b0 con 0x7f58980e3250 2023-11-24T08:04:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55754/0 (socket says 172.21.15.57:55754) 2023-11-24T08:04:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 -- 172.21.15.57:0/419664446 learned_addr learned my addr 172.21.15.57:0/419664446 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 -- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 msgr2=0x7f5898036300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:04:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898036300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 -- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58980076c0 msgr2=0x7f589804bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58980076c0 0x7f589804bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 -- 172.21.15.57:0/419664446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a004f7e0 con 0x7f589804fbe0 2023-11-24T08:04:05.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f589dffb640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e1880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f589400b3e0 tx=0x7f589400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.928+0000 7f888affd640 1 -- 172.21.15.57:0/674555338 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f888c014a90 con 0x7f889415f560 2023-11-24T08:04:05.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f888affd640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f88780664c0 0x7f8878068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889404e850 con 0x7f889415f560 2023-11-24T08:04:05.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f58877fe640 1 -- 172.21.15.57:0/419664446 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011830 con 0x7f589804fbe0 2023-11-24T08:04:05.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f58877fe640 1 -- 172.21.15.57:0/419664446 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58940119b0 con 0x7f589804fbe0 2023-11-24T08:04:05.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f58877fe640 1 -- 172.21.15.57:0/419664446 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011d60 con 0x7f589804fbe0 2023-11-24T08:04:05.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f888affd640 1 -- 172.21.15.57:0/674555338 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f888c083e40 con 0x7f889415f560 2023-11-24T08:04:05.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f889a594640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f88780664c0 0x7f8878068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f89a2ffd640 1 --2- 172.21.15.57:0/1320374789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac06f4a0 0x7f89ac162520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0b25c0 tx=0x7f899401bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7758b168e26dc604 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f58a5594640 1 -- 172.21.15.57:0/419664446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589804c990 con 0x7f589804fbe0 2023-11-24T08:04:05.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f58a5594640 1 -- 172.21.15.57:0/419664446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589804cf50 con 0x7f589804fbe0 2023-11-24T08:04:05.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7fb55effd640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5480039d0 0x7fb548003df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb55000dc40 tx=0x7fb55001ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738bd7ae75cc62b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5898008590 con 0x7f589804fbe0 2023-11-24T08:04:05.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f889a594640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f88780664c0 0x7f8878068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88940c5e50 tx=0x7f88840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f89aaffd640 1 -- 172.21.15.57:0/1320374789 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940a56f0 con 0x7f89ac06f4a0 2023-11-24T08:04:05.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f89aaffd640 1 -- 172.21.15.57:0/1320374789 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940a5850 con 0x7f89ac06f4a0 2023-11-24T08:04:05.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f89aaffd640 1 -- 172.21.15.57:0/1320374789 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940a56f0 con 0x7f89ac06f4a0 2023-11-24T08:04:05.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f89b1b1c640 1 -- 172.21.15.57:0/1320374789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac06f4a0 msgr2=0x7f89ac162520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.932+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/1320374789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac06f4a0 0x7f89ac162520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0b25c0 tx=0x7f899401bf80 comp rx=0 tx=0).stop 2023-11-24T08:04:05.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 -- 172.21.15.57:0/1320374789 shutdown_connections 2023-11-24T08:04:05.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/1320374789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac06f4a0 0x7f89ac162520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/1320374789 >> v2:172.21.15.57:3300/0 conn(0x7f89ac0cf250 0x7f89ac0ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 -- 172.21.15.57:0/1320374789 >> 172.21.15.57:0/1320374789 conn(0x7f89ac0cc390 msgr2=0x7f89ac0cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f58877fe640 1 -- 172.21.15.57:0/419664446 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f589401a400 con 0x7f589804fbe0 2023-11-24T08:04:05.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f58877fe640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f588c0664c0 0x7f588c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f58877fe640 1 -- 172.21.15.57:0/419664446 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5894083ee0 con 0x7f589804fbe0 2023-11-24T08:04:05.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 -- 172.21.15.57:0/1320374789 shutdown_connections 2023-11-24T08:04:05.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 -- 172.21.15.57:0/1320374789 wait complete. 2023-11-24T08:04:05.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f589e7fc640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f588c0664c0 0x7f588c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5500a7c70 con 0x7fb5480039d0 2023-11-24T08:04:05.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5500ab070 con 0x7fb5480039d0 2023-11-24T08:04:05.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7fb55dffb640 1 -- 172.21.15.57:0/625014021 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5500b1400 con 0x7fb5480039d0 2023-11-24T08:04:05.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f888affd640 1 -- 172.21.15.57:0/674555338 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f888c0514e0 con 0x7f889415f560 2023-11-24T08:04:05.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 Processor -- start 2023-11-24T08:04:05.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5480039d0 msgr2=0x7fb548003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7fb56529a640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5480039d0 0x7fb548003df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb55000dc40 tx=0x7fb55001ec80 comp rx=0 tx=0).stop 2023-11-24T08:04:05.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.936+0000 7f89b1b1c640 1 -- start start 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89b1b1c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ac06f4a0 0x7f89ac14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89b1b1c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac0cf250 0x7f89ac15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89b1b1c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac161a30 0x7f89ac06a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89b1b1c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac150080 con 0x7f89ac161a30 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89b1b1c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac15df70 con 0x7f89ac0cf250 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89b1b1c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac15e250 con 0x7f89ac06f4a0 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ac06f4a0 0x7f89ac14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ac06f4a0 0x7f89ac14fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57938/0 (socket says 172.21.15.57:57938) 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 -- 172.21.15.57:0/2897671361 learned_addr learned my addr 172.21.15.57:0/2897671361 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 -- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac0cf250 msgr2=0x7f89ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89abfff640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac161a30 0x7f89ac06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89a2ffd640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac0cf250 0x7f89ac15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac0cf250 0x7f89ac15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 -- 172.21.15.57:0/2897671361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac161a30 msgr2=0x7f89ac06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac161a30 0x7f89ac06a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 -- 172.21.15.57:0/2897671361 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940094d0 con 0x7f89ac06f4a0 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89a2ffd640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac0cf250 0x7f89ac15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89ab7fe640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ac06f4a0 0x7f89ac14fb40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f899c00caf0 tx=0x7f899c002070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.940+0000 7f89a8ff9640 1 -- 172.21.15.57:0/2897671361 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c003db0 con 0x7f89ac06f4a0 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7f89a8ff9640 1 -- 172.21.15.57:0/2897671361 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c00a700 con 0x7f89ac06f4a0 2023-11-24T08:04:05.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7f89a8ff9640 1 -- 172.21.15.57:0/2897671361 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00aa90 con 0x7f89ac06f4a0 2023-11-24T08:04:05.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 shutdown_connections 2023-11-24T08:04:05.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7fb56529a640 1 --2- 172.21.15.57:0/625014021 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5480039d0 0x7fb548003df0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 >> 172.21.15.57:0/625014021 conn(0x7fb558009fc0 msgr2=0x7fb55800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:05.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac15e530 con 0x7f89ac06f4a0 2023-11-24T08:04:05.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 shutdown_connections 2023-11-24T08:04:05.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7fb56529a640 1 -- 172.21.15.57:0/625014021 wait complete. 2023-11-24T08:04:05.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac155980 con 0x7f89ac06f4a0 2023-11-24T08:04:05.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7f589e7fc640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f588c0664c0 0x7f588c068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5890006f50 tx=0x7f5890006ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.944+0000 7f58877fe640 1 -- 172.21.15.57:0/419664446 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58940514d0 con 0x7f589804fbe0 2023-11-24T08:04:05.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb56529a640 1 Processor -- start 2023-11-24T08:04:05.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac155b70 con 0x7f89ac06f4a0 2023-11-24T08:04:05.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb56529a640 1 -- start start 2023-11-24T08:04:05.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb56529a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480039d0 0x7fb5580d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb56529a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5580cf070 0x7fb5580d2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb56529a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cd5c0 0x7fb5580d2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb55e7fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5580cf070 0x7fb5580d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb55e7fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5580cf070 0x7fb5580d2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57950/0 (socket says 172.21.15.57:57950) 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.948+0000 7fb55e7fc640 1 -- 172.21.15.57:0/1832448229 learned_addr learned my addr 172.21.15.57:0/1832448229 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55f7fe640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cd5c0 0x7fb5580d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb56529a640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580ceeb0 con 0x7fb5480039d0 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb56529a640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580cde10 con 0x7fb5580cd5c0 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb56529a640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580ce0f0 con 0x7fb5580cf070 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55effd640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480039d0 0x7fb5580d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55e7fc640 1 -- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cd5c0 msgr2=0x7fb5580d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55e7fc640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cd5c0 0x7fb5580d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55e7fc640 1 -- 172.21.15.57:0/1832448229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480039d0 msgr2=0x7fb5580d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:05.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55e7fc640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480039d0 0x7fb5580d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:05.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55e7fc640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580ce3d0 con 0x7fb5580cf070 2023-11-24T08:04:05.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7fb55e7fc640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5580cf070 0x7fb5580d2340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb55400f960 tx=0x7fb55400fe20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7f89a8ff9640 1 -- 172.21.15.57:0/2897671361 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f899c00abf0 con 0x7f89ac06f4a0 2023-11-24T08:04:05.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7f89a8ff9640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f898c066540 0x7f898c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7f89a8ff9640 1 -- 172.21.15.57:0/2897671361 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f899c083870 con 0x7f89ac06f4a0 2023-11-24T08:04:05.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7f89a2ffd640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f898c066540 0x7f898c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.952+0000 7f89a2ffd640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f898c066540 0x7f898c068a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89940ae000 tx=0x7f8994008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.956+0000 7fb5477fe640 1 -- 172.21.15.57:0/1832448229 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554005320 con 0x7fb5580cf070 2023-11-24T08:04:05.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.956+0000 7fb5477fe640 1 -- 172.21.15.57:0/1832448229 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540067e0 con 0x7fb5580cf070 2023-11-24T08:04:05.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.956+0000 7fb5477fe640 1 -- 172.21.15.57:0/1832448229 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540054c0 con 0x7fb5580cf070 2023-11-24T08:04:05.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.956+0000 7fb56529a640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5580ce6b0 con 0x7fb5580cf070 2023-11-24T08:04:05.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.956+0000 7fb56529a640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5580cdaa0 con 0x7fb5580cf070 2023-11-24T08:04:05.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.956+0000 7f89a8ff9640 1 -- 172.21.15.57:0/2897671361 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f899c050d60 con 0x7f89ac06f4a0 2023-11-24T08:04:05.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.956+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb538005260 con 0x7fb5580cf070 2023-11-24T08:04:05.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.960+0000 7fb5477fe640 1 -- 172.21.15.57:0/1832448229 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb554006b90 con 0x7fb5580cf070 2023-11-24T08:04:05.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.960+0000 7fb5477fe640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb54c0664a0 0x7fb54c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:05.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.960+0000 7fb5477fe640 1 -- 172.21.15.57:0/1832448229 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb554083670 con 0x7fb5580cf070 2023-11-24T08:04:05.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.964+0000 7fb55effd640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb54c0664a0 0x7fb54c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:05.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.964+0000 7fb55effd640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb54c0664a0 0x7fb54c068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5500b2000 tx=0x7fb5500046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:05.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:05.968+0000 7fb5477fe640 1 -- 172.21.15.57:0/1832448229 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb554050b90 con 0x7fb5580cf070 2023-11-24T08:04:06.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.176+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa0dc0b4270 con 0x7fa0dc165de0 2023-11-24T08:04:06.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.176+0000 7fa0d97fa640 1 -- 172.21.15.57:0/3340075448 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0cc054810 con 0x7fa0dc165de0 2023-11-24T08:04:06.177 INFO:teuthology.orchestra.run.smithi057.stdout:64424509445 2023-11-24T08:04:06.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa0c8066540 msgr2=0x7fa0c8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa0c8066540 0x7fa0c8068a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009ad0 tx=0x7fa0d4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc165de0 msgr2=0x7fa0dc15aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc165de0 0x7fa0dc15aa00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c3c0 tx=0x7fa0cc00c880 comp rx=0 tx=0).stop 2023-11-24T08:04:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 shutdown_connections 2023-11-24T08:04:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa0c8066540 0x7fa0c8068a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc165de0 0x7fa0dc15aa00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0dc0ce490 0x7fa0dc0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 --2- 172.21.15.57:0/3340075448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0dc0c25e0 0x7fa0dc1624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.180+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 >> 172.21.15.57:0/3340075448 conn(0x7fa0dc0cbb50 msgr2=0x7fa0dc15bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.184+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 shutdown_connections 2023-11-24T08:04:06.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.184+0000 7fa0c2ffd640 1 -- 172.21.15.57:0/3340075448 wait complete. 2023-11-24T08:04:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.192+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f64e4005510 con 0x7f6504159600 2023-11-24T08:04:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.192+0000 7f65017fa640 1 -- 172.21.15.57:0/995920446 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64f8018090 con 0x7f6504159600 2023-11-24T08:04:06.195 INFO:teuthology.orchestra.run.smithi057.stdout:64424509444 2023-11-24T08:04:06.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bd8156930 con 0x7f6bd8157d70 2023-11-24T08:04:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6bd4ff9640 1 -- 172.21.15.57:0/174722777 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bd8156930 con 0x7f6bd8157d70 2023-11-24T08:04:06.197 INFO:teuthology.orchestra.run.smithi057.stdout:64424509444 2023-11-24T08:04:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f64f0066470 msgr2=0x7f64f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f64f0066470 0x7f64f0068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0012f0 tx=0x7f64fc009040 comp rx=0 tx=0).stop 2023-11-24T08:04:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6504159600 msgr2=0x7f65040b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6504159600 0x7f65040b2b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f64f800c450 tx=0x7f64f800c910 comp rx=0 tx=0).stop 2023-11-24T08:04:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 shutdown_connections 2023-11-24T08:04:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f64f0066470 0x7f64f0068930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6504159600 0x7f65040b2b60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65040cc670 0x7f650409b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 --2- 172.21.15.57:0/995920446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65040b1600 0x7f6504207550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.196+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 >> 172.21.15.57:0/995920446 conn(0x7f65040cbb50 msgr2=0x7f65040acbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 shutdown_connections 2023-11-24T08:04:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6bbc066470 msgr2=0x7f6bbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6bbc066470 0x7f6bbc068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40ad000 tx=0x7f6bc4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6509a17640 1 -- 172.21.15.57:0/995920446 wait complete. 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 msgr2=0x7f6bd8155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd8155ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0007de0 tx=0x7f6bd000e4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 shutdown_connections 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6bbc066470 0x7f6bbc068930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6bd8157d70 0x7f6bd8155ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6bd8071b30 0x7f6bd81559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 --2- 172.21.15.57:0/174722777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd806de80 0x7f6bd8150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 >> 172.21.15.57:0/174722777 conn(0x7f6bd80b0b60 msgr2=0x7f6bd80cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 shutdown_connections 2023-11-24T08:04:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.200+0000 7f6bde965640 1 -- 172.21.15.57:0/174722777 wait complete. 2023-11-24T08:04:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.204+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c8c09d250 con 0x7f6c8c06d1b0 2023-11-24T08:04:06.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.204+0000 7f6c7affd640 1 -- 172.21.15.57:0/2687031883 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c7c016030 con 0x7f6c8c06d1b0 2023-11-24T08:04:06.206 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-11-24T08:04:06.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c6c066540 msgr2=0x7f6c6c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c6c066540 0x7f6c6c068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0ae210 tx=0x7f6c84008040 comp rx=0 tx=0).stop 2023-11-24T08:04:06.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8c06d1b0 msgr2=0x7f6c8c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8c06d1b0 0x7f6c8c0b4610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c7c0 tx=0x7f6c7c00cc80 comp rx=0 tx=0).stop 2023-11-24T08:04:06.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 shutdown_connections 2023-11-24T08:04:06.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c6c066540 0x7f6c6c068a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c8c0cc2f0 0x7f6c8c0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c8c0b1710 0x7f6c8c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 --2- 172.21.15.57:0/2687031883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c8c06d1b0 0x7f6c8c0b4610 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 >> 172.21.15.57:0/2687031883 conn(0x7f6c8c0b0bf0 msgr2=0x7f6c8c15b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 shutdown_connections 2023-11-24T08:04:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.208+0000 7f6c90c91640 1 -- 172.21.15.57:0/2687031883 wait complete. 2023-11-24T08:04:06.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2023-11-24T08:04:06.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.5 2023-11-24T08:04:06.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2023-11-24T08:04:06.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2023-11-24T08:04:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f589804d170 con 0x7f589804fbe0 2023-11-24T08:04:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58877fe640 1 -- 172.21.15.57:0/419664446 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5894054af0 con 0x7f589804fbe0 2023-11-24T08:04:06.261 INFO:teuthology.orchestra.run.smithi057.stdout:64424509445 2023-11-24T08:04:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f588c0664c0 msgr2=0x7f588c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f588c0664c0 0x7f588c068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5890006f50 tx=0x7f5890006ea0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 msgr2=0x7f58980e1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e1880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f589400b3e0 tx=0x7f589400b8a0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 shutdown_connections 2023-11-24T08:04:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f588c0664c0 0x7f588c068980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f58980e3250 0x7f5898036300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f589804fbe0 0x7f58980e1880 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 --2- 172.21.15.57:0/419664446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58980076c0 0x7f589804bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 >> 172.21.15.57:0/419664446 conn(0x7f5898054c70 msgr2=0x7f5898037e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 shutdown_connections 2023-11-24T08:04:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.260+0000 7f58857fa640 1 -- 172.21.15.57:0/419664446 wait complete. 2023-11-24T08:04:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.264+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f89ac0b2660 con 0x7f89ac06f4a0 2023-11-24T08:04:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.264+0000 7f89a8ff9640 1 -- 172.21.15.57:0/2897671361 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89ac0b2660 con 0x7f89ac06f4a0 2023-11-24T08:04:06.267 INFO:teuthology.orchestra.run.smithi057.stdout:64424509445 2023-11-24T08:04:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f898c066540 msgr2=0x7f898c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f898c066540 0x7f898c068a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89940ae000 tx=0x7f8994008040 comp rx=0 tx=0).stop 2023-11-24T08:04:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ac06f4a0 msgr2=0x7f89ac14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ac06f4a0 0x7f89ac14fb40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f899c00caf0 tx=0x7f899c002070 comp rx=0 tx=0).stop 2023-11-24T08:04:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 shutdown_connections 2023-11-24T08:04:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f898c066540 0x7f898c068a00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac161a30 0x7f89ac06a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ac0cf250 0x7f89ac15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 --2- 172.21.15.57:0/2897671361 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ac06f4a0 0x7f89ac14fb40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 >> 172.21.15.57:0/2897671361 conn(0x7f89ac0cc390 msgr2=0x7f89ac06dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 shutdown_connections 2023-11-24T08:04:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f89b1b1c640 1 -- 172.21.15.57:0/2897671361 wait complete. 2023-11-24T08:04:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f88940b18d0 con 0x7f889415f560 2023-11-24T08:04:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.268+0000 7f888affd640 1 -- 172.21.15.57:0/674555338 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f888c019020 con 0x7f889415f560 2023-11-24T08:04:06.272 INFO:teuthology.orchestra.run.smithi057.stdout:64424509444 2023-11-24T08:04:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f88780664c0 msgr2=0x7f8878068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f88780664c0 0x7f8878068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88940c5e50 tx=0x7f88840a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f889415f560 msgr2=0x7f88941605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f889415f560 0x7f88941605a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f888c00be20 tx=0x7f888c009f70 comp rx=0 tx=0).stop 2023-11-24T08:04:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 shutdown_connections 2023-11-24T08:04:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f88780664c0 0x7f8878068980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8894162260 0x7f8894160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f889415f560 0x7f88941605a0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f888c00be20 tx=0x7f888c009f70 comp rx=0 tx=0).stop 2023-11-24T08:04:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 --2- 172.21.15.57:0/674555338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f889415f180 0x7f889414f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 >> 172.21.15.57:0/674555338 conn(0x7f88940cbb50 msgr2=0x7f889415fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 shutdown_connections 2023-11-24T08:04:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.272+0000 7f889b596640 1 -- 172.21.15.57:0/674555338 wait complete. 2023-11-24T08:04:06.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2023-11-24T08:04:06.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-11-24T08:04:06.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.300+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb538005510 con 0x7fb5580cf070 2023-11-24T08:04:06.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.300+0000 7fb5477fe640 1 -- 172.21.15.57:0/1832448229 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb554050b90 con 0x7fb5580cf070 2023-11-24T08:04:06.302 INFO:teuthology.orchestra.run.smithi057.stdout:64424509444 2023-11-24T08:04:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb54c0664a0 msgr2=0x7fb54c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb54c0664a0 0x7fb54c068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb5500b2000 tx=0x7fb5500046d0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5580cf070 msgr2=0x7fb5580d2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5580cf070 0x7fb5580d2340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb55400f960 tx=0x7fb55400fe20 comp rx=0 tx=0).stop 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 shutdown_connections 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb54c0664a0 0x7fb54c068960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cd5c0 0x7fb5580d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb5580cf070 0x7fb5580d2340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 --2- 172.21.15.57:0/1832448229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5480039d0 0x7fb5580d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 >> 172.21.15.57:0/1832448229 conn(0x7fb558009fc0 msgr2=0x7fb558034e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 shutdown_connections 2023-11-24T08:04:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:06.304+0000 7fb5457fa640 1 -- 172.21.15.57:0/1832448229 wait complete. 2023-11-24T08:04:06.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2023-11-24T08:04:06.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.7 2023-11-24T08:04:07.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:04:07.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:04:07.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:04:07.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:04:07.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:04:07.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:04:07.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:04:07.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:04:07.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.412+0000 7f054fd01640 1 Processor -- start 2023-11-24T08:04:07.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054fd01640 1 -- start start 2023-11-24T08:04:07.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054fd01640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0548159420 0x7f054806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054fd01640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054815daf0 con 0x7f054815d0a0 2023-11-24T08:04:07.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054fd01640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054815ddd0 con 0x7f05480b30f0 2023-11-24T08:04:07.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054fd01640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054815e0b0 con 0x7f0548159420 2023-11-24T08:04:07.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054d29c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f054815d0a0 0x7f05480b29e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44316/0 (socket says 172.21.15.57:44316) 2023-11-24T08:04:07.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054d29c640 1 -- 172.21.15.57:0/2544828974 learned_addr learned my addr 172.21.15.57:0/2544828974 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:07.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.416+0000 7f054da9d640 1 --2- 172.21.15.57:0/2544828974 >> v2:172.21.15.132:3300/0 conn(0x7f0548159420 0x7f054806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984989657 0 0) 0x7f054815daf0 con 0x7f054815d0a0 2023-11-24T08:04:07.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0534003450 con 0x7f054815d0a0 2023-11-24T08:04:07.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887058746 0 0) 0x7f0534003450 con 0x7f054815d0a0 2023-11-24T08:04:07.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 >> v2:172.21.15.132:3300/0 conn(0x7f0548159420 msgr2=0x7f054806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 --2- 172.21.15.57:0/2544828974 >> v2:172.21.15.132:3300/0 conn(0x7f0548159420 0x7f054806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 >> v1:172.21.15.132:6789/0 conn(0x7f05480b30f0 legacy=0x7f0548070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054806da60 con 0x7f054815d0a0 2023-11-24T08:04:07.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f0540001a00 con 0x7f054815d0a0 2023-11-24T08:04:07.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 >> v1:172.21.15.57:6789/0 conn(0x7f054815d0a0 legacy=0x7f05480b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534003a70 0x7f0534003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0534008860 0x7f053400ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0534004890 0x7f0534004d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054815e0b0 con 0x7f0534008860 2023-11-24T08:04:07.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340055f0 con 0x7f0534004890 2023-11-24T08:04:07.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340057b0 con 0x7f0534003a70 2023-11-24T08:04:07.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054e29e640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0534004890 0x7f0534004d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054d29c640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0534008860 0x7f053400ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054e29e640 1 -- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534003a70 msgr2=0x7f0534003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:04:07.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054e29e640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534003a70 0x7f0534003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054e29e640 1 -- 172.21.15.57:0/2544828974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0534008860 msgr2=0x7f053400ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054e29e640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0534008860 0x7f053400ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.420+0000 7f054e29e640 1 -- 172.21.15.57:0/2544828974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054806da60 con 0x7f0534004890 2023-11-24T08:04:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.424+0000 7f054e29e640 1 -- 172.21.15.57:0/2544828974 reap_dead start 2023-11-24T08:04:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054e29e640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0534004890 0x7f0534004d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0538001860 tx=0x7f053801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcbfd6637a2c562f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380052d0 con 0x7f0534004890 2023-11-24T08:04:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538005430 con 0x7f0534004890 2023-11-24T08:04:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054ca9b640 1 -- 172.21.15.57:0/2544828974 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538003820 con 0x7f0534004890 2023-11-24T08:04:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054fd01640 1 -- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0534004890 msgr2=0x7f0534004d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054fd01640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0534004890 0x7f0534004d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0538001860 tx=0x7f053801c4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054fd01640 1 -- 172.21.15.57:0/2544828974 shutdown_connections 2023-11-24T08:04:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054fd01640 1 --2- 172.21.15.57:0/2544828974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0534004890 0x7f0534004d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054fd01640 1 -- 172.21.15.57:0/2544828974 >> 172.21.15.57:0/2544828974 conn(0x7f054806ae90 msgr2=0x7f05480b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054fd01640 1 -- 172.21.15.57:0/2544828974 shutdown_connections 2023-11-24T08:04:07.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.428+0000 7f054fd01640 1 -- 172.21.15.57:0/2544828974 wait complete. 2023-11-24T08:04:07.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.432+0000 7f054fd01640 1 Processor -- start 2023-11-24T08:04:07.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054fd01640 1 -- start start 2023-11-24T08:04:07.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054fd01640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534004890 0x7f05481f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054fd01640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0548145300 0x7f054814ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054fd01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05480ce8c0 0x7f05480ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054fd01640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548150340 con 0x7f0548145300 2023-11-24T08:04:07.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054fd01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480cf280 con 0x7f05480ce8c0 2023-11-24T08:04:07.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054fd01640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054814f490 con 0x7f0534004890 2023-11-24T08:04:07.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054e29e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05480ce8c0 0x7f05480ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054e29e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05480ce8c0 0x7f05480ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53948/0 (socket says 172.21.15.57:53948) 2023-11-24T08:04:07.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054e29e640 1 -- 172.21.15.57:0/3358041382 learned_addr learned my addr 172.21.15.57:0/3358041382 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.436+0000 7f054da9d640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534004890 0x7f05481f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054d29c640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0548145300 0x7f054814ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054da9d640 1 -- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05480ce8c0 msgr2=0x7f05480ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054da9d640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05480ce8c0 0x7f05480ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054da9d640 1 -- 172.21.15.57:0/3358041382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0548145300 msgr2=0x7f054814ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054da9d640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0548145300 0x7f054814ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054da9d640 1 -- 172.21.15.57:0/3358041382 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054814f6c0 con 0x7f0534004890 2023-11-24T08:04:07.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054d29c640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0548145300 0x7f054814ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:07.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.440+0000 7f054da9d640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534004890 0x7f05481f1f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f054400e780 tx=0x7f054400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.444+0000 7f053e7fc640 1 -- 172.21.15.57:0/3358041382 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400ee90 con 0x7f0534004890 2023-11-24T08:04:07.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.444+0000 7f053e7fc640 1 -- 172.21.15.57:0/3358041382 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054400c940 con 0x7f0534004890 2023-11-24T08:04:07.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.444+0000 7f053e7fc640 1 -- 172.21.15.57:0/3358041382 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400ccf0 con 0x7f0534004890 2023-11-24T08:04:07.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.444+0000 7f054fd01640 1 -- 172.21.15.57:0/3358041382 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054814f9a0 con 0x7f0534004890 2023-11-24T08:04:07.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.444+0000 7f054fd01640 1 -- 172.21.15.57:0/3358041382 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054814ff60 con 0x7f0534004890 2023-11-24T08:04:07.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.444+0000 7f054fd01640 1 -- 172.21.15.57:0/3358041382 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054804e850 con 0x7f0534004890 2023-11-24T08:04:07.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.448+0000 7f053e7fc640 1 -- 172.21.15.57:0/3358041382 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0544013470 con 0x7f0534004890 2023-11-24T08:04:07.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.448+0000 7f053e7fc640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f052c0664f0 0x7f052c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.448+0000 7f053e7fc640 1 -- 172.21.15.57:0/3358041382 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05440843e0 con 0x7f0534004890 2023-11-24T08:04:07.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.448+0000 7f054d29c640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f052c0664f0 0x7f052c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.452+0000 7f053e7fc640 1 -- 172.21.15.57:0/3358041382 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0544051860 con 0x7f0534004890 2023-11-24T08:04:07.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.452+0000 7f054d29c640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f052c0664f0 0x7f052c0689b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05480ae690 tx=0x7f0540009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.464+0000 7f6a75380640 1 Processor -- start 2023-11-24T08:04:07.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.464+0000 7f6a75380640 1 -- start start 2023-11-24T08:04:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.464+0000 7f6a75380640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a700cc4c0 0x7f6a7006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.464+0000 7f6a75380640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a70159b10 0x7f6a70159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.464+0000 7f6a75380640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7006cd20 con 0x7f6a701570c0 2023-11-24T08:04:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.464+0000 7f6a75380640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700ae9a0 con 0x7f6a70159b10 2023-11-24T08:04:07.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.464+0000 7f6a75380640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7015a4e0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6a701570c0 0x7f6a700cbdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:38218/0 (socket says 172.21.15.57:38218) 2023-11-24T08:04:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6effd640 1 -- 172.21.15.57:0/539234240 learned_addr learned my addr 172.21.15.57:0/539234240 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6e7fc640 1 --2- 172.21.15.57:0/539234240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a700cc4c0 0x7f6a7006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6f7fe640 1 --2- 172.21.15.57:0/539234240 >> v2:172.21.15.57:3300/0 conn(0x7f6a70159b10 0x7f6a70159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6e7fc640 1 -- 172.21.15.57:0/539234240 >> v2:172.21.15.57:3300/0 conn(0x7f6a70159b10 msgr2=0x7f6a70159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6e7fc640 1 --2- 172.21.15.57:0/539234240 >> v2:172.21.15.57:3300/0 conn(0x7f6a70159b10 0x7f6a70159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6e7fc640 1 -- 172.21.15.57:0/539234240 >> v1:172.21.15.132:6789/0 conn(0x7f6a701570c0 legacy=0x7f6a700cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.468+0000 7f6a6e7fc640 1 -- 172.21.15.57:0/539234240 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7015a760 con 0x7f6a700cc4c0 2023-11-24T08:04:07.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a6e7fc640 1 --2- 172.21.15.57:0/539234240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a700cc4c0 0x7f6a7006d1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400ba50 tx=0x7f6a6401e9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07aa2fd44de9e96 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a6dffb640 1 -- 172.21.15.57:0/539234240 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640a78b0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a6dffb640 1 -- 172.21.15.57:0/539234240 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640ab070 con 0x7f6a700cc4c0 2023-11-24T08:04:07.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a6dffb640 1 -- 172.21.15.57:0/539234240 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640a7c30 con 0x7f6a700cc4c0 2023-11-24T08:04:07.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 -- 172.21.15.57:0/539234240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a700cc4c0 msgr2=0x7f6a7006d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 --2- 172.21.15.57:0/539234240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a700cc4c0 0x7f6a7006d1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400ba50 tx=0x7f6a6401e9b0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 -- 172.21.15.57:0/539234240 shutdown_connections 2023-11-24T08:04:07.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 --2- 172.21.15.57:0/539234240 >> v2:172.21.15.57:3300/0 conn(0x7f6a70159b10 0x7f6a70159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 --2- 172.21.15.57:0/539234240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a700cc4c0 0x7f6a7006d1b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 -- 172.21.15.57:0/539234240 >> 172.21.15.57:0/539234240 conn(0x7f6a700b0bf0 msgr2=0x7f6a700b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 -- 172.21.15.57:0/539234240 shutdown_connections 2023-11-24T08:04:07.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.476+0000 7f6a75380640 1 -- 172.21.15.57:0/539234240 wait complete. 2023-11-24T08:04:07.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.480+0000 7f6a75380640 1 Processor -- start 2023-11-24T08:04:07.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.480+0000 7f6a75380640 1 -- start start 2023-11-24T08:04:07.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.480+0000 7fa19bf94640 1 Processor -- start 2023-11-24T08:04:07.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a75380640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700cc4c0 0x7f6a70203db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a75380640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a701570c0 0x7f6a701fd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700cc4c0 0x7f6a70203db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700cc4c0 0x7f6a70203db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53962/0 (socket says 172.21.15.57:53962) 2023-11-24T08:04:07.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 -- 172.21.15.57:0/1928845242 learned_addr learned my addr 172.21.15.57:0/1928845242 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a75380640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a70159b10 0x7f6a70158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19bf94640 1 -- start start 2023-11-24T08:04:07.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a75380640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b4b50 con 0x7f6a70159b10 2023-11-24T08:04:07.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6e7fc640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a701570c0 0x7f6a701fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19bf94640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1941570c0 0x7fa19406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19bf94640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa19415a220 0x7fa1940cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19bf94640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1940cc750 con 0x7fa1940cbdb0 2023-11-24T08:04:07.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19bf94640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19406cd20 con 0x7fa19415a220 2023-11-24T08:04:07.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19bf94640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940ae9a0 con 0x7fa1941570c0 2023-11-24T08:04:07.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a75380640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a702042f0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f84bd854640 1 Processor -- start 2023-11-24T08:04:07.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19952f640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa1940cbdb0 0x7fa194159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44318/0 (socket says 172.21.15.57:44318) 2023-11-24T08:04:07.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19952f640 1 -- 172.21.15.57:0/1013092404 learned_addr learned my addr 172.21.15.57:0/1013092404 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:07.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa199d30640 1 --2- 172.21.15.57:0/1013092404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1941570c0 0x7fa19406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a75380640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b4590 con 0x7f6a701570c0 2023-11-24T08:04:07.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f84bd854640 1 -- start start 2023-11-24T08:04:07.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7fa19a531640 1 --2- 172.21.15.57:0/1013092404 >> v2:172.21.15.132:3300/0 conn(0x7fa19415a220 0x7fa1940cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6f7fe640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a70159b10 0x7f6a70158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 -- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a701570c0 msgr2=0x7f6a701fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a701570c0 0x7f6a701fd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 -- 172.21.15.57:0/1928845242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a70159b10 msgr2=0x7f6a70158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a70159b10 0x7f6a70158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.484+0000 7f6a6effd640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6400b6b0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f6a6f7fe640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a70159b10 0x7f6a70158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:07.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f6a6effd640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700cc4c0 0x7f6a70203db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000ba50 tx=0x7f6a6000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84bd854640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84b80d0780 0x7f84b80c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84bd854640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1a50 0x7f84b80d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84bd854640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b80d3db0 con 0x7f84b80d1400 2023-11-24T08:04:07.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84bd854640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b80d2420 con 0x7f84b80d0780 2023-11-24T08:04:07.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84bd854640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80ce150 con 0x7f84b80d1a50 2023-11-24T08:04:07.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f6a577fe640 1 -- 172.21.15.57:0/1928845242 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000cbe0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f6a75380640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a700b4870 con 0x7f6a700cc4c0 2023-11-24T08:04:07.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f6a75380640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a700c64c0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f6a577fe640 1 -- 172.21.15.57:0/1928845242 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6000cd40 con 0x7f6a700cc4c0 2023-11-24T08:04:07.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1a50 0x7f84b80d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1a50 0x7f84b80d1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57996/0 (socket says 172.21.15.57:57996) 2023-11-24T08:04:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b77fe640 1 -- 172.21.15.57:0/1154072849 learned_addr learned my addr 172.21.15.57:0/1154072849 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b5ffb640 1 -- 172.21.15.57:0/1154072849 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757494383 0 0) 0x7f84b80d3db0 con 0x7f84b80d1400 2023-11-24T08:04:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f6a577fe640 1 -- 172.21.15.57:0/1928845242 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600156b0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b5ffb640 1 -- 172.21.15.57:0/1154072849 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a0003530 con 0x7f84b80d1400 2023-11-24T08:04:07.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7fa199d30640 1 -- 172.21.15.57:0/1013092404 >> v2:172.21.15.132:3300/0 conn(0x7fa19415a220 msgr2=0x7fa1940cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7fa199d30640 1 --2- 172.21.15.57:0/1013092404 >> v2:172.21.15.132:3300/0 conn(0x7fa19415a220 0x7fa1940cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7fa199d30640 1 -- 172.21.15.57:0/1013092404 >> v1:172.21.15.57:6789/0 conn(0x7fa1940cbdb0 legacy=0x7fa194159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7fa199d30640 1 -- 172.21.15.57:0/1013092404 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19415a760 con 0x7fa1941570c0 2023-11-24T08:04:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b77fe640 1 -- 172.21.15.57:0/1154072849 >> v2:172.21.15.132:3300/0 conn(0x7f84b80d0780 msgr2=0x7f84b80c6870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b77fe640 1 --2- 172.21.15.57:0/1154072849 >> v2:172.21.15.132:3300/0 conn(0x7f84b80d0780 0x7f84b80c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b77fe640 1 -- 172.21.15.57:0/1154072849 >> v1:172.21.15.132:6789/0 conn(0x7f84b80d1400 legacy=0x7f84b806b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.488+0000 7f84b77fe640 1 -- 172.21.15.57:0/1154072849 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b80d42e0 con 0x7f84b80d1a50 2023-11-24T08:04:07.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7f6a75380640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a50005260 con 0x7f6a700cc4c0 2023-11-24T08:04:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa199d30640 1 --2- 172.21.15.57:0/1013092404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1941570c0 0x7fa19406d1b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa18400a8c0 tx=0x7fa18401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5673c1e9b9b22aeb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa198d2e640 1 -- 172.21.15.57:0/1013092404 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840ab600 con 0x7fa1941570c0 2023-11-24T08:04:07.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa198d2e640 1 -- 172.21.15.57:0/1013092404 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1840a7050 con 0x7fa1941570c0 2023-11-24T08:04:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa198d2e640 1 -- 172.21.15.57:0/1013092404 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840ab980 con 0x7fa1941570c0 2023-11-24T08:04:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7f6a577fe640 1 -- 172.21.15.57:0/1928845242 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a60012070 con 0x7f6a700cc4c0 2023-11-24T08:04:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa19bf94640 1 -- 172.21.15.57:0/1013092404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1941570c0 msgr2=0x7fa19406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa19bf94640 1 --2- 172.21.15.57:0/1013092404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1941570c0 0x7fa19406d1b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa18400a8c0 tx=0x7fa18401c480 comp rx=0 tx=0).stop 2023-11-24T08:04:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa19bf94640 1 -- 172.21.15.57:0/1013092404 shutdown_connections 2023-11-24T08:04:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.492+0000 7fa19bf94640 1 --2- 172.21.15.57:0/1013092404 >> v2:172.21.15.132:3300/0 conn(0x7fa19415a220 0x7fa1940cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7fa19bf94640 1 --2- 172.21.15.57:0/1013092404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1941570c0 0x7fa19406d1b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7fa19bf94640 1 -- 172.21.15.57:0/1013092404 >> 172.21.15.57:0/1013092404 conn(0x7fa1940b0bf0 msgr2=0x7fa1940b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f6a577fe640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6a5c066570 0x7f6a5c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f6a577fe640 1 -- 172.21.15.57:0/1928845242 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a60083ea0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84b77fe640 1 --2- 172.21.15.57:0/1154072849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1a50 0x7f84b80d1ee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009e50 tx=0x7f84b001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf92dc26271e7a64 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7fa19bf94640 1 -- 172.21.15.57:0/1013092404 shutdown_connections 2023-11-24T08:04:07.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84b5ffb640 1 -- 172.21.15.57:0/1154072849 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00a57f0 con 0x7f84b80d1a50 2023-11-24T08:04:07.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7fa19bf94640 1 -- 172.21.15.57:0/1013092404 wait complete. 2023-11-24T08:04:07.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84b5ffb640 1 -- 172.21.15.57:0/1154072849 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00a5950 con 0x7f84b80d1a50 2023-11-24T08:04:07.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84b5ffb640 1 -- 172.21.15.57:0/1154072849 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00a5ce0 con 0x7f84b80d1a50 2023-11-24T08:04:07.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 -- 172.21.15.57:0/1154072849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1a50 msgr2=0x7f84b80d1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 --2- 172.21.15.57:0/1154072849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1a50 0x7f84b80d1ee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009e50 tx=0x7f84b001ca10 comp rx=0 tx=0).stop 2023-11-24T08:04:07.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f6a6e7fc640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6a5c066570 0x7f6a5c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 -- 172.21.15.57:0/1154072849 shutdown_connections 2023-11-24T08:04:07.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 --2- 172.21.15.57:0/1154072849 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1a50 0x7f84b80d1ee0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 --2- 172.21.15.57:0/1154072849 >> v2:172.21.15.132:3300/0 conn(0x7f84b80d0780 0x7f84b80c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 -- 172.21.15.57:0/1154072849 >> 172.21.15.57:0/1154072849 conn(0x7f84b809c7c0 msgr2=0x7f84b80d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 -- 172.21.15.57:0/1154072849 shutdown_connections 2023-11-24T08:04:07.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f84bd854640 1 -- 172.21.15.57:0/1154072849 wait complete. 2023-11-24T08:04:07.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7fa19bf94640 1 Processor -- start 2023-11-24T08:04:07.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7f6a6e7fc640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6a5c066570 0x7f6a5c068a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a640b2000 tx=0x7f6a640a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.496+0000 7fa19bf94640 1 -- start start 2023-11-24T08:04:07.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7f6a577fe640 1 -- 172.21.15.57:0/1928845242 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a60051300 con 0x7f6a700cc4c0 2023-11-24T08:04:07.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19bf94640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1940cbdb0 0x7fa194156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19bf94640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1941570c0 0x7fa1940b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19bf94640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19415a220 0x7fa194158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19bf94640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1941fb9f0 con 0x7fa1941570c0 2023-11-24T08:04:07.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19bf94640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940b4bd0 con 0x7fa1940cbdb0 2023-11-24T08:04:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19bf94640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa194156ad0 con 0x7fa19415a220 2023-11-24T08:04:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19a531640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19415a220 0x7fa194158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19a531640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19415a220 0x7fa194158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:58004/0 (socket says 172.21.15.57:58004) 2023-11-24T08:04:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7fa19a531640 1 -- 172.21.15.57:0/56054111 learned_addr learned my addr 172.21.15.57:0/56054111 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7f84bd854640 1 Processor -- start 2023-11-24T08:04:07.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.500+0000 7f84bd854640 1 -- start start 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa199d30640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1940cbdb0 0x7fa194156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19a531640 1 -- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1940cbdb0 msgr2=0x7fa194156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19a531640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1940cbdb0 0x7fa194156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19a531640 1 -- 172.21.15.57:0/56054111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1941570c0 msgr2=0x7fa1940b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19a531640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1941570c0 0x7fa1940b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19a531640 1 -- 172.21.15.57:0/56054111 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18400a520 con 0x7fa19415a220 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa199d30640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1940cbdb0 0x7fa194156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19a531640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19415a220 0x7fa194158320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa19000f9c0 tx=0x7fa19000fe80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84bd854640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84b80d0780 0x7f84b80c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84bd854640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1400 0x7f84b815d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84bd854640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84b80d1a50 0x7f84b80c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84bd854640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80cd410 con 0x7f84b80d1a50 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84bd854640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b815e3f0 con 0x7f84b80d0780 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84bd854640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80c93f0 con 0x7f84b80d1400 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa18a7fc640 1 -- 172.21.15.57:0/56054111 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19000c070 con 0x7fa19415a220 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa18a7fc640 1 -- 172.21.15.57:0/56054111 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19000db50 con 0x7fa19415a220 2023-11-24T08:04:07.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa18a7fc640 1 -- 172.21.15.57:0/56054111 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19001a480 con 0x7fa19415a220 2023-11-24T08:04:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84b80d0780 0x7f84b80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84b80d0780 0x7f84b80c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:53990/0 (socket says 172.21.15.57:53990) 2023-11-24T08:04:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84b67fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1400 0x7f84b815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84b67fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1400 0x7f84b815d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:58010/0 (socket says 172.21.15.57:58010) 2023-11-24T08:04:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84b67fc640 1 -- 172.21.15.57:0/3373922519 learned_addr learned my addr 172.21.15.57:0/3373922519 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7f84b77fe640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84b80d1a50 0x7f84b80c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1940b39a0 con 0x7fa19415a220 2023-11-24T08:04:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.504+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1940999e0 con 0x7fa19415a220 2023-11-24T08:04:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f84b6ffd640 1 -- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1400 msgr2=0x7f84b815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f84b6ffd640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1400 0x7f84b815d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f84b6ffd640 1 -- 172.21.15.57:0/3373922519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84b80d1a50 msgr2=0x7f84b80c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f84b6ffd640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84b80d1a50 0x7f84b80c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f84b6ffd640 1 -- 172.21.15.57:0/3373922519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0009b30 con 0x7f84b80d0780 2023-11-24T08:04:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19409d250 con 0x7fa19415a220 2023-11-24T08:04:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f84b6ffd640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84b80d0780 0x7f84b80c8d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00b440 tx=0x7f84ac00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f849ffff640 1 -- 172.21.15.57:0/3373922519 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011830 con 0x7f84b80d0780 2023-11-24T08:04:07.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f849ffff640 1 -- 172.21.15.57:0/3373922519 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac011990 con 0x7f84b80d0780 2023-11-24T08:04:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f849ffff640 1 -- 172.21.15.57:0/3373922519 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011830 con 0x7f84b80d0780 2023-11-24T08:04:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7f84b67fc640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1400 0x7f84b815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b80c96d0 con 0x7f84b80d0780 2023-11-24T08:04:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b80c9c90 con 0x7f84b80d0780 2023-11-24T08:04:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.508+0000 7fa18a7fc640 1 -- 172.21.15.57:0/56054111 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa19001a5e0 con 0x7fa19415a220 2023-11-24T08:04:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7fa18a7fc640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa178066540 0x7fa178068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7fa18a7fc640 1 -- 172.21.15.57:0/56054111 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa190015070 con 0x7fa19415a220 2023-11-24T08:04:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b80a13a0 con 0x7f84b80d0780 2023-11-24T08:04:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7f849ffff640 1 -- 172.21.15.57:0/3373922519 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84ac011b00 con 0x7f84b80d0780 2023-11-24T08:04:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7fa199d30640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa178066540 0x7fa178068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.512+0000 7fa18a7fc640 1 -- 172.21.15.57:0/56054111 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa190051880 con 0x7fa19415a220 2023-11-24T08:04:07.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.516+0000 7fa199d30640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa178066540 0x7fa178068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1840ad000 tx=0x7fa184009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.516+0000 7f849ffff640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f84a40664d0 0x7f84a4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.516+0000 7f849ffff640 1 -- 172.21.15.57:0/3373922519 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84ac054b50 con 0x7f84b80d0780 2023-11-24T08:04:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.516+0000 7f84b67fc640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f84a40664d0 0x7f84a4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.516+0000 7f84b67fc640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f84a40664d0 0x7f84a4068990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f84b80b21c0 tx=0x7f84a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.520+0000 7f849ffff640 1 -- 172.21.15.57:0/3373922519 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84ac051620 con 0x7f84b80d0780 2023-11-24T08:04:07.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f1959479640 1 Processor -- start 2023-11-24T08:04:07.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f1959479640 1 -- start start 2023-11-24T08:04:07.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f1959479640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f195415d570 0x7f19540ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f1959479640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540c9650 con 0x7f19540cc3f0 2023-11-24T08:04:07.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f1959479640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540c98a0 con 0x7f195406d040 2023-11-24T08:04:07.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f1959479640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540c9b80 con 0x7f195415d570 2023-11-24T08:04:07.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f19537fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f19540cc3f0 0x7f19540ac520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44328/0 (socket says 172.21.15.57:44328) 2023-11-24T08:04:07.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.564+0000 7f19537fe640 1 -- 172.21.15.57:0/1490168448 learned_addr learned my addr 172.21.15.57:0/1490168448 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:07.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622766652 0 0) 0x7f19540c9650 con 0x7f19540cc3f0 2023-11-24T08:04:07.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1940003530 con 0x7f19540cc3f0 2023-11-24T08:04:07.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866802424 0 0) 0x7f1940003530 con 0x7f19540cc3f0 2023-11-24T08:04:07.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 >> v2:172.21.15.132:3300/0 conn(0x7f195415d570 msgr2=0x7f19540ae550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:07.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 --2- 172.21.15.57:0/1490168448 >> v2:172.21.15.132:3300/0 conn(0x7f195415d570 0x7f19540ae550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 >> v1:172.21.15.132:6789/0 conn(0x7f195406d040 legacy=0x7f19540cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540ac000 con 0x7f19540cc3f0 2023-11-24T08:04:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f193c001680 con 0x7f19540cc3f0 2023-11-24T08:04:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 >> v1:172.21.15.57:6789/0 conn(0x7f19540cc3f0 legacy=0x7f19540ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1940003980 0x7f1940003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19400047d0 0x7f1940004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1940005390 0x7f194000b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c9b80 con 0x7f19400047d0 2023-11-24T08:04:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194000c2d0 con 0x7f1940003980 2023-11-24T08:04:07.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194000c490 con 0x7f1940005390 2023-11-24T08:04:07.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f19527fc640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19400047d0 0x7f1940004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f19537fe640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1940005390 0x7f194000b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f19527fc640 1 -- 172.21.15.57:0/1490168448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1940005390 msgr2=0x7f194000b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f19527fc640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1940005390 0x7f194000b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f19527fc640 1 -- 172.21.15.57:0/1490168448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1940003980 msgr2=0x7f1940003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:04:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f19527fc640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1940003980 0x7f1940003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.568+0000 7f19527fc640 1 -- 172.21.15.57:0/1490168448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540ac000 con 0x7f19400047d0 2023-11-24T08:04:07.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.572+0000 7f19537fe640 1 -- 172.21.15.57:0/1490168448 reap_dead start 2023-11-24T08:04:07.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.572+0000 7f657bfff640 1 Processor -- start 2023-11-24T08:04:07.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.572+0000 7f657bfff640 1 -- start start 2023-11-24T08:04:07.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.572+0000 7f19527fc640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19400047d0 0x7f1940004c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f194c001670 tx=0x7f194c01c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ba415edf4c3728 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.572+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c005270 con 0x7f19400047d0 2023-11-24T08:04:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.572+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c0a7070 con 0x7f19400047d0 2023-11-24T08:04:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.572+0000 7f1951ffb640 1 -- 172.21.15.57:0/1490168448 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c003620 con 0x7f19400047d0 2023-11-24T08:04:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65740e32b0 0x7f657403e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f65740077e0 0x7f6574054050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657bfff640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657403bfa0 con 0x7f6574053bf0 2023-11-24T08:04:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657bfff640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6574058660 con 0x7f65740077e0 2023-11-24T08:04:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657bfff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6574057dc0 con 0x7f65740e32b0 2023-11-24T08:04:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657a7fc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6574053bf0 0x7f65740e6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44342/0 (socket says 172.21.15.57:44342) 2023-11-24T08:04:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657a7fc640 1 -- 172.21.15.57:0/2337263369 learned_addr learned my addr 172.21.15.57:0/2337263369 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657b7fe640 1 --2- 172.21.15.57:0/2337263369 >> v2:172.21.15.57:3300/0 conn(0x7f65740077e0 0x7f6574054050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657affd640 1 --2- 172.21.15.57:0/2337263369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65740e32b0 0x7f657403e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f6579ffb640 1 -- 172.21.15.57:0/2337263369 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568717311 0 0) 0x7f657403bfa0 con 0x7f6574053bf0 2023-11-24T08:04:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f6579ffb640 1 -- 172.21.15.57:0/2337263369 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6564003530 con 0x7f6574053bf0 2023-11-24T08:04:07.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657affd640 1 -- 172.21.15.57:0/2337263369 >> v2:172.21.15.57:3300/0 conn(0x7f65740077e0 msgr2=0x7f6574054050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657affd640 1 --2- 172.21.15.57:0/2337263369 >> v2:172.21.15.57:3300/0 conn(0x7f65740077e0 0x7f6574054050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657affd640 1 -- 172.21.15.57:0/2337263369 >> v1:172.21.15.57:6789/0 conn(0x7f6574053bf0 legacy=0x7f65740e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657affd640 1 -- 172.21.15.57:0/2337263369 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6574054590 con 0x7f65740e32b0 2023-11-24T08:04:07.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f657b7fe640 1 --2- 172.21.15.57:0/2337263369 >> v2:172.21.15.57:3300/0 conn(0x7f65740077e0 0x7f6574054050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f1959479640 1 -- 172.21.15.57:0/1490168448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19400047d0 msgr2=0x7f1940004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f1959479640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19400047d0 0x7f1940004c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f194c001670 tx=0x7f194c01c2f0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f1959479640 1 -- 172.21.15.57:0/1490168448 shutdown_connections 2023-11-24T08:04:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f1959479640 1 --2- 172.21.15.57:0/1490168448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19400047d0 0x7f1940004c50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f1959479640 1 -- 172.21.15.57:0/1490168448 >> 172.21.15.57:0/1490168448 conn(0x7f19540b0bf0 msgr2=0x7f19540b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f1959479640 1 -- 172.21.15.57:0/1490168448 shutdown_connections 2023-11-24T08:04:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.576+0000 7f1959479640 1 -- 172.21.15.57:0/1490168448 wait complete. 2023-11-24T08:04:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 Processor -- start 2023-11-24T08:04:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 -- start start 2023-11-24T08:04:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19400047d0 0x7f19540c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19540c20a0 0x7f19540999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19540affe0 0x7f19540c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c53d0 con 0x7f19540affe0 2023-11-24T08:04:07.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1954099f20 con 0x7f19540c20a0 2023-11-24T08:04:07.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1959479640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c6730 con 0x7f19400047d0 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f19527fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19540c20a0 0x7f19540999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19400047d0 0x7f19540c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19400047d0 0x7f19540c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:58040/0 (socket says 172.21.15.57:58040) 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 -- 172.21.15.57:0/1642184992 learned_addr learned my addr 172.21.15.57:0/1642184992 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 -- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19540c20a0 msgr2=0x7f19540999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19540c20a0 0x7f19540999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 -- 172.21.15.57:0/1642184992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19540affe0 msgr2=0x7f19540c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19540affe0 0x7f19540c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.580+0000 7f1952ffd640 1 -- 172.21.15.57:0/1642184992 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540b04c0 con 0x7f19400047d0 2023-11-24T08:04:07.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f1952ffd640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19400047d0 0x7f19540c6940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f194400b9c0 tx=0x7f194400be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f194b7fe640 1 -- 172.21.15.57:0/1642184992 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400cba0 con 0x7f19400047d0 2023-11-24T08:04:07.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f194b7fe640 1 -- 172.21.15.57:0/1642184992 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194400cd00 con 0x7f19400047d0 2023-11-24T08:04:07.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f194b7fe640 1 -- 172.21.15.57:0/1642184992 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944014680 con 0x7f19400047d0 2023-11-24T08:04:07.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f657affd640 1 --2- 172.21.15.57:0/2337263369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65740e32b0 0x7f657403e820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f656c0097c0 tx=0x7f656c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a88f8a3a2d3d638 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f6579ffb640 1 -- 172.21.15.57:0/2337263369 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c0ab600 con 0x7f65740e32b0 2023-11-24T08:04:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f6579ffb640 1 -- 172.21.15.57:0/2337263369 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c0a7050 con 0x7f65740e32b0 2023-11-24T08:04:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f6579ffb640 1 -- 172.21.15.57:0/2337263369 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c0ab980 con 0x7f65740e32b0 2023-11-24T08:04:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19540c6170 con 0x7f19400047d0 2023-11-24T08:04:07.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540c5820 con 0x7f19400047d0 2023-11-24T08:04:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f657bfff640 1 -- 172.21.15.57:0/2337263369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65740e32b0 msgr2=0x7f657403e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f657bfff640 1 --2- 172.21.15.57:0/2337263369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65740e32b0 0x7f657403e820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f656c0097c0 tx=0x7f656c01c450 comp rx=0 tx=0).stop 2023-11-24T08:04:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f657bfff640 1 -- 172.21.15.57:0/2337263369 shutdown_connections 2023-11-24T08:04:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f657bfff640 1 --2- 172.21.15.57:0/2337263369 >> v2:172.21.15.57:3300/0 conn(0x7f65740077e0 0x7f6574054050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f657bfff640 1 --2- 172.21.15.57:0/2337263369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65740e32b0 0x7f657403e820 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.584+0000 7f657bfff640 1 -- 172.21.15.57:0/2337263369 >> 172.21.15.57:0/2337263369 conn(0x7f65740559c0 msgr2=0x7f6574055dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.588+0000 7f657bfff640 1 -- 172.21.15.57:0/2337263369 shutdown_connections 2023-11-24T08:04:07.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.588+0000 7f657bfff640 1 -- 172.21.15.57:0/2337263369 wait complete. 2023-11-24T08:04:07.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.588+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195409ce80 con 0x7f19400047d0 2023-11-24T08:04:07.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.588+0000 7f37b3dec640 1 Processor -- start 2023-11-24T08:04:07.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.588+0000 7f37b3dec640 1 -- start start 2023-11-24T08:04:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.588+0000 7f657bfff640 1 Processor -- start 2023-11-24T08:04:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657bfff640 1 -- start start 2023-11-24T08:04:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f194b7fe640 1 -- 172.21.15.57:0/1642184992 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f19440147e0 con 0x7f19400047d0 2023-11-24T08:04:07.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f194b7fe640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19340664f0 0x7f19340689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65740077e0 0x7f65740e5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6574053bf0 0x7f65740df470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65740d4f50 0x7f65740d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f37b3dec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0cab60 0x7f37ac0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f37b3dec640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac0ccbd0 con 0x7f37ac0cb480 2023-11-24T08:04:07.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f37b3dec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac06dac0 con 0x7f37ac0ce070 2023-11-24T08:04:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f37b3dec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac06dda0 con 0x7f37ac0cab60 2023-11-24T08:04:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657bfff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65740d6020 con 0x7f65740077e0 2023-11-24T08:04:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f37b2389640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f37ac0ce070 0x7f37ac16b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:38232/0 (socket says 172.21.15.57:38232) 2023-11-24T08:04:07.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f37b2389640 1 -- 172.21.15.57:0/3731868837 learned_addr learned my addr 172.21.15.57:0/3731868837 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657bfff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65740d5410 con 0x7f65740d4f50 2023-11-24T08:04:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657bfff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65740d56f0 con 0x7f6574053bf0 2023-11-24T08:04:07.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f19527fc640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19340664f0 0x7f19340689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65740d4f50 0x7f65740d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f194b7fe640 1 -- 172.21.15.57:0/1642184992 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1944054bd0 con 0x7f19400047d0 2023-11-24T08:04:07.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f37b1b88640 1 --2- 172.21.15.57:0/3731868837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0cab60 0x7f37ac0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657a7fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6574053bf0 0x7f65740df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657a7fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6574053bf0 0x7f65740df470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:58046/0 (socket says 172.21.15.57:58046) 2023-11-24T08:04:07.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.592+0000 7f657a7fc640 1 -- 172.21.15.57:0/1452204245 learned_addr learned my addr 172.21.15.57:0/1452204245 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f19527fc640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19340664f0 0x7f19340689b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f194c0aa000 tx=0x7f194c001030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f37b1b88640 1 -- 172.21.15.57:0/3731868837 >> v1:172.21.15.132:6789/0 conn(0x7f37ac0ce070 legacy=0x7f37ac16b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657affd640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65740077e0 0x7f65740e5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657a7fc640 1 -- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65740d4f50 msgr2=0x7f65740d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657a7fc640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65740d4f50 0x7f65740d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657a7fc640 1 -- 172.21.15.57:0/1452204245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65740077e0 msgr2=0x7f65740e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657a7fc640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65740077e0 0x7f65740e5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657a7fc640 1 -- 172.21.15.57:0/1452204245 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c009420 con 0x7f6574053bf0 2023-11-24T08:04:07.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657affd640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65740077e0 0x7f65740e5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:07.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f37b1b88640 1 -- 172.21.15.57:0/3731868837 >> v1:172.21.15.57:6789/0 conn(0x7f37ac0cb480 legacy=0x7f37ac06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f657a7fc640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6574053bf0 0x7f65740df470 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f657000c4d0 tx=0x7f657000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.596+0000 7f37b1b88640 1 -- 172.21.15.57:0/3731868837 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac06e080 con 0x7f37ac0cab60 2023-11-24T08:04:07.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f194b7fe640 1 -- 172.21.15.57:0/1642184992 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19440516a0 con 0x7f19400047d0 2023-11-24T08:04:07.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f6563fff640 1 -- 172.21.15.57:0/1452204245 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570005cf0 con 0x7f6574053bf0 2023-11-24T08:04:07.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f37b1b88640 1 --2- 172.21.15.57:0/3731868837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0cab60 0x7f37ac0caf40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009dc0 tx=0x7f37a401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37502399ff62d48d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65740d59d0 con 0x7f6574053bf0 2023-11-24T08:04:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f6563fff640 1 -- 172.21.15.57:0/1452204245 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6570005e50 con 0x7f6574053bf0 2023-11-24T08:04:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f6563fff640 1 -- 172.21.15.57:0/1452204245 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570005cf0 con 0x7f6574053bf0 2023-11-24T08:04:07.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65740e63d0 con 0x7f6574053bf0 2023-11-24T08:04:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.600+0000 7f37b0b86640 1 -- 172.21.15.57:0/3731868837 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40a5840 con 0x7f37ac0cab60 2023-11-24T08:04:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f37b0b86640 1 -- 172.21.15.57:0/3731868837 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a40a59a0 con 0x7f37ac0cab60 2023-11-24T08:04:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f37b0b86640 1 -- 172.21.15.57:0/3731868837 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40a5840 con 0x7f37ac0cab60 2023-11-24T08:04:07.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f37b3dec640 1 -- 172.21.15.57:0/3731868837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0cab60 msgr2=0x7f37ac0caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f37b3dec640 1 --2- 172.21.15.57:0/3731868837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0cab60 0x7f37ac0caf40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009dc0 tx=0x7f37a401c930 comp rx=0 tx=0).stop 2023-11-24T08:04:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f37b3dec640 1 -- 172.21.15.57:0/3731868837 shutdown_connections 2023-11-24T08:04:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f37b3dec640 1 --2- 172.21.15.57:0/3731868837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0cab60 0x7f37ac0caf40 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009dc0 tx=0x7f37a401c930 comp rx=0 tx=0).stop 2023-11-24T08:04:07.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f37b3dec640 1 -- 172.21.15.57:0/3731868837 >> 172.21.15.57:0/3731868837 conn(0x7f37ac0b0bf0 msgr2=0x7f37ac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65740d61d0 con 0x7f6574053bf0 2023-11-24T08:04:07.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.604+0000 7f6563fff640 1 -- 172.21.15.57:0/1452204245 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6570007070 con 0x7f6574053bf0 2023-11-24T08:04:07.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.608+0000 7f6563fff640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6568066500 0x7f65680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.608+0000 7f37b3dec640 1 -- 172.21.15.57:0/3731868837 shutdown_connections 2023-11-24T08:04:07.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.608+0000 7f37b3dec640 1 -- 172.21.15.57:0/3731868837 wait complete. 2023-11-24T08:04:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.608+0000 7f6563fff640 1 -- 172.21.15.57:0/1452204245 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6570082f30 con 0x7f6574053bf0 2023-11-24T08:04:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.608+0000 7f657affd640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6568066500 0x7f65680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.608+0000 7f657affd640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6568066500 0x7f65680689c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f656c0ad000 tx=0x7f656c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 Processor -- start 2023-11-24T08:04:07.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 -- start start 2023-11-24T08:04:07.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f6563fff640 1 -- 172.21.15.57:0/1452204245 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65740d61d0 con 0x7f6574053bf0 2023-11-24T08:04:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37ac0cb480 0x7f37ac154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0ce070 0x7f37ac15e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37ac15ee30 0x7f37ac1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac161550 con 0x7f37ac0cb480 2023-11-24T08:04:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac162310 con 0x7f37ac15ee30 2023-11-24T08:04:07.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.612+0000 7f37b3dec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac162560 con 0x7f37ac0ce070 2023-11-24T08:04:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0ce070 0x7f37ac15e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0ce070 0x7f37ac15e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:58072/0 (socket says 172.21.15.57:58072) 2023-11-24T08:04:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 -- 172.21.15.57:0/2466984210 learned_addr learned my addr 172.21.15.57:0/2466984210 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1b88640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37ac0cb480 0x7f37ac154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 -- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37ac15ee30 msgr2=0x7f37ac1605d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:04:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37ac15ee30 0x7f37ac1605d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 -- 172.21.15.57:0/2466984210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37ac0cb480 msgr2=0x7f37ac154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37ac0cb480 0x7f37ac154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 -- 172.21.15.57:0/2466984210 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a4009a70 con 0x7f37ac0ce070 2023-11-24T08:04:07.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b1387640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0ce070 0x7f37ac15e8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f379c00c410 tx=0x7f379c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37a27fc640 1 -- 172.21.15.57:0/2466984210 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c011790 con 0x7f37ac0ce070 2023-11-24T08:04:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37a27fc640 1 -- 172.21.15.57:0/2466984210 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c0118f0 con 0x7f37ac0ce070 2023-11-24T08:04:07.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37a27fc640 1 -- 172.21.15.57:0/2466984210 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c011cc0 con 0x7f37ac0ce070 2023-11-24T08:04:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.616+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac162840 con 0x7f37ac0ce070 2023-11-24T08:04:07.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.620+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac162e00 con 0x7f37ac0ce070 2023-11-24T08:04:07.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.620+0000 7f37a27fc640 1 -- 172.21.15.57:0/2466984210 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f379c01c460 con 0x7f37ac0ce070 2023-11-24T08:04:07.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.624+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac09d250 con 0x7f37ac0ce070 2023-11-24T08:04:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.624+0000 7f37a27fc640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3790066470 0x7f3790068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.624+0000 7f37a27fc640 1 -- 172.21.15.57:0/2466984210 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f379c083b80 con 0x7f37ac0ce070 2023-11-24T08:04:07.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.624+0000 7f37b1b88640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3790066470 0x7f3790068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.628+0000 7f37b1b88640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3790066470 0x7f3790068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f37a40af000 tx=0x7f37a40a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.632+0000 7f37a27fc640 1 -- 172.21.15.57:0/2466984210 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f379c050f60 con 0x7f37ac0ce070 2023-11-24T08:04:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66ff274640 1 Processor -- start 2023-11-24T08:04:07.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66ff274640 1 -- start start 2023-11-24T08:04:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66ff274640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f66f8160aa0 0x7f66f80d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66ff274640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f66f80d0240 0x7f66f80d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66ff274640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f80cf1a0 con 0x7f66f80ca2f0 2023-11-24T08:04:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66ff274640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80cf480 con 0x7f66f80d0240 2023-11-24T08:04:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66ff274640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80cf760 con 0x7f66f8160aa0 2023-11-24T08:04:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.636+0000 7f66fea73640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f66f80ca2f0 0x7f66f80d31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44372/0 (socket says 172.21.15.57:44372) 2023-11-24T08:04:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fea73640 1 -- 172.21.15.57:0/3741120924 learned_addr learned my addr 172.21.15.57:0/3741120924 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fda71640 1 --2- 172.21.15.57:0/3741120924 >> v2:172.21.15.57:3300/0 conn(0x7f66f80d0240 0x7f66f80d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972494043 0 0) 0x7f66f80cf1a0 con 0x7f66f80ca2f0 2023-11-24T08:04:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e4003530 con 0x7f66f80ca2f0 2023-11-24T08:04:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 420425419 0 0) 0x7f66e4003530 con 0x7f66f80ca2f0 2023-11-24T08:04:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 >> v2:172.21.15.132:3300/0 conn(0x7f66f8160aa0 msgr2=0x7f66f80d0e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:04:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 --2- 172.21.15.57:0/3741120924 >> v2:172.21.15.132:3300/0 conn(0x7f66f8160aa0 0x7f66f80d0e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 >> v2:172.21.15.57:3300/0 conn(0x7f66f80d0240 msgr2=0x7f66f80d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 --2- 172.21.15.57:0/3741120924 >> v2:172.21.15.57:3300/0 conn(0x7f66f80d0240 0x7f66f80d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80cfa40 con 0x7f66f80ca2f0 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f66f0001a00 con 0x7f66f80ca2f0 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 >> v1:172.21.15.57:6789/0 conn(0x7f66f80ca2f0 legacy=0x7f66f80d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66e4003980 0x7f66e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66e4005190 0x7f66e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80cf480 con 0x7f66e4003980 2023-11-24T08:04:07.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80cf760 con 0x7f66e40047d0 2023-11-24T08:04:07.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e400c1b0 con 0x7f66e4005190 2023-11-24T08:04:07.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fda71640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fea73640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66e4005190 0x7f66e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fda71640 1 -- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66e4005190 msgr2=0x7f66e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fda71640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66e4005190 0x7f66e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fda71640 1 -- 172.21.15.57:0/3741120924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66e4003980 msgr2=0x7f66e4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fe272640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66e4003980 0x7f66e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fda71640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66e4003980 0x7f66e4003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fda71640 1 -- 172.21.15.57:0/3741120924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4003530 con 0x7f66e40047d0 2023-11-24T08:04:07.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.640+0000 7f66fea73640 1 -- 172.21.15.57:0/3741120924 reap_dead start 2023-11-24T08:04:07.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66fda71640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009ae0 tx=0x7f66f401ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e931e4e2708fd24f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40a55c0 con 0x7f66e40047d0 2023-11-24T08:04:07.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f40a5720 con 0x7f66e40047d0 2023-11-24T08:04:07.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66fd270640 1 -- 172.21.15.57:0/3741120924 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40a5ad0 con 0x7f66e40047d0 2023-11-24T08:04:07.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66ff274640 1 -- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 msgr2=0x7f66e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66ff274640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009ae0 tx=0x7f66f401ca50 comp rx=0 tx=0).stop 2023-11-24T08:04:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66ff274640 1 -- 172.21.15.57:0/3741120924 shutdown_connections 2023-11-24T08:04:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66ff274640 1 --2- 172.21.15.57:0/3741120924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.648+0000 7f66ff274640 1 -- 172.21.15.57:0/3741120924 >> 172.21.15.57:0/3741120924 conn(0x7f66f808cca0 msgr2=0x7f66f809c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.652+0000 7f66ff274640 1 -- 172.21.15.57:0/3741120924 shutdown_connections 2023-11-24T08:04:07.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.652+0000 7f66ff274640 1 -- 172.21.15.57:0/3741120924 wait complete. 2023-11-24T08:04:07.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.652+0000 7f66ff274640 1 Processor -- start 2023-11-24T08:04:07.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.652+0000 7f66ff274640 1 -- start start 2023-11-24T08:04:07.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66ff274640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66f81539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66ff274640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66f80c9370 0x7f66f814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66ff274640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66f80ce340 0x7f66f80ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66ff274640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80ced00 con 0x7f66f80c9370 2023-11-24T08:04:07.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fda71640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66f80c9370 0x7f66f814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fe272640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66f81539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66ff274640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f81537f0 con 0x7f66e40047d0 2023-11-24T08:04:07.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fda71640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66f80c9370 0x7f66f814e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55866/0 (socket says 172.21.15.57:55866) 2023-11-24T08:04:07.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fda71640 1 -- 172.21.15.57:0/2324300041 learned_addr learned my addr 172.21.15.57:0/2324300041 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:07.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fea73640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66f80ce340 0x7f66f80ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66ff274640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b7f30 con 0x7f66f80ce340 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fea73640 1 -- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 msgr2=0x7f66f81539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fea73640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66f81539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fea73640 1 -- 172.21.15.57:0/2324300041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66f80c9370 msgr2=0x7f66f814e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fea73640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66f80c9370 0x7f66f814e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fea73640 1 -- 172.21.15.57:0/2324300041 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80b87d0 con 0x7f66f80ce340 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.656+0000 7f66fea73640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66f80ce340 0x7f66f80ce7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f66f80d0d70 tx=0x7f66f000a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.660+0000 7f66eeffd640 1 -- 172.21.15.57:0/2324300041 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000acc0 con 0x7f66f80ce340 2023-11-24T08:04:07.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.660+0000 7f66eeffd640 1 -- 172.21.15.57:0/2324300041 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000ae20 con 0x7f66f80ce340 2023-11-24T08:04:07.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.660+0000 7f66eeffd640 1 -- 172.21.15.57:0/2324300041 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f00135f0 con 0x7f66f80ce340 2023-11-24T08:04:07.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.660+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f80c97d0 con 0x7f66f80ce340 2023-11-24T08:04:07.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.660+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f80c9a30 con 0x7f66f80ce340 2023-11-24T08:04:07.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.664+0000 7f66fe272640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66f81539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:07.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.664+0000 7f66eeffd640 1 -- 172.21.15.57:0/2324300041 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66f0013750 con 0x7f66f80ce340 2023-11-24T08:04:07.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.664+0000 7f66eeffd640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f66dc066540 0x7f66dc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.664+0000 7f66eeffd640 1 -- 172.21.15.57:0/2324300041 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66f00844c0 con 0x7f66f80ce340 2023-11-24T08:04:07.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.664+0000 7f66fe272640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f66dc066540 0x7f66dc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.664+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f80b8960 con 0x7f66f80ce340 2023-11-24T08:04:07.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.668+0000 7f66fe272640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f66dc066540 0x7f66dc068a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f66f8067bd0 tx=0x7f66e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.672+0000 7f66eeffd640 1 -- 172.21.15.57:0/2324300041 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66f0051940 con 0x7f66f80ce340 2023-11-24T08:04:07.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.796+0000 7f054fd01640 1 -- 172.21.15.57:0/3358041382 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05481f3430 con 0x7f0534004890 2023-11-24T08:04:07.802 INFO:teuthology.orchestra.run.smithi057.stdout:64424509447 2023-11-24T08:04:07.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.796+0000 7f053e7fc640 1 -- 172.21.15.57:0/3358041382 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0544017020 con 0x7f0534004890 2023-11-24T08:04:07.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.800+0000 7f052bfff640 1 -- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f052c0664f0 msgr2=0x7f052c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.800+0000 7f052bfff640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f052c0664f0 0x7f052c0689b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05480ae690 tx=0x7f0540009040 comp rx=0 tx=0).stop 2023-11-24T08:04:07.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.800+0000 7f052bfff640 1 -- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534004890 msgr2=0x7f05481f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.800+0000 7f052bfff640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534004890 0x7f05481f1f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f054400e780 tx=0x7f054400ec40 comp rx=0 tx=0).stop 2023-11-24T08:04:07.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 -- 172.21.15.57:0/3358041382 shutdown_connections 2023-11-24T08:04:07.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f052c0664f0 0x7f052c0689b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05480ce8c0 0x7f05480ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0548145300 0x7f054814ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 --2- 172.21.15.57:0/3358041382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0534004890 0x7f05481f1f00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 -- 172.21.15.57:0/3358041382 >> 172.21.15.57:0/3358041382 conn(0x7f054806ae90 msgr2=0x7f05480cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 -- 172.21.15.57:0/3358041382 shutdown_connections 2023-11-24T08:04:07.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.804+0000 7f052bfff640 1 -- 172.21.15.57:0/3358041382 wait complete. 2023-11-24T08:04:07.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.812+0000 7f6a75380640 1 -- 172.21.15.57:0/1928845242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a50005510 con 0x7f6a700cc4c0 2023-11-24T08:04:07.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.812+0000 7f6a577fe640 1 -- 172.21.15.57:0/1928845242 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a600047f0 con 0x7f6a700cc4c0 2023-11-24T08:04:07.815 INFO:teuthology.orchestra.run.smithi057.stdout:64424509446 2023-11-24T08:04:07.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 -- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6a5c066570 msgr2=0x7f6a5c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6a5c066570 0x7f6a5c068a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a640b2000 tx=0x7f6a640a9070 comp rx=0 tx=0).stop 2023-11-24T08:04:07.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 -- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700cc4c0 msgr2=0x7f6a70203db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700cc4c0 0x7f6a70203db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000ba50 tx=0x7f6a6000bf10 comp rx=0 tx=0).stop 2023-11-24T08:04:07.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 -- 172.21.15.57:0/1928845242 shutdown_connections 2023-11-24T08:04:07.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6a5c066570 0x7f6a5c068a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a70159b10 0x7f6a70158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a701570c0 0x7f6a701fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 --2- 172.21.15.57:0/1928845242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700cc4c0 0x7f6a70203db0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.816+0000 7f6a557fa640 1 -- 172.21.15.57:0/1928845242 >> 172.21.15.57:0/1928845242 conn(0x7f6a700b0bf0 msgr2=0x7f6a700b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.820+0000 7f6a557fa640 1 -- 172.21.15.57:0/1928845242 shutdown_connections 2023-11-24T08:04:07.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.820+0000 7f6a557fa640 1 -- 172.21.15.57:0/1928845242 wait complete. 2023-11-24T08:04:07.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2023-11-24T08:04:07.840 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2023-11-24T08:04:07.854 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.876+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa19404e930 con 0x7fa19415a220 2023-11-24T08:04:07.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.876+0000 7fa18a7fc640 1 -- 172.21.15.57:0/56054111 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa190054ea0 con 0x7fa19415a220 2023-11-24T08:04:07.878 INFO:teuthology.orchestra.run.smithi057.stdout:64424509446 2023-11-24T08:04:07.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa178066540 msgr2=0x7fa178068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa178066540 0x7fa178068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1840ad000 tx=0x7fa184009040 comp rx=0 tx=0).stop 2023-11-24T08:04:07.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19415a220 msgr2=0x7fa194158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19415a220 0x7fa194158320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa19000f9c0 tx=0x7fa19000fe80 comp rx=0 tx=0).stop 2023-11-24T08:04:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 shutdown_connections 2023-11-24T08:04:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa178066540 0x7fa178068a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19415a220 0x7fa194158320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1941570c0 0x7fa1940b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 --2- 172.21.15.57:0/56054111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1940cbdb0 0x7fa194156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 >> 172.21.15.57:0/56054111 conn(0x7fa1940b0bf0 msgr2=0x7fa194070570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 shutdown_connections 2023-11-24T08:04:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84b8161f80 con 0x7f84b80d0780 2023-11-24T08:04:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.880+0000 7fa19bf94640 1 -- 172.21.15.57:0/56054111 wait complete. 2023-11-24T08:04:07.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.884+0000 7f849ffff640 1 -- 172.21.15.57:0/3373922519 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84ac015020 con 0x7f84b80d0780 2023-11-24T08:04:07.885 INFO:teuthology.orchestra.run.smithi057.stdout:60129542152 2023-11-24T08:04:07.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.884+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f84a40664d0 msgr2=0x7f84a4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.884+0000 7f84bd854640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f84a40664d0 0x7f84a4068990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f84b80b21c0 tx=0x7f84a8009040 comp rx=0 tx=0).stop 2023-11-24T08:04:07.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84b80d0780 msgr2=0x7f84b80c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84b80d0780 0x7f84b80c8d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00b440 tx=0x7f84ac00b840 comp rx=0 tx=0).stop 2023-11-24T08:04:07.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 shutdown_connections 2023-11-24T08:04:07.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f84a40664d0 0x7f84a4068990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84b80d1a50 0x7f84b80c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84b80d1400 0x7f84b815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 --2- 172.21.15.57:0/3373922519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84b80d0780 0x7f84b80c8d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 >> 172.21.15.57:0/3373922519 conn(0x7f84b809c7c0 msgr2=0x7f84b80b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 shutdown_connections 2023-11-24T08:04:07.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.888+0000 7f84bd854640 1 -- 172.21.15.57:0/3373922519 wait complete. 2023-11-24T08:04:07.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.892+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19540cb6e0 con 0x7f19400047d0 2023-11-24T08:04:07.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.892+0000 7f194b7fe640 1 -- 172.21.15.57:0/1642184992 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19440516a0 con 0x7f19400047d0 2023-11-24T08:04:07.896 INFO:teuthology.orchestra.run.smithi057.stdout:64424509447 2023-11-24T08:04:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19340664f0 msgr2=0x7f19340689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19340664f0 0x7f19340689b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f194c0aa000 tx=0x7f194c001030 comp rx=0 tx=0).stop 2023-11-24T08:04:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19400047d0 msgr2=0x7f19540c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19400047d0 0x7f19540c6940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f194400b9c0 tx=0x7f194400be80 comp rx=0 tx=0).stop 2023-11-24T08:04:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 shutdown_connections 2023-11-24T08:04:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19340664f0 0x7f19340689b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19540affe0 0x7f19540c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19540c20a0 0x7f19540999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 --2- 172.21.15.57:0/1642184992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19400047d0 0x7f19540c6940 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 >> 172.21.15.57:0/1642184992 conn(0x7f19540b0bf0 msgr2=0x7f19540ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 shutdown_connections 2023-11-24T08:04:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.896+0000 7f1959479640 1 -- 172.21.15.57:0/1642184992 wait complete. 2023-11-24T08:04:07.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.912+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f65740d5830 con 0x7f6574053bf0 2023-11-24T08:04:07.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.912+0000 7f6563fff640 1 -- 172.21.15.57:0/1452204245 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65740d5830 con 0x7f6574053bf0 2023-11-24T08:04:07.916 INFO:teuthology.orchestra.run.smithi057.stdout:64424509447 2023-11-24T08:04:07.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.5 2023-11-24T08:04:07.918 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6568066500 msgr2=0x7f65680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6568066500 0x7f65680689c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f656c0ad000 tx=0x7f656c0a6000 comp rx=0 tx=0).stop 2023-11-24T08:04:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6574053bf0 msgr2=0x7f65740df470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6574053bf0 0x7f65740df470 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f657000c4d0 tx=0x7f657000c990 comp rx=0 tx=0).stop 2023-11-24T08:04:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 shutdown_connections 2023-11-24T08:04:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6568066500 0x7f65680689c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65740d4f50 0x7f65740d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6574053bf0 0x7f65740df470 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 --2- 172.21.15.57:0/1452204245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65740077e0 0x7f65740e5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 >> 172.21.15.57:0/1452204245 conn(0x7f65740559c0 msgr2=0x7f657403bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 shutdown_connections 2023-11-24T08:04:07.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.916+0000 7f657bfff640 1 -- 172.21.15.57:0/1452204245 wait complete. 2023-11-24T08:04:07.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.3 2023-11-24T08:04:07.922 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2023-11-24T08:04:07.926 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2023-11-24T08:04:07.939 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.940+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f37ac04e930 con 0x7f37ac0ce070 2023-11-24T08:04:07.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.940+0000 7f37a27fc640 1 -- 172.21.15.57:0/2466984210 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f379c083e60 con 0x7f37ac0ce070 2023-11-24T08:04:07.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.940+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f66f804e850 con 0x7f66f80ce340 2023-11-24T08:04:07.942 INFO:teuthology.orchestra.run.smithi057.stdout:64424509446 2023-11-24T08:04:07.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.940+0000 7f66eeffd640 1 -- 172.21.15.57:0/2324300041 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66f0054f60 con 0x7f66f80ce340 2023-11-24T08:04:07.943 INFO:teuthology.orchestra.run.smithi057.stdout:64424509446 2023-11-24T08:04:07.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3790066470 msgr2=0x7f3790068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3790066470 0x7f3790068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f37a40af000 tx=0x7f37a40a7070 comp rx=0 tx=0).stop 2023-11-24T08:04:07.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0ce070 msgr2=0x7f37ac15e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0ce070 0x7f37ac15e8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f379c00c410 tx=0x7f379c00c8d0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 shutdown_connections 2023-11-24T08:04:07.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3790066470 0x7f3790068930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37ac15ee30 0x7f37ac1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f37ac0ce070 0x7f37ac15e8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 --2- 172.21.15.57:0/2466984210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37ac0cb480 0x7f37ac154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 >> 172.21.15.57:0/2466984210 conn(0x7f37ac0b0bf0 msgr2=0x7f37ac0716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 shutdown_connections 2023-11-24T08:04:07.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f37b3dec640 1 -- 172.21.15.57:0/2466984210 wait complete. 2023-11-24T08:04:07.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f66dc066540 msgr2=0x7f66dc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f66dc066540 0x7f66dc068a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f66f8067bd0 tx=0x7f66e8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:07.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66f80ce340 msgr2=0x7f66f80ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66f80ce340 0x7f66f80ce7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f66f80d0d70 tx=0x7f66f000a6c0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 shutdown_connections 2023-11-24T08:04:07.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f66dc066540 0x7f66dc068a00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66f80ce340 0x7f66f80ce7c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66f80c9370 0x7f66f814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 --2- 172.21.15.57:0/2324300041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66e40047d0 0x7f66f81539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 >> 172.21.15.57:0/2324300041 conn(0x7f66f808cca0 msgr2=0x7f66f80d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 shutdown_connections 2023-11-24T08:04:07.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:07.944+0000 7f66ff274640 1 -- 172.21.15.57:0/2324300041 wait complete. 2023-11-24T08:04:07.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.7 2023-11-24T08:04:07.967 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.6 2023-11-24T08:04:07.968 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:07.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:04:07.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81cccd6640 1 Processor -- start 2023-11-24T08:04:08.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81cccd6640 1 -- start start 2023-11-24T08:04:08.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81cccd6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81c80b36c0 0x7f81c80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81cccd6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81c8070da0 0x7f81c80711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81cccd6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c815a700 con 0x7f81c815a320 2023-11-24T08:04:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81cccd6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80b2430 con 0x7f81c80b36c0 2023-11-24T08:04:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81cccd6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80b2620 con 0x7f81c8070da0 2023-11-24T08:04:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81c659c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f81c815a320 0x7f81c8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44378/0 (socket says 172.21.15.57:44378) 2023-11-24T08:04:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81c659c640 1 -- 172.21.15.57:0/1426162948 learned_addr learned my addr 172.21.15.57:0/1426162948 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81bffff640 1 --2- 172.21.15.57:0/1426162948 >> v2:172.21.15.57:3300/0 conn(0x7f81c80b36c0 0x7f81c80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81c6d9d640 1 --2- 172.21.15.57:0/1426162948 >> v2:172.21.15.132:3300/0 conn(0x7f81c8070da0 0x7f81c80711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81c5d9b640 1 -- 172.21.15.57:0/1426162948 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596039773 0 0) 0x7f81c815a700 con 0x7f81c815a320 2023-11-24T08:04:08.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81c5d9b640 1 -- 172.21.15.57:0/1426162948 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b4003530 con 0x7f81c815a320 2023-11-24T08:04:08.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81bffff640 1 -- 172.21.15.57:0/1426162948 >> v2:172.21.15.132:3300/0 conn(0x7f81c8070da0 msgr2=0x7f81c80711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81bffff640 1 --2- 172.21.15.57:0/1426162948 >> v2:172.21.15.132:3300/0 conn(0x7f81c8070da0 0x7f81c80711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81bffff640 1 -- 172.21.15.57:0/1426162948 >> v1:172.21.15.57:6789/0 conn(0x7f81c815a320 legacy=0x7f81c8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81bffff640 1 -- 172.21.15.57:0/1426162948 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80b2900 con 0x7f81c80b36c0 2023-11-24T08:04:08.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.148+0000 7f81c6d9d640 1 --2- 172.21.15.57:0/1426162948 >> v2:172.21.15.132:3300/0 conn(0x7f81c8070da0 0x7f81c80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81bffff640 1 --2- 172.21.15.57:0/1426162948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c80b1ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81c806c2d0 tx=0x7f81b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6d9a3d8b9f7389 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81c5d9b640 1 -- 172.21.15.57:0/1426162948 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00ab600 con 0x7f81c80b36c0 2023-11-24T08:04:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81c5d9b640 1 -- 172.21.15.57:0/1426162948 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b00a7050 con 0x7f81c80b36c0 2023-11-24T08:04:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81c5d9b640 1 -- 172.21.15.57:0/1426162948 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00ab980 con 0x7f81c80b36c0 2023-11-24T08:04:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 -- 172.21.15.57:0/1426162948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 msgr2=0x7f81c80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 --2- 172.21.15.57:0/1426162948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c80b1ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81c806c2d0 tx=0x7f81b001c430 comp rx=0 tx=0).stop 2023-11-24T08:04:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 -- 172.21.15.57:0/1426162948 shutdown_connections 2023-11-24T08:04:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 --2- 172.21.15.57:0/1426162948 >> v2:172.21.15.132:3300/0 conn(0x7f81c8070da0 0x7f81c80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 --2- 172.21.15.57:0/1426162948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c80b1ef0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 -- 172.21.15.57:0/1426162948 >> 172.21.15.57:0/1426162948 conn(0x7f81c80b0bf0 msgr2=0x7f81c80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 -- 172.21.15.57:0/1426162948 shutdown_connections 2023-11-24T08:04:08.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.152+0000 7f81cccd6640 1 -- 172.21.15.57:0/1426162948 wait complete. 2023-11-24T08:04:08.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 Processor -- start 2023-11-24T08:04:08.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 -- start start 2023-11-24T08:04:08.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81c8070da0 0x7f81c8145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c8155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81c815a320 0x7f81c80af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8146320 con 0x7f81c80b36c0 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8155b90 con 0x7f81c8070da0 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c814f0d0 con 0x7f81c815a320 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c8155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c8155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55890/0 (socket says 172.21.15.57:55890) 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 -- 172.21.15.57:0/2727530154 learned_addr learned my addr 172.21.15.57:0/2727530154 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81c659c640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81c8070da0 0x7f81c8145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81c6d9d640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81c815a320 0x7f81c80af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 -- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81c815a320 msgr2=0x7f81c80af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81c815a320 0x7f81c80af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 -- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81c8070da0 msgr2=0x7f81c8145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81c8070da0 0x7f81c8145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 -- 172.21.15.57:0/2727530154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009420 con 0x7f81c80b36c0 2023-11-24T08:04:08.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81c6d9d640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81c815a320 0x7f81c80af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:08.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81c659c640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81c8070da0 0x7f81c8145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:08.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81bffff640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c8155650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ae040 tx=0x7f81b00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81beffd640 1 -- 172.21.15.57:0/2727530154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00b4410 con 0x7f81c80b36c0 2023-11-24T08:04:08.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81beffd640 1 -- 172.21.15.57:0/2727530154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b00b4590 con 0x7f81c80b36c0 2023-11-24T08:04:08.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c814e4c0 con 0x7f81c80b36c0 2023-11-24T08:04:08.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81beffd640 1 -- 172.21.15.57:0/2727530154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00b4940 con 0x7f81c80b36c0 2023-11-24T08:04:08.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.156+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c814ea80 con 0x7f81c80b36c0 2023-11-24T08:04:08.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.160+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c8067520 con 0x7f81c80b36c0 2023-11-24T08:04:08.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.160+0000 7f81beffd640 1 -- 172.21.15.57:0/2727530154 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81b00b2040 con 0x7f81c80b36c0 2023-11-24T08:04:08.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.160+0000 7f81beffd640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81a8066470 0x7f81a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.160+0000 7f81beffd640 1 -- 172.21.15.57:0/2727530154 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81b011ddb0 con 0x7f81c80b36c0 2023-11-24T08:04:08.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.160+0000 7f81c659c640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81a8066470 0x7f81a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.160+0000 7f81c659c640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81a8066470 0x7f81a8068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81b80011f0 tx=0x7f81b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.164+0000 7f81beffd640 1 -- 172.21.15.57:0/2727530154 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81b00eb230 con 0x7f81c80b36c0 2023-11-24T08:04:08.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.320+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81c8072410 con 0x7f81a8066470 2023-11-24T08:04:08.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.328+0000 7f81beffd640 1 -- 172.21.15.57:0/2727530154 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264501 (secure 0 0 0) 0x7f81c8072410 con 0x7f81a8066470 2023-11-24T08:04:08.332 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:04:08.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81a8066470 msgr2=0x7f81a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81a8066470 0x7f81a8068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81b80011f0 tx=0x7f81b8009040 comp rx=0 tx=0).stop 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 msgr2=0x7f81c8155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c8155650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ae040 tx=0x7f81b00191d0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 shutdown_connections 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81a8066470 0x7f81a8068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81c815a320 0x7f81c80af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c80b36c0 0x7f81c8155650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 --2- 172.21.15.57:0/2727530154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81c8070da0 0x7f81c8145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 >> 172.21.15.57:0/2727530154 conn(0x7f81c80b0bf0 msgr2=0x7f81c80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 shutdown_connections 2023-11-24T08:04:08.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.332+0000 7f81cccd6640 1 -- 172.21.15.57:0/2727530154 wait complete. 2023-11-24T08:04:08.353 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-24T08:04:06.680992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223380,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751340,"statfs":{"total":773094113280,"available":772865372160,"internally_reserved":0,"allocated":3121152,"data_stored":1832940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001918"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921630+0000","last_change":"2023-11-24T08:03:59.599040+0000","last_active":"2023-11-24T08:04:01.921630+0000","last_peered":"2023-11-24T08:04:01.921630+0000","last_clean":"2023-11-24T08:04:01.921630+0000","last_became_active":"2023-11-24T08:03:59.598731+0000","last_became_peered":"2023-11-24T08:03:59.598731+0000","last_unstale":"2023-11-24T08:04:01.921630+0000","last_undegraded":"2023-11-24T08:04:01.921630+0000","last_fullsized":"2023-11-24T08:04:01.921630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:49.497144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.421088+0000","last_change":"2023-11-24T08:03:59.587668+0000","last_active":"2023-11-24T08:04:01.421088+0000","last_peered":"2023-11-24T08:04:01.421088+0000","last_clean":"2023-11-24T08:04:01.421088+0000","last_became_active":"2023-11-24T08:03:59.585499+0000","last_became_peered":"2023-11-24T08:03:59.585499+0000","last_unstale":"2023-11-24T08:04:01.421088+0000","last_undegraded":"2023-11-24T08:04:01.421088+0000","last_fullsized":"2023-11-24T08:04:01.421088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:31:50.887296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596660+0000","last_change":"2023-11-24T08:03:59.595671+0000","last_active":"2023-11-24T08:04:00.596660+0000","last_peered":"2023-11-24T08:04:00.596660+0000","last_clean":"2023-11-24T08:04:00.596660+0000","last_became_active":"2023-11-24T08:03:59.595451+0000","last_became_peered":"2023-11-24T08:03:59.595451+0000","last_unstale":"2023-11-24T08:04:00.596660+0000","last_undegraded":"2023-11-24T08:04:00.596660+0000","last_fullsized":"2023-11-24T08:04:00.596660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:50:50.625309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921411+0000","last_change":"2023-11-24T08:03:59.585093+0000","last_active":"2023-11-24T08:04:01.921411+0000","last_peered":"2023-11-24T08:04:01.921411+0000","last_clean":"2023-11-24T08:04:01.921411+0000","last_became_active":"2023-11-24T08:03:59.584715+0000","last_became_peered":"2023-11-24T08:03:59.584715+0000","last_unstale":"2023-11-24T08:04:01.921411+0000","last_undegraded":"2023-11-24T08:04:01.921411+0000","last_fullsized":"2023-11-24T08:04:01.921411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:49.497144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921632+0000","last_change":"2023-11-24T08:03:59.594763+0000","last_active":"2023-11-24T08:04:01.921632+0000","last_peered":"2023-11-24T08:04:01.921632+0000","last_clean":"2023-11-24T08:04:01.921632+0000","last_became_active":"2023-11-24T08:03:59.594479+0000","last_became_peered":"2023-11-24T08:03:59.594479+0000","last_unstale":"2023-11-24T08:04:01.921632+0000","last_undegraded":"2023-11-24T08:04:01.921632+0000","last_fullsized":"2023-11-24T08:04:01.921632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:45.738363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920680+0000","last_change":"2023-11-24T08:03:59.586577+0000","last_active":"2023-11-24T08:04:01.920680+0000","last_peered":"2023-11-24T08:04:01.920680+0000","last_clean":"2023-11-24T08:04:01.920680+0000","last_became_active":"2023-11-24T08:03:59.586189+0000","last_became_peered":"2023-11-24T08:03:59.586189+0000","last_unstale":"2023-11-24T08:04:01.920680+0000","last_undegraded":"2023-11-24T08:04:01.920680+0000","last_fullsized":"2023-11-24T08:04:01.920680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920935+0000","last_change":"2023-11-24T08:03:59.596712+0000","last_active":"2023-11-24T08:04:01.920935+0000","last_peered":"2023-11-24T08:04:01.920935+0000","last_clean":"2023-11-24T08:04:01.920935+0000","last_became_active":"2023-11-24T08:03:59.596335+0000","last_became_peered":"2023-11-24T08:03:59.596335+0000","last_unstale":"2023-11-24T08:04:01.920935+0000","last_undegraded":"2023-11-24T08:04:01.920935+0000","last_fullsized":"2023-11-24T08:04:01.920935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:49.357450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920910+0000","last_change":"2023-11-24T08:03:59.588712+0000","last_active":"2023-11-24T08:04:01.920910+0000","last_peered":"2023-11-24T08:04:01.920910+0000","last_clean":"2023-11-24T08:04:01.920910+0000","last_became_active":"2023-11-24T08:03:59.588015+0000","last_became_peered":"2023-11-24T08:03:59.588015+0000","last_unstale":"2023-11-24T08:04:01.920910+0000","last_undegraded":"2023-11-24T08:04:01.920910+0000","last_fullsized":"2023-11-24T08:04:01.920910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:24.485625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921790+0000","last_change":"2023-11-24T08:03:59.600086+0000","last_active":"2023-11-24T08:04:01.921790+0000","last_peered":"2023-11-24T08:04:01.921790+0000","last_clean":"2023-11-24T08:04:01.921790+0000","last_became_active":"2023-11-24T08:03:59.598793+0000","last_became_peered":"2023-11-24T08:03:59.598793+0000","last_unstale":"2023-11-24T08:04:01.921790+0000","last_undegraded":"2023-11-24T08:04:01.921790+0000","last_fullsized":"2023-11-24T08:04:01.921790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:40.694620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922295+0000","last_change":"2023-11-24T08:03:59.587766+0000","last_active":"2023-11-24T08:04:01.922295+0000","last_peered":"2023-11-24T08:04:01.922295+0000","last_clean":"2023-11-24T08:04:01.922295+0000","last_became_active":"2023-11-24T08:03:59.587435+0000","last_became_peered":"2023-11-24T08:03:59.587435+0000","last_unstale":"2023-11-24T08:04:01.922295+0000","last_undegraded":"2023-11-24T08:04:01.922295+0000","last_fullsized":"2023-11-24T08:04:01.922295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921669+0000","last_change":"2023-11-24T08:03:59.587777+0000","last_active":"2023-11-24T08:04:01.921669+0000","last_peered":"2023-11-24T08:04:01.921669+0000","last_clean":"2023-11-24T08:04:01.921669+0000","last_became_active":"2023-11-24T08:03:59.587442+0000","last_became_peered":"2023-11-24T08:03:59.587442+0000","last_unstale":"2023-11-24T08:04:01.921669+0000","last_undegraded":"2023-11-24T08:04:01.921669+0000","last_fullsized":"2023-11-24T08:04:01.921669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595515+0000","last_change":"2023-11-24T08:03:59.595995+0000","last_active":"2023-11-24T08:04:00.595515+0000","last_peered":"2023-11-24T08:04:00.595515+0000","last_clean":"2023-11-24T08:04:00.595515+0000","last_became_active":"2023-11-24T08:03:59.595526+0000","last_became_peered":"2023-11-24T08:03:59.595526+0000","last_unstale":"2023-11-24T08:04:00.595515+0000","last_undegraded":"2023-11-24T08:04:00.595515+0000","last_fullsized":"2023-11-24T08:04:00.595515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921181+0000","last_change":"2023-11-24T08:03:59.591371+0000","last_active":"2023-11-24T08:04:01.921181+0000","last_peered":"2023-11-24T08:04:01.921181+0000","last_clean":"2023-11-24T08:04:01.921181+0000","last_became_active":"2023-11-24T08:03:59.590300+0000","last_became_peered":"2023-11-24T08:03:59.590300+0000","last_unstale":"2023-11-24T08:04:01.921181+0000","last_undegraded":"2023-11-24T08:04:01.921181+0000","last_fullsized":"2023-11-24T08:04:01.921181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596221+0000","last_change":"2023-11-24T08:03:59.592432+0000","last_active":"2023-11-24T08:04:00.596221+0000","last_peered":"2023-11-24T08:04:00.596221+0000","last_clean":"2023-11-24T08:04:00.596221+0000","last_became_active":"2023-11-24T08:03:59.592087+0000","last_became_peered":"2023-11-24T08:03:59.592087+0000","last_unstale":"2023-11-24T08:04:00.596221+0000","last_undegraded":"2023-11-24T08:04:00.596221+0000","last_fullsized":"2023-11-24T08:04:00.596221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:15.926853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420713+0000","last_change":"2023-11-24T08:03:59.594278+0000","last_active":"2023-11-24T08:04:01.420713+0000","last_peered":"2023-11-24T08:04:01.420713+0000","last_clean":"2023-11-24T08:04:01.420713+0000","last_became_active":"2023-11-24T08:03:59.593956+0000","last_became_peered":"2023-11-24T08:03:59.593956+0000","last_unstale":"2023-11-24T08:04:01.420713+0000","last_undegraded":"2023-11-24T08:04:01.420713+0000","last_fullsized":"2023-11-24T08:04:01.420713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920633+0000","last_change":"2023-11-24T08:03:59.573698+0000","last_active":"2023-11-24T08:04:01.920633+0000","last_peered":"2023-11-24T08:04:01.920633+0000","last_clean":"2023-11-24T08:04:01.920633+0000","last_became_active":"2023-11-24T08:03:59.573383+0000","last_became_peered":"2023-11-24T08:03:59.573383+0000","last_unstale":"2023-11-24T08:04:01.920633+0000","last_undegraded":"2023-11-24T08:04:01.920633+0000","last_fullsized":"2023-11-24T08:04:01.920633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921742+0000","last_change":"2023-11-24T08:03:59.590145+0000","last_active":"2023-11-24T08:04:01.921742+0000","last_peered":"2023-11-24T08:04:01.921742+0000","last_clean":"2023-11-24T08:04:01.921742+0000","last_became_active":"2023-11-24T08:03:59.589840+0000","last_became_peered":"2023-11-24T08:03:59.589840+0000","last_unstale":"2023-11-24T08:04:01.921742+0000","last_undegraded":"2023-11-24T08:04:01.921742+0000","last_fullsized":"2023-11-24T08:04:01.921742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:40.694620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598839+0000","last_change":"2023-11-24T08:03:59.590044+0000","last_active":"2023-11-24T08:04:00.598839+0000","last_peered":"2023-11-24T08:04:00.598839+0000","last_clean":"2023-11-24T08:04:00.598839+0000","last_became_active":"2023-11-24T08:03:59.589664+0000","last_became_peered":"2023-11-24T08:03:59.589664+0000","last_unstale":"2023-11-24T08:04:00.598839+0000","last_undegraded":"2023-11-24T08:04:00.598839+0000","last_fullsized":"2023-11-24T08:04:00.598839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922340+0000","last_change":"2023-11-24T08:03:59.597467+0000","last_active":"2023-11-24T08:04:01.922340+0000","last_peered":"2023-11-24T08:04:01.922340+0000","last_clean":"2023-11-24T08:04:01.922340+0000","last_became_active":"2023-11-24T08:03:59.596875+0000","last_became_peered":"2023-11-24T08:03:59.596875+0000","last_unstale":"2023-11-24T08:04:01.922340+0000","last_undegraded":"2023-11-24T08:04:01.922340+0000","last_fullsized":"2023-11-24T08:04:01.922340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:21.325975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921492+0000","last_change":"2023-11-24T08:03:59.599402+0000","last_active":"2023-11-24T08:04:01.921492+0000","last_peered":"2023-11-24T08:04:01.921492+0000","last_clean":"2023-11-24T08:04:01.921492+0000","last_became_active":"2023-11-24T08:03:59.598995+0000","last_became_peered":"2023-11-24T08:03:59.598995+0000","last_unstale":"2023-11-24T08:04:01.921492+0000","last_undegraded":"2023-11-24T08:04:01.921492+0000","last_fullsized":"2023-11-24T08:04:01.921492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596410+0000","last_change":"2023-11-24T08:03:59.592092+0000","last_active":"2023-11-24T08:04:00.596410+0000","last_peered":"2023-11-24T08:04:00.596410+0000","last_clean":"2023-11-24T08:04:00.596410+0000","last_became_active":"2023-11-24T08:03:59.591623+0000","last_became_peered":"2023-11-24T08:03:59.591623+0000","last_unstale":"2023-11-24T08:04:00.596410+0000","last_undegraded":"2023-11-24T08:04:00.596410+0000","last_fullsized":"2023-11-24T08:04:00.596410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:31.489475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920784+0000","last_change":"2023-11-24T08:03:59.591087+0000","last_active":"2023-11-24T08:04:01.920784+0000","last_peered":"2023-11-24T08:04:01.920784+0000","last_clean":"2023-11-24T08:04:01.920784+0000","last_became_active":"2023-11-24T08:03:59.590767+0000","last_became_peered":"2023-11-24T08:03:59.590767+0000","last_unstale":"2023-11-24T08:04:01.920784+0000","last_undegraded":"2023-11-24T08:04:01.920784+0000","last_fullsized":"2023-11-24T08:04:01.920784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:31:50.887296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921057+0000","last_change":"2023-11-24T08:03:59.595583+0000","last_active":"2023-11-24T08:04:01.921057+0000","last_peered":"2023-11-24T08:04:01.921057+0000","last_clean":"2023-11-24T08:04:01.921057+0000","last_became_active":"2023-11-24T08:03:59.595284+0000","last_became_peered":"2023-11-24T08:03:59.595284+0000","last_unstale":"2023-11-24T08:04:01.921057+0000","last_undegraded":"2023-11-24T08:04:01.921057+0000","last_fullsized":"2023-11-24T08:04:01.921057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:43.665608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920789+0000","last_change":"2023-11-24T08:03:59.579548+0000","last_active":"2023-11-24T08:04:01.920789+0000","last_peered":"2023-11-24T08:04:01.920789+0000","last_clean":"2023-11-24T08:04:01.920789+0000","last_became_active":"2023-11-24T08:03:59.579263+0000","last_became_peered":"2023-11-24T08:03:59.579263+0000","last_unstale":"2023-11-24T08:04:01.920789+0000","last_undegraded":"2023-11-24T08:04:01.920789+0000","last_fullsized":"2023-11-24T08:04:01.920789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:49.357450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921339+0000","last_change":"2023-11-24T08:03:59.598908+0000","last_active":"2023-11-24T08:04:01.921339+0000","last_peered":"2023-11-24T08:04:01.921339+0000","last_clean":"2023-11-24T08:04:01.921339+0000","last_became_active":"2023-11-24T08:03:59.598657+0000","last_became_peered":"2023-11-24T08:03:59.598657+0000","last_unstale":"2023-11-24T08:04:01.921339+0000","last_undegraded":"2023-11-24T08:04:01.921339+0000","last_fullsized":"2023-11-24T08:04:01.921339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:31:50.887296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922322+0000","last_change":"2023-11-24T08:03:59.598426+0000","last_active":"2023-11-24T08:04:01.922322+0000","last_peered":"2023-11-24T08:04:01.922322+0000","last_clean":"2023-11-24T08:04:01.922322+0000","last_became_active":"2023-11-24T08:03:59.598155+0000","last_became_peered":"2023-11-24T08:03:59.598155+0000","last_unstale":"2023-11-24T08:04:01.922322+0000","last_undegraded":"2023-11-24T08:04:01.922322+0000","last_fullsized":"2023-11-24T08:04:01.922322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420935+0000","last_change":"2023-11-24T08:03:59.588426+0000","last_active":"2023-11-24T08:04:01.420935+0000","last_peered":"2023-11-24T08:04:01.420935+0000","last_clean":"2023-11-24T08:04:01.420935+0000","last_became_active":"2023-11-24T08:03:59.588118+0000","last_became_peered":"2023-11-24T08:03:59.588118+0000","last_unstale":"2023-11-24T08:04:01.420935+0000","last_undegraded":"2023-11-24T08:04:01.420935+0000","last_fullsized":"2023-11-24T08:04:01.420935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921418+0000","last_change":"2023-11-24T08:03:59.600156+0000","last_active":"2023-11-24T08:04:01.921418+0000","last_peered":"2023-11-24T08:04:01.921418+0000","last_clean":"2023-11-24T08:04:01.921418+0000","last_became_active":"2023-11-24T08:03:59.599912+0000","last_became_peered":"2023-11-24T08:03:59.599912+0000","last_unstale":"2023-11-24T08:04:01.921418+0000","last_undegraded":"2023-11-24T08:04:01.921418+0000","last_fullsized":"2023-11-24T08:04:01.921418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:37.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596391+0000","last_change":"2023-11-24T08:03:59.581204+0000","last_active":"2023-11-24T08:04:00.596391+0000","last_peered":"2023-11-24T08:04:00.596391+0000","last_clean":"2023-11-24T08:04:00.596391+0000","last_became_active":"2023-11-24T08:03:59.580877+0000","last_became_peered":"2023-11-24T08:03:59.580877+0000","last_unstale":"2023-11-24T08:04:00.596391+0000","last_undegraded":"2023-11-24T08:04:00.596391+0000","last_fullsized":"2023-11-24T08:04:00.596391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:38:32.043325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921201+0000","last_change":"2023-11-24T08:03:59.579863+0000","last_active":"2023-11-24T08:04:01.921201+0000","last_peered":"2023-11-24T08:04:01.921201+0000","last_clean":"2023-11-24T08:04:01.921201+0000","last_became_active":"2023-11-24T08:03:59.579542+0000","last_became_peered":"2023-11-24T08:03:59.579542+0000","last_unstale":"2023-11-24T08:04:01.921201+0000","last_undegraded":"2023-11-24T08:04:01.921201+0000","last_fullsized":"2023-11-24T08:04:01.921201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:37.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598575+0000","last_change":"2023-11-24T08:03:59.595768+0000","last_active":"2023-11-24T08:04:00.598575+0000","last_peered":"2023-11-24T08:04:00.598575+0000","last_clean":"2023-11-24T08:04:00.598575+0000","last_became_active":"2023-11-24T08:03:59.594474+0000","last_became_peered":"2023-11-24T08:03:59.594474+0000","last_unstale":"2023-11-24T08:04:00.598575+0000","last_undegraded":"2023-11-24T08:04:00.598575+0000","last_fullsized":"2023-11-24T08:04:00.598575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920949+0000","last_change":"2023-11-24T08:03:59.584924+0000","last_active":"2023-11-24T08:04:01.920949+0000","last_peered":"2023-11-24T08:04:01.920949+0000","last_clean":"2023-11-24T08:04:01.920949+0000","last_became_active":"2023-11-24T08:03:59.584192+0000","last_became_peered":"2023-11-24T08:03:59.584192+0000","last_unstale":"2023-11-24T08:04:01.920949+0000","last_undegraded":"2023-11-24T08:04:01.920949+0000","last_fullsized":"2023-11-24T08:04:01.920949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:24.485625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595270+0000","last_change":"2023-11-24T08:03:59.594108+0000","last_active":"2023-11-24T08:04:00.595270+0000","last_peered":"2023-11-24T08:04:00.595270+0000","last_clean":"2023-11-24T08:04:00.595270+0000","last_became_active":"2023-11-24T08:03:59.593151+0000","last_became_peered":"2023-11-24T08:03:59.593151+0000","last_unstale":"2023-11-24T08:04:00.595270+0000","last_undegraded":"2023-11-24T08:04:00.595270+0000","last_fullsized":"2023-11-24T08:04:00.595270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.701810+0000","last_change":"2023-11-24T08:03:58.595372+0000","last_active":"2023-11-24T08:04:00.701810+0000","last_peered":"2023-11-24T08:04:00.701810+0000","last_clean":"2023-11-24T08:04:00.701810+0000","last_became_active":"2023-11-24T08:03:58.595011+0000","last_became_peered":"2023-11-24T08:03:58.595011+0000","last_unstale":"2023-11-24T08:04:00.701810+0000","last_undegraded":"2023-11-24T08:04:00.701810+0000","last_fullsized":"2023-11-24T08:04:00.701810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596456+0000","last_change":"2023-11-24T08:03:59.604482+0000","last_active":"2023-11-24T08:04:00.596456+0000","last_peered":"2023-11-24T08:04:00.596456+0000","last_clean":"2023-11-24T08:04:00.596456+0000","last_became_active":"2023-11-24T08:03:59.604180+0000","last_became_peered":"2023-11-24T08:03:59.604180+0000","last_unstale":"2023-11-24T08:04:00.596456+0000","last_undegraded":"2023-11-24T08:04:00.596456+0000","last_fullsized":"2023-11-24T08:04:00.596456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:34:26.115762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.699972+0000","last_change":"2023-11-24T08:03:58.574383+0000","last_active":"2023-11-24T08:04:00.699972+0000","last_peered":"2023-11-24T08:04:00.699972+0000","last_clean":"2023-11-24T08:04:00.699972+0000","last_became_active":"2023-11-24T08:03:58.574059+0000","last_became_peered":"2023-11-24T08:03:58.574059+0000","last_unstale":"2023-11-24T08:04:00.699972+0000","last_undegraded":"2023-11-24T08:04:00.699972+0000","last_fullsized":"2023-11-24T08:04:00.699972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.701754+0000","last_change":"2023-11-24T08:03:58.591311+0000","last_active":"2023-11-24T08:04:00.701754+0000","last_peered":"2023-11-24T08:04:00.701754+0000","last_clean":"2023-11-24T08:04:00.701754+0000","last_became_active":"2023-11-24T08:03:58.590678+0000","last_became_peered":"2023-11-24T08:03:58.590678+0000","last_unstale":"2023-11-24T08:04:00.701754+0000","last_undegraded":"2023-11-24T08:04:00.701754+0000","last_fullsized":"2023-11-24T08:04:00.701754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921010+0000","last_change":"2023-11-24T08:03:59.584561+0000","last_active":"2023-11-24T08:04:01.921010+0000","last_peered":"2023-11-24T08:04:01.921010+0000","last_clean":"2023-11-24T08:04:01.921010+0000","last_became_active":"2023-11-24T08:03:59.584227+0000","last_became_peered":"2023-11-24T08:03:59.584227+0000","last_unstale":"2023-11-24T08:04:01.921010+0000","last_undegraded":"2023-11-24T08:04:01.921010+0000","last_fullsized":"2023-11-24T08:04:01.921010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:39.675569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700135+0000","last_change":"2023-11-24T08:03:58.594517+0000","last_active":"2023-11-24T08:04:00.700135+0000","last_peered":"2023-11-24T08:04:00.700135+0000","last_clean":"2023-11-24T08:04:00.700135+0000","last_became_active":"2023-11-24T08:03:58.592799+0000","last_became_peered":"2023-11-24T08:03:58.592799+0000","last_unstale":"2023-11-24T08:04:00.700135+0000","last_undegraded":"2023-11-24T08:04:00.700135+0000","last_fullsized":"2023-11-24T08:04:00.700135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420674+0000","last_change":"2023-11-24T08:03:59.587401+0000","last_active":"2023-11-24T08:04:01.420674+0000","last_peered":"2023-11-24T08:04:01.420674+0000","last_clean":"2023-11-24T08:04:01.420674+0000","last_became_active":"2023-11-24T08:03:59.587106+0000","last_became_peered":"2023-11-24T08:03:59.587106+0000","last_unstale":"2023-11-24T08:04:01.420674+0000","last_undegraded":"2023-11-24T08:04:01.420674+0000","last_fullsized":"2023-11-24T08:04:01.420674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:43.665608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700051+0000","last_change":"2023-11-24T08:03:58.593371+0000","last_active":"2023-11-24T08:04:00.700051+0000","last_peered":"2023-11-24T08:04:00.700051+0000","last_clean":"2023-11-24T08:04:00.700051+0000","last_became_active":"2023-11-24T08:03:58.591545+0000","last_became_peered":"2023-11-24T08:03:58.591545+0000","last_unstale":"2023-11-24T08:04:00.700051+0000","last_undegraded":"2023-11-24T08:04:00.700051+0000","last_fullsized":"2023-11-24T08:04:00.700051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922113+0000","last_change":"2023-11-24T08:03:59.598485+0000","last_active":"2023-11-24T08:04:01.922113+0000","last_peered":"2023-11-24T08:04:01.922113+0000","last_clean":"2023-11-24T08:04:01.922113+0000","last_became_active":"2023-11-24T08:03:59.598252+0000","last_became_peered":"2023-11-24T08:03:59.598252+0000","last_unstale":"2023-11-24T08:04:01.922113+0000","last_undegraded":"2023-11-24T08:04:01.922113+0000","last_fullsized":"2023-11-24T08:04:01.922113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:37:04.257381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700358+0000","last_change":"2023-11-24T08:03:58.588831+0000","last_active":"2023-11-24T08:04:00.700358+0000","last_peered":"2023-11-24T08:04:00.700358+0000","last_clean":"2023-11-24T08:04:00.700358+0000","last_became_active":"2023-11-24T08:03:58.588494+0000","last_became_peered":"2023-11-24T08:03:58.588494+0000","last_unstale":"2023-11-24T08:04:00.700358+0000","last_undegraded":"2023-11-24T08:04:00.700358+0000","last_fullsized":"2023-11-24T08:04:00.700358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:23.475033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596791+0000","last_change":"2023-11-24T08:03:59.586309+0000","last_active":"2023-11-24T08:04:00.596791+0000","last_peered":"2023-11-24T08:04:00.596791+0000","last_clean":"2023-11-24T08:04:00.596791+0000","last_became_active":"2023-11-24T08:03:59.585998+0000","last_became_peered":"2023-11-24T08:03:59.585998+0000","last_unstale":"2023-11-24T08:04:00.596791+0000","last_undegraded":"2023-11-24T08:04:00.596791+0000","last_fullsized":"2023-11-24T08:04:00.596791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:42.276832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698367+0000","last_change":"2023-11-24T08:03:58.592635+0000","last_active":"2023-11-24T08:04:00.698367+0000","last_peered":"2023-11-24T08:04:00.698367+0000","last_clean":"2023-11-24T08:04:00.698367+0000","last_became_active":"2023-11-24T08:03:58.592339+0000","last_became_peered":"2023-11-24T08:03:58.592339+0000","last_unstale":"2023-11-24T08:04:00.698367+0000","last_undegraded":"2023-11-24T08:04:00.698367+0000","last_fullsized":"2023-11-24T08:04:00.698367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595544+0000","last_change":"2023-11-24T08:03:59.600109+0000","last_active":"2023-11-24T08:04:00.595544+0000","last_peered":"2023-11-24T08:04:00.595544+0000","last_clean":"2023-11-24T08:04:00.595544+0000","last_became_active":"2023-11-24T08:03:59.599837+0000","last_became_peered":"2023-11-24T08:03:59.599837+0000","last_unstale":"2023-11-24T08:04:00.595544+0000","last_undegraded":"2023-11-24T08:04:00.595544+0000","last_fullsized":"2023-11-24T08:04:00.595544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.699991+0000","last_change":"2023-11-24T08:03:58.586653+0000","last_active":"2023-11-24T08:04:00.699991+0000","last_peered":"2023-11-24T08:04:00.699991+0000","last_clean":"2023-11-24T08:04:00.699991+0000","last_became_active":"2023-11-24T08:03:58.586327+0000","last_became_peered":"2023-11-24T08:03:58.586327+0000","last_unstale":"2023-11-24T08:04:00.699991+0000","last_undegraded":"2023-11-24T08:04:00.699991+0000","last_fullsized":"2023-11-24T08:04:00.699991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921585+0000","last_change":"2023-11-24T08:03:59.597689+0000","last_active":"2023-11-24T08:04:01.921585+0000","last_peered":"2023-11-24T08:04:01.921585+0000","last_clean":"2023-11-24T08:04:01.921585+0000","last_became_active":"2023-11-24T08:03:59.597176+0000","last_became_peered":"2023-11-24T08:03:59.597176+0000","last_unstale":"2023-11-24T08:04:01.921585+0000","last_undegraded":"2023-11-24T08:04:01.921585+0000","last_fullsized":"2023-11-24T08:04:01.921585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:37.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.695342+0000","last_change":"2023-11-24T08:03:58.577074+0000","last_active":"2023-11-24T08:03:59.695342+0000","last_peered":"2023-11-24T08:03:59.695342+0000","last_clean":"2023-11-24T08:03:59.695342+0000","last_became_active":"2023-11-24T08:03:58.576708+0000","last_became_peered":"2023-11-24T08:03:58.576708+0000","last_unstale":"2023-11-24T08:03:59.695342+0000","last_undegraded":"2023-11-24T08:03:59.695342+0000","last_fullsized":"2023-11-24T08:03:59.695342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:51:21.116952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596237+0000","last_change":"2023-11-24T08:03:59.592620+0000","last_active":"2023-11-24T08:04:00.596237+0000","last_peered":"2023-11-24T08:04:00.596237+0000","last_clean":"2023-11-24T08:04:00.596237+0000","last_became_active":"2023-11-24T08:03:59.592335+0000","last_became_peered":"2023-11-24T08:03:59.592335+0000","last_unstale":"2023-11-24T08:04:00.596237+0000","last_undegraded":"2023-11-24T08:04:00.596237+0000","last_fullsized":"2023-11-24T08:04:00.596237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:11.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700201+0000","last_change":"2023-11-24T08:03:58.589858+0000","last_active":"2023-11-24T08:04:00.700201+0000","last_peered":"2023-11-24T08:04:00.700201+0000","last_clean":"2023-11-24T08:04:00.700201+0000","last_became_active":"2023-11-24T08:03:58.589555+0000","last_became_peered":"2023-11-24T08:03:58.589555+0000","last_unstale":"2023-11-24T08:04:00.700201+0000","last_undegraded":"2023-11-24T08:04:00.700201+0000","last_fullsized":"2023-11-24T08:04:00.700201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:42.320735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921790+0000","last_change":"2023-11-24T08:03:59.602898+0000","last_active":"2023-11-24T08:04:01.921790+0000","last_peered":"2023-11-24T08:04:01.921790+0000","last_clean":"2023-11-24T08:04:01.921790+0000","last_became_active":"2023-11-24T08:03:59.602585+0000","last_became_peered":"2023-11-24T08:03:59.602585+0000","last_unstale":"2023-11-24T08:04:01.921790+0000","last_undegraded":"2023-11-24T08:04:01.921790+0000","last_fullsized":"2023-11-24T08:04:01.921790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:34.454939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.699940+0000","last_change":"2023-11-24T08:03:58.581293+0000","last_active":"2023-11-24T08:04:00.699940+0000","last_peered":"2023-11-24T08:04:00.699940+0000","last_clean":"2023-11-24T08:04:00.699940+0000","last_became_active":"2023-11-24T08:03:58.580548+0000","last_became_peered":"2023-11-24T08:03:58.580548+0000","last_unstale":"2023-11-24T08:04:00.699940+0000","last_undegraded":"2023-11-24T08:04:00.699940+0000","last_fullsized":"2023-11-24T08:04:00.699940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921087+0000","last_change":"2023-11-24T08:03:59.584395+0000","last_active":"2023-11-24T08:04:01.921087+0000","last_peered":"2023-11-24T08:04:01.921087+0000","last_clean":"2023-11-24T08:04:01.921087+0000","last_became_active":"2023-11-24T08:03:59.583808+0000","last_became_peered":"2023-11-24T08:03:59.583808+0000","last_unstale":"2023-11-24T08:04:01.921087+0000","last_undegraded":"2023-11-24T08:04:01.921087+0000","last_fullsized":"2023-11-24T08:04:01.921087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:39.675569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598501+0000","last_change":"2023-11-24T08:03:58.580057+0000","last_active":"2023-11-24T08:04:00.598501+0000","last_peered":"2023-11-24T08:04:00.598501+0000","last_clean":"2023-11-24T08:04:00.598501+0000","last_became_active":"2023-11-24T08:03:58.579752+0000","last_became_peered":"2023-11-24T08:03:58.579752+0000","last_unstale":"2023-11-24T08:04:00.598501+0000","last_undegraded":"2023-11-24T08:04:00.598501+0000","last_fullsized":"2023-11-24T08:04:00.598501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:44.412407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921296+0000","last_change":"2023-11-24T08:03:59.602642+0000","last_active":"2023-11-24T08:04:01.921296+0000","last_peered":"2023-11-24T08:04:01.921296+0000","last_clean":"2023-11-24T08:04:01.921296+0000","last_became_active":"2023-11-24T08:03:59.602383+0000","last_became_peered":"2023-11-24T08:03:59.602383+0000","last_unstale":"2023-11-24T08:04:01.921296+0000","last_undegraded":"2023-11-24T08:04:01.921296+0000","last_fullsized":"2023-11-24T08:04:01.921296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:45:52.279485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595740+0000","last_change":"2023-11-24T08:03:58.576485+0000","last_active":"2023-11-24T08:04:00.595740+0000","last_peered":"2023-11-24T08:04:00.595740+0000","last_clean":"2023-11-24T08:04:00.595740+0000","last_became_active":"2023-11-24T08:03:58.576148+0000","last_became_peered":"2023-11-24T08:03:58.576148+0000","last_unstale":"2023-11-24T08:04:00.595740+0000","last_undegraded":"2023-11-24T08:04:00.595740+0000","last_fullsized":"2023-11-24T08:04:00.595740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922132+0000","last_change":"2023-11-24T08:03:59.605656+0000","last_active":"2023-11-24T08:04:01.922132+0000","last_peered":"2023-11-24T08:04:01.922132+0000","last_clean":"2023-11-24T08:04:01.922132+0000","last_became_active":"2023-11-24T08:03:59.605293+0000","last_became_peered":"2023-11-24T08:03:59.605293+0000","last_unstale":"2023-11-24T08:04:01.922132+0000","last_undegraded":"2023-11-24T08:04:01.922132+0000","last_fullsized":"2023-11-24T08:04:01.922132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:37:04.257381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598844+0000","last_change":"2023-11-24T08:03:58.590332+0000","last_active":"2023-11-24T08:04:00.598844+0000","last_peered":"2023-11-24T08:04:00.598844+0000","last_clean":"2023-11-24T08:04:00.598844+0000","last_became_active":"2023-11-24T08:03:58.587974+0000","last_became_peered":"2023-11-24T08:03:58.587974+0000","last_unstale":"2023-11-24T08:04:00.598844+0000","last_undegraded":"2023-11-24T08:04:00.598844+0000","last_fullsized":"2023-11-24T08:04:00.598844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921997+0000","last_change":"2023-11-24T08:03:59.606241+0000","last_active":"2023-11-24T08:04:01.921997+0000","last_peered":"2023-11-24T08:04:01.921997+0000","last_clean":"2023-11-24T08:04:01.921997+0000","last_became_active":"2023-11-24T08:03:59.604149+0000","last_became_peered":"2023-11-24T08:03:59.604149+0000","last_unstale":"2023-11-24T08:04:01.921997+0000","last_undegraded":"2023-11-24T08:04:01.921997+0000","last_fullsized":"2023-11-24T08:04:01.921997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:21.376153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698388+0000","last_change":"2023-11-24T08:03:58.581525+0000","last_active":"2023-11-24T08:04:00.698388+0000","last_peered":"2023-11-24T08:04:00.698388+0000","last_clean":"2023-11-24T08:04:00.698388+0000","last_became_active":"2023-11-24T08:03:58.578531+0000","last_became_peered":"2023-11-24T08:03:58.578531+0000","last_unstale":"2023-11-24T08:04:00.698388+0000","last_undegraded":"2023-11-24T08:04:00.698388+0000","last_fullsized":"2023-11-24T08:04:00.698388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:12.928445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921700+0000","last_change":"2023-11-24T08:03:59.582239+0000","last_active":"2023-11-24T08:04:01.921700+0000","last_peered":"2023-11-24T08:04:01.921700+0000","last_clean":"2023-11-24T08:04:01.921700+0000","last_became_active":"2023-11-24T08:03:59.580468+0000","last_became_peered":"2023-11-24T08:03:59.580468+0000","last_unstale":"2023-11-24T08:04:01.921700+0000","last_undegraded":"2023-11-24T08:04:01.921700+0000","last_fullsized":"2023-11-24T08:04:01.921700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:55.139904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598701+0000","last_change":"2023-11-24T08:03:58.592974+0000","last_active":"2023-11-24T08:04:00.598701+0000","last_peered":"2023-11-24T08:04:00.598701+0000","last_clean":"2023-11-24T08:04:00.598701+0000","last_became_active":"2023-11-24T08:03:58.592300+0000","last_became_peered":"2023-11-24T08:03:58.592300+0000","last_unstale":"2023-11-24T08:04:00.598701+0000","last_undegraded":"2023-11-24T08:04:00.598701+0000","last_fullsized":"2023-11-24T08:04:00.598701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921743+0000","last_change":"2023-11-24T08:03:59.595203+0000","last_active":"2023-11-24T08:04:01.921743+0000","last_peered":"2023-11-24T08:04:01.921743+0000","last_clean":"2023-11-24T08:04:01.921743+0000","last_became_active":"2023-11-24T08:03:59.594780+0000","last_became_peered":"2023-11-24T08:03:59.594780+0000","last_unstale":"2023-11-24T08:04:01.921743+0000","last_undegraded":"2023-11-24T08:04:01.921743+0000","last_fullsized":"2023-11-24T08:04:01.921743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:55.139904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.579866+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:03:59.579866+0000","last_peered":"2023-11-24T08:03:59.579866+0000","last_clean":"2023-11-24T08:03:59.579866+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:03:59.579866+0000","last_undegraded":"2023-11-24T08:03:59.579866+0000","last_fullsized":"2023-11-24T08:03:59.579866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700235+0000","last_change":"2023-11-24T08:03:58.590597+0000","last_active":"2023-11-24T08:04:00.700235+0000","last_peered":"2023-11-24T08:04:00.700235+0000","last_clean":"2023-11-24T08:04:00.700235+0000","last_became_active":"2023-11-24T08:03:58.590130+0000","last_became_peered":"2023-11-24T08:03:58.590130+0000","last_unstale":"2023-11-24T08:04:00.700235+0000","last_undegraded":"2023-11-24T08:04:00.700235+0000","last_fullsized":"2023-11-24T08:04:00.700235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921170+0000","last_change":"2023-11-24T08:03:59.589854+0000","last_active":"2023-11-24T08:04:01.921170+0000","last_peered":"2023-11-24T08:04:01.921170+0000","last_clean":"2023-11-24T08:04:01.921170+0000","last_became_active":"2023-11-24T08:03:59.589630+0000","last_became_peered":"2023-11-24T08:03:59.589630+0000","last_unstale":"2023-11-24T08:04:01.921170+0000","last_undegraded":"2023-11-24T08:04:01.921170+0000","last_fullsized":"2023-11-24T08:04:01.921170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695101+0000","last_change":"2023-11-24T08:03:58.593106+0000","last_active":"2023-11-24T08:04:00.695101+0000","last_peered":"2023-11-24T08:04:00.695101+0000","last_clean":"2023-11-24T08:04:00.695101+0000","last_became_active":"2023-11-24T08:03:58.592777+0000","last_became_peered":"2023-11-24T08:03:58.592777+0000","last_unstale":"2023-11-24T08:04:00.695101+0000","last_undegraded":"2023-11-24T08:04:00.695101+0000","last_fullsized":"2023-11-24T08:04:00.695101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:59.232039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596124+0000","last_change":"2023-11-24T08:03:59.594009+0000","last_active":"2023-11-24T08:04:00.596124+0000","last_peered":"2023-11-24T08:04:00.596124+0000","last_clean":"2023-11-24T08:04:00.596124+0000","last_became_active":"2023-11-24T08:03:59.593697+0000","last_became_peered":"2023-11-24T08:03:59.593697+0000","last_unstale":"2023-11-24T08:04:00.596124+0000","last_undegraded":"2023-11-24T08:04:00.596124+0000","last_fullsized":"2023-11-24T08:04:00.596124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:21.024507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598642+0000","last_change":"2023-11-24T08:03:58.590726+0000","last_active":"2023-11-24T08:04:00.598642+0000","last_peered":"2023-11-24T08:04:00.598642+0000","last_clean":"2023-11-24T08:04:00.598642+0000","last_became_active":"2023-11-24T08:03:58.590385+0000","last_became_peered":"2023-11-24T08:03:58.590385+0000","last_unstale":"2023-11-24T08:04:00.598642+0000","last_undegraded":"2023-11-24T08:04:00.598642+0000","last_fullsized":"2023-11-24T08:04:00.598642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:19.226023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420804+0000","last_change":"2023-11-24T08:03:59.594256+0000","last_active":"2023-11-24T08:04:01.420804+0000","last_peered":"2023-11-24T08:04:01.420804+0000","last_clean":"2023-11-24T08:04:01.420804+0000","last_became_active":"2023-11-24T08:03:59.593902+0000","last_became_peered":"2023-11-24T08:03:59.593902+0000","last_unstale":"2023-11-24T08:04:01.420804+0000","last_undegraded":"2023-11-24T08:04:01.420804+0000","last_fullsized":"2023-11-24T08:04:01.420804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700218+0000","last_change":"2023-11-24T08:03:58.589309+0000","last_active":"2023-11-24T08:04:00.700218+0000","last_peered":"2023-11-24T08:04:00.700218+0000","last_clean":"2023-11-24T08:04:00.700218+0000","last_became_active":"2023-11-24T08:03:58.588917+0000","last_became_peered":"2023-11-24T08:03:58.588917+0000","last_unstale":"2023-11-24T08:04:00.700218+0000","last_undegraded":"2023-11-24T08:04:00.700218+0000","last_fullsized":"2023-11-24T08:04:00.700218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595434+0000","last_change":"2023-11-24T08:03:59.597797+0000","last_active":"2023-11-24T08:04:00.595434+0000","last_peered":"2023-11-24T08:04:00.595434+0000","last_clean":"2023-11-24T08:04:00.595434+0000","last_became_active":"2023-11-24T08:03:59.597491+0000","last_became_peered":"2023-11-24T08:03:59.597491+0000","last_unstale":"2023-11-24T08:04:00.595434+0000","last_undegraded":"2023-11-24T08:04:00.595434+0000","last_fullsized":"2023-11-24T08:04:00.595434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698331+0000","last_change":"2023-11-24T08:03:58.581746+0000","last_active":"2023-11-24T08:04:00.698331+0000","last_peered":"2023-11-24T08:04:00.698331+0000","last_clean":"2023-11-24T08:04:00.698331+0000","last_became_active":"2023-11-24T08:03:58.578821+0000","last_became_peered":"2023-11-24T08:03:58.578821+0000","last_unstale":"2023-11-24T08:04:00.698331+0000","last_undegraded":"2023-11-24T08:04:00.698331+0000","last_fullsized":"2023-11-24T08:04:00.698331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922018+0000","last_change":"2023-11-24T08:03:59.584022+0000","last_active":"2023-11-24T08:04:01.922018+0000","last_peered":"2023-11-24T08:04:01.922018+0000","last_clean":"2023-11-24T08:04:01.922018+0000","last_became_active":"2023-11-24T08:03:59.583697+0000","last_became_peered":"2023-11-24T08:03:59.583697+0000","last_unstale":"2023-11-24T08:04:01.922018+0000","last_undegraded":"2023-11-24T08:04:01.922018+0000","last_fullsized":"2023-11-24T08:04:01.922018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:21.376153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695268+0000","last_change":"2023-11-24T08:03:58.595698+0000","last_active":"2023-11-24T08:04:00.695268+0000","last_peered":"2023-11-24T08:04:00.695268+0000","last_clean":"2023-11-24T08:04:00.695268+0000","last_became_active":"2023-11-24T08:03:58.595445+0000","last_became_peered":"2023-11-24T08:03:58.595445+0000","last_unstale":"2023-11-24T08:04:00.695268+0000","last_undegraded":"2023-11-24T08:04:00.695268+0000","last_fullsized":"2023-11-24T08:04:00.695268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.664977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.421013+0000","last_change":"2023-11-24T08:03:59.591006+0000","last_active":"2023-11-24T08:04:01.421013+0000","last_peered":"2023-11-24T08:04:01.421013+0000","last_clean":"2023-11-24T08:04:01.421013+0000","last_became_active":"2023-11-24T08:03:59.590697+0000","last_became_peered":"2023-11-24T08:03:59.590697+0000","last_unstale":"2023-11-24T08:04:01.421013+0000","last_undegraded":"2023-11-24T08:04:01.421013+0000","last_fullsized":"2023-11-24T08:04:01.421013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.421059+0000","last_change":"2023-11-24T08:03:58.585471+0000","last_active":"2023-11-24T08:04:01.421059+0000","last_peered":"2023-11-24T08:04:01.421059+0000","last_clean":"2023-11-24T08:04:01.421059+0000","last_became_active":"2023-11-24T08:03:58.584512+0000","last_became_peered":"2023-11-24T08:03:58.584512+0000","last_unstale":"2023-11-24T08:04:01.421059+0000","last_undegraded":"2023-11-24T08:04:01.421059+0000","last_fullsized":"2023-11-24T08:04:01.421059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921487+0000","last_change":"2023-11-24T08:03:59.597245+0000","last_active":"2023-11-24T08:04:01.921487+0000","last_peered":"2023-11-24T08:04:01.921487+0000","last_clean":"2023-11-24T08:04:01.921487+0000","last_became_active":"2023-11-24T08:03:59.596949+0000","last_became_peered":"2023-11-24T08:03:59.596949+0000","last_unstale":"2023-11-24T08:04:01.921487+0000","last_undegraded":"2023-11-24T08:04:01.921487+0000","last_fullsized":"2023-11-24T08:04:01.921487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:49.497144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700067+0000","last_change":"2023-11-24T08:03:58.587720+0000","last_active":"2023-11-24T08:04:00.700067+0000","last_peered":"2023-11-24T08:04:00.700067+0000","last_clean":"2023-11-24T08:04:00.700067+0000","last_became_active":"2023-11-24T08:03:58.587501+0000","last_became_peered":"2023-11-24T08:03:58.587501+0000","last_unstale":"2023-11-24T08:04:00.700067+0000","last_undegraded":"2023-11-24T08:04:00.700067+0000","last_fullsized":"2023-11-24T08:04:00.700067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:19.371283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596765+0000","last_change":"2023-11-24T08:03:59.592131+0000","last_active":"2023-11-24T08:04:00.596765+0000","last_peered":"2023-11-24T08:04:00.596765+0000","last_clean":"2023-11-24T08:04:00.596765+0000","last_became_active":"2023-11-24T08:03:59.591709+0000","last_became_peered":"2023-11-24T08:03:59.591709+0000","last_unstale":"2023-11-24T08:04:00.596765+0000","last_undegraded":"2023-11-24T08:04:00.596765+0000","last_fullsized":"2023-11-24T08:04:00.596765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:47:46.539937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695080+0000","last_change":"2023-11-24T08:03:58.592505+0000","last_active":"2023-11-24T08:04:00.695080+0000","last_peered":"2023-11-24T08:04:00.695080+0000","last_clean":"2023-11-24T08:04:00.695080+0000","last_became_active":"2023-11-24T08:03:58.592097+0000","last_became_peered":"2023-11-24T08:03:58.592097+0000","last_unstale":"2023-11-24T08:04:00.695080+0000","last_undegraded":"2023-11-24T08:04:00.695080+0000","last_fullsized":"2023-11-24T08:04:00.695080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595333+0000","last_change":"2023-11-24T08:03:59.590194+0000","last_active":"2023-11-24T08:04:00.595333+0000","last_peered":"2023-11-24T08:04:00.595333+0000","last_clean":"2023-11-24T08:04:00.595333+0000","last_became_active":"2023-11-24T08:03:59.589879+0000","last_became_peered":"2023-11-24T08:03:59.589879+0000","last_unstale":"2023-11-24T08:04:00.595333+0000","last_undegraded":"2023-11-24T08:04:00.595333+0000","last_fullsized":"2023-11-24T08:04:00.595333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698300+0000","last_change":"2023-11-24T08:03:58.593989+0000","last_active":"2023-11-24T08:04:00.698300+0000","last_peered":"2023-11-24T08:04:00.698300+0000","last_clean":"2023-11-24T08:04:00.698300+0000","last_became_active":"2023-11-24T08:03:58.593641+0000","last_became_peered":"2023-11-24T08:03:58.593641+0000","last_unstale":"2023-11-24T08:04:00.698300+0000","last_undegraded":"2023-11-24T08:04:00.698300+0000","last_fullsized":"2023-11-24T08:04:00.698300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921069+0000","last_change":"2023-11-24T08:03:59.588962+0000","last_active":"2023-11-24T08:04:01.921069+0000","last_peered":"2023-11-24T08:04:01.921069+0000","last_clean":"2023-11-24T08:04:01.921069+0000","last_became_active":"2023-11-24T08:03:59.588405+0000","last_became_peered":"2023-11-24T08:03:59.588405+0000","last_unstale":"2023-11-24T08:04:01.921069+0000","last_undegraded":"2023-11-24T08:04:01.921069+0000","last_fullsized":"2023-11-24T08:04:01.921069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698313+0000","last_change":"2023-11-24T08:03:58.589209+0000","last_active":"2023-11-24T08:04:00.698313+0000","last_peered":"2023-11-24T08:04:00.698313+0000","last_clean":"2023-11-24T08:04:00.698313+0000","last_became_active":"2023-11-24T08:03:58.588034+0000","last_became_peered":"2023-11-24T08:03:58.588034+0000","last_unstale":"2023-11-24T08:04:00.698313+0000","last_undegraded":"2023-11-24T08:04:00.698313+0000","last_fullsized":"2023-11-24T08:04:00.698313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921333+0000","last_change":"2023-11-24T08:03:59.584679+0000","last_active":"2023-11-24T08:04:01.921333+0000","last_peered":"2023-11-24T08:04:01.921333+0000","last_clean":"2023-11-24T08:04:01.921333+0000","last_became_active":"2023-11-24T08:03:59.584311+0000","last_became_peered":"2023-11-24T08:03:59.584311+0000","last_unstale":"2023-11-24T08:04:01.921333+0000","last_undegraded":"2023-11-24T08:04:01.921333+0000","last_fullsized":"2023-11-24T08:04:01.921333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695162+0000","last_change":"2023-11-24T08:03:58.593136+0000","last_active":"2023-11-24T08:04:00.695162+0000","last_peered":"2023-11-24T08:04:00.695162+0000","last_clean":"2023-11-24T08:04:00.695162+0000","last_became_active":"2023-11-24T08:03:58.592737+0000","last_became_peered":"2023-11-24T08:03:58.592737+0000","last_unstale":"2023-11-24T08:04:00.695162+0000","last_undegraded":"2023-11-24T08:04:00.695162+0000","last_fullsized":"2023-11-24T08:04:00.695162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921179+0000","last_change":"2023-11-24T08:03:59.595926+0000","last_active":"2023-11-24T08:04:01.921179+0000","last_peered":"2023-11-24T08:04:01.921179+0000","last_clean":"2023-11-24T08:04:01.921179+0000","last_became_active":"2023-11-24T08:03:59.595576+0000","last_became_peered":"2023-11-24T08:03:59.595576+0000","last_unstale":"2023-11-24T08:04:01.921179+0000","last_undegraded":"2023-11-24T08:04:01.921179+0000","last_fullsized":"2023-11-24T08:04:01.921179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:43.665608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921952+0000","last_change":"2023-11-24T08:03:59.596718+0000","last_active":"2023-11-24T08:04:01.921952+0000","last_peered":"2023-11-24T08:04:01.921952+0000","last_clean":"2023-11-24T08:04:01.921952+0000","last_became_active":"2023-11-24T08:03:59.596430+0000","last_became_peered":"2023-11-24T08:03:59.596430+0000","last_unstale":"2023-11-24T08:04:01.921952+0000","last_undegraded":"2023-11-24T08:04:01.921952+0000","last_fullsized":"2023-11-24T08:04:01.921952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:34.454939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695171+0000","last_change":"2023-11-24T08:03:58.595326+0000","last_active":"2023-11-24T08:04:00.695171+0000","last_peered":"2023-11-24T08:04:00.695171+0000","last_clean":"2023-11-24T08:04:00.695171+0000","last_became_active":"2023-11-24T08:03:58.593856+0000","last_became_peered":"2023-11-24T08:03:58.593856+0000","last_unstale":"2023-11-24T08:04:00.695171+0000","last_undegraded":"2023-11-24T08:04:00.695171+0000","last_fullsized":"2023-11-24T08:04:00.695171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921561+0000","last_change":"2023-11-24T08:03:59.600352+0000","last_active":"2023-11-24T08:04:01.921561+0000","last_peered":"2023-11-24T08:04:01.921561+0000","last_clean":"2023-11-24T08:04:01.921561+0000","last_became_active":"2023-11-24T08:03:59.599271+0000","last_became_peered":"2023-11-24T08:03:59.599271+0000","last_unstale":"2023-11-24T08:04:01.921561+0000","last_undegraded":"2023-11-24T08:04:01.921561+0000","last_fullsized":"2023-11-24T08:04:01.921561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:45.738363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695233+0000","last_change":"2023-11-24T08:03:58.595226+0000","last_active":"2023-11-24T08:04:00.695233+0000","last_peered":"2023-11-24T08:04:00.695233+0000","last_clean":"2023-11-24T08:04:00.695233+0000","last_became_active":"2023-11-24T08:03:58.593565+0000","last_became_peered":"2023-11-24T08:03:58.593565+0000","last_unstale":"2023-11-24T08:04:00.695233+0000","last_undegraded":"2023-11-24T08:04:00.695233+0000","last_fullsized":"2023-11-24T08:04:00.695233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596765+0000","last_change":"2023-11-24T08:03:59.586457+0000","last_active":"2023-11-24T08:04:00.596765+0000","last_peered":"2023-11-24T08:04:00.596765+0000","last_clean":"2023-11-24T08:04:00.596765+0000","last_became_active":"2023-11-24T08:03:59.586176+0000","last_became_peered":"2023-11-24T08:03:59.586176+0000","last_unstale":"2023-11-24T08:04:00.596765+0000","last_undegraded":"2023-11-24T08:04:00.596765+0000","last_fullsized":"2023-11-24T08:04:00.596765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:24:30.702456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.701848+0000","last_change":"2023-11-24T08:03:58.587271+0000","last_active":"2023-11-24T08:04:00.701848+0000","last_peered":"2023-11-24T08:04:00.701848+0000","last_clean":"2023-11-24T08:04:00.701848+0000","last_became_active":"2023-11-24T08:03:58.586888+0000","last_became_peered":"2023-11-24T08:03:58.586888+0000","last_unstale":"2023-11-24T08:04:00.701848+0000","last_undegraded":"2023-11-24T08:04:00.701848+0000","last_fullsized":"2023-11-24T08:04:00.701848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921397+0000","last_change":"2023-11-24T08:03:59.585467+0000","last_active":"2023-11-24T08:04:01.921397+0000","last_peered":"2023-11-24T08:04:01.921397+0000","last_clean":"2023-11-24T08:04:01.921397+0000","last_became_active":"2023-11-24T08:03:59.585159+0000","last_became_peered":"2023-11-24T08:03:59.585159+0000","last_unstale":"2023-11-24T08:04:01.921397+0000","last_undegraded":"2023-11-24T08:04:01.921397+0000","last_fullsized":"2023-11-24T08:04:01.921397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:49.357450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.695450+0000","last_change":"2023-11-24T08:03:58.589593+0000","last_active":"2023-11-24T08:03:59.695450+0000","last_peered":"2023-11-24T08:03:59.695450+0000","last_clean":"2023-11-24T08:03:59.695450+0000","last_became_active":"2023-11-24T08:03:58.588864+0000","last_became_peered":"2023-11-24T08:03:58.588864+0000","last_unstale":"2023-11-24T08:03:59.695450+0000","last_undegraded":"2023-11-24T08:03:59.695450+0000","last_fullsized":"2023-11-24T08:03:59.695450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:11.240162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4539999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.923}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":671929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:08.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:08.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.536+0000 7fa6bd6bb640 1 Processor -- start 2023-11-24T08:04:08.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.536+0000 7fa6bd6bb640 1 -- start start 2023-11-24T08:04:08.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.536+0000 7fa6bd6bb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b806d5f0 0x7fa6b806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.536+0000 7fa6bd6bb640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa6b80b3670 0x7fa6b80ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.536+0000 7fa6bd6bb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b80ae950 con 0x7fa6b8159a80 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.536+0000 7fa6bd6bb640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b80b1ef0 con 0x7fa6b80b3670 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.536+0000 7fa6bd6bb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80adca0 con 0x7fa6b806d5f0 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa6b80b3670 0x7fa6b80ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa6b80b3670 0x7fa6b80ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55898/0 (socket says 172.21.15.57:55898) 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 -- 172.21.15.57:0/4173815387 learned_addr learned my addr 172.21.15.57:0/4173815387 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6ae7fc640 1 --2- 172.21.15.57:0/4173815387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b806d5f0 0x7fa6b806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 -- 172.21.15.57:0/4173815387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b806d5f0 msgr2=0x7fa6b806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 --2- 172.21.15.57:0/4173815387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b806d5f0 0x7fa6b806de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 -- 172.21.15.57:0/4173815387 >> v1:172.21.15.132:6789/0 conn(0x7fa6b8159a80 legacy=0x7fa6b806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 -- 172.21.15.57:0/4173815387 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80adf80 con 0x7fa6b80b3670 2023-11-24T08:04:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b77fe640 1 --2- 172.21.15.57:0/4173815387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b80ac5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0006fd0 tx=0x7fa6b001e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abadafa8011a7bda server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b67fc640 1 -- 172.21.15.57:0/4173815387 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0004230 con 0x7fa6b80b3670 2023-11-24T08:04:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b67fc640 1 -- 172.21.15.57:0/4173815387 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b00ab070 con 0x7fa6b80b3670 2023-11-24T08:04:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.540+0000 7fa6b67fc640 1 -- 172.21.15.57:0/4173815387 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00a77f0 con 0x7fa6b80b3670 2023-11-24T08:04:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/4173815387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 msgr2=0x7fa6b80ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/4173815387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b80ac5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0006fd0 tx=0x7fa6b001e9a0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/4173815387 shutdown_connections 2023-11-24T08:04:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/4173815387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b80ac5d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/4173815387 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b806d5f0 0x7fa6b806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/4173815387 >> 172.21.15.57:0/4173815387 conn(0x7fa6b80b0bf0 msgr2=0x7fa6b80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/4173815387 shutdown_connections 2023-11-24T08:04:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/4173815387 wait complete. 2023-11-24T08:04:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 Processor -- start 2023-11-24T08:04:08.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- start start 2023-11-24T08:04:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6b806d5f0 0x7fa6b8154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b8158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b8159a80 0x7fa6b8148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b809aa90 con 0x7fa6b80b3670 2023-11-24T08:04:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b81490a0 con 0x7fa6b806d5f0 2023-11-24T08:04:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6bd6bb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b815a180 con 0x7fa6b8159a80 2023-11-24T08:04:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6ae7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b8158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6ae7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b8158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55906/0 (socket says 172.21.15.57:55906) 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6ae7fc640 1 -- 172.21.15.57:0/1451952684 learned_addr learned my addr 172.21.15.57:0/1451952684 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6b77fe640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b8159a80 0x7fa6b8148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.544+0000 7fa6b6ffd640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6b806d5f0 0x7fa6b8154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6ae7fc640 1 -- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b8159a80 msgr2=0x7fa6b8148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6ae7fc640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b8159a80 0x7fa6b8148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6ae7fc640 1 -- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6b806d5f0 msgr2=0x7fa6b8154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6ae7fc640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6b806d5f0 0x7fa6b8154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6ae7fc640 1 -- 172.21.15.57:0/1451952684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b000b780 con 0x7fa6b80b3670 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6b6ffd640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6b806d5f0 0x7fa6b8154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6ae7fc640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b8158640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000e930 tx=0x7fa6a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6affff640 1 -- 172.21.15.57:0/1451952684 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0009690 con 0x7fa6b80b3670 2023-11-24T08:04:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6affff640 1 -- 172.21.15.57:0/1451952684 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000ca00 con 0x7fa6b80b3670 2023-11-24T08:04:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b815a460 con 0x7fa6b80b3670 2023-11-24T08:04:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6affff640 1 -- 172.21.15.57:0/1451952684 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000cd70 con 0x7fa6b80b3670 2023-11-24T08:04:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b809a380 con 0x7fa6b80b3670 2023-11-24T08:04:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b809abd0 con 0x7fa6b80b3670 2023-11-24T08:04:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.548+0000 7fa6affff640 1 -- 172.21.15.57:0/1451952684 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6a0013470 con 0x7fa6b80b3670 2023-11-24T08:04:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.552+0000 7fa6affff640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa6980664a0 0x7fa698068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.552+0000 7fa6affff640 1 -- 172.21.15.57:0/1451952684 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6a0084020 con 0x7fa6b80b3670 2023-11-24T08:04:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.552+0000 7fa6b6ffd640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa6980664a0 0x7fa698068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.552+0000 7fa6b6ffd640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa6980664a0 0x7fa698068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80012f0 tx=0x7fa6a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.556+0000 7fa6affff640 1 -- 172.21.15.57:0/1451952684 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6b809abd0 con 0x7fa6b80b3670 2023-11-24T08:04:08.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.712+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6b809abd0 con 0x7fa6980664a0 2023-11-24T08:04:08.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.720+0000 7fa6affff640 1 -- 172.21.15.57:0/1451952684 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264501 (secure 0 0 0) 0x7fa6b809abd0 con 0x7fa6980664a0 2023-11-24T08:04:08.723 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:08.725 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa6980664a0 msgr2=0x7fa698068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa6980664a0 0x7fa698068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80012f0 tx=0x7fa6a8009040 comp rx=0 tx=0).stop 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 msgr2=0x7fa6b8158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b8158640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000e930 tx=0x7fa6a000edf0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 shutdown_connections 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa6980664a0 0x7fa698068960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6b8159a80 0x7fa6b8148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6b80b3670 0x7fa6b8158640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 --2- 172.21.15.57:0/1451952684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6b806d5f0 0x7fa6b8154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 >> 172.21.15.57:0/1451952684 conn(0x7fa6b80b0bf0 msgr2=0x7fa6b8155440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 shutdown_connections 2023-11-24T08:04:08.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.724+0000 7fa6bd6bb640 1 -- 172.21.15.57:0/1451952684 wait complete. 2023-11-24T08:04:08.744 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-11-24T08:04:08.681531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223380,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751340,"statfs":{"total":773094113280,"available":772865372160,"internally_reserved":0,"allocated":3121152,"data_stored":1832940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.117104"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921630+0000","last_change":"2023-11-24T08:03:59.599040+0000","last_active":"2023-11-24T08:04:01.921630+0000","last_peered":"2023-11-24T08:04:01.921630+0000","last_clean":"2023-11-24T08:04:01.921630+0000","last_became_active":"2023-11-24T08:03:59.598731+0000","last_became_peered":"2023-11-24T08:03:59.598731+0000","last_unstale":"2023-11-24T08:04:01.921630+0000","last_undegraded":"2023-11-24T08:04:01.921630+0000","last_fullsized":"2023-11-24T08:04:01.921630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:49.497144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.421088+0000","last_change":"2023-11-24T08:03:59.587668+0000","last_active":"2023-11-24T08:04:01.421088+0000","last_peered":"2023-11-24T08:04:01.421088+0000","last_clean":"2023-11-24T08:04:01.421088+0000","last_became_active":"2023-11-24T08:03:59.585499+0000","last_became_peered":"2023-11-24T08:03:59.585499+0000","last_unstale":"2023-11-24T08:04:01.421088+0000","last_undegraded":"2023-11-24T08:04:01.421088+0000","last_fullsized":"2023-11-24T08:04:01.421088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:31:50.887296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596660+0000","last_change":"2023-11-24T08:03:59.595671+0000","last_active":"2023-11-24T08:04:00.596660+0000","last_peered":"2023-11-24T08:04:00.596660+0000","last_clean":"2023-11-24T08:04:00.596660+0000","last_became_active":"2023-11-24T08:03:59.595451+0000","last_became_peered":"2023-11-24T08:03:59.595451+0000","last_unstale":"2023-11-24T08:04:00.596660+0000","last_undegraded":"2023-11-24T08:04:00.596660+0000","last_fullsized":"2023-11-24T08:04:00.596660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:50:50.625309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921411+0000","last_change":"2023-11-24T08:03:59.585093+0000","last_active":"2023-11-24T08:04:01.921411+0000","last_peered":"2023-11-24T08:04:01.921411+0000","last_clean":"2023-11-24T08:04:01.921411+0000","last_became_active":"2023-11-24T08:03:59.584715+0000","last_became_peered":"2023-11-24T08:03:59.584715+0000","last_unstale":"2023-11-24T08:04:01.921411+0000","last_undegraded":"2023-11-24T08:04:01.921411+0000","last_fullsized":"2023-11-24T08:04:01.921411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:49.497144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921632+0000","last_change":"2023-11-24T08:03:59.594763+0000","last_active":"2023-11-24T08:04:01.921632+0000","last_peered":"2023-11-24T08:04:01.921632+0000","last_clean":"2023-11-24T08:04:01.921632+0000","last_became_active":"2023-11-24T08:03:59.594479+0000","last_became_peered":"2023-11-24T08:03:59.594479+0000","last_unstale":"2023-11-24T08:04:01.921632+0000","last_undegraded":"2023-11-24T08:04:01.921632+0000","last_fullsized":"2023-11-24T08:04:01.921632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:45.738363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920680+0000","last_change":"2023-11-24T08:03:59.586577+0000","last_active":"2023-11-24T08:04:01.920680+0000","last_peered":"2023-11-24T08:04:01.920680+0000","last_clean":"2023-11-24T08:04:01.920680+0000","last_became_active":"2023-11-24T08:03:59.586189+0000","last_became_peered":"2023-11-24T08:03:59.586189+0000","last_unstale":"2023-11-24T08:04:01.920680+0000","last_undegraded":"2023-11-24T08:04:01.920680+0000","last_fullsized":"2023-11-24T08:04:01.920680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920935+0000","last_change":"2023-11-24T08:03:59.596712+0000","last_active":"2023-11-24T08:04:01.920935+0000","last_peered":"2023-11-24T08:04:01.920935+0000","last_clean":"2023-11-24T08:04:01.920935+0000","last_became_active":"2023-11-24T08:03:59.596335+0000","last_became_peered":"2023-11-24T08:03:59.596335+0000","last_unstale":"2023-11-24T08:04:01.920935+0000","last_undegraded":"2023-11-24T08:04:01.920935+0000","last_fullsized":"2023-11-24T08:04:01.920935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:49.357450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920910+0000","last_change":"2023-11-24T08:03:59.588712+0000","last_active":"2023-11-24T08:04:01.920910+0000","last_peered":"2023-11-24T08:04:01.920910+0000","last_clean":"2023-11-24T08:04:01.920910+0000","last_became_active":"2023-11-24T08:03:59.588015+0000","last_became_peered":"2023-11-24T08:03:59.588015+0000","last_unstale":"2023-11-24T08:04:01.920910+0000","last_undegraded":"2023-11-24T08:04:01.920910+0000","last_fullsized":"2023-11-24T08:04:01.920910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:24.485625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921790+0000","last_change":"2023-11-24T08:03:59.600086+0000","last_active":"2023-11-24T08:04:01.921790+0000","last_peered":"2023-11-24T08:04:01.921790+0000","last_clean":"2023-11-24T08:04:01.921790+0000","last_became_active":"2023-11-24T08:03:59.598793+0000","last_became_peered":"2023-11-24T08:03:59.598793+0000","last_unstale":"2023-11-24T08:04:01.921790+0000","last_undegraded":"2023-11-24T08:04:01.921790+0000","last_fullsized":"2023-11-24T08:04:01.921790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:40.694620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922295+0000","last_change":"2023-11-24T08:03:59.587766+0000","last_active":"2023-11-24T08:04:01.922295+0000","last_peered":"2023-11-24T08:04:01.922295+0000","last_clean":"2023-11-24T08:04:01.922295+0000","last_became_active":"2023-11-24T08:03:59.587435+0000","last_became_peered":"2023-11-24T08:03:59.587435+0000","last_unstale":"2023-11-24T08:04:01.922295+0000","last_undegraded":"2023-11-24T08:04:01.922295+0000","last_fullsized":"2023-11-24T08:04:01.922295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921669+0000","last_change":"2023-11-24T08:03:59.587777+0000","last_active":"2023-11-24T08:04:01.921669+0000","last_peered":"2023-11-24T08:04:01.921669+0000","last_clean":"2023-11-24T08:04:01.921669+0000","last_became_active":"2023-11-24T08:03:59.587442+0000","last_became_peered":"2023-11-24T08:03:59.587442+0000","last_unstale":"2023-11-24T08:04:01.921669+0000","last_undegraded":"2023-11-24T08:04:01.921669+0000","last_fullsized":"2023-11-24T08:04:01.921669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595515+0000","last_change":"2023-11-24T08:03:59.595995+0000","last_active":"2023-11-24T08:04:00.595515+0000","last_peered":"2023-11-24T08:04:00.595515+0000","last_clean":"2023-11-24T08:04:00.595515+0000","last_became_active":"2023-11-24T08:03:59.595526+0000","last_became_peered":"2023-11-24T08:03:59.595526+0000","last_unstale":"2023-11-24T08:04:00.595515+0000","last_undegraded":"2023-11-24T08:04:00.595515+0000","last_fullsized":"2023-11-24T08:04:00.595515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921181+0000","last_change":"2023-11-24T08:03:59.591371+0000","last_active":"2023-11-24T08:04:01.921181+0000","last_peered":"2023-11-24T08:04:01.921181+0000","last_clean":"2023-11-24T08:04:01.921181+0000","last_became_active":"2023-11-24T08:03:59.590300+0000","last_became_peered":"2023-11-24T08:03:59.590300+0000","last_unstale":"2023-11-24T08:04:01.921181+0000","last_undegraded":"2023-11-24T08:04:01.921181+0000","last_fullsized":"2023-11-24T08:04:01.921181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596221+0000","last_change":"2023-11-24T08:03:59.592432+0000","last_active":"2023-11-24T08:04:00.596221+0000","last_peered":"2023-11-24T08:04:00.596221+0000","last_clean":"2023-11-24T08:04:00.596221+0000","last_became_active":"2023-11-24T08:03:59.592087+0000","last_became_peered":"2023-11-24T08:03:59.592087+0000","last_unstale":"2023-11-24T08:04:00.596221+0000","last_undegraded":"2023-11-24T08:04:00.596221+0000","last_fullsized":"2023-11-24T08:04:00.596221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:15.926853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420713+0000","last_change":"2023-11-24T08:03:59.594278+0000","last_active":"2023-11-24T08:04:01.420713+0000","last_peered":"2023-11-24T08:04:01.420713+0000","last_clean":"2023-11-24T08:04:01.420713+0000","last_became_active":"2023-11-24T08:03:59.593956+0000","last_became_peered":"2023-11-24T08:03:59.593956+0000","last_unstale":"2023-11-24T08:04:01.420713+0000","last_undegraded":"2023-11-24T08:04:01.420713+0000","last_fullsized":"2023-11-24T08:04:01.420713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920633+0000","last_change":"2023-11-24T08:03:59.573698+0000","last_active":"2023-11-24T08:04:01.920633+0000","last_peered":"2023-11-24T08:04:01.920633+0000","last_clean":"2023-11-24T08:04:01.920633+0000","last_became_active":"2023-11-24T08:03:59.573383+0000","last_became_peered":"2023-11-24T08:03:59.573383+0000","last_unstale":"2023-11-24T08:04:01.920633+0000","last_undegraded":"2023-11-24T08:04:01.920633+0000","last_fullsized":"2023-11-24T08:04:01.920633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921742+0000","last_change":"2023-11-24T08:03:59.590145+0000","last_active":"2023-11-24T08:04:01.921742+0000","last_peered":"2023-11-24T08:04:01.921742+0000","last_clean":"2023-11-24T08:04:01.921742+0000","last_became_active":"2023-11-24T08:03:59.589840+0000","last_became_peered":"2023-11-24T08:03:59.589840+0000","last_unstale":"2023-11-24T08:04:01.921742+0000","last_undegraded":"2023-11-24T08:04:01.921742+0000","last_fullsized":"2023-11-24T08:04:01.921742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:50:40.694620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598839+0000","last_change":"2023-11-24T08:03:59.590044+0000","last_active":"2023-11-24T08:04:00.598839+0000","last_peered":"2023-11-24T08:04:00.598839+0000","last_clean":"2023-11-24T08:04:00.598839+0000","last_became_active":"2023-11-24T08:03:59.589664+0000","last_became_peered":"2023-11-24T08:03:59.589664+0000","last_unstale":"2023-11-24T08:04:00.598839+0000","last_undegraded":"2023-11-24T08:04:00.598839+0000","last_fullsized":"2023-11-24T08:04:00.598839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922340+0000","last_change":"2023-11-24T08:03:59.597467+0000","last_active":"2023-11-24T08:04:01.922340+0000","last_peered":"2023-11-24T08:04:01.922340+0000","last_clean":"2023-11-24T08:04:01.922340+0000","last_became_active":"2023-11-24T08:03:59.596875+0000","last_became_peered":"2023-11-24T08:03:59.596875+0000","last_unstale":"2023-11-24T08:04:01.922340+0000","last_undegraded":"2023-11-24T08:04:01.922340+0000","last_fullsized":"2023-11-24T08:04:01.922340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:31:21.325975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921492+0000","last_change":"2023-11-24T08:03:59.599402+0000","last_active":"2023-11-24T08:04:01.921492+0000","last_peered":"2023-11-24T08:04:01.921492+0000","last_clean":"2023-11-24T08:04:01.921492+0000","last_became_active":"2023-11-24T08:03:59.598995+0000","last_became_peered":"2023-11-24T08:03:59.598995+0000","last_unstale":"2023-11-24T08:04:01.921492+0000","last_undegraded":"2023-11-24T08:04:01.921492+0000","last_fullsized":"2023-11-24T08:04:01.921492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596410+0000","last_change":"2023-11-24T08:03:59.592092+0000","last_active":"2023-11-24T08:04:00.596410+0000","last_peered":"2023-11-24T08:04:00.596410+0000","last_clean":"2023-11-24T08:04:00.596410+0000","last_became_active":"2023-11-24T08:03:59.591623+0000","last_became_peered":"2023-11-24T08:03:59.591623+0000","last_unstale":"2023-11-24T08:04:00.596410+0000","last_undegraded":"2023-11-24T08:04:00.596410+0000","last_fullsized":"2023-11-24T08:04:00.596410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:31.489475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920784+0000","last_change":"2023-11-24T08:03:59.591087+0000","last_active":"2023-11-24T08:04:01.920784+0000","last_peered":"2023-11-24T08:04:01.920784+0000","last_clean":"2023-11-24T08:04:01.920784+0000","last_became_active":"2023-11-24T08:03:59.590767+0000","last_became_peered":"2023-11-24T08:03:59.590767+0000","last_unstale":"2023-11-24T08:04:01.920784+0000","last_undegraded":"2023-11-24T08:04:01.920784+0000","last_fullsized":"2023-11-24T08:04:01.920784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:31:50.887296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921057+0000","last_change":"2023-11-24T08:03:59.595583+0000","last_active":"2023-11-24T08:04:01.921057+0000","last_peered":"2023-11-24T08:04:01.921057+0000","last_clean":"2023-11-24T08:04:01.921057+0000","last_became_active":"2023-11-24T08:03:59.595284+0000","last_became_peered":"2023-11-24T08:03:59.595284+0000","last_unstale":"2023-11-24T08:04:01.921057+0000","last_undegraded":"2023-11-24T08:04:01.921057+0000","last_fullsized":"2023-11-24T08:04:01.921057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:43.665608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920789+0000","last_change":"2023-11-24T08:03:59.579548+0000","last_active":"2023-11-24T08:04:01.920789+0000","last_peered":"2023-11-24T08:04:01.920789+0000","last_clean":"2023-11-24T08:04:01.920789+0000","last_became_active":"2023-11-24T08:03:59.579263+0000","last_became_peered":"2023-11-24T08:03:59.579263+0000","last_unstale":"2023-11-24T08:04:01.920789+0000","last_undegraded":"2023-11-24T08:04:01.920789+0000","last_fullsized":"2023-11-24T08:04:01.920789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:49.357450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921339+0000","last_change":"2023-11-24T08:03:59.598908+0000","last_active":"2023-11-24T08:04:01.921339+0000","last_peered":"2023-11-24T08:04:01.921339+0000","last_clean":"2023-11-24T08:04:01.921339+0000","last_became_active":"2023-11-24T08:03:59.598657+0000","last_became_peered":"2023-11-24T08:03:59.598657+0000","last_unstale":"2023-11-24T08:04:01.921339+0000","last_undegraded":"2023-11-24T08:04:01.921339+0000","last_fullsized":"2023-11-24T08:04:01.921339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:31:50.887296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922322+0000","last_change":"2023-11-24T08:03:59.598426+0000","last_active":"2023-11-24T08:04:01.922322+0000","last_peered":"2023-11-24T08:04:01.922322+0000","last_clean":"2023-11-24T08:04:01.922322+0000","last_became_active":"2023-11-24T08:03:59.598155+0000","last_became_peered":"2023-11-24T08:03:59.598155+0000","last_unstale":"2023-11-24T08:04:01.922322+0000","last_undegraded":"2023-11-24T08:04:01.922322+0000","last_fullsized":"2023-11-24T08:04:01.922322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420935+0000","last_change":"2023-11-24T08:03:59.588426+0000","last_active":"2023-11-24T08:04:01.420935+0000","last_peered":"2023-11-24T08:04:01.420935+0000","last_clean":"2023-11-24T08:04:01.420935+0000","last_became_active":"2023-11-24T08:03:59.588118+0000","last_became_peered":"2023-11-24T08:03:59.588118+0000","last_unstale":"2023-11-24T08:04:01.420935+0000","last_undegraded":"2023-11-24T08:04:01.420935+0000","last_fullsized":"2023-11-24T08:04:01.420935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:54.040803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921418+0000","last_change":"2023-11-24T08:03:59.600156+0000","last_active":"2023-11-24T08:04:01.921418+0000","last_peered":"2023-11-24T08:04:01.921418+0000","last_clean":"2023-11-24T08:04:01.921418+0000","last_became_active":"2023-11-24T08:03:59.599912+0000","last_became_peered":"2023-11-24T08:03:59.599912+0000","last_unstale":"2023-11-24T08:04:01.921418+0000","last_undegraded":"2023-11-24T08:04:01.921418+0000","last_fullsized":"2023-11-24T08:04:01.921418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:37.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596391+0000","last_change":"2023-11-24T08:03:59.581204+0000","last_active":"2023-11-24T08:04:00.596391+0000","last_peered":"2023-11-24T08:04:00.596391+0000","last_clean":"2023-11-24T08:04:00.596391+0000","last_became_active":"2023-11-24T08:03:59.580877+0000","last_became_peered":"2023-11-24T08:03:59.580877+0000","last_unstale":"2023-11-24T08:04:00.596391+0000","last_undegraded":"2023-11-24T08:04:00.596391+0000","last_fullsized":"2023-11-24T08:04:00.596391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:38:32.043325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921201+0000","last_change":"2023-11-24T08:03:59.579863+0000","last_active":"2023-11-24T08:04:01.921201+0000","last_peered":"2023-11-24T08:04:01.921201+0000","last_clean":"2023-11-24T08:04:01.921201+0000","last_became_active":"2023-11-24T08:03:59.579542+0000","last_became_peered":"2023-11-24T08:03:59.579542+0000","last_unstale":"2023-11-24T08:04:01.921201+0000","last_undegraded":"2023-11-24T08:04:01.921201+0000","last_fullsized":"2023-11-24T08:04:01.921201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:37.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598575+0000","last_change":"2023-11-24T08:03:59.595768+0000","last_active":"2023-11-24T08:04:00.598575+0000","last_peered":"2023-11-24T08:04:00.598575+0000","last_clean":"2023-11-24T08:04:00.598575+0000","last_became_active":"2023-11-24T08:03:59.594474+0000","last_became_peered":"2023-11-24T08:03:59.594474+0000","last_unstale":"2023-11-24T08:04:00.598575+0000","last_undegraded":"2023-11-24T08:04:00.598575+0000","last_fullsized":"2023-11-24T08:04:00.598575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:20.381875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.920949+0000","last_change":"2023-11-24T08:03:59.584924+0000","last_active":"2023-11-24T08:04:01.920949+0000","last_peered":"2023-11-24T08:04:01.920949+0000","last_clean":"2023-11-24T08:04:01.920949+0000","last_became_active":"2023-11-24T08:03:59.584192+0000","last_became_peered":"2023-11-24T08:03:59.584192+0000","last_unstale":"2023-11-24T08:04:01.920949+0000","last_undegraded":"2023-11-24T08:04:01.920949+0000","last_fullsized":"2023-11-24T08:04:01.920949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:24.485625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595270+0000","last_change":"2023-11-24T08:03:59.594108+0000","last_active":"2023-11-24T08:04:00.595270+0000","last_peered":"2023-11-24T08:04:00.595270+0000","last_clean":"2023-11-24T08:04:00.595270+0000","last_became_active":"2023-11-24T08:03:59.593151+0000","last_became_peered":"2023-11-24T08:03:59.593151+0000","last_unstale":"2023-11-24T08:04:00.595270+0000","last_undegraded":"2023-11-24T08:04:00.595270+0000","last_fullsized":"2023-11-24T08:04:00.595270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:00.242631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.701810+0000","last_change":"2023-11-24T08:03:58.595372+0000","last_active":"2023-11-24T08:04:00.701810+0000","last_peered":"2023-11-24T08:04:00.701810+0000","last_clean":"2023-11-24T08:04:00.701810+0000","last_became_active":"2023-11-24T08:03:58.595011+0000","last_became_peered":"2023-11-24T08:03:58.595011+0000","last_unstale":"2023-11-24T08:04:00.701810+0000","last_undegraded":"2023-11-24T08:04:00.701810+0000","last_fullsized":"2023-11-24T08:04:00.701810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596456+0000","last_change":"2023-11-24T08:03:59.604482+0000","last_active":"2023-11-24T08:04:00.596456+0000","last_peered":"2023-11-24T08:04:00.596456+0000","last_clean":"2023-11-24T08:04:00.596456+0000","last_became_active":"2023-11-24T08:03:59.604180+0000","last_became_peered":"2023-11-24T08:03:59.604180+0000","last_unstale":"2023-11-24T08:04:00.596456+0000","last_undegraded":"2023-11-24T08:04:00.596456+0000","last_fullsized":"2023-11-24T08:04:00.596456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:34:26.115762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.699972+0000","last_change":"2023-11-24T08:03:58.574383+0000","last_active":"2023-11-24T08:04:00.699972+0000","last_peered":"2023-11-24T08:04:00.699972+0000","last_clean":"2023-11-24T08:04:00.699972+0000","last_became_active":"2023-11-24T08:03:58.574059+0000","last_became_peered":"2023-11-24T08:03:58.574059+0000","last_unstale":"2023-11-24T08:04:00.699972+0000","last_undegraded":"2023-11-24T08:04:00.699972+0000","last_fullsized":"2023-11-24T08:04:00.699972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.701754+0000","last_change":"2023-11-24T08:03:58.591311+0000","last_active":"2023-11-24T08:04:00.701754+0000","last_peered":"2023-11-24T08:04:00.701754+0000","last_clean":"2023-11-24T08:04:00.701754+0000","last_became_active":"2023-11-24T08:03:58.590678+0000","last_became_peered":"2023-11-24T08:03:58.590678+0000","last_unstale":"2023-11-24T08:04:00.701754+0000","last_undegraded":"2023-11-24T08:04:00.701754+0000","last_fullsized":"2023-11-24T08:04:00.701754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921010+0000","last_change":"2023-11-24T08:03:59.584561+0000","last_active":"2023-11-24T08:04:01.921010+0000","last_peered":"2023-11-24T08:04:01.921010+0000","last_clean":"2023-11-24T08:04:01.921010+0000","last_became_active":"2023-11-24T08:03:59.584227+0000","last_became_peered":"2023-11-24T08:03:59.584227+0000","last_unstale":"2023-11-24T08:04:01.921010+0000","last_undegraded":"2023-11-24T08:04:01.921010+0000","last_fullsized":"2023-11-24T08:04:01.921010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:39.675569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700135+0000","last_change":"2023-11-24T08:03:58.594517+0000","last_active":"2023-11-24T08:04:00.700135+0000","last_peered":"2023-11-24T08:04:00.700135+0000","last_clean":"2023-11-24T08:04:00.700135+0000","last_became_active":"2023-11-24T08:03:58.592799+0000","last_became_peered":"2023-11-24T08:03:58.592799+0000","last_unstale":"2023-11-24T08:04:00.700135+0000","last_undegraded":"2023-11-24T08:04:00.700135+0000","last_fullsized":"2023-11-24T08:04:00.700135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420674+0000","last_change":"2023-11-24T08:03:59.587401+0000","last_active":"2023-11-24T08:04:01.420674+0000","last_peered":"2023-11-24T08:04:01.420674+0000","last_clean":"2023-11-24T08:04:01.420674+0000","last_became_active":"2023-11-24T08:03:59.587106+0000","last_became_peered":"2023-11-24T08:03:59.587106+0000","last_unstale":"2023-11-24T08:04:01.420674+0000","last_undegraded":"2023-11-24T08:04:01.420674+0000","last_fullsized":"2023-11-24T08:04:01.420674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:43.665608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700051+0000","last_change":"2023-11-24T08:03:58.593371+0000","last_active":"2023-11-24T08:04:00.700051+0000","last_peered":"2023-11-24T08:04:00.700051+0000","last_clean":"2023-11-24T08:04:00.700051+0000","last_became_active":"2023-11-24T08:03:58.591545+0000","last_became_peered":"2023-11-24T08:03:58.591545+0000","last_unstale":"2023-11-24T08:04:00.700051+0000","last_undegraded":"2023-11-24T08:04:00.700051+0000","last_fullsized":"2023-11-24T08:04:00.700051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922113+0000","last_change":"2023-11-24T08:03:59.598485+0000","last_active":"2023-11-24T08:04:01.922113+0000","last_peered":"2023-11-24T08:04:01.922113+0000","last_clean":"2023-11-24T08:04:01.922113+0000","last_became_active":"2023-11-24T08:03:59.598252+0000","last_became_peered":"2023-11-24T08:03:59.598252+0000","last_unstale":"2023-11-24T08:04:01.922113+0000","last_undegraded":"2023-11-24T08:04:01.922113+0000","last_fullsized":"2023-11-24T08:04:01.922113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:37:04.257381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700358+0000","last_change":"2023-11-24T08:03:58.588831+0000","last_active":"2023-11-24T08:04:00.700358+0000","last_peered":"2023-11-24T08:04:00.700358+0000","last_clean":"2023-11-24T08:04:00.700358+0000","last_became_active":"2023-11-24T08:03:58.588494+0000","last_became_peered":"2023-11-24T08:03:58.588494+0000","last_unstale":"2023-11-24T08:04:00.700358+0000","last_undegraded":"2023-11-24T08:04:00.700358+0000","last_fullsized":"2023-11-24T08:04:00.700358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:23.475033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596791+0000","last_change":"2023-11-24T08:03:59.586309+0000","last_active":"2023-11-24T08:04:00.596791+0000","last_peered":"2023-11-24T08:04:00.596791+0000","last_clean":"2023-11-24T08:04:00.596791+0000","last_became_active":"2023-11-24T08:03:59.585998+0000","last_became_peered":"2023-11-24T08:03:59.585998+0000","last_unstale":"2023-11-24T08:04:00.596791+0000","last_undegraded":"2023-11-24T08:04:00.596791+0000","last_fullsized":"2023-11-24T08:04:00.596791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:42.276832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698367+0000","last_change":"2023-11-24T08:03:58.592635+0000","last_active":"2023-11-24T08:04:00.698367+0000","last_peered":"2023-11-24T08:04:00.698367+0000","last_clean":"2023-11-24T08:04:00.698367+0000","last_became_active":"2023-11-24T08:03:58.592339+0000","last_became_peered":"2023-11-24T08:03:58.592339+0000","last_unstale":"2023-11-24T08:04:00.698367+0000","last_undegraded":"2023-11-24T08:04:00.698367+0000","last_fullsized":"2023-11-24T08:04:00.698367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:59.685338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595544+0000","last_change":"2023-11-24T08:03:59.600109+0000","last_active":"2023-11-24T08:04:00.595544+0000","last_peered":"2023-11-24T08:04:00.595544+0000","last_clean":"2023-11-24T08:04:00.595544+0000","last_became_active":"2023-11-24T08:03:59.599837+0000","last_became_peered":"2023-11-24T08:03:59.599837+0000","last_unstale":"2023-11-24T08:04:00.595544+0000","last_undegraded":"2023-11-24T08:04:00.595544+0000","last_fullsized":"2023-11-24T08:04:00.595544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:00.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.699991+0000","last_change":"2023-11-24T08:03:58.586653+0000","last_active":"2023-11-24T08:04:00.699991+0000","last_peered":"2023-11-24T08:04:00.699991+0000","last_clean":"2023-11-24T08:04:00.699991+0000","last_became_active":"2023-11-24T08:03:58.586327+0000","last_became_peered":"2023-11-24T08:03:58.586327+0000","last_unstale":"2023-11-24T08:04:00.699991+0000","last_undegraded":"2023-11-24T08:04:00.699991+0000","last_fullsized":"2023-11-24T08:04:00.699991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921585+0000","last_change":"2023-11-24T08:03:59.597689+0000","last_active":"2023-11-24T08:04:01.921585+0000","last_peered":"2023-11-24T08:04:01.921585+0000","last_clean":"2023-11-24T08:04:01.921585+0000","last_became_active":"2023-11-24T08:03:59.597176+0000","last_became_peered":"2023-11-24T08:03:59.597176+0000","last_unstale":"2023-11-24T08:04:01.921585+0000","last_undegraded":"2023-11-24T08:04:01.921585+0000","last_fullsized":"2023-11-24T08:04:01.921585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:37.891535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.695342+0000","last_change":"2023-11-24T08:03:58.577074+0000","last_active":"2023-11-24T08:03:59.695342+0000","last_peered":"2023-11-24T08:03:59.695342+0000","last_clean":"2023-11-24T08:03:59.695342+0000","last_became_active":"2023-11-24T08:03:58.576708+0000","last_became_peered":"2023-11-24T08:03:58.576708+0000","last_unstale":"2023-11-24T08:03:59.695342+0000","last_undegraded":"2023-11-24T08:03:59.695342+0000","last_fullsized":"2023-11-24T08:03:59.695342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:51:21.116952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596237+0000","last_change":"2023-11-24T08:03:59.592620+0000","last_active":"2023-11-24T08:04:00.596237+0000","last_peered":"2023-11-24T08:04:00.596237+0000","last_clean":"2023-11-24T08:04:00.596237+0000","last_became_active":"2023-11-24T08:03:59.592335+0000","last_became_peered":"2023-11-24T08:03:59.592335+0000","last_unstale":"2023-11-24T08:04:00.596237+0000","last_undegraded":"2023-11-24T08:04:00.596237+0000","last_fullsized":"2023-11-24T08:04:00.596237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:11.484868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700201+0000","last_change":"2023-11-24T08:03:58.589858+0000","last_active":"2023-11-24T08:04:00.700201+0000","last_peered":"2023-11-24T08:04:00.700201+0000","last_clean":"2023-11-24T08:04:00.700201+0000","last_became_active":"2023-11-24T08:03:58.589555+0000","last_became_peered":"2023-11-24T08:03:58.589555+0000","last_unstale":"2023-11-24T08:04:00.700201+0000","last_undegraded":"2023-11-24T08:04:00.700201+0000","last_fullsized":"2023-11-24T08:04:00.700201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:42.320735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921790+0000","last_change":"2023-11-24T08:03:59.602898+0000","last_active":"2023-11-24T08:04:01.921790+0000","last_peered":"2023-11-24T08:04:01.921790+0000","last_clean":"2023-11-24T08:04:01.921790+0000","last_became_active":"2023-11-24T08:03:59.602585+0000","last_became_peered":"2023-11-24T08:03:59.602585+0000","last_unstale":"2023-11-24T08:04:01.921790+0000","last_undegraded":"2023-11-24T08:04:01.921790+0000","last_fullsized":"2023-11-24T08:04:01.921790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:34.454939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.699940+0000","last_change":"2023-11-24T08:03:58.581293+0000","last_active":"2023-11-24T08:04:00.699940+0000","last_peered":"2023-11-24T08:04:00.699940+0000","last_clean":"2023-11-24T08:04:00.699940+0000","last_became_active":"2023-11-24T08:03:58.580548+0000","last_became_peered":"2023-11-24T08:03:58.580548+0000","last_unstale":"2023-11-24T08:04:00.699940+0000","last_undegraded":"2023-11-24T08:04:00.699940+0000","last_fullsized":"2023-11-24T08:04:00.699940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921087+0000","last_change":"2023-11-24T08:03:59.584395+0000","last_active":"2023-11-24T08:04:01.921087+0000","last_peered":"2023-11-24T08:04:01.921087+0000","last_clean":"2023-11-24T08:04:01.921087+0000","last_became_active":"2023-11-24T08:03:59.583808+0000","last_became_peered":"2023-11-24T08:03:59.583808+0000","last_unstale":"2023-11-24T08:04:01.921087+0000","last_undegraded":"2023-11-24T08:04:01.921087+0000","last_fullsized":"2023-11-24T08:04:01.921087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:39.675569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598501+0000","last_change":"2023-11-24T08:03:58.580057+0000","last_active":"2023-11-24T08:04:00.598501+0000","last_peered":"2023-11-24T08:04:00.598501+0000","last_clean":"2023-11-24T08:04:00.598501+0000","last_became_active":"2023-11-24T08:03:58.579752+0000","last_became_peered":"2023-11-24T08:03:58.579752+0000","last_unstale":"2023-11-24T08:04:00.598501+0000","last_undegraded":"2023-11-24T08:04:00.598501+0000","last_fullsized":"2023-11-24T08:04:00.598501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:13:44.412407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921296+0000","last_change":"2023-11-24T08:03:59.602642+0000","last_active":"2023-11-24T08:04:01.921296+0000","last_peered":"2023-11-24T08:04:01.921296+0000","last_clean":"2023-11-24T08:04:01.921296+0000","last_became_active":"2023-11-24T08:03:59.602383+0000","last_became_peered":"2023-11-24T08:03:59.602383+0000","last_unstale":"2023-11-24T08:04:01.921296+0000","last_undegraded":"2023-11-24T08:04:01.921296+0000","last_fullsized":"2023-11-24T08:04:01.921296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:45:52.279485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595740+0000","last_change":"2023-11-24T08:03:58.576485+0000","last_active":"2023-11-24T08:04:00.595740+0000","last_peered":"2023-11-24T08:04:00.595740+0000","last_clean":"2023-11-24T08:04:00.595740+0000","last_became_active":"2023-11-24T08:03:58.576148+0000","last_became_peered":"2023-11-24T08:03:58.576148+0000","last_unstale":"2023-11-24T08:04:00.595740+0000","last_undegraded":"2023-11-24T08:04:00.595740+0000","last_fullsized":"2023-11-24T08:04:00.595740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922132+0000","last_change":"2023-11-24T08:03:59.605656+0000","last_active":"2023-11-24T08:04:01.922132+0000","last_peered":"2023-11-24T08:04:01.922132+0000","last_clean":"2023-11-24T08:04:01.922132+0000","last_became_active":"2023-11-24T08:03:59.605293+0000","last_became_peered":"2023-11-24T08:03:59.605293+0000","last_unstale":"2023-11-24T08:04:01.922132+0000","last_undegraded":"2023-11-24T08:04:01.922132+0000","last_fullsized":"2023-11-24T08:04:01.922132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:37:04.257381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598844+0000","last_change":"2023-11-24T08:03:58.590332+0000","last_active":"2023-11-24T08:04:00.598844+0000","last_peered":"2023-11-24T08:04:00.598844+0000","last_clean":"2023-11-24T08:04:00.598844+0000","last_became_active":"2023-11-24T08:03:58.587974+0000","last_became_peered":"2023-11-24T08:03:58.587974+0000","last_unstale":"2023-11-24T08:04:00.598844+0000","last_undegraded":"2023-11-24T08:04:00.598844+0000","last_fullsized":"2023-11-24T08:04:00.598844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921997+0000","last_change":"2023-11-24T08:03:59.606241+0000","last_active":"2023-11-24T08:04:01.921997+0000","last_peered":"2023-11-24T08:04:01.921997+0000","last_clean":"2023-11-24T08:04:01.921997+0000","last_became_active":"2023-11-24T08:03:59.604149+0000","last_became_peered":"2023-11-24T08:03:59.604149+0000","last_unstale":"2023-11-24T08:04:01.921997+0000","last_undegraded":"2023-11-24T08:04:01.921997+0000","last_fullsized":"2023-11-24T08:04:01.921997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:21.376153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698388+0000","last_change":"2023-11-24T08:03:58.581525+0000","last_active":"2023-11-24T08:04:00.698388+0000","last_peered":"2023-11-24T08:04:00.698388+0000","last_clean":"2023-11-24T08:04:00.698388+0000","last_became_active":"2023-11-24T08:03:58.578531+0000","last_became_peered":"2023-11-24T08:03:58.578531+0000","last_unstale":"2023-11-24T08:04:00.698388+0000","last_undegraded":"2023-11-24T08:04:00.698388+0000","last_fullsized":"2023-11-24T08:04:00.698388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:12.928445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921700+0000","last_change":"2023-11-24T08:03:59.582239+0000","last_active":"2023-11-24T08:04:01.921700+0000","last_peered":"2023-11-24T08:04:01.921700+0000","last_clean":"2023-11-24T08:04:01.921700+0000","last_became_active":"2023-11-24T08:03:59.580468+0000","last_became_peered":"2023-11-24T08:03:59.580468+0000","last_unstale":"2023-11-24T08:04:01.921700+0000","last_undegraded":"2023-11-24T08:04:01.921700+0000","last_fullsized":"2023-11-24T08:04:01.921700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:55.139904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598701+0000","last_change":"2023-11-24T08:03:58.592974+0000","last_active":"2023-11-24T08:04:00.598701+0000","last_peered":"2023-11-24T08:04:00.598701+0000","last_clean":"2023-11-24T08:04:00.598701+0000","last_became_active":"2023-11-24T08:03:58.592300+0000","last_became_peered":"2023-11-24T08:03:58.592300+0000","last_unstale":"2023-11-24T08:04:00.598701+0000","last_undegraded":"2023-11-24T08:04:00.598701+0000","last_fullsized":"2023-11-24T08:04:00.598701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:09:03.890704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921743+0000","last_change":"2023-11-24T08:03:59.595203+0000","last_active":"2023-11-24T08:04:01.921743+0000","last_peered":"2023-11-24T08:04:01.921743+0000","last_clean":"2023-11-24T08:04:01.921743+0000","last_became_active":"2023-11-24T08:03:59.594780+0000","last_became_peered":"2023-11-24T08:03:59.594780+0000","last_unstale":"2023-11-24T08:04:01.921743+0000","last_undegraded":"2023-11-24T08:04:01.921743+0000","last_fullsized":"2023-11-24T08:04:01.921743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:09:55.139904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.579866+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:03:59.579866+0000","last_peered":"2023-11-24T08:03:59.579866+0000","last_clean":"2023-11-24T08:03:59.579866+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:03:59.579866+0000","last_undegraded":"2023-11-24T08:03:59.579866+0000","last_fullsized":"2023-11-24T08:03:59.579866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700235+0000","last_change":"2023-11-24T08:03:58.590597+0000","last_active":"2023-11-24T08:04:00.700235+0000","last_peered":"2023-11-24T08:04:00.700235+0000","last_clean":"2023-11-24T08:04:00.700235+0000","last_became_active":"2023-11-24T08:03:58.590130+0000","last_became_peered":"2023-11-24T08:03:58.590130+0000","last_unstale":"2023-11-24T08:04:00.700235+0000","last_undegraded":"2023-11-24T08:04:00.700235+0000","last_fullsized":"2023-11-24T08:04:00.700235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921170+0000","last_change":"2023-11-24T08:03:59.589854+0000","last_active":"2023-11-24T08:04:01.921170+0000","last_peered":"2023-11-24T08:04:01.921170+0000","last_clean":"2023-11-24T08:04:01.921170+0000","last_became_active":"2023-11-24T08:03:59.589630+0000","last_became_peered":"2023-11-24T08:03:59.589630+0000","last_unstale":"2023-11-24T08:04:01.921170+0000","last_undegraded":"2023-11-24T08:04:01.921170+0000","last_fullsized":"2023-11-24T08:04:01.921170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695101+0000","last_change":"2023-11-24T08:03:58.593106+0000","last_active":"2023-11-24T08:04:00.695101+0000","last_peered":"2023-11-24T08:04:00.695101+0000","last_clean":"2023-11-24T08:04:00.695101+0000","last_became_active":"2023-11-24T08:03:58.592777+0000","last_became_peered":"2023-11-24T08:03:58.592777+0000","last_unstale":"2023-11-24T08:04:00.695101+0000","last_undegraded":"2023-11-24T08:04:00.695101+0000","last_fullsized":"2023-11-24T08:04:00.695101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:58:59.232039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596124+0000","last_change":"2023-11-24T08:03:59.594009+0000","last_active":"2023-11-24T08:04:00.596124+0000","last_peered":"2023-11-24T08:04:00.596124+0000","last_clean":"2023-11-24T08:04:00.596124+0000","last_became_active":"2023-11-24T08:03:59.593697+0000","last_became_peered":"2023-11-24T08:03:59.593697+0000","last_unstale":"2023-11-24T08:04:00.596124+0000","last_undegraded":"2023-11-24T08:04:00.596124+0000","last_fullsized":"2023-11-24T08:04:00.596124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:21.024507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.598642+0000","last_change":"2023-11-24T08:03:58.590726+0000","last_active":"2023-11-24T08:04:00.598642+0000","last_peered":"2023-11-24T08:04:00.598642+0000","last_clean":"2023-11-24T08:04:00.598642+0000","last_became_active":"2023-11-24T08:03:58.590385+0000","last_became_peered":"2023-11-24T08:03:58.590385+0000","last_unstale":"2023-11-24T08:04:00.598642+0000","last_undegraded":"2023-11-24T08:04:00.598642+0000","last_fullsized":"2023-11-24T08:04:00.598642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:50:19.226023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.420804+0000","last_change":"2023-11-24T08:03:59.594256+0000","last_active":"2023-11-24T08:04:01.420804+0000","last_peered":"2023-11-24T08:04:01.420804+0000","last_clean":"2023-11-24T08:04:01.420804+0000","last_became_active":"2023-11-24T08:03:59.593902+0000","last_became_peered":"2023-11-24T08:03:59.593902+0000","last_unstale":"2023-11-24T08:04:01.420804+0000","last_undegraded":"2023-11-24T08:04:01.420804+0000","last_fullsized":"2023-11-24T08:04:01.420804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:13:48.312743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700218+0000","last_change":"2023-11-24T08:03:58.589309+0000","last_active":"2023-11-24T08:04:00.700218+0000","last_peered":"2023-11-24T08:04:00.700218+0000","last_clean":"2023-11-24T08:04:00.700218+0000","last_became_active":"2023-11-24T08:03:58.588917+0000","last_became_peered":"2023-11-24T08:03:58.588917+0000","last_unstale":"2023-11-24T08:04:00.700218+0000","last_undegraded":"2023-11-24T08:04:00.700218+0000","last_fullsized":"2023-11-24T08:04:00.700218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595434+0000","last_change":"2023-11-24T08:03:59.597797+0000","last_active":"2023-11-24T08:04:00.595434+0000","last_peered":"2023-11-24T08:04:00.595434+0000","last_clean":"2023-11-24T08:04:00.595434+0000","last_became_active":"2023-11-24T08:03:59.597491+0000","last_became_peered":"2023-11-24T08:03:59.597491+0000","last_unstale":"2023-11-24T08:04:00.595434+0000","last_undegraded":"2023-11-24T08:04:00.595434+0000","last_fullsized":"2023-11-24T08:04:00.595434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:02:51.472689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698331+0000","last_change":"2023-11-24T08:03:58.581746+0000","last_active":"2023-11-24T08:04:00.698331+0000","last_peered":"2023-11-24T08:04:00.698331+0000","last_clean":"2023-11-24T08:04:00.698331+0000","last_became_active":"2023-11-24T08:03:58.578821+0000","last_became_peered":"2023-11-24T08:03:58.578821+0000","last_unstale":"2023-11-24T08:04:00.698331+0000","last_undegraded":"2023-11-24T08:04:00.698331+0000","last_fullsized":"2023-11-24T08:04:00.698331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.922018+0000","last_change":"2023-11-24T08:03:59.584022+0000","last_active":"2023-11-24T08:04:01.922018+0000","last_peered":"2023-11-24T08:04:01.922018+0000","last_clean":"2023-11-24T08:04:01.922018+0000","last_became_active":"2023-11-24T08:03:59.583697+0000","last_became_peered":"2023-11-24T08:03:59.583697+0000","last_unstale":"2023-11-24T08:04:01.922018+0000","last_undegraded":"2023-11-24T08:04:01.922018+0000","last_fullsized":"2023-11-24T08:04:01.922018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:52:21.376153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695268+0000","last_change":"2023-11-24T08:03:58.595698+0000","last_active":"2023-11-24T08:04:00.695268+0000","last_peered":"2023-11-24T08:04:00.695268+0000","last_clean":"2023-11-24T08:04:00.695268+0000","last_became_active":"2023-11-24T08:03:58.595445+0000","last_became_peered":"2023-11-24T08:03:58.595445+0000","last_unstale":"2023-11-24T08:04:00.695268+0000","last_undegraded":"2023-11-24T08:04:00.695268+0000","last_fullsized":"2023-11-24T08:04:00.695268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:38.664977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.421013+0000","last_change":"2023-11-24T08:03:59.591006+0000","last_active":"2023-11-24T08:04:01.421013+0000","last_peered":"2023-11-24T08:04:01.421013+0000","last_clean":"2023-11-24T08:04:01.421013+0000","last_became_active":"2023-11-24T08:03:59.590697+0000","last_became_peered":"2023-11-24T08:03:59.590697+0000","last_unstale":"2023-11-24T08:04:01.421013+0000","last_undegraded":"2023-11-24T08:04:01.421013+0000","last_fullsized":"2023-11-24T08:04:01.421013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.421059+0000","last_change":"2023-11-24T08:03:58.585471+0000","last_active":"2023-11-24T08:04:01.421059+0000","last_peered":"2023-11-24T08:04:01.421059+0000","last_clean":"2023-11-24T08:04:01.421059+0000","last_became_active":"2023-11-24T08:03:58.584512+0000","last_became_peered":"2023-11-24T08:03:58.584512+0000","last_unstale":"2023-11-24T08:04:01.421059+0000","last_undegraded":"2023-11-24T08:04:01.421059+0000","last_fullsized":"2023-11-24T08:04:01.421059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:34:40.580051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921487+0000","last_change":"2023-11-24T08:03:59.597245+0000","last_active":"2023-11-24T08:04:01.921487+0000","last_peered":"2023-11-24T08:04:01.921487+0000","last_clean":"2023-11-24T08:04:01.921487+0000","last_became_active":"2023-11-24T08:03:59.596949+0000","last_became_peered":"2023-11-24T08:03:59.596949+0000","last_unstale":"2023-11-24T08:04:01.921487+0000","last_undegraded":"2023-11-24T08:04:01.921487+0000","last_fullsized":"2023-11-24T08:04:01.921487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:14:49.497144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.700067+0000","last_change":"2023-11-24T08:03:58.587720+0000","last_active":"2023-11-24T08:04:00.700067+0000","last_peered":"2023-11-24T08:04:00.700067+0000","last_clean":"2023-11-24T08:04:00.700067+0000","last_became_active":"2023-11-24T08:03:58.587501+0000","last_became_peered":"2023-11-24T08:03:58.587501+0000","last_unstale":"2023-11-24T08:04:00.700067+0000","last_undegraded":"2023-11-24T08:04:00.700067+0000","last_fullsized":"2023-11-24T08:04:00.700067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:52:19.371283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596765+0000","last_change":"2023-11-24T08:03:59.592131+0000","last_active":"2023-11-24T08:04:00.596765+0000","last_peered":"2023-11-24T08:04:00.596765+0000","last_clean":"2023-11-24T08:04:00.596765+0000","last_became_active":"2023-11-24T08:03:59.591709+0000","last_became_peered":"2023-11-24T08:03:59.591709+0000","last_unstale":"2023-11-24T08:04:00.596765+0000","last_undegraded":"2023-11-24T08:04:00.596765+0000","last_fullsized":"2023-11-24T08:04:00.596765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:47:46.539937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695080+0000","last_change":"2023-11-24T08:03:58.592505+0000","last_active":"2023-11-24T08:04:00.695080+0000","last_peered":"2023-11-24T08:04:00.695080+0000","last_clean":"2023-11-24T08:04:00.695080+0000","last_became_active":"2023-11-24T08:03:58.592097+0000","last_became_peered":"2023-11-24T08:03:58.592097+0000","last_unstale":"2023-11-24T08:04:00.695080+0000","last_undegraded":"2023-11-24T08:04:00.695080+0000","last_fullsized":"2023-11-24T08:04:00.695080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:20.402034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.595333+0000","last_change":"2023-11-24T08:03:59.590194+0000","last_active":"2023-11-24T08:04:00.595333+0000","last_peered":"2023-11-24T08:04:00.595333+0000","last_clean":"2023-11-24T08:04:00.595333+0000","last_became_active":"2023-11-24T08:03:59.589879+0000","last_became_peered":"2023-11-24T08:03:59.589879+0000","last_unstale":"2023-11-24T08:04:00.595333+0000","last_undegraded":"2023-11-24T08:04:00.595333+0000","last_fullsized":"2023-11-24T08:04:00.595333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:21.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698300+0000","last_change":"2023-11-24T08:03:58.593989+0000","last_active":"2023-11-24T08:04:00.698300+0000","last_peered":"2023-11-24T08:04:00.698300+0000","last_clean":"2023-11-24T08:04:00.698300+0000","last_became_active":"2023-11-24T08:03:58.593641+0000","last_became_peered":"2023-11-24T08:03:58.593641+0000","last_unstale":"2023-11-24T08:04:00.698300+0000","last_undegraded":"2023-11-24T08:04:00.698300+0000","last_fullsized":"2023-11-24T08:04:00.698300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921069+0000","last_change":"2023-11-24T08:03:59.588962+0000","last_active":"2023-11-24T08:04:01.921069+0000","last_peered":"2023-11-24T08:04:01.921069+0000","last_clean":"2023-11-24T08:04:01.921069+0000","last_became_active":"2023-11-24T08:03:59.588405+0000","last_became_peered":"2023-11-24T08:03:59.588405+0000","last_unstale":"2023-11-24T08:04:01.921069+0000","last_undegraded":"2023-11-24T08:04:01.921069+0000","last_fullsized":"2023-11-24T08:04:01.921069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:12:43.331327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.698313+0000","last_change":"2023-11-24T08:03:58.589209+0000","last_active":"2023-11-24T08:04:00.698313+0000","last_peered":"2023-11-24T08:04:00.698313+0000","last_clean":"2023-11-24T08:04:00.698313+0000","last_became_active":"2023-11-24T08:03:58.588034+0000","last_became_peered":"2023-11-24T08:03:58.588034+0000","last_unstale":"2023-11-24T08:04:00.698313+0000","last_undegraded":"2023-11-24T08:04:00.698313+0000","last_fullsized":"2023-11-24T08:04:00.698313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921333+0000","last_change":"2023-11-24T08:03:59.584679+0000","last_active":"2023-11-24T08:04:01.921333+0000","last_peered":"2023-11-24T08:04:01.921333+0000","last_clean":"2023-11-24T08:04:01.921333+0000","last_became_active":"2023-11-24T08:03:59.584311+0000","last_became_peered":"2023-11-24T08:03:59.584311+0000","last_unstale":"2023-11-24T08:04:01.921333+0000","last_undegraded":"2023-11-24T08:04:01.921333+0000","last_fullsized":"2023-11-24T08:04:01.921333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:56.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695162+0000","last_change":"2023-11-24T08:03:58.593136+0000","last_active":"2023-11-24T08:04:00.695162+0000","last_peered":"2023-11-24T08:04:00.695162+0000","last_clean":"2023-11-24T08:04:00.695162+0000","last_became_active":"2023-11-24T08:03:58.592737+0000","last_became_peered":"2023-11-24T08:03:58.592737+0000","last_unstale":"2023-11-24T08:04:00.695162+0000","last_undegraded":"2023-11-24T08:04:00.695162+0000","last_fullsized":"2023-11-24T08:04:00.695162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:40.999867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921179+0000","last_change":"2023-11-24T08:03:59.595926+0000","last_active":"2023-11-24T08:04:01.921179+0000","last_peered":"2023-11-24T08:04:01.921179+0000","last_clean":"2023-11-24T08:04:01.921179+0000","last_became_active":"2023-11-24T08:03:59.595576+0000","last_became_peered":"2023-11-24T08:03:59.595576+0000","last_unstale":"2023-11-24T08:04:01.921179+0000","last_undegraded":"2023-11-24T08:04:01.921179+0000","last_fullsized":"2023-11-24T08:04:01.921179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:43.665608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921952+0000","last_change":"2023-11-24T08:03:59.596718+0000","last_active":"2023-11-24T08:04:01.921952+0000","last_peered":"2023-11-24T08:04:01.921952+0000","last_clean":"2023-11-24T08:04:01.921952+0000","last_became_active":"2023-11-24T08:03:59.596430+0000","last_became_peered":"2023-11-24T08:03:59.596430+0000","last_unstale":"2023-11-24T08:04:01.921952+0000","last_undegraded":"2023-11-24T08:04:01.921952+0000","last_fullsized":"2023-11-24T08:04:01.921952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:34.454939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695171+0000","last_change":"2023-11-24T08:03:58.595326+0000","last_active":"2023-11-24T08:04:00.695171+0000","last_peered":"2023-11-24T08:04:00.695171+0000","last_clean":"2023-11-24T08:04:00.695171+0000","last_became_active":"2023-11-24T08:03:58.593856+0000","last_became_peered":"2023-11-24T08:03:58.593856+0000","last_unstale":"2023-11-24T08:04:00.695171+0000","last_undegraded":"2023-11-24T08:04:00.695171+0000","last_fullsized":"2023-11-24T08:04:00.695171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:42.655016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921561+0000","last_change":"2023-11-24T08:03:59.600352+0000","last_active":"2023-11-24T08:04:01.921561+0000","last_peered":"2023-11-24T08:04:01.921561+0000","last_clean":"2023-11-24T08:04:01.921561+0000","last_became_active":"2023-11-24T08:03:59.599271+0000","last_became_peered":"2023-11-24T08:03:59.599271+0000","last_unstale":"2023-11-24T08:04:01.921561+0000","last_undegraded":"2023-11-24T08:04:01.921561+0000","last_fullsized":"2023-11-24T08:04:01.921561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:45.738363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.695233+0000","last_change":"2023-11-24T08:03:58.595226+0000","last_active":"2023-11-24T08:04:00.695233+0000","last_peered":"2023-11-24T08:04:00.695233+0000","last_clean":"2023-11-24T08:04:00.695233+0000","last_became_active":"2023-11-24T08:03:58.593565+0000","last_became_peered":"2023-11-24T08:03:58.593565+0000","last_unstale":"2023-11-24T08:04:00.695233+0000","last_undegraded":"2023-11-24T08:04:00.695233+0000","last_fullsized":"2023-11-24T08:04:00.695233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:22.568126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.596765+0000","last_change":"2023-11-24T08:03:59.586457+0000","last_active":"2023-11-24T08:04:00.596765+0000","last_peered":"2023-11-24T08:04:00.596765+0000","last_clean":"2023-11-24T08:04:00.596765+0000","last_became_active":"2023-11-24T08:03:59.586176+0000","last_became_peered":"2023-11-24T08:03:59.586176+0000","last_unstale":"2023-11-24T08:04:00.596765+0000","last_undegraded":"2023-11-24T08:04:00.596765+0000","last_fullsized":"2023-11-24T08:04:00.596765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:24:30.702456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:04:00.701848+0000","last_change":"2023-11-24T08:03:58.587271+0000","last_active":"2023-11-24T08:04:00.701848+0000","last_peered":"2023-11-24T08:04:00.701848+0000","last_clean":"2023-11-24T08:04:00.701848+0000","last_became_active":"2023-11-24T08:03:58.586888+0000","last_became_peered":"2023-11-24T08:03:58.586888+0000","last_unstale":"2023-11-24T08:04:00.701848+0000","last_undegraded":"2023-11-24T08:04:00.701848+0000","last_fullsized":"2023-11-24T08:04:00.701848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:48.347742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-24T08:04:01.921397+0000","last_change":"2023-11-24T08:03:59.585467+0000","last_active":"2023-11-24T08:04:01.921397+0000","last_peered":"2023-11-24T08:04:01.921397+0000","last_clean":"2023-11-24T08:04:01.921397+0000","last_became_active":"2023-11-24T08:03:59.585159+0000","last_became_peered":"2023-11-24T08:03:59.585159+0000","last_unstale":"2023-11-24T08:04:01.921397+0000","last_undegraded":"2023-11-24T08:04:01.921397+0000","last_fullsized":"2023-11-24T08:04:01.921397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:58.551943+0000","last_clean_scrub_stamp":"2023-11-24T08:03:58.551943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:49.357450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:03:59.695450+0000","last_change":"2023-11-24T08:03:58.589593+0000","last_active":"2023-11-24T08:03:59.695450+0000","last_peered":"2023-11-24T08:03:59.695450+0000","last_clean":"2023-11-24T08:03:59.695450+0000","last_became_active":"2023-11-24T08:03:58.588864+0000","last_became_peered":"2023-11-24T08:03:58.588864+0000","last_unstale":"2023-11-24T08:03:59.695450+0000","last_undegraded":"2023-11-24T08:03:59.695450+0000","last_fullsized":"2023-11-24T08:03:59.695450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:57.541351+0000","last_clean_scrub_stamp":"2023-11-24T08:03:57.541351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:11.240162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4539999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.923}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":81083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":671929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:08.748 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:04:08.749 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T08:04:08.749 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T08:04:08.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T08:04:08.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb7550fe640 1 Processor -- start 2023-11-24T08:04:08.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb7550fe640 1 -- start start 2023-11-24T08:04:08.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb7550fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb75015d570 0x7fb75006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb7550fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb7500d3020 0x7fb7500d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb7550fe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7500d39c0 con 0x7fb7500ce8b0 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb7550fe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7500d1cc0 con 0x7fb7500d3020 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb7550fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7500d1fa0 con 0x7fb75015d570 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb7500d3020 0x7fb7500d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74ed9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb75015d570 0x7fb75006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb7500d3020 0x7fb7500d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:54096/0 (socket says 172.21.15.57:54096) 2023-11-24T08:04:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74e59c640 1 -- 172.21.15.57:0/2101974498 learned_addr learned my addr 172.21.15.57:0/2101974498 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74ed9d640 1 -- 172.21.15.57:0/2101974498 >> v2:172.21.15.132:3300/0 conn(0x7fb7500d3020 msgr2=0x7fb7500d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74ed9d640 1 --2- 172.21.15.57:0/2101974498 >> v2:172.21.15.132:3300/0 conn(0x7fb7500d3020 0x7fb7500d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74ed9d640 1 -- 172.21.15.57:0/2101974498 >> v1:172.21.15.132:6789/0 conn(0x7fb7500ce8b0 legacy=0x7fb7500ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74ed9d640 1 -- 172.21.15.57:0/2101974498 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500ce0b0 con 0x7fb75015d570 2023-11-24T08:04:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.928+0000 7fb74e59c640 1 --2- 172.21.15.57:0/2101974498 >> v2:172.21.15.132:3300/0 conn(0x7fb7500d3020 0x7fb7500d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb74ed9d640 1 --2- 172.21.15.57:0/2101974498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb75015d570 0x7fb75006b9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb7400097c0 tx=0x7fb74001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57190730fc26824 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb74dd9b640 1 -- 172.21.15.57:0/2101974498 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400ac640 con 0x7fb75015d570 2023-11-24T08:04:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb74dd9b640 1 -- 172.21.15.57:0/2101974498 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7400ac7a0 con 0x7fb75015d570 2023-11-24T08:04:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb74dd9b640 1 -- 172.21.15.57:0/2101974498 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400acb30 con 0x7fb75015d570 2023-11-24T08:04:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 -- 172.21.15.57:0/2101974498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb75015d570 msgr2=0x7fb75006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 --2- 172.21.15.57:0/2101974498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb75015d570 0x7fb75006b9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb7400097c0 tx=0x7fb74001c3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 -- 172.21.15.57:0/2101974498 shutdown_connections 2023-11-24T08:04:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 --2- 172.21.15.57:0/2101974498 >> v2:172.21.15.132:3300/0 conn(0x7fb7500d3020 0x7fb7500d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 --2- 172.21.15.57:0/2101974498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb75015d570 0x7fb75006b9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 -- 172.21.15.57:0/2101974498 >> 172.21.15.57:0/2101974498 conn(0x7fb75008ceb0 msgr2=0x7fb75009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 -- 172.21.15.57:0/2101974498 shutdown_connections 2023-11-24T08:04:08.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.932+0000 7fb7550fe640 1 -- 172.21.15.57:0/2101974498 wait complete. 2023-11-24T08:04:08.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 Processor -- start 2023-11-24T08:04:08.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 -- start start 2023-11-24T08:04:08.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500ce8b0 0x7fb75015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7500d3020 0x7fb7500c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb75015d570 0x7fb7500b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750155170 con 0x7fb7500ce8b0 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750154380 con 0x7fb75015d570 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb750154560 con 0x7fb7500d3020 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500ce8b0 0x7fb75015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500ce8b0 0x7fb75015f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55916/0 (socket says 172.21.15.57:55916) 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 -- 172.21.15.57:0/587124815 learned_addr learned my addr 172.21.15.57:0/587124815 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74e59c640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7500d3020 0x7fb7500c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74f59e640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb75015d570 0x7fb7500b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 -- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7500d3020 msgr2=0x7fb7500c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7500d3020 0x7fb7500c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 -- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb75015d570 msgr2=0x7fb7500b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb75015d570 0x7fb7500b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 -- 172.21.15.57:0/587124815 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440094d0 con 0x7fb7500ce8b0 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74f59e640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb75015d570 0x7fb7500b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb74ed9d640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500ce8b0 0x7fb75015f4e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb74001aa70 tx=0x7fb740019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7377fe640 1 -- 172.21.15.57:0/587124815 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400b6670 con 0x7fb7500ce8b0 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7377fe640 1 -- 172.21.15.57:0/587124815 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7400b67f0 con 0x7fb7500ce8b0 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb740009420 con 0x7fb7500ce8b0 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7377fe640 1 -- 172.21.15.57:0/587124815 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400b6ba0 con 0x7fb7500ce8b0 2023-11-24T08:04:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.936+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb750154b20 con 0x7fb7500ce8b0 2023-11-24T08:04:08.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.940+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb750067520 con 0x7fb7500ce8b0 2023-11-24T08:04:08.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.940+0000 7fb7377fe640 1 -- 172.21.15.57:0/587124815 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7400b3040 con 0x7fb7500ce8b0 2023-11-24T08:04:08.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.940+0000 7fb7377fe640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb73c066470 0x7fb73c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:08.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.940+0000 7fb7377fe640 1 -- 172.21.15.57:0/587124815 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb74011e670 con 0x7fb7500ce8b0 2023-11-24T08:04:08.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.940+0000 7fb74e59c640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb73c066470 0x7fb73c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:08.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.940+0000 7fb74e59c640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb73c066470 0x7fb73c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7500cfc80 tx=0x7fb744008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:08.944+0000 7fb7377fe640 1 -- 172.21.15.57:0/587124815 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7400eba50 con 0x7fb7500ce8b0 2023-11-24T08:04:09.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.132+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb7500d37a0 con 0x7fb7500ce8b0 2023-11-24T08:04:09.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.132+0000 7fb7377fe640 1 -- 172.21.15.57:0/587124815 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb7400ef070 con 0x7fb7500ce8b0 2023-11-24T08:04:09.135 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:09.136 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T08:04:09.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb73c066470 msgr2=0x7fb73c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb73c066470 0x7fb73c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7500cfc80 tx=0x7fb744008040 comp rx=0 tx=0).stop 2023-11-24T08:04:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500ce8b0 msgr2=0x7fb75015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500ce8b0 0x7fb75015f4e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb74001aa70 tx=0x7fb740019160 comp rx=0 tx=0).stop 2023-11-24T08:04:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 shutdown_connections 2023-11-24T08:04:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb73c066470 0x7fb73c068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb75015d570 0x7fb7500b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb7500d3020 0x7fb7500c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 --2- 172.21.15.57:0/587124815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7500ce8b0 0x7fb75015f4e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 >> 172.21.15.57:0/587124815 conn(0x7fb75008ceb0 msgr2=0x7fb75015c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 shutdown_connections 2023-11-24T08:04:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.136+0000 7fb7550fe640 1 -- 172.21.15.57:0/587124815 wait complete. 2023-11-24T08:04:09.156 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T08:04:09.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:09.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c81de7640 1 Processor -- start 2023-11-24T08:04:09.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c81de7640 1 -- start start 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c81de7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c15d720 0x7f4c7c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c81de7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c06d050 con 0x7f4c7c0d3a50 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c81de7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c06c720 con 0x7f4c7c0b25c0 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c81de7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0d2240 con 0x7f4c7c15d720 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4c7c0d3a50 0x7f4c7c0cde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44380/0 (socket says 172.21.15.57:44380) 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7bfff640 1 -- 172.21.15.57:0/4292980681 learned_addr learned my addr 172.21.15.57:0/4292980681 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7b7fe640 1 --2- 172.21.15.57:0/4292980681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c15d720 0x7f4c7c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605741613 0 0) 0x7f4c7c06d050 con 0x7f4c7c0d3a50 2023-11-24T08:04:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c64003530 con 0x7f4c7c0d3a50 2023-11-24T08:04:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515081822 0 0) 0x7f4c7c06c720 con 0x7f4c7c0b25c0 2023-11-24T08:04:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c7c06d050 con 0x7f4c7c0b25c0 2023-11-24T08:04:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044678691 0 0) 0x7f4c64003530 con 0x7f4c7c0d3a50 2023-11-24T08:04:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7b7fe640 1 -- 172.21.15.57:0/4292980681 >> v1:172.21.15.132:6789/0 conn(0x7f4c7c0b25c0 legacy=0x7f4c7c0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7b7fe640 1 -- 172.21.15.57:0/4292980681 >> v1:172.21.15.57:6789/0 conn(0x7f4c7c0d3a50 legacy=0x7f4c7c0cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.300+0000 7f4c7b7fe640 1 -- 172.21.15.57:0/4292980681 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c06ca00 con 0x7f4c7c15d720 2023-11-24T08:04:09.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c7b7fe640 1 --2- 172.21.15.57:0/4292980681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c15d720 0x7f4c7c0d1a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0097f0 tx=0x7f4c6c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=705b26589efa1a93 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74001a00 con 0x7f4c7c15d720 2023-11-24T08:04:09.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0a7050 con 0x7f4c7c15d720 2023-11-24T08:04:09.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c7a7fc640 1 -- 172.21.15.57:0/4292980681 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0ab620 con 0x7f4c7c15d720 2023-11-24T08:04:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c81de7640 1 -- 172.21.15.57:0/4292980681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c15d720 msgr2=0x7f4c7c0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c81de7640 1 --2- 172.21.15.57:0/4292980681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c15d720 0x7f4c7c0d1a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0097f0 tx=0x7f4c6c01c3e0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c81de7640 1 -- 172.21.15.57:0/4292980681 shutdown_connections 2023-11-24T08:04:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c81de7640 1 --2- 172.21.15.57:0/4292980681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c15d720 0x7f4c7c0d1a10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c81de7640 1 -- 172.21.15.57:0/4292980681 >> 172.21.15.57:0/4292980681 conn(0x7f4c7c08af70 msgr2=0x7f4c7c09c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.304+0000 7f4c81de7640 1 -- 172.21.15.57:0/4292980681 shutdown_connections 2023-11-24T08:04:09.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 -- 172.21.15.57:0/4292980681 wait complete. 2023-11-24T08:04:09.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 Processor -- start 2023-11-24T08:04:09.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 -- start start 2023-11-24T08:04:09.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c0b25c0 0x7f4c7c14b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c7c0d3a50 0x7f4c7c159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7c15d720 0x7f4c7c0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c14bc40 con 0x7f4c7c15d720 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c153b10 con 0x7f4c7c0d3a50 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c81de7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c153db0 con 0x7f4c7c0b25c0 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7c15d720 0x7f4c7c0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7c15d720 0x7f4c7c0cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55930/0 (socket says 172.21.15.57:55930) 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 -- 172.21.15.57:0/1190506961 learned_addr learned my addr 172.21.15.57:0/1190506961 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7b7fe640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c0b25c0 0x7f4c7c14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7affd640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c7c0d3a50 0x7f4c7c159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 -- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c0b25c0 msgr2=0x7f4c7c14b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c0b25c0 0x7f4c7c14b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 -- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c7c0d3a50 msgr2=0x7f4c7c159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c7c0d3a50 0x7f4c7c159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.308+0000 7f4c7bfff640 1 -- 172.21.15.57:0/1190506961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c009420 con 0x7f4c7c15d720 2023-11-24T08:04:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c7bfff640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7c15d720 0x7f4c7c0cc110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400cc30 tx=0x7f4c7400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c63fff640 1 -- 172.21.15.57:0/1190506961 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7400ce40 con 0x7f4c7c15d720 2023-11-24T08:04:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c63fff640 1 -- 172.21.15.57:0/1190506961 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c74012400 con 0x7f4c7c15d720 2023-11-24T08:04:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c63fff640 1 -- 172.21.15.57:0/1190506961 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740127b0 con 0x7f4c7c15d720 2023-11-24T08:04:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c154090 con 0x7f4c7c15d720 2023-11-24T08:04:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c154650 con 0x7f4c7c15d720 2023-11-24T08:04:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c154840 con 0x7f4c7c15d720 2023-11-24T08:04:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c63fff640 1 -- 172.21.15.57:0/1190506961 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c74012910 con 0x7f4c7c15d720 2023-11-24T08:04:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c63fff640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4c68066470 0x7f4c68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c63fff640 1 -- 172.21.15.57:0/1190506961 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c740844c0 con 0x7f4c7c15d720 2023-11-24T08:04:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.312+0000 7f4c7b7fe640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4c68066470 0x7f4c68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.316+0000 7f4c7b7fe640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4c68066470 0x7f4c68068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0ad000 tx=0x7f4c6c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.316+0000 7f4c63fff640 1 -- 172.21.15.57:0/1190506961 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c740519f0 con 0x7f4c7c15d720 2023-11-24T08:04:09.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.472+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c7c067520 con 0x7f4c7c15d720 2023-11-24T08:04:09.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c63fff640 1 -- 172.21.15.57:0/1190506961 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4c74055010 con 0x7f4c7c15d720 2023-11-24T08:04:09.476 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:09.476 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:09.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4c68066470 msgr2=0x7f4c68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4c68066470 0x7f4c68068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0ad000 tx=0x7f4c6c0a6000 comp rx=0 tx=0).stop 2023-11-24T08:04:09.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7c15d720 msgr2=0x7f4c7c0cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7c15d720 0x7f4c7c0cc110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400cc30 tx=0x7f4c7400a430 comp rx=0 tx=0).stop 2023-11-24T08:04:09.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 shutdown_connections 2023-11-24T08:04:09.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4c68066470 0x7f4c68068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7c15d720 0x7f4c7c0cc110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c7c0d3a50 0x7f4c7c159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 --2- 172.21.15.57:0/1190506961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4c7c0b25c0 0x7f4c7c14b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 >> 172.21.15.57:0/1190506961 conn(0x7f4c7c08af70 msgr2=0x7f4c7c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 shutdown_connections 2023-11-24T08:04:09.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.476+0000 7f4c81de7640 1 -- 172.21.15.57:0/1190506961 wait complete. 2023-11-24T08:04:09.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:09.498 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:09.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.640+0000 7f8e77491640 1 Processor -- start 2023-11-24T08:04:09.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e77491640 1 -- start start 2023-11-24T08:04:09.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e77491640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e700cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e77491640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e700cf300 0x7f8e7006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e77491640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7006c620 con 0x7f8e7015d630 2023-11-24T08:04:09.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e77491640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e700cf790 con 0x7f8e700cf300 2023-11-24T08:04:09.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e77491640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7006ba10 con 0x7f8e700ce200 2023-11-24T08:04:09.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e75a2e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e700cf300 0x7f8e7006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e75a2e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e700cf300 0x7f8e7006cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55936/0 (socket says 172.21.15.57:55936) 2023-11-24T08:04:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e75a2e640 1 -- 172.21.15.57:0/2759326632 learned_addr learned my addr 172.21.15.57:0/2759326632 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e74a2c640 1 --2- 172.21.15.57:0/2759326632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e700cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e75a2e640 1 -- 172.21.15.57:0/2759326632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 msgr2=0x7f8e700cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e75a2e640 1 --2- 172.21.15.57:0/2759326632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e700cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e75a2e640 1 -- 172.21.15.57:0/2759326632 >> v1:172.21.15.132:6789/0 conn(0x7f8e7015d630 legacy=0x7f8e700cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e75a2e640 1 -- 172.21.15.57:0/2759326632 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7006bcf0 con 0x7f8e700cf300 2023-11-24T08:04:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.644+0000 7f8e74a2c640 1 --2- 172.21.15.57:0/2759326632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e700cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:09.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e75a2e640 1 --2- 172.21.15.57:0/2759326632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e7006cab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009e50 tx=0x7f8e6801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378d5fbf66dd6823 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e67fff640 1 -- 172.21.15.57:0/2759326632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680a5820 con 0x7f8e700cf300 2023-11-24T08:04:09.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e67fff640 1 -- 172.21.15.57:0/2759326632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e680a5980 con 0x7f8e700cf300 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e67fff640 1 -- 172.21.15.57:0/2759326632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680a5d10 con 0x7f8e700cf300 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 -- 172.21.15.57:0/2759326632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 msgr2=0x7f8e7006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 --2- 172.21.15.57:0/2759326632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e7006cab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009e50 tx=0x7f8e6801c9a0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 -- 172.21.15.57:0/2759326632 shutdown_connections 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 --2- 172.21.15.57:0/2759326632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e7006cab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 --2- 172.21.15.57:0/2759326632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e700cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 -- 172.21.15.57:0/2759326632 >> 172.21.15.57:0/2759326632 conn(0x7f8e7006e860 msgr2=0x7f8e7006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 -- 172.21.15.57:0/2759326632 shutdown_connections 2023-11-24T08:04:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 -- 172.21.15.57:0/2759326632 wait complete. 2023-11-24T08:04:09.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 Processor -- start 2023-11-24T08:04:09.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.648+0000 7f8e77491640 1 -- start start 2023-11-24T08:04:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e7015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e700c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e7015d630 0x7f8e7015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70150cb0 con 0x7f8e700cf300 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70160160 con 0x7f8e7015d630 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70160440 con 0x7f8e700ce200 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e700c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e700c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55944/0 (socket says 172.21.15.57:55944) 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 -- 172.21.15.57:0/601432764 learned_addr learned my addr 172.21.15.57:0/601432764 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e75a2e640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e7015d630 0x7f8e7015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e7522d640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e7015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 -- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 msgr2=0x7f8e7015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e7015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 -- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e7015d630 msgr2=0x7f8e7015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e7015d630 0x7f8e7015f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 -- 172.21.15.57:0/601432764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e68009b30 con 0x7f8e700cf300 2023-11-24T08:04:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e74a2c640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e700c6440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c7c0 tx=0x7f8e6000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e65ffb640 1 -- 172.21.15.57:0/601432764 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60007a30 con 0x7f8e700cf300 2023-11-24T08:04:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e65ffb640 1 -- 172.21.15.57:0/601432764 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60007b90 con 0x7f8e700cf300 2023-11-24T08:04:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e65ffb640 1 -- 172.21.15.57:0/601432764 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000ce70 con 0x7f8e700cf300 2023-11-24T08:04:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e70160720 con 0x7f8e700cf300 2023-11-24T08:04:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e70160a00 con 0x7f8e700cf300 2023-11-24T08:04:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.652+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e70067a40 con 0x7f8e700cf300 2023-11-24T08:04:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.656+0000 7f8e65ffb640 1 -- 172.21.15.57:0/601432764 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8e600113f0 con 0x7f8e700cf300 2023-11-24T08:04:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.656+0000 7f8e65ffb640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8e54066470 0x7f8e54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.656+0000 7f8e65ffb640 1 -- 172.21.15.57:0/601432764 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e60084380 con 0x7f8e700cf300 2023-11-24T08:04:09.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.656+0000 7f8e7522d640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8e54066470 0x7f8e54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.656+0000 7f8e7522d640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8e54066470 0x7f8e54068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00b810 tx=0x7f8e6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.660+0000 7f8e65ffb640 1 -- 172.21.15.57:0/601432764 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e60051760 con 0x7f8e700cf300 2023-11-24T08:04:09.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e7015ad60 con 0x7f8e700cf300 2023-11-24T08:04:09.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e65ffb640 1 -- 172.21.15.57:0/601432764 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e60054d80 con 0x7f8e700cf300 2023-11-24T08:04:09.822 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:09.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8e54066470 msgr2=0x7f8e54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8e54066470 0x7f8e54068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00b810 tx=0x7f8e6c008040 comp rx=0 tx=0).stop 2023-11-24T08:04:09.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 msgr2=0x7f8e700c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e700c6440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c7c0 tx=0x7f8e6000cc80 comp rx=0 tx=0).stop 2023-11-24T08:04:09.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 shutdown_connections 2023-11-24T08:04:09.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8e54066470 0x7f8e54068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e7015d630 0x7f8e7015f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e700cf300 0x7f8e700c6440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 --2- 172.21.15.57:0/601432764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e700ce200 0x7f8e7015e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 >> 172.21.15.57:0/601432764 conn(0x7f8e7006e860 msgr2=0x7f8e7015b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 shutdown_connections 2023-11-24T08:04:09.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.820+0000 7f8e77491640 1 -- 172.21.15.57:0/601432764 wait complete. 2023-11-24T08:04:09.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:09.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 Processor -- start 2023-11-24T08:04:09.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 -- start start 2023-11-24T08:04:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7effbc15a290 0x7effbc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc15ec60 0x7effbc0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effbc0cc6b0 0x7effbc0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc071170 con 0x7effbc0cc6b0 2023-11-24T08:04:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0cb690 con 0x7effbc15a290 2023-11-24T08:04:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effc1be7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0cb970 con 0x7effbc15ec60 2023-11-24T08:04:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effbc0cc6b0 0x7effbc0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effbc0cc6b0 0x7effbc0b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55950/0 (socket says 172.21.15.57:55950) 2023-11-24T08:04:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 -- 172.21.15.57:0/3566569894 learned_addr learned my addr 172.21.15.57:0/3566569894 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbaffd640 1 --2- 172.21.15.57:0/3566569894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc15ec60 0x7effbc0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbb7fe640 1 --2- 172.21.15.57:0/3566569894 >> v2:172.21.15.132:3300/0 conn(0x7effbc15a290 0x7effbc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 -- 172.21.15.57:0/3566569894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc15ec60 msgr2=0x7effbc0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:09.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 --2- 172.21.15.57:0/3566569894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc15ec60 0x7effbc0cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 -- 172.21.15.57:0/3566569894 >> v2:172.21.15.132:3300/0 conn(0x7effbc15a290 msgr2=0x7effbc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 --2- 172.21.15.57:0/3566569894 >> v2:172.21.15.132:3300/0 conn(0x7effbc15a290 0x7effbc0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.992+0000 7effbbfff640 1 -- 172.21.15.57:0/3566569894 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0cbc50 con 0x7effbc0cc6b0 2023-11-24T08:04:09.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effbbfff640 1 --2- 172.21.15.57:0/3566569894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc0cc6b0 0x7effbc0b1f80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7effbc06c0d0 tx=0x7effb401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7749a1b6290ae4dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effba7fc640 1 -- 172.21.15.57:0/3566569894 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40a56d0 con 0x7effbc0cc6b0 2023-11-24T08:04:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effba7fc640 1 -- 172.21.15.57:0/3566569894 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb40a5830 con 0x7effbc0cc6b0 2023-11-24T08:04:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effba7fc640 1 -- 172.21.15.57:0/3566569894 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40a5bc0 con 0x7effbc0cc6b0 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 -- 172.21.15.57:0/3566569894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc0cc6b0 msgr2=0x7effbc0b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 --2- 172.21.15.57:0/3566569894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc0cc6b0 0x7effbc0b1f80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7effbc06c0d0 tx=0x7effb401c940 comp rx=0 tx=0).stop 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 -- 172.21.15.57:0/3566569894 shutdown_connections 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 --2- 172.21.15.57:0/3566569894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc0cc6b0 0x7effbc0b1f80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 --2- 172.21.15.57:0/3566569894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc15ec60 0x7effbc0cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 --2- 172.21.15.57:0/3566569894 >> v2:172.21.15.132:3300/0 conn(0x7effbc15a290 0x7effbc0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 -- 172.21.15.57:0/3566569894 >> 172.21.15.57:0/3566569894 conn(0x7effbc0b0c80 msgr2=0x7effbc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 -- 172.21.15.57:0/3566569894 shutdown_connections 2023-11-24T08:04:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:09.996+0000 7effc1be7640 1 -- 172.21.15.57:0/3566569894 wait complete. 2023-11-24T08:04:10.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 Processor -- start 2023-11-24T08:04:10.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 -- start start 2023-11-24T08:04:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc0cc6b0 0x7effbc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc15a290 0x7effbc09c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effbc15ec60 0x7effbc157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc159510 con 0x7effbc15a290 2023-11-24T08:04:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15d970 con 0x7effbc15ec60 2023-11-24T08:04:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc158c70 con 0x7effbc0cc6b0 2023-11-24T08:04:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc15a290 0x7effbc09c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc15a290 0x7effbc09c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55964/0 (socket says 172.21.15.57:55964) 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 -- 172.21.15.57:0/710650196 learned_addr learned my addr 172.21.15.57:0/710650196 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbb7fe640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc0cc6b0 0x7effbc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbbfff640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effbc15ec60 0x7effbc157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 -- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc0cc6b0 msgr2=0x7effbc15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc0cc6b0 0x7effbc15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 -- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effbc15ec60 msgr2=0x7effbc157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effbc15ec60 0x7effbc157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 -- 172.21.15.57:0/710650196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009b30 con 0x7effbc15a290 2023-11-24T08:04:10.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effbaffd640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc15a290 0x7effbc09c250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7effb000e840 tx=0x7effb000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effa3fff640 1 -- 172.21.15.57:0/710650196 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0009510 con 0x7effbc15a290 2023-11-24T08:04:10.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effa3fff640 1 -- 172.21.15.57:0/710650196 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb000ee90 con 0x7effbc15a290 2023-11-24T08:04:10.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effa3fff640 1 -- 172.21.15.57:0/710650196 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000cb80 con 0x7effbc15a290 2023-11-24T08:04:10.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc070f40 con 0x7effbc15a290 2023-11-24T08:04:10.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.000+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc159230 con 0x7effbc15a290 2023-11-24T08:04:10.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.004+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc0ce720 con 0x7effbc15a290 2023-11-24T08:04:10.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.004+0000 7effa3fff640 1 -- 172.21.15.57:0/710650196 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7effb000cce0 con 0x7effbc15a290 2023-11-24T08:04:10.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.004+0000 7effa3fff640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7effa8066470 0x7effa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.004+0000 7effa3fff640 1 -- 172.21.15.57:0/710650196 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effb0083eb0 con 0x7effbc15a290 2023-11-24T08:04:10.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.004+0000 7effbb7fe640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7effa8066470 0x7effa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.004+0000 7effbb7fe640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7effa8066470 0x7effa8068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7effbc15ae10 tx=0x7effac009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.008+0000 7effa3fff640 1 -- 172.21.15.57:0/710650196 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7effb00513c0 con 0x7effbc15a290 2023-11-24T08:04:10.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.164+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effbc04e8c0 con 0x7effbc15a290 2023-11-24T08:04:10.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effa3fff640 1 -- 172.21.15.57:0/710650196 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7effb0059e60 con 0x7effbc15a290 2023-11-24T08:04:10.168 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7effa8066470 msgr2=0x7effa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7effa8066470 0x7effa8068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7effbc15ae10 tx=0x7effac009190 comp rx=0 tx=0).stop 2023-11-24T08:04:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc15a290 msgr2=0x7effbc09c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc15a290 0x7effbc09c250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7effb000e840 tx=0x7effb000ec40 comp rx=0 tx=0).stop 2023-11-24T08:04:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 shutdown_connections 2023-11-24T08:04:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7effa8066470 0x7effa8068930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7effbc15ec60 0x7effbc157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effbc15a290 0x7effbc09c250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 --2- 172.21.15.57:0/710650196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7effbc0cc6b0 0x7effbc15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 >> 172.21.15.57:0/710650196 conn(0x7effbc0b0c80 msgr2=0x7effbc073670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:10.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 shutdown_connections 2023-11-24T08:04:10.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.168+0000 7effc1be7640 1 -- 172.21.15.57:0/710650196 wait complete. 2023-11-24T08:04:10.189 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:10.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.332+0000 7f97a6479640 1 Processor -- start 2023-11-24T08:04:10.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.332+0000 7f97a6479640 1 -- start start 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.332+0000 7f97a6479640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a015d7f0 0x7f97a00d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.332+0000 7f97a6479640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97a00d37e0 0x7f97a00b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.332+0000 7f97a6479640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00d3c60 con 0x7f97a00b1630 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.332+0000 7f97a6479640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a006b980 con 0x7f97a00d37e0 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.332+0000 7f97a6479640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00b0090 con 0x7f97a015d7f0 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f97a4a16640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f97a00b1630 0x7f97a00b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44384/0 (socket says 172.21.15.57:44384) 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f97a4a16640 1 -- 172.21.15.57:0/825127596 learned_addr learned my addr 172.21.15.57:0/825127596 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979f7fe640 1 --2- 172.21.15.57:0/825127596 >> v2:172.21.15.132:3300/0 conn(0x7f97a00d37e0 0x7f97a00b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979ffff640 1 --2- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a015d7f0 0x7f97a00d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979effd640 1 -- 172.21.15.57:0/825127596 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280504390 0 0) 0x7f97a00d3c60 con 0x7f97a00b1630 2023-11-24T08:04:10.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979effd640 1 -- 172.21.15.57:0/825127596 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9788003530 con 0x7f97a00b1630 2023-11-24T08:04:10.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979f7fe640 1 -- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a015d7f0 msgr2=0x7f97a00d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:10.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979f7fe640 1 --2- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a015d7f0 0x7f97a00d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979f7fe640 1 -- 172.21.15.57:0/825127596 >> v1:172.21.15.57:6789/0 conn(0x7f97a00b1630 legacy=0x7f97a00b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979f7fe640 1 -- 172.21.15.57:0/825127596 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00b0330 con 0x7f97a00d37e0 2023-11-24T08:04:10.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.336+0000 7f979ffff640 1 --2- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a015d7f0 0x7f97a00d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:10.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f979f7fe640 1 --2- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a00d37e0 0x7f97a00b10f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97940097c0 tx=0x7f979401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b15547bbe663d47 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f979effd640 1 -- 172.21.15.57:0/825127596 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940ab600 con 0x7f97a00d37e0 2023-11-24T08:04:10.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f979effd640 1 -- 172.21.15.57:0/825127596 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97940a7050 con 0x7f97a00d37e0 2023-11-24T08:04:10.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f979effd640 1 -- 172.21.15.57:0/825127596 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940ab960 con 0x7f97a00d37e0 2023-11-24T08:04:10.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 -- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a00d37e0 msgr2=0x7f97a00b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 --2- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a00d37e0 0x7f97a00b10f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97940097c0 tx=0x7f979401c480 comp rx=0 tx=0).stop 2023-11-24T08:04:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 -- 172.21.15.57:0/825127596 shutdown_connections 2023-11-24T08:04:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 --2- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a00d37e0 0x7f97a00b10f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 --2- 172.21.15.57:0/825127596 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a015d7f0 0x7f97a00d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 -- 172.21.15.57:0/825127596 >> 172.21.15.57:0/825127596 conn(0x7f97a009c790 msgr2=0x7f97a008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 -- 172.21.15.57:0/825127596 shutdown_connections 2023-11-24T08:04:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 -- 172.21.15.57:0/825127596 wait complete. 2023-11-24T08:04:10.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 Processor -- start 2023-11-24T08:04:10.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 -- start start 2023-11-24T08:04:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00b1630 0x7f97a00b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.340+0000 7f97a6479640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d37e0 0x7f97a014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a6479640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d7f0 0x7f97a014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a6479640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0155300 con 0x7f97a00b1630 2023-11-24T08:04:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a6479640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0155830 con 0x7f97a015d7f0 2023-11-24T08:04:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a6479640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0155550 con 0x7f97a00d37e0 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00b1630 0x7f97a00b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00b1630 0x7f97a00b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55978/0 (socket says 172.21.15.57:55978) 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 -- 172.21.15.57:0/1060773766 learned_addr learned my addr 172.21.15.57:0/1060773766 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979f7fe640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d37e0 0x7f97a014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a4a16640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d7f0 0x7f97a014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 -- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d37e0 msgr2=0x7f97a014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d37e0 0x7f97a014ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 -- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d7f0 msgr2=0x7f97a014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d7f0 0x7f97a014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 -- 172.21.15.57:0/1060773766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009420 con 0x7f97a00b1630 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979f7fe640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d37e0 0x7f97a014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a4a16640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d7f0 0x7f97a014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979ffff640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00b1630 0x7f97a00b2d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f979000e980 tx=0x7f979000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979cff9640 1 -- 172.21.15.57:0/1060773766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000ca00 con 0x7f97a00b1630 2023-11-24T08:04:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979cff9640 1 -- 172.21.15.57:0/1060773766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979000cb60 con 0x7f97a00b1630 2023-11-24T08:04:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979cff9640 1 -- 172.21.15.57:0/1060773766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790013470 con 0x7f97a00b1630 2023-11-24T08:04:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794009420 con 0x7f97a00b1630 2023-11-24T08:04:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a00b54d0 con 0x7f97a00b1630 2023-11-24T08:04:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a004e8c0 con 0x7f97a00b1630 2023-11-24T08:04:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.344+0000 7f979cff9640 1 -- 172.21.15.57:0/1060773766 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97900135d0 con 0x7f97a00b1630 2023-11-24T08:04:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.348+0000 7f979cff9640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f978c066470 0x7f978c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.348+0000 7f979cff9640 1 -- 172.21.15.57:0/1060773766 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9790084140 con 0x7f97a00b1630 2023-11-24T08:04:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.348+0000 7f979f7fe640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f978c066470 0x7f978c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.348+0000 7f979f7fe640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f978c066470 0x7f978c068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97940ad000 tx=0x7f97940a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.352+0000 7f979cff9640 1 -- 172.21.15.57:0/1060773766 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97900515b0 con 0x7f97a00b1630 2023-11-24T08:04:10.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.508+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97a006a5b0 con 0x7f97a00b1630 2023-11-24T08:04:10.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.508+0000 7f979cff9640 1 -- 172.21.15.57:0/1060773766 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9790054bd0 con 0x7f97a00b1630 2023-11-24T08:04:10.511 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:10.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f978c066470 msgr2=0x7f978c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f978c066470 0x7f978c068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97940ad000 tx=0x7f97940a6000 comp rx=0 tx=0).stop 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00b1630 msgr2=0x7f97a00b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00b1630 0x7f97a00b2d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f979000e980 tx=0x7f979000ee40 comp rx=0 tx=0).stop 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 shutdown_connections 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f978c066470 0x7f978c068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d7f0 0x7f97a014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d37e0 0x7f97a014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 --2- 172.21.15.57:0/1060773766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00b1630 0x7f97a00b2d60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 >> 172.21.15.57:0/1060773766 conn(0x7f97a009c790 msgr2=0x7f97a015ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:10.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 shutdown_connections 2023-11-24T08:04:10.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.512+0000 7f97a6479640 1 -- 172.21.15.57:0/1060773766 wait complete. 2023-11-24T08:04:10.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:10.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd137217640 1 Processor -- start 2023-11-24T08:04:10.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd137217640 1 -- start start 2023-11-24T08:04:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd137217640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd13006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd137217640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1300ce8b0 0x7fd1300ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd137217640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300d1cc0 con 0x7fd1300d3020 2023-11-24T08:04:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd137217640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1300d1fa0 con 0x7fd1300ce8b0 2023-11-24T08:04:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd137217640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300ce0b0 con 0x7fd13015d570 2023-11-24T08:04:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd1357b4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1300ce8b0 0x7fd1300ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd1357b4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1300ce8b0 0x7fd1300ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55986/0 (socket says 172.21.15.57:55986) 2023-11-24T08:04:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd1357b4640 1 -- 172.21.15.57:0/3180787593 learned_addr learned my addr 172.21.15.57:0/3180787593 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd134fb3640 1 --2- 172.21.15.57:0/3180787593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd13006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd1357b4640 1 -- 172.21.15.57:0/3180787593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 msgr2=0x7fd13006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:10.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd1357b4640 1 --2- 172.21.15.57:0/3180787593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd13006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd1357b4640 1 -- 172.21.15.57:0/3180787593 >> v1:172.21.15.132:6789/0 conn(0x7fd1300d3020 legacy=0x7fd1300d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.676+0000 7fd1357b4640 1 -- 172.21.15.57:0/3180787593 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300ce390 con 0x7fd1300ce8b0 2023-11-24T08:04:10.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd1357b4640 1 --2- 172.21.15.57:0/3180787593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300ce8b0 0x7fd1300ced40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd128009e50 tx=0x7fd12801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cffaadd3673d49 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd12f7fe640 1 -- 172.21.15.57:0/3180787593 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a58b0 con 0x7fd1300ce8b0 2023-11-24T08:04:10.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd12f7fe640 1 -- 172.21.15.57:0/3180787593 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1280a5a10 con 0x7fd1300ce8b0 2023-11-24T08:04:10.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd12f7fe640 1 -- 172.21.15.57:0/3180787593 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a5da0 con 0x7fd1300ce8b0 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 -- 172.21.15.57:0/3180787593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300ce8b0 msgr2=0x7fd1300ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 --2- 172.21.15.57:0/3180787593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300ce8b0 0x7fd1300ced40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd128009e50 tx=0x7fd12801ca10 comp rx=0 tx=0).stop 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 -- 172.21.15.57:0/3180787593 shutdown_connections 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 --2- 172.21.15.57:0/3180787593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300ce8b0 0x7fd1300ced40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 --2- 172.21.15.57:0/3180787593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd13006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 -- 172.21.15.57:0/3180787593 >> 172.21.15.57:0/3180787593 conn(0x7fd13008ceb0 msgr2=0x7fd13009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 -- 172.21.15.57:0/3180787593 shutdown_connections 2023-11-24T08:04:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.680+0000 7fd137217640 1 -- 172.21.15.57:0/3180787593 wait complete. 2023-11-24T08:04:10.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 Processor -- start 2023-11-24T08:04:10.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 -- start start 2023-11-24T08:04:10.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1300ce8b0 0x7fd130156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300d3020 0x7fd1301424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd130154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300cc320 con 0x7fd1300d3020 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300cc600 con 0x7fd1300ce8b0 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300cc8e0 con 0x7fd13015d570 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300d3020 0x7fd1301424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300d3020 0x7fd1301424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55998/0 (socket says 172.21.15.57:55998) 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 -- 172.21.15.57:0/2094795887 learned_addr learned my addr 172.21.15.57:0/2094795887 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd134fb3640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1300ce8b0 0x7fd130156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd1357b4640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd130154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 -- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 msgr2=0x7fd130154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd130154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 -- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1300ce8b0 msgr2=0x7fd130156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1300ce8b0 0x7fd130156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 -- 172.21.15.57:0/2094795887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009b30 con 0x7fd1300d3020 2023-11-24T08:04:10.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12ffff640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300d3020 0x7fd1301424c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00c500 tx=0x7fd11c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12d7fa640 1 -- 172.21.15.57:0/2094795887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c005220 con 0x7fd1300d3020 2023-11-24T08:04:10.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12d7fa640 1 -- 172.21.15.57:0/2094795887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c005380 con 0x7fd1300d3020 2023-11-24T08:04:10.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd12d7fa640 1 -- 172.21.15.57:0/2094795887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c007270 con 0x7fd1300d3020 2023-11-24T08:04:10.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1300ccbc0 con 0x7fd1300d3020 2023-11-24T08:04:10.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd130156590 con 0x7fd1300d3020 2023-11-24T08:04:10.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.684+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1300cce00 con 0x7fd1300d3020 2023-11-24T08:04:10.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.688+0000 7fd12d7fa640 1 -- 172.21.15.57:0/2094795887 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd11c0073d0 con 0x7fd1300d3020 2023-11-24T08:04:10.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.688+0000 7fd12d7fa640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd114066470 0x7fd114068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:10.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.688+0000 7fd12d7fa640 1 -- 172.21.15.57:0/2094795887 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd11c0836d0 con 0x7fd1300d3020 2023-11-24T08:04:10.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.688+0000 7fd134fb3640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd114066470 0x7fd114068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:10.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.688+0000 7fd134fb3640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd114066470 0x7fd114068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd124009ac0 tx=0x7fd124009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:10.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.692+0000 7fd12d7fa640 1 -- 172.21.15.57:0/2094795887 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1300cce00 con 0x7fd1300d3020 2023-11-24T08:04:10.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.880+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1300cce00 con 0x7fd1300d3020 2023-11-24T08:04:10.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.880+0000 7fd12d7fa640 1 -- 172.21.15.57:0/2094795887 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fd1300cce00 con 0x7fd1300d3020 2023-11-24T08:04:10.882 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:10.883 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:10.883 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:10.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd114066470 msgr2=0x7fd114068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd114066470 0x7fd114068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd124009ac0 tx=0x7fd124009190 comp rx=0 tx=0).stop 2023-11-24T08:04:10.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300d3020 msgr2=0x7fd1301424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:10.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300d3020 0x7fd1301424c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00c500 tx=0x7fd11c00c9c0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 shutdown_connections 2023-11-24T08:04:10.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd114066470 0x7fd114068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd13015d570 0x7fd130154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1300d3020 0x7fd1301424c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 --2- 172.21.15.57:0/2094795887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1300ce8b0 0x7fd130156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:10.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 >> 172.21.15.57:0/2094795887 conn(0x7fd13008ceb0 msgr2=0x7fd130159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:10.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 shutdown_connections 2023-11-24T08:04:10.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:10.884+0000 7fd137217640 1 -- 172.21.15.57:0/2094795887 wait complete. 2023-11-24T08:04:10.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:11.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.044+0000 7f0d16e9c640 1 Processor -- start 2023-11-24T08:04:11.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.044+0000 7f0d16e9c640 1 -- start start 2023-11-24T08:04:11.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d16e9c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d1006d5f0 0x7f0d1006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d16e9c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d100ae950 con 0x7f0d100b3670 2023-11-24T08:04:11.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d16e9c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d100b1ef0 con 0x7f0d10159a80 2023-11-24T08:04:11.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d16e9c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100adca0 con 0x7f0d1006d5f0 2023-11-24T08:04:11.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d15439640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0d100b3670 0x7f0d100ac5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44386/0 (socket says 172.21.15.57:44386) 2023-11-24T08:04:11.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d15439640 1 -- 172.21.15.57:0/1516303466 learned_addr learned my addr 172.21.15.57:0/1516303466 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0ffff640 1 --2- 172.21.15.57:0/1516303466 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d1006d5f0 0x7f0d1006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0f7fe640 1 -- 172.21.15.57:0/1516303466 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644401709 0 0) 0x7f0d100ae950 con 0x7f0d100b3670 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0f7fe640 1 -- 172.21.15.57:0/1516303466 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d00003450 con 0x7f0d100b3670 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0f7fe640 1 -- 172.21.15.57:0/1516303466 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182648503 0 0) 0x7f0d100b1ef0 con 0x7f0d10159a80 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0f7fe640 1 -- 172.21.15.57:0/1516303466 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d100ae950 con 0x7f0d10159a80 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0ffff640 1 -- 172.21.15.57:0/1516303466 >> v1:172.21.15.132:6789/0 conn(0x7f0d10159a80 legacy=0x7f0d1006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0ffff640 1 -- 172.21.15.57:0/1516303466 >> v1:172.21.15.57:6789/0 conn(0x7f0d100b3670 legacy=0x7f0d100ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0ffff640 1 -- 172.21.15.57:0/1516303466 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100adf80 con 0x7f0d1006d5f0 2023-11-24T08:04:11.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.048+0000 7f0d0ffff640 1 --2- 172.21.15.57:0/1516303466 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d1006d5f0 0x7f0d1006de50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0097f0 tx=0x7f0cfc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b834557e06e2fa8f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d0f7fe640 1 -- 172.21.15.57:0/1516303466 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc0ab610 con 0x7f0d1006d5f0 2023-11-24T08:04:11.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d0f7fe640 1 -- 172.21.15.57:0/1516303466 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc0ab770 con 0x7f0d1006d5f0 2023-11-24T08:04:11.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d0f7fe640 1 -- 172.21.15.57:0/1516303466 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc0abb00 con 0x7f0d1006d5f0 2023-11-24T08:04:11.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- 172.21.15.57:0/1516303466 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d1006d5f0 msgr2=0x7f0d1006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/1516303466 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d1006d5f0 0x7f0d1006de50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0097f0 tx=0x7f0cfc01c490 comp rx=0 tx=0).stop 2023-11-24T08:04:11.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- 172.21.15.57:0/1516303466 shutdown_connections 2023-11-24T08:04:11.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/1516303466 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d1006d5f0 0x7f0d1006de50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- 172.21.15.57:0/1516303466 >> 172.21.15.57:0/1516303466 conn(0x7f0d100b0bf0 msgr2=0x7f0d100b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- 172.21.15.57:0/1516303466 shutdown_connections 2023-11-24T08:04:11.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- 172.21.15.57:0/1516303466 wait complete. 2023-11-24T08:04:11.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 Processor -- start 2023-11-24T08:04:11.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- start start 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1006d5f0 0x7f0d10148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d100b3670 0x7f0d1014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d10159a80 0x7f0d1014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1014bed0 con 0x7f0d1006d5f0 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1009b6f0 con 0x7f0d10159a80 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d16e9c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1009a840 con 0x7f0d100b3670 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d14c38640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1006d5f0 0x7f0d10148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d14c38640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1006d5f0 0x7f0d10148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56006/0 (socket says 172.21.15.57:56006) 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.052+0000 7f0d14c38640 1 -- 172.21.15.57:0/465510650 learned_addr learned my addr 172.21.15.57:0/465510650 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d0ffff640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d100b3670 0x7f0d1014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d15439640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d10159a80 0x7f0d1014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d14c38640 1 -- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d100b3670 msgr2=0x7f0d1014af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d14c38640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d100b3670 0x7f0d1014af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d14c38640 1 -- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d10159a80 msgr2=0x7f0d1014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d14c38640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d10159a80 0x7f0d1014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d14c38640 1 -- 172.21.15.57:0/465510650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc009420 con 0x7f0d1006d5f0 2023-11-24T08:04:11.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d14c38640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1006d5f0 0x7f0d10148ba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c430 tx=0x7f0d0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d0d7fa640 1 -- 172.21.15.57:0/465510650 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d040052d0 con 0x7f0d1006d5f0 2023-11-24T08:04:11.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d0d7fa640 1 -- 172.21.15.57:0/465510650 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04005450 con 0x7f0d1006d5f0 2023-11-24T08:04:11.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d0d7fa640 1 -- 172.21.15.57:0/465510650 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04003840 con 0x7f0d1006d5f0 2023-11-24T08:04:11.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1009aae0 con 0x7f0d1006d5f0 2023-11-24T08:04:11.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1009b0a0 con 0x7f0d1006d5f0 2023-11-24T08:04:11.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d10067520 con 0x7f0d1006d5f0 2023-11-24T08:04:11.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d0d7fa640 1 -- 172.21.15.57:0/465510650 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d040039a0 con 0x7f0d1006d5f0 2023-11-24T08:04:11.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d0d7fa640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0cf40664a0 0x7f0cf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.056+0000 7f0d0d7fa640 1 -- 172.21.15.57:0/465510650 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d04083480 con 0x7f0d1006d5f0 2023-11-24T08:04:11.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.060+0000 7f0d0ffff640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0cf40664a0 0x7f0cf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.060+0000 7f0d0ffff640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0cf40664a0 0x7f0cf4068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0af000 tx=0x7f0cfc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.060+0000 7f0d0d7fa640 1 -- 172.21.15.57:0/465510650 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d04050910 con 0x7f0d1006d5f0 2023-11-24T08:04:11.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.220+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d100ce990 con 0x7f0d1006d5f0 2023-11-24T08:04:11.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.220+0000 7f0d0d7fa640 1 -- 172.21.15.57:0/465510650 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f0d04053f30 con 0x7f0d1006d5f0 2023-11-24T08:04:11.222 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:11.222 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:11.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0cf40664a0 msgr2=0x7f0cf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0cf40664a0 0x7f0cf4068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0af000 tx=0x7f0cfc0a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:11.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1006d5f0 msgr2=0x7f0d10148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1006d5f0 0x7f0d10148ba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c430 tx=0x7f0d0400c8f0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 shutdown_connections 2023-11-24T08:04:11.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0cf40664a0 0x7f0cf4068960 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d10159a80 0x7f0d1014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d100b3670 0x7f0d1014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 --2- 172.21.15.57:0/465510650 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1006d5f0 0x7f0d10148ba0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 >> 172.21.15.57:0/465510650 conn(0x7f0d100b0bf0 msgr2=0x7f0d10153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 shutdown_connections 2023-11-24T08:04:11.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.224+0000 7f0d16e9c640 1 -- 172.21.15.57:0/465510650 wait complete. 2023-11-24T08:04:11.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:11.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:11.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.388+0000 7f49a84fe640 1 Processor -- start 2023-11-24T08:04:11.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.388+0000 7f49a84fe640 1 -- start start 2023-11-24T08:04:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a84fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f49a015d630 0x7f49a00cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a84fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a00ce200 0x7f49a00cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a84fe640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a006c620 con 0x7f49a00cf300 2023-11-24T08:04:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a84fe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a00cf790 con 0x7f49a015d630 2023-11-24T08:04:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a84fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00cbd80 con 0x7f49a00ce200 2023-11-24T08:04:11.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a6a9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f49a00cf300 0x7f49a006cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44402/0 (socket says 172.21.15.57:44402) 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a6a9b640 1 -- 172.21.15.57:0/3093394324 learned_addr learned my addr 172.21.15.57:0/3093394324 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a5a99640 1 --2- 172.21.15.57:0/3093394324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a00ce200 0x7f49a00cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a629a640 1 --2- 172.21.15.57:0/3093394324 >> v2:172.21.15.132:3300/0 conn(0x7f49a015d630 0x7f49a00cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a5298640 1 -- 172.21.15.57:0/3093394324 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736870962 0 0) 0x7f49a006c620 con 0x7f49a00cf300 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a5298640 1 -- 172.21.15.57:0/3093394324 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f498c003530 con 0x7f49a00cf300 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a5a99640 1 -- 172.21.15.57:0/3093394324 >> v2:172.21.15.132:3300/0 conn(0x7f49a015d630 msgr2=0x7f49a00cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a5a99640 1 --2- 172.21.15.57:0/3093394324 >> v2:172.21.15.132:3300/0 conn(0x7f49a015d630 0x7f49a00cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a5a99640 1 -- 172.21.15.57:0/3093394324 >> v1:172.21.15.57:6789/0 conn(0x7f49a00cf300 legacy=0x7f49a006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.392+0000 7f49a5a99640 1 -- 172.21.15.57:0/3093394324 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a006ba10 con 0x7f49a00ce200 2023-11-24T08:04:11.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a5a99640 1 --2- 172.21.15.57:0/3093394324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a00ce200 0x7f49a00cedc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49900097c0 tx=0x7f499001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68497a623edf398b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a5298640 1 -- 172.21.15.57:0/3093394324 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900ab650 con 0x7f49a00ce200 2023-11-24T08:04:11.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a5298640 1 -- 172.21.15.57:0/3093394324 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49900ab7b0 con 0x7f49a00ce200 2023-11-24T08:04:11.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a5298640 1 -- 172.21.15.57:0/3093394324 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900abb20 con 0x7f49a00ce200 2023-11-24T08:04:11.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 -- 172.21.15.57:0/3093394324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a00ce200 msgr2=0x7f49a00cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 --2- 172.21.15.57:0/3093394324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a00ce200 0x7f49a00cedc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49900097c0 tx=0x7f499001c450 comp rx=0 tx=0).stop 2023-11-24T08:04:11.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 -- 172.21.15.57:0/3093394324 shutdown_connections 2023-11-24T08:04:11.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 --2- 172.21.15.57:0/3093394324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a00ce200 0x7f49a00cedc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 --2- 172.21.15.57:0/3093394324 >> v2:172.21.15.132:3300/0 conn(0x7f49a015d630 0x7f49a00cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 -- 172.21.15.57:0/3093394324 >> 172.21.15.57:0/3093394324 conn(0x7f49a006e860 msgr2=0x7f49a006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 -- 172.21.15.57:0/3093394324 shutdown_connections 2023-11-24T08:04:11.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 -- 172.21.15.57:0/3093394324 wait complete. 2023-11-24T08:04:11.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 Processor -- start 2023-11-24T08:04:11.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.396+0000 7f49a84fe640 1 -- start start 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a00ce200 0x7f49a015c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49a00cf300 0x7f49a00c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a015d630 0x7f49a0153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a015cdf0 con 0x7f49a00cf300 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0154c00 con 0x7f49a00ce200 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00ca410 con 0x7f49a015d630 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49a00cf300 0x7f49a00c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49a00cf300 0x7f49a00c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56020/0 (socket says 172.21.15.57:56020) 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 -- 172.21.15.57:0/1182508581 learned_addr learned my addr 172.21.15.57:0/1182508581 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a629a640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a00ce200 0x7f49a015c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a6a9b640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a015d630 0x7f49a0153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 -- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a015d630 msgr2=0x7f49a0153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a015d630 0x7f49a0153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 -- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a00ce200 msgr2=0x7f49a015c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a00ce200 0x7f49a015c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 -- 172.21.15.57:0/1182508581 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990009420 con 0x7f49a00cf300 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a5a99640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49a00cf300 0x7f49a00c7770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49900ad040 tx=0x7f499001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f4996ffd640 1 -- 172.21.15.57:0/1182508581 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900bf610 con 0x7f49a00cf300 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f4996ffd640 1 -- 172.21.15.57:0/1182508581 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49900bf770 con 0x7f49a00cf300 2023-11-24T08:04:11.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f4996ffd640 1 -- 172.21.15.57:0/1182508581 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900bfae0 con 0x7f49a00cf300 2023-11-24T08:04:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a0154e50 con 0x7f49a00cf300 2023-11-24T08:04:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a0155410 con 0x7f49a00cf300 2023-11-24T08:04:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a00ca5d0 con 0x7f49a00cf300 2023-11-24T08:04:11.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.400+0000 7f4996ffd640 1 -- 172.21.15.57:0/1182508581 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49900b5400 con 0x7f49a00cf300 2023-11-24T08:04:11.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.404+0000 7f4996ffd640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4984066470 0x7f4984068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.404+0000 7f4996ffd640 1 -- 172.21.15.57:0/1182508581 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f499011e890 con 0x7f49a00cf300 2023-11-24T08:04:11.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.404+0000 7f49a629a640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4984066470 0x7f4984068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.404+0000 7f49a629a640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4984066470 0x7f4984068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ca300 tx=0x7f499c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.408+0000 7f4996ffd640 1 -- 172.21.15.57:0/1182508581 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49900ebd30 con 0x7f49a00cf300 2023-11-24T08:04:11.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.564+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49a004e8c0 con 0x7f49a00cf300 2023-11-24T08:04:11.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.564+0000 7f4996ffd640 1 -- 172.21.15.57:0/1182508581 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49900ef350 con 0x7f49a00cf300 2023-11-24T08:04:11.567 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4984066470 msgr2=0x7f4984068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4984066470 0x7f4984068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ca300 tx=0x7f499c009190 comp rx=0 tx=0).stop 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49a00cf300 msgr2=0x7f49a00c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49a00cf300 0x7f49a00c7770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49900ad040 tx=0x7f499001ac90 comp rx=0 tx=0).stop 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 shutdown_connections 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4984066470 0x7f4984068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49a015d630 0x7f49a0153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49a00cf300 0x7f49a00c7770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 --2- 172.21.15.57:0/1182508581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49a00ce200 0x7f49a015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 >> 172.21.15.57:0/1182508581 conn(0x7f49a006e860 msgr2=0x7f49a01504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 shutdown_connections 2023-11-24T08:04:11.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.568+0000 7f49a84fe640 1 -- 172.21.15.57:0/1182508581 wait complete. 2023-11-24T08:04:11.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:11.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.732+0000 7f7c32d1d640 1 Processor -- start 2023-11-24T08:04:11.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.732+0000 7f7c32d1d640 1 -- start start 2023-11-24T08:04:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.732+0000 7f7c32d1d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c2c0ccef0 0x7f7c2c071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.732+0000 7f7c32d1d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0723c0 con 0x7f7c2c1624f0 2023-11-24T08:04:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.732+0000 7f7c32d1d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0726a0 con 0x7f7c2c0cd380 2023-11-24T08:04:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.732+0000 7f7c32d1d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c072980 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c30ab9640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7c2c1624f0 0x7f7c2c1628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44408/0 (socket says 172.21.15.57:44408) 2023-11-24T08:04:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c30ab9640 1 -- 172.21.15.57:0/1172540177 learned_addr learned my addr 172.21.15.57:0/1172540177 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2bfff640 1 --2- 172.21.15.57:0/1172540177 >> v2:172.21.15.132:3300/0 conn(0x7f7c2c0ccef0 0x7f7c2c071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2b7fe640 1 -- 172.21.15.57:0/1172540177 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680306078 0 0) 0x7f7c2c0723c0 con 0x7f7c2c1624f0 2023-11-24T08:04:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2b7fe640 1 -- 172.21.15.57:0/1172540177 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c1c003530 con 0x7f7c2c1624f0 2023-11-24T08:04:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2bfff640 1 -- 172.21.15.57:0/1172540177 >> v1:172.21.15.132:6789/0 conn(0x7f7c2c0cd380 legacy=0x7f7c2c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2bfff640 1 -- 172.21.15.57:0/1172540177 >> v1:172.21.15.57:6789/0 conn(0x7f7c2c1624f0 legacy=0x7f7c2c1628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2bfff640 1 -- 172.21.15.57:0/1172540177 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c06c7e0 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2bfff640 1 --2- 172.21.15.57:0/1172540177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c071900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c180097c0 tx=0x7f7c1801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efff6bcd14267dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.736+0000 7f7c2b7fe640 1 -- 172.21.15.57:0/1172540177 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180ac640 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c2b7fe640 1 -- 172.21.15.57:0/1172540177 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180ac7a0 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c2b7fe640 1 -- 172.21.15.57:0/1172540177 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180acb30 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1172540177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0ccef0 msgr2=0x7f7c2c071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1172540177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c071900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c180097c0 tx=0x7f7c1801c3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1172540177 shutdown_connections 2023-11-24T08:04:11.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1172540177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c071900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1172540177 >> 172.21.15.57:0/1172540177 conn(0x7f7c2c0b0c80 msgr2=0x7f7c2c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1172540177 shutdown_connections 2023-11-24T08:04:11.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1172540177 wait complete. 2023-11-24T08:04:11.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 Processor -- start 2023-11-24T08:04:11.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- start start 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0cd380 0x7f7c2c09c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2c1624f0 0x7f7c2c09cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c09d090 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c09abb0 con 0x7f7c2c0cd380 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c32d1d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c099fa0 con 0x7f7c2c1624f0 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c30ab9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c30ab9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c163380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56022/0 (socket says 172.21.15.57:56022) 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.740+0000 7f7c30ab9640 1 -- 172.21.15.57:0/1396362115 learned_addr learned my addr 172.21.15.57:0/1396362115 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c2bfff640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0cd380 0x7f7c2c09c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c30ab9640 1 -- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2c1624f0 msgr2=0x7f7c2c09cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c312ba640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2c1624f0 0x7f7c2c09cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c30ab9640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2c1624f0 0x7f7c2c09cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c30ab9640 1 -- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0cd380 msgr2=0x7f7c2c09c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c30ab9640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0cd380 0x7f7c2c09c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c30ab9640 1 -- 172.21.15.57:0/1396362115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009420 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c2bfff640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0cd380 0x7f7c2c09c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c312ba640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2c1624f0 0x7f7c2c09cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c30ab9640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c163380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c420 tx=0x7f7c2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c297fa640 1 -- 172.21.15.57:0/1396362115 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20005cf0 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c297fa640 1 -- 172.21.15.57:0/1396362115 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20005e50 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c09a280 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c297fa640 1 -- 172.21.15.57:0/1396362115 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200072d0 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c09a840 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c067830 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c297fa640 1 -- 172.21.15.57:0/1396362115 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c20007430 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c297fa640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066470 0x7f7c10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:11.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.744+0000 7f7c297fa640 1 -- 172.21.15.57:0/1396362115 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c20083540 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.748+0000 7f7c2bfff640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066470 0x7f7c10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:11.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.748+0000 7f7c2bfff640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066470 0x7f7c10068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c180ae000 tx=0x7f7c18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.748+0000 7f7c297fa640 1 -- 172.21.15.57:0/1396362115 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c200508c0 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.904+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c2c04e8c0 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.904+0000 7f7c297fa640 1 -- 172.21.15.57:0/1396362115 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c20053ee0 con 0x7f7c2c0ccef0 2023-11-24T08:04:11.908 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066470 msgr2=0x7f7c10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066470 0x7f7c10068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c180ae000 tx=0x7f7c18008040 comp rx=0 tx=0).stop 2023-11-24T08:04:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c0ccef0 msgr2=0x7f7c2c163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c163380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c420 tx=0x7f7c2000c8e0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 shutdown_connections 2023-11-24T08:04:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066470 0x7f7c10068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2c1624f0 0x7f7c2c09cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c0cd380 0x7f7c2c09c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 --2- 172.21.15.57:0/1396362115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c0ccef0 0x7f7c2c163380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 >> 172.21.15.57:0/1396362115 conn(0x7f7c2c0b0c80 msgr2=0x7f7c2c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 shutdown_connections 2023-11-24T08:04:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:11.908+0000 7f7c32d1d640 1 -- 172.21.15.57:0/1396362115 wait complete. 2023-11-24T08:04:11.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.072+0000 7f2bbdfb5640 1 Processor -- start 2023-11-24T08:04:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.072+0000 7f2bbdfb5640 1 -- start start 2023-11-24T08:04:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbdfb5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2bb8160970 0x7f2bb80d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbdfb5640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80cf0a0 con 0x7f2bb80cdc60 2023-11-24T08:04:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbdfb5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80ce490 con 0x7f2bb80d1de0 2023-11-24T08:04:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbdfb5640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb80ce770 con 0x7f2bb8160970 2023-11-24T08:04:12.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbcfb3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2bb8160970 0x7f2bb80d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bb7fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2bb80cdc60 0x7f2bb80d16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44410/0 (socket says 172.21.15.57:44410) 2023-11-24T08:04:12.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bb7fff640 1 -- 172.21.15.57:0/3258748314 learned_addr learned my addr 172.21.15.57:0/3258748314 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:12.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbcfb3640 1 -- 172.21.15.57:0/3258748314 >> v1:172.21.15.132:6789/0 conn(0x7f2bb80d1de0 legacy=0x7f2bb80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:12.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bb77fe640 1 -- 172.21.15.57:0/3258748314 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212596210 0 0) 0x7f2bb80cf0a0 con 0x7f2bb80cdc60 2023-11-24T08:04:12.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbcfb3640 1 -- 172.21.15.57:0/3258748314 >> v1:172.21.15.57:6789/0 conn(0x7f2bb80cdc60 legacy=0x7f2bb80d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.076+0000 7f2bbcfb3640 1 -- 172.21.15.57:0/3258748314 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80cea50 con 0x7f2bb8160970 2023-11-24T08:04:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbcfb3640 1 --2- 172.21.15.57:0/3258748314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb8160970 0x7f2bb80d3d20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0097c0 tx=0x7f2bac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f107b5e89e545814 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bb77fe640 1 -- 172.21.15.57:0/3258748314 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0ab670 con 0x7f2bb8160970 2023-11-24T08:04:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bb77fe640 1 -- 172.21.15.57:0/3258748314 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac0ab7d0 con 0x7f2bb8160970 2023-11-24T08:04:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bb77fe640 1 -- 172.21.15.57:0/3258748314 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0abb60 con 0x7f2bb8160970 2023-11-24T08:04:12.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/3258748314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb8160970 msgr2=0x7f2bb80d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/3258748314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb8160970 0x7f2bb80d3d20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0097c0 tx=0x7f2bac01c450 comp rx=0 tx=0).stop 2023-11-24T08:04:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/3258748314 shutdown_connections 2023-11-24T08:04:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/3258748314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb8160970 0x7f2bb80d3d20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/3258748314 >> 172.21.15.57:0/3258748314 conn(0x7f2bb809c5c0 msgr2=0x7f2bb80d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/3258748314 shutdown_connections 2023-11-24T08:04:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/3258748314 wait complete. 2023-11-24T08:04:12.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 Processor -- start 2023-11-24T08:04:12.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- start start 2023-11-24T08:04:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb80cdc60 0x7f2bb814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb80d1de0 0x7f2bb80ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2bb8160970 0x7f2bb80cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb814fab0 con 0x7f2bb80d1de0 2023-11-24T08:04:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80cd330 con 0x7f2bb80cdc60 2023-11-24T08:04:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.080+0000 7f2bbdfb5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80cbde0 con 0x7f2bb8160970 2023-11-24T08:04:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb80d1de0 0x7f2bb80ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb80d1de0 0x7f2bb80ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56042/0 (socket says 172.21.15.57:56042) 2023-11-24T08:04:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 -- 172.21.15.57:0/2304341146 learned_addr learned my addr 172.21.15.57:0/2304341146 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bbcfb3640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb80cdc60 0x7f2bb814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bbd7b4640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2bb8160970 0x7f2bb80cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 -- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2bb8160970 msgr2=0x7f2bb80cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2bb8160970 0x7f2bb80cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 -- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb80cdc60 msgr2=0x7f2bb814c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb80cdc60 0x7f2bb814c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 -- 172.21.15.57:0/2304341146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009420 con 0x7f2bb80d1de0 2023-11-24T08:04:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb7fff640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb80d1de0 0x7f2bb80ca8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400c4a0 tx=0x7f2ba400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb57fa640 1 -- 172.21.15.57:0/2304341146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40074e0 con 0x7f2bb80d1de0 2023-11-24T08:04:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb57fa640 1 -- 172.21.15.57:0/2304341146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba4007640 con 0x7f2bb80d1de0 2023-11-24T08:04:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb57fa640 1 -- 172.21.15.57:0/2304341146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4004a30 con 0x7f2bb80d1de0 2023-11-24T08:04:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb814cce0 con 0x7f2bb80d1de0 2023-11-24T08:04:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb80ccd70 con 0x7f2bb80d1de0 2023-11-24T08:04:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb80cbf50 con 0x7f2bb80d1de0 2023-11-24T08:04:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.084+0000 7f2bb57fa640 1 -- 172.21.15.57:0/2304341146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ba4004b90 con 0x7f2bb80d1de0 2023-11-24T08:04:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.088+0000 7f2bb57fa640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b9c066470 0x7f2b9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.088+0000 7f2bb57fa640 1 -- 172.21.15.57:0/2304341146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ba4083070 con 0x7f2bb80d1de0 2023-11-24T08:04:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.088+0000 7f2bbcfb3640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b9c066470 0x7f2b9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.088+0000 7f2bbcfb3640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b9c066470 0x7f2b9c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0af000 tx=0x7f2bac0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.092+0000 7f2bb57fa640 1 -- 172.21.15.57:0/2304341146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ba40b4280 con 0x7f2bb80d1de0 2023-11-24T08:04:12.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.248+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2bb804e850 con 0x7f2bb80d1de0 2023-11-24T08:04:12.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.248+0000 7f2bb57fa640 1 -- 172.21.15.57:0/2304341146 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ba4018020 con 0x7f2bb80d1de0 2023-11-24T08:04:12.251 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b9c066470 msgr2=0x7f2b9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b9c066470 0x7f2b9c068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0af000 tx=0x7f2bac0a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb80d1de0 msgr2=0x7f2bb80ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb80d1de0 0x7f2bb80ca8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400c4a0 tx=0x7f2ba400c960 comp rx=0 tx=0).stop 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 shutdown_connections 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b9c066470 0x7f2b9c068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2bb8160970 0x7f2bb80cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb80d1de0 0x7f2bb80ca8c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 --2- 172.21.15.57:0/2304341146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb80cdc60 0x7f2bb814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 >> 172.21.15.57:0/2304341146 conn(0x7f2bb809c5c0 msgr2=0x7f2bb80b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 shutdown_connections 2023-11-24T08:04:12.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.252+0000 7f2bbdfb5640 1 -- 172.21.15.57:0/2304341146 wait complete. 2023-11-24T08:04:12.272 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa7a7d0640 1 Processor -- start 2023-11-24T08:04:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa7a7d0640 1 -- start start 2023-11-24T08:04:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa7a7d0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffa740d17c0 0x7ffa740d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa7a7d0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa7a7d0640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7415d9c0 con 0x7ffa7415d5e0 2023-11-24T08:04:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa7a7d0640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa740d2190 con 0x7ffa740d17c0 2023-11-24T08:04:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa7a7d0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740d40b0 con 0x7ffa740b3560 2023-11-24T08:04:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa797ce640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffa7415d5e0 0x7ffa740d39a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44414/0 (socket says 172.21.15.57:44414) 2023-11-24T08:04:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa78fcd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffa740d17c0 0x7ffa740d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa797ce640 1 -- 172.21.15.57:0/2843153203 learned_addr learned my addr 172.21.15.57:0/2843153203 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa79fcf640 1 --2- 172.21.15.57:0/2843153203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa78fcd640 1 -- 172.21.15.57:0/2843153203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 msgr2=0x7ffa740b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa78fcd640 1 --2- 172.21.15.57:0/2843153203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa78fcd640 1 -- 172.21.15.57:0/2843153203 >> v1:172.21.15.57:6789/0 conn(0x7ffa7415d5e0 legacy=0x7ffa740d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa78fcd640 1 -- 172.21.15.57:0/2843153203 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740d1190 con 0x7ffa740d17c0 2023-11-24T08:04:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa79fcf640 1 --2- 172.21.15.57:0/2843153203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.416+0000 7ffa6bfff640 1 -- 172.21.15.57:0/2843153203 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277710901 0 0) 0x7ffa7415d9c0 con 0x7ffa7415d5e0 2023-11-24T08:04:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa78fcd640 1 --2- 172.21.15.57:0/2843153203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa740d1c50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3273c813d513b6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa6bfff640 1 -- 172.21.15.57:0/2843153203 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640ab650 con 0x7ffa740d17c0 2023-11-24T08:04:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa6bfff640 1 -- 172.21.15.57:0/2843153203 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa640ab7b0 con 0x7ffa740d17c0 2023-11-24T08:04:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa6bfff640 1 -- 172.21.15.57:0/2843153203 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640abb40 con 0x7ffa740d17c0 2023-11-24T08:04:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/2843153203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 msgr2=0x7ffa740d1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/2843153203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa740d1c50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/2843153203 shutdown_connections 2023-11-24T08:04:12.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/2843153203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/2843153203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa740d1c50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/2843153203 >> 172.21.15.57:0/2843153203 conn(0x7ffa7409c520 msgr2=0x7ffa740d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/2843153203 shutdown_connections 2023-11-24T08:04:12.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/2843153203 wait complete. 2023-11-24T08:04:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.420+0000 7ffa7a7d0640 1 Processor -- start 2023-11-24T08:04:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 -- start start 2023-11-24T08:04:12.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa74153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa7415d5e0 0x7ffa740cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740b8bc0 con 0x7ffa740d17c0 2023-11-24T08:04:12.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740b8320 con 0x7ffa7415d5e0 2023-11-24T08:04:12.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740b8600 con 0x7ffa740b3560 2023-11-24T08:04:12.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa74153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa74153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56046/0 (socket says 172.21.15.57:56046) 2023-11-24T08:04:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 -- 172.21.15.57:0/910922204 learned_addr learned my addr 172.21.15.57:0/910922204 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa797ce640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 -- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 msgr2=0x7ffa740ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa79fcf640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa7415d5e0 0x7ffa740cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 -- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa7415d5e0 msgr2=0x7ffa740cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa7415d5e0 0x7ffa740cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 -- 172.21.15.57:0/910922204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009420 con 0x7ffa740d17c0 2023-11-24T08:04:12.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa797ce640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:12.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa79fcf640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa7415d5e0 0x7ffa740cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:12.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa78fcd640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa74153a90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa69ffb640 1 -- 172.21.15.57:0/910922204 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004220 con 0x7ffa740d17c0 2023-11-24T08:04:12.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa69ffb640 1 -- 172.21.15.57:0/910922204 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa640b9070 con 0x7ffa740d17c0 2023-11-24T08:04:12.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa69ffb640 1 -- 172.21.15.57:0/910922204 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64003620 con 0x7ffa740d17c0 2023-11-24T08:04:12.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa740b88e0 con 0x7ffa740d17c0 2023-11-24T08:04:12.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa740b7e80 con 0x7ffa740d17c0 2023-11-24T08:04:12.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.424+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa740b8740 con 0x7ffa740d17c0 2023-11-24T08:04:12.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.428+0000 7ffa69ffb640 1 -- 172.21.15.57:0/910922204 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa64003780 con 0x7ffa740d17c0 2023-11-24T08:04:12.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.428+0000 7ffa69ffb640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffa58066470 0x7ffa58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.428+0000 7ffa69ffb640 1 -- 172.21.15.57:0/910922204 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa640bb070 con 0x7ffa740d17c0 2023-11-24T08:04:12.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.428+0000 7ffa797ce640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffa58066470 0x7ffa58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.428+0000 7ffa797ce640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffa58066470 0x7ffa58068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa70000f70 tx=0x7ffa70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.432+0000 7ffa69ffb640 1 -- 172.21.15.57:0/910922204 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa740b8740 con 0x7ffa740d17c0 2023-11-24T08:04:12.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.620+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa740b8740 con 0x7ffa740d17c0 2023-11-24T08:04:12.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.620+0000 7ffa69ffb640 1 -- 172.21.15.57:0/910922204 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7ffa740b8740 con 0x7ffa740d17c0 2023-11-24T08:04:12.623 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:12.623 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:12.624 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:12.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffa58066470 msgr2=0x7ffa58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffa58066470 0x7ffa58068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa70000f70 tx=0x7ffa70009040 comp rx=0 tx=0).stop 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 msgr2=0x7ffa74153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa74153a90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401ac90 comp rx=0 tx=0).stop 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 shutdown_connections 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffa58066470 0x7ffa58068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa7415d5e0 0x7ffa740cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa740d17c0 0x7ffa74153a90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 --2- 172.21.15.57:0/910922204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffa740b3560 0x7ffa740ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 >> 172.21.15.57:0/910922204 conn(0x7ffa7409c520 msgr2=0x7ffa740b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 shutdown_connections 2023-11-24T08:04:12.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.624+0000 7ffa7a7d0640 1 -- 172.21.15.57:0/910922204 wait complete. 2023-11-24T08:04:12.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:12.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b79238640 1 Processor -- start 2023-11-24T08:04:12.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b79238640 1 -- start start 2023-11-24T08:04:12.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b79238640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b7415d5e0 0x7f6b740d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b79238640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b740d1ed0 0x7f6b740b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b79238640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7415d9c0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b79238640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740d1190 con 0x7f6b740d1ed0 2023-11-24T08:04:12.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b79238640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740d1470 con 0x7f6b7415d5e0 2023-11-24T08:04:12.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b78a37640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b740d1ed0 0x7f6b740b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b78a37640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b740d1ed0 0x7f6b740b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56062/0 (socket says 172.21.15.57:56062) 2023-11-24T08:04:12.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b78a37640 1 -- 172.21.15.57:0/409335527 learned_addr learned my addr 172.21.15.57:0/409335527 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:12.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b73fff640 1 --2- 172.21.15.57:0/409335527 >> v2:172.21.15.132:3300/0 conn(0x7f6b7415d5e0 0x7f6b740d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b78a37640 1 -- 172.21.15.57:0/409335527 >> v2:172.21.15.132:3300/0 conn(0x7f6b7415d5e0 msgr2=0x7f6b740d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:12.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b78a37640 1 --2- 172.21.15.57:0/409335527 >> v2:172.21.15.132:3300/0 conn(0x7f6b7415d5e0 0x7f6b740d39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b78a37640 1 -- 172.21.15.57:0/409335527 >> v1:172.21.15.132:6789/0 conn(0x7f6b740d3ee0 legacy=0x7f6b740d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.788+0000 7f6b78a37640 1 -- 172.21.15.57:0/409335527 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740b2a80 con 0x7f6b740d1ed0 2023-11-24T08:04:12.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b78a37640 1 --2- 172.21.15.57:0/409335527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d1ed0 0x7f6b740b3560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b7408d9c0 tx=0x7f6b6c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7cf2ee966ffcfe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b72ffd640 1 -- 172.21.15.57:0/409335527 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0a5860 con 0x7f6b740d1ed0 2023-11-24T08:04:12.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b72ffd640 1 -- 172.21.15.57:0/409335527 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c0a59c0 con 0x7f6b740d1ed0 2023-11-24T08:04:12.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b72ffd640 1 -- 172.21.15.57:0/409335527 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0a5d50 con 0x7f6b740d1ed0 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 -- 172.21.15.57:0/409335527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d1ed0 msgr2=0x7f6b740b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 --2- 172.21.15.57:0/409335527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d1ed0 0x7f6b740b3560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b7408d9c0 tx=0x7f6b6c01c9a0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 -- 172.21.15.57:0/409335527 shutdown_connections 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 --2- 172.21.15.57:0/409335527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d1ed0 0x7f6b740b3560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 --2- 172.21.15.57:0/409335527 >> v2:172.21.15.132:3300/0 conn(0x7f6b7415d5e0 0x7f6b740d39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 -- 172.21.15.57:0/409335527 >> 172.21.15.57:0/409335527 conn(0x7f6b7409c520 msgr2=0x7f6b740d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 -- 172.21.15.57:0/409335527 shutdown_connections 2023-11-24T08:04:12.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 -- 172.21.15.57:0/409335527 wait complete. 2023-11-24T08:04:12.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.792+0000 7f6b79238640 1 Processor -- start 2023-11-24T08:04:12.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 -- start start 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b740d1ed0 0x7f6b7415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d3ee0 0x7f6b740ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7415d5e0 0x7f6b740c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7415b6d0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7415ab00 con 0x7f6b7415d5e0 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740cd310 con 0x7f6b740d1ed0 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d3ee0 0x7f6b740ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d3ee0 0x7f6b740ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56066/0 (socket says 172.21.15.57:56066) 2023-11-24T08:04:12.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 -- 172.21.15.57:0/3120401512 learned_addr learned my addr 172.21.15.57:0/3120401512 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b78a37640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7415d5e0 0x7f6b740c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b73fff640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b740d1ed0 0x7f6b7415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 -- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b740d1ed0 msgr2=0x7f6b7415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b740d1ed0 0x7f6b7415bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 -- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7415d5e0 msgr2=0x7f6b740c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7415d5e0 0x7f6b740c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 -- 172.21.15.57:0/3120401512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c009b30 con 0x7f6b740d3ee0 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b73fff640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b740d1ed0 0x7f6b7415bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:12.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b737fe640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d3ee0 0x7f6b740ccdd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c500 tx=0x7f6b6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b70ff9640 1 -- 172.21.15.57:0/3120401512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68005220 con 0x7f6b740d3ee0 2023-11-24T08:04:12.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b70ff9640 1 -- 172.21.15.57:0/3120401512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68005380 con 0x7f6b740d3ee0 2023-11-24T08:04:12.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b70ff9640 1 -- 172.21.15.57:0/3120401512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68007270 con 0x7f6b740d3ee0 2023-11-24T08:04:12.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7415ada0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7415b360 con 0x7f6b740d3ee0 2023-11-24T08:04:12.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.796+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7404e850 con 0x7f6b740d3ee0 2023-11-24T08:04:12.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.800+0000 7f6b70ff9640 1 -- 172.21.15.57:0/3120401512 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b680073d0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.800+0000 7f6b70ff9640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b60066470 0x7f6b60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:12.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.800+0000 7f6b70ff9640 1 -- 172.21.15.57:0/3120401512 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b680837d0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.800+0000 7f6b73fff640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b60066470 0x7f6b60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:12.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.800+0000 7f6b73fff640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b60066470 0x7f6b60068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009b10 tx=0x7f6b64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:12.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.804+0000 7f6b70ff9640 1 -- 172.21.15.57:0/3120401512 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b68050bc0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.960+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b740b12d0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.960+0000 7f6b70ff9640 1 -- 172.21.15.57:0/3120401512 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f6b680541e0 con 0x7f6b740d3ee0 2023-11-24T08:04:12.963 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:12.963 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:12.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b60066470 msgr2=0x7f6b60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b60066470 0x7f6b60068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009b10 tx=0x7f6b64008040 comp rx=0 tx=0).stop 2023-11-24T08:04:12.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d3ee0 msgr2=0x7f6b740ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:12.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d3ee0 0x7f6b740ccdd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c500 tx=0x7f6b6800c9c0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 shutdown_connections 2023-11-24T08:04:12.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b60066470 0x7f6b60068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b7415d5e0 0x7f6b740c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b740d3ee0 0x7f6b740ccdd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 --2- 172.21.15.57:0/3120401512 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b740d1ed0 0x7f6b7415bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:12.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 >> 172.21.15.57:0/3120401512 conn(0x7f6b7409c520 msgr2=0x7f6b7415c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:12.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 shutdown_connections 2023-11-24T08:04:12.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:12.964+0000 7f6b79238640 1 -- 172.21.15.57:0/3120401512 wait complete. 2023-11-24T08:04:12.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:13.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa335479640 1 Processor -- start 2023-11-24T08:04:13.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa335479640 1 -- start start 2023-11-24T08:04:13.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa335479640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa33015d570 0x7fa33006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa335479640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3300d3020 0x7fa3300d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa335479640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300d39f0 con 0x7fa3300ce8b0 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa335479640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300d1cc0 con 0x7fa33015d570 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa335479640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300d1fa0 con 0x7fa3300d3020 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa33015d570 0x7fa33006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa33015d570 0x7fa33006b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56082/0 (socket says 172.21.15.57:56082) 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32effd640 1 -- 172.21.15.57:0/2289023346 learned_addr learned my addr 172.21.15.57:0/2289023346 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32e7fc640 1 --2- 172.21.15.57:0/2289023346 >> v2:172.21.15.132:3300/0 conn(0x7fa3300d3020 0x7fa3300d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32effd640 1 -- 172.21.15.57:0/2289023346 >> v2:172.21.15.132:3300/0 conn(0x7fa3300d3020 msgr2=0x7fa3300d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32effd640 1 --2- 172.21.15.57:0/2289023346 >> v2:172.21.15.132:3300/0 conn(0x7fa3300d3020 0x7fa3300d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32effd640 1 -- 172.21.15.57:0/2289023346 >> v1:172.21.15.132:6789/0 conn(0x7fa3300ce8b0 legacy=0x7fa3300ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.128+0000 7fa32effd640 1 -- 172.21.15.57:0/2289023346 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300ce0b0 con 0x7fa33015d570 2023-11-24T08:04:13.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa32effd640 1 --2- 172.21.15.57:0/2289023346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa33015d570 0x7fa33006b9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3300b5f00 tx=0x7fa32001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c8cb512c18f640 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa32dffb640 1 -- 172.21.15.57:0/2289023346 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200aa650 con 0x7fa33015d570 2023-11-24T08:04:13.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa32dffb640 1 -- 172.21.15.57:0/2289023346 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3200aa7b0 con 0x7fa33015d570 2023-11-24T08:04:13.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa32dffb640 1 -- 172.21.15.57:0/2289023346 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200aab40 con 0x7fa33015d570 2023-11-24T08:04:13.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 -- 172.21.15.57:0/2289023346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa33015d570 msgr2=0x7fa33006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 --2- 172.21.15.57:0/2289023346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa33015d570 0x7fa33006b9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3300b5f00 tx=0x7fa32001c4d0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 -- 172.21.15.57:0/2289023346 shutdown_connections 2023-11-24T08:04:13.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 --2- 172.21.15.57:0/2289023346 >> v2:172.21.15.132:3300/0 conn(0x7fa3300d3020 0x7fa3300d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 --2- 172.21.15.57:0/2289023346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa33015d570 0x7fa33006b9d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 -- 172.21.15.57:0/2289023346 >> 172.21.15.57:0/2289023346 conn(0x7fa33008ceb0 msgr2=0x7fa33009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 -- 172.21.15.57:0/2289023346 shutdown_connections 2023-11-24T08:04:13.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.132+0000 7fa335479640 1 -- 172.21.15.57:0/2289023346 wait complete. 2023-11-24T08:04:13.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 Processor -- start 2023-11-24T08:04:13.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 -- start start 2023-11-24T08:04:13.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3300ce8b0 0x7fa3300c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3300d3020 0x7fa3300b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa33015d570 0x7fa3300c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300ca4d0 con 0x7fa3300d3020 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33015fb50 con 0x7fa33015d570 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33015fe30 con 0x7fa3300ce8b0 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3300d3020 0x7fa3300b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3300d3020 0x7fa3300b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56086/0 (socket says 172.21.15.57:56086) 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 -- 172.21.15.57:0/1287345704 learned_addr learned my addr 172.21.15.57:0/1287345704 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32f7fe640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa33015d570 0x7fa3300c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32effd640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3300ce8b0 0x7fa3300c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 -- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3300ce8b0 msgr2=0x7fa3300c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3300ce8b0 0x7fa3300c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 -- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa33015d570 msgr2=0x7fa3300c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa33015d570 0x7fa3300c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 -- 172.21.15.57:0/1287345704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200094d0 con 0x7fa3300d3020 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa32e7fc640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3300d3020 0x7fa3300b4330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa32400d800 tx=0x7fa32400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa3177fe640 1 -- 172.21.15.57:0/1287345704 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400b6c0 con 0x7fa3300d3020 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa3177fe640 1 -- 172.21.15.57:0/1287345704 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32400b860 con 0x7fa3300d3020 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa3177fe640 1 -- 172.21.15.57:0/1287345704 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400bc10 con 0x7fa3300d3020 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa330160110 con 0x7fa3300d3020 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3300c8ea0 con 0x7fa3300d3020 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.136+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa330067520 con 0x7fa3300d3020 2023-11-24T08:04:13.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.140+0000 7fa3177fe640 1 -- 172.21.15.57:0/1287345704 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa32401e460 con 0x7fa3300d3020 2023-11-24T08:04:13.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.140+0000 7fa3177fe640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa31c066470 0x7fa31c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.140+0000 7fa3177fe640 1 -- 172.21.15.57:0/1287345704 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa324084330 con 0x7fa3300d3020 2023-11-24T08:04:13.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.140+0000 7fa32effd640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa31c066470 0x7fa31c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.140+0000 7fa32effd640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa31c066470 0x7fa31c068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3200ae000 tx=0x7fa3200b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.144+0000 7fa3177fe640 1 -- 172.21.15.57:0/1287345704 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa324051850 con 0x7fa3300d3020 2023-11-24T08:04:13.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.332+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3300cd830 con 0x7fa3300d3020 2023-11-24T08:04:13.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.332+0000 7fa3177fe640 1 -- 172.21.15.57:0/1287345704 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fa324054e70 con 0x7fa3300d3020 2023-11-24T08:04:13.336 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:13.336 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:13.336 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:13.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa31c066470 msgr2=0x7fa31c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa31c066470 0x7fa31c068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3200ae000 tx=0x7fa3200b5040 comp rx=0 tx=0).stop 2023-11-24T08:04:13.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3300d3020 msgr2=0x7fa3300b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3300d3020 0x7fa3300b4330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa32400d800 tx=0x7fa32400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 shutdown_connections 2023-11-24T08:04:13.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa31c066470 0x7fa31c068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa33015d570 0x7fa3300c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3300d3020 0x7fa3300b4330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 --2- 172.21.15.57:0/1287345704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3300ce8b0 0x7fa3300c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 >> 172.21.15.57:0/1287345704 conn(0x7fa33008ceb0 msgr2=0x7fa330153910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 shutdown_connections 2023-11-24T08:04:13.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.336+0000 7fa335479640 1 -- 172.21.15.57:0/1287345704 wait complete. 2023-11-24T08:04:13.760 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:03:58.959263+0000', 'modified': '2023-11-24T08:04:01.997394+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 54167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_54167': {'gid': 54167, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6833/2419149614', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2419149614}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 2419149614}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:04:13.760 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:04:13.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T08:04:13.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245d06b640 1 Processor -- start 2023-11-24T08:04:13.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245d06b640 1 -- start start 2023-11-24T08:04:13.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245d06b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f24580ce8b0 0x7f24580ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245d06b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245806c0e0 con 0x7f245815d570 2023-11-24T08:04:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245d06b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580d1cc0 con 0x7f24580d3020 2023-11-24T08:04:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245d06b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580d1fa0 con 0x7f24580ce8b0 2023-11-24T08:04:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f2456d9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f245815d570 0x7f245806b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44418/0 (socket says 172.21.15.57:44418) 2023-11-24T08:04:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f2456d9d640 1 -- 172.21.15.57:0/251467692 learned_addr learned my addr 172.21.15.57:0/251467692 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:13.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245759e640 1 --2- 172.21.15.57:0/251467692 >> v2:172.21.15.57:3300/0 conn(0x7f24580ce8b0 0x7f24580ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245659c640 1 -- 172.21.15.57:0/251467692 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995261891 0 0) 0x7f245806c0e0 con 0x7f245815d570 2023-11-24T08:04:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245659c640 1 -- 172.21.15.57:0/251467692 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2444003530 con 0x7f245815d570 2023-11-24T08:04:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245759e640 1 -- 172.21.15.57:0/251467692 >> v1:172.21.15.132:6789/0 conn(0x7f24580d3020 legacy=0x7f24580d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245759e640 1 -- 172.21.15.57:0/251467692 >> v1:172.21.15.57:6789/0 conn(0x7f245815d570 legacy=0x7f245806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.908+0000 7f245759e640 1 -- 172.21.15.57:0/251467692 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580ce0b0 con 0x7f24580ce8b0 2023-11-24T08:04:13.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245759e640 1 --2- 172.21.15.57:0/251467692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580ce8b0 0x7f24580ced60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2450009d90 tx=0x7f245001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99265a22e5385fc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245659c640 1 -- 172.21.15.57:0/251467692 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500a59a0 con 0x7f24580ce8b0 2023-11-24T08:04:13.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245659c640 1 -- 172.21.15.57:0/251467692 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500a5b00 con 0x7f24580ce8b0 2023-11-24T08:04:13.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245659c640 1 -- 172.21.15.57:0/251467692 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500a5e70 con 0x7f24580ce8b0 2023-11-24T08:04:13.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245d06b640 1 -- 172.21.15.57:0/251467692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580ce8b0 msgr2=0x7f24580ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245d06b640 1 --2- 172.21.15.57:0/251467692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580ce8b0 0x7f24580ced60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2450009d90 tx=0x7f245001c8e0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245d06b640 1 -- 172.21.15.57:0/251467692 shutdown_connections 2023-11-24T08:04:13.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245d06b640 1 --2- 172.21.15.57:0/251467692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580ce8b0 0x7f24580ced60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245d06b640 1 -- 172.21.15.57:0/251467692 >> 172.21.15.57:0/251467692 conn(0x7f245808ceb0 msgr2=0x7f245809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245d06b640 1 -- 172.21.15.57:0/251467692 shutdown_connections 2023-11-24T08:04:13.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.912+0000 7f245d06b640 1 -- 172.21.15.57:0/251467692 wait complete. 2023-11-24T08:04:13.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 Processor -- start 2023-11-24T08:04:13.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 -- start start 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24580ce8b0 0x7f2458160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580d3020 0x7f24580b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245815d570 0x7f24580b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458152650 con 0x7f24580d3020 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c8380 con 0x7f24580ce8b0 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245815eb80 con 0x7f245815d570 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580d3020 0x7f24580b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580d3020 0x7f24580b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56108/0 (socket says 172.21.15.57:56108) 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 -- 172.21.15.57:0/1888171041 learned_addr learned my addr 172.21.15.57:0/1888171041 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:13.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f2456d9d640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24580ce8b0 0x7f2458160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245759e640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245815d570 0x7f24580b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 -- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245815d570 msgr2=0x7f24580b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245815d570 0x7f24580b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 -- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24580ce8b0 msgr2=0x7f2458160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24580ce8b0 0x7f2458160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 -- 172.21.15.57:0/1888171041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450009a70 con 0x7f24580d3020 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245759e640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245815d570 0x7f24580b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244ffff640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580d3020 0x7f24580b8270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f244000c440 tx=0x7f244000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244f7fe640 1 -- 172.21.15.57:0/1888171041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440012830 con 0x7f24580d3020 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244f7fe640 1 -- 172.21.15.57:0/1888171041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440012990 con 0x7f24580d3020 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f244f7fe640 1 -- 172.21.15.57:0/1888171041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440012d40 con 0x7f24580d3020 2023-11-24T08:04:13.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24580c7d30 con 0x7f24580d3020 2023-11-24T08:04:13.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.916+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245815ee60 con 0x7f24580d3020 2023-11-24T08:04:13.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.920+0000 7f244f7fe640 1 -- 172.21.15.57:0/1888171041 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f244001b400 con 0x7f24580d3020 2023-11-24T08:04:13.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.920+0000 7f244f7fe640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2438066470 0x7f2438068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.920+0000 7f244f7fe640 1 -- 172.21.15.57:0/1888171041 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2440083da0 con 0x7f24580d3020 2023-11-24T08:04:13.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.920+0000 7f24603df000 1 Processor -- start 2023-11-24T08:04:13.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.920+0000 7f2456d9d640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2438066470 0x7f2438068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.920+0000 7f24603df000 1 -- start start 2023-11-24T08:04:13.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.920+0000 7f2456d9d640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2438066470 0x7f2438068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2448007fd0 tx=0x7f2448009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec42070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ebf8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea62130 con 0x558e6ec41c90 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea4f9a0 con 0x558e6ebf8320 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea4ced0 con 0x558e6ec425b0 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec42070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec42070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56114/0 (socket says 172.21.15.57:56114) 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 -- 172.21.15.57:0/375870823 learned_addr learned my addr 172.21.15.57:0/375870823 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f244ffff640 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f245759e640 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ebf8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 -- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 msgr2=0x558e6ebf7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 -- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 msgr2=0x558e6ebf8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ebf8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 -- 172.21.15.57:0/375870823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e6e740890 con 0x558e6ec41c90 2023-11-24T08:04:13.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f2456d9d640 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec42070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f244800f870 tx=0x7f2448000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beef9a444d367658 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f244cff9640 1 -- 172.21.15.57:0/375870823 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480159a0 con 0x558e6ec41c90 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f244cff9640 1 -- 172.21.15.57:0/375870823 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2448015b00 con 0x558e6ec41c90 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f244cff9640 1 -- 172.21.15.57:0/375870823 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448015e70 con 0x558e6ec41c90 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- 172.21.15.57:0/375870823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 msgr2=0x558e6ec42070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec42070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f244800f870 tx=0x7f2448000ee0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- 172.21.15.57:0/375870823 shutdown_connections 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ebf8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 --2- 172.21.15.57:0/375870823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec42070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- 172.21.15.57:0/375870823 >> 172.21.15.57:0/375870823 conn(0x558e6ebf42d0 msgr2=0x558e6ebf66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- 172.21.15.57:0/375870823 shutdown_connections 2023-11-24T08:04:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- 172.21.15.57:0/375870823 wait complete. 2023-11-24T08:04:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 -- start start 2023-11-24T08:04:13.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.924+0000 7f24603df000 1 Processor -- start 2023-11-24T08:04:13.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ebf8320 0x558e6ebfcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ebfd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec425b0 0x558e6ec10910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea487c0 con 0x558e6ec41c90 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea00bf0 con 0x558e6ec425b0 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea06a90 con 0x558e6ebf8320 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 10 client.0 _ll_register_callbacks cb 0x558e6ebe33c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ebfd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ebfd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56120/0 (socket says 172.21.15.57:56120) 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 -- 172.21.15.57:0/3352269193 learned_addr learned my addr 172.21.15.57:0/3352269193 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ebf8320 0x558e6ebfcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f245759e640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec425b0 0x558e6ec10910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 -- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ebf8320 msgr2=0x558e6ebfcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ebf8320 0x558e6ebfcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 -- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec425b0 msgr2=0x558e6ec10910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec425b0 0x558e6ec10910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 -- 172.21.15.57:0/3352269193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2444003530 con 0x558e6ec41c90 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ebf8320 0x558e6ebfcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f245759e640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec425b0 0x558e6ec10910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f244ffff640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ebfd280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f244000c410 tx=0x7f24400556b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5f2e0c7c1415eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 1 -- 172.21.15.57:0/3352269193 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244005d140 con 0x558e6ec41c90 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 1 -- 172.21.15.57:0/3352269193 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f244005ccb0 con 0x558e6ec41c90 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e6ea0a470 con 0x558e6ec41c90 2023-11-24T08:04:13.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 1 -- 172.21.15.57:0/3352269193 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f244005ce70 con 0x558e6ec41c90 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 10 client.4650 fetch_fsmap learned FSMap version 8 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558e6ea09190 con 0x558e6ec41c90 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 1 -- 172.21.15.57:0/3352269193 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e6ea0a470 con 0x558e6ec41c90 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 1 -- 172.21.15.57:0/3352269193 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2440022020 con 0x558e6ec41c90 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 10 client.4650 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 20 client.4650 populate_metadata read hostname 'smithi057' 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec11320 0x558e6ec53f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 4 client.4650 mds_command: new command op to 54167 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 --> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e6ea0db50 con 0x558e6ec11320 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec11320 0x558e6ec53f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec11320 0x558e6ec53f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9edbad8b5550fb51 server_cookie=20795fc57f186433 in_seq=0 out_seq=0 2023-11-24T08:04:13.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 10 client.4650 ms_handle_connect on v2:172.21.15.57:6832/2419149614 2023-11-24T08:04:13.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 1 -- 172.21.15.57:0/3352269193 <== mds.0 v2:172.21.15.57:6832/2419149614 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558e6ea0db50 con 0x558e6ec11320 2023-11-24T08:04:13.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 10 client.4650 handle_command_reply: tid=0 2023-11-24T08:04:13.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 client.4650 shutdown 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 msgr2=0x558e6ebfd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ebfd280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f244000c410 tx=0x7f24400556b0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 shutdown_connections 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec11320 0x558e6ec53f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec425b0 0x558e6ec10910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ebfd280 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 --2- 172.21.15.57:0/3352269193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ebf8320 0x558e6ebfcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f2435ffb640 0 client.4650 ms_handle_reset on v2:172.21.15.57:6832/2419149614 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 >> 172.21.15.57:0/3352269193 conn(0x558e6ebf42d0 msgr2=0x558e6ebf66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.928+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 shutdown_connections 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.932+0000 7f24603df000 1 -- 172.21.15.57:0/3352269193 wait complete. 2023-11-24T08:04:13.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.932+0000 7f24603df000 20 client.4650 trim_cache size 0 max 16384 2023-11-24T08:04:13.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.944+0000 7f24603df000 1 Processor -- start 2023-11-24T08:04:13.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.944+0000 7f24603df000 1 -- start start 2023-11-24T08:04:13.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ec40c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec3fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ec40070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6e701940 con 0x558e6ec41c90 2023-11-24T08:04:13.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea45bc0 con 0x558e6ebf8320 2023-11-24T08:04:13.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea22e30 con 0x558e6ec425b0 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec3fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec3fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56126/0 (socket says 172.21.15.57:56126) 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 -- 172.21.15.57:0/3713943961 learned_addr learned my addr 172.21.15.57:0/3713943961 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ec40c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f245759e640 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ec40070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 -- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 msgr2=0x558e6ec40070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ec40070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 -- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 msgr2=0x558e6ec40c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ec40c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 -- 172.21.15.57:0/3713943961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458154f10 con 0x558e6ec41c90 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f245759e640 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ec40070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:13.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244ffff640 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec3fb30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2440051340 tx=0x7f244006a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4d71792d766892 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244d7fa640 1 -- 172.21.15.57:0/3713943961 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244005d140 con 0x558e6ec41c90 2023-11-24T08:04:13.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244d7fa640 1 -- 172.21.15.57:0/3713943961 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244006c070 con 0x558e6ec41c90 2023-11-24T08:04:13.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f244d7fa640 1 -- 172.21.15.57:0/3713943961 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000e040 con 0x558e6ec41c90 2023-11-24T08:04:13.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- 172.21.15.57:0/3713943961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 msgr2=0x558e6ec3fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec3fb30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2440051340 tx=0x7f244006a000 comp rx=0 tx=0).stop 2023-11-24T08:04:13.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- 172.21.15.57:0/3713943961 shutdown_connections 2023-11-24T08:04:13.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ec40070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ec41c90 0x558e6ec3fb30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 --2- 172.21.15.57:0/3713943961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ebf8320 0x558e6ec40c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- 172.21.15.57:0/3713943961 >> 172.21.15.57:0/3713943961 conn(0x558e6ebf42d0 msgr2=0x558e6ec4f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- 172.21.15.57:0/3713943961 shutdown_connections 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- 172.21.15.57:0/3713943961 wait complete. 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 -- start start 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.948+0000 7f24603df000 1 Processor -- start 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ebf8320 0x558e6ec24ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec41c90 0x558e6ebf96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6eb00030 con 0x558e6ebf8320 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6ea21e10 con 0x558e6ec41c90 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6e9cfa00 con 0x558e6ec425b0 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 10 client.0 _ll_register_callbacks cb 0x558e6ea96c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ebf8320 0x558e6ec24ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ebf8320 0x558e6ec24ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56140/0 (socket says 172.21.15.57:56140) 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 -- 172.21.15.57:0/3671444777 learned_addr learned my addr 172.21.15.57:0/3671444777 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f245759e640 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f244ffff640 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec41c90 0x558e6ebf96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 -- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 msgr2=0x558e6ebf9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 -- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec41c90 msgr2=0x558e6ebf96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec41c90 0x558e6ebf96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 -- 172.21.15.57:0/3671444777 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e6ea09190 con 0x558e6ebf8320 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2456d9d640 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ebf8320 0x558e6ec24ff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f244800f840 tx=0x7f24480010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ebf012680f518f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 1 -- 172.21.15.57:0/3671444777 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448031d00 con 0x558e6ebf8320 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 1 -- 172.21.15.57:0/3671444777 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2448031070 con 0x558e6ebf8320 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e6ea47110 con 0x558e6ebf8320 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 1 -- 172.21.15.57:0/3671444777 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24480159a0 con 0x558e6ebf8320 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 10 client.4656 fetch_fsmap learned FSMap version 8 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558e6e9ef490 con 0x558e6ebf8320 2023-11-24T08:04:13.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 1 -- 172.21.15.57:0/3671444777 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e6ea47110 con 0x558e6ebf8320 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 1 -- 172.21.15.57:0/3671444777 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2448012070 con 0x558e6ebf8320 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 10 client.4656 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 20 client.4656 populate_metadata read hostname 'smithi057' 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec54340 0x558e6ec54720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 4 client.4656 mds_command: new command op to 54167 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 --> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558e6ea769a0 con 0x558e6ec54340 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f244ffff640 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec54340 0x558e6ec54720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f244ffff640 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec54340 0x558e6ec54720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ef494649aa2f59a server_cookie=52aaae75bc9e2b81 in_seq=0 out_seq=0 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 10 client.4656 ms_handle_connect on v2:172.21.15.57:6832/2419149614 2023-11-24T08:04:13.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 1 -- 172.21.15.57:0/3671444777 <== mds.0 v2:172.21.15.57:6832/2419149614 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x558e6ea769a0 con 0x558e6ec54340 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 10 client.4656 handle_command_reply: tid=0 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 client.4656 shutdown 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ebf8320 msgr2=0x558e6ec24ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ebf8320 0x558e6ec24ff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f244800f840 tx=0x7f24480010b0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 shutdown_connections 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558e6ec425b0 0x558e6ebf9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:6832/2419149614,v1:172.21.15.57:6833/2419149614] conn(0x558e6ec54340 0x558e6ec54720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558e6ec41c90 0x558e6ebf96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 --2- 172.21.15.57:0/3671444777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558e6ebf8320 0x558e6ec24ff0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 >> 172.21.15.57:0/3671444777 conn(0x558e6ebf42d0 msgr2=0x558e6ebf66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f2435ffb640 0 client.4656 ms_handle_reset on v2:172.21.15.57:6832/2419149614 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 shutdown_connections 2023-11-24T08:04:13.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.952+0000 7f24603df000 1 -- 172.21.15.57:0/3671444777 wait complete. 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f24603df000 20 client.4656 trim_cache size 0 max 16384 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "445cea61-e72c-4da9-979a-02ade002d7d6", 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 54167, 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-11-24T08:04:13.961 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 14.362985598, 2023-11-24T08:04:13.962 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 8, 2023-11-24T08:04:13.962 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 23, 2023-11-24T08:04:13.962 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 23, 2023-11-24T08:04:13.962 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 21.779038835000001 2023-11-24T08:04:13.962 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2438066470 msgr2=0x7f2438068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2438066470 0x7f2438068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2448007fd0 tx=0x7f2448009040 comp rx=0 tx=0).stop 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580d3020 msgr2=0x7f24580b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580d3020 0x7f24580b8270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f244000c440 tx=0x7f244000c900 comp rx=0 tx=0).stop 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 shutdown_connections 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2438066470 0x7f2438068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245815d570 0x7f24580b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24580d3020 0x7f24580b8270 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 --2- 172.21.15.57:0/1888171041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24580ce8b0 0x7f2458160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 >> 172.21.15.57:0/1888171041 conn(0x7f245808ceb0 msgr2=0x7f24580b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 shutdown_connections 2023-11-24T08:04:13.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:13.956+0000 7f245d06b640 1 -- 172.21.15.57:0/1888171041 wait complete. 2023-11-24T08:04:13.975 INFO:teuthology.run_tasks:Running task kclient... 2023-11-24T08:04:14.003 INFO:tasks.kclient:Mounting kernel clients... 2023-11-24T08:04:14.003 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T08:04:14.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.004 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:04:14.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.015 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-11-24T08:04:14.078 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:14.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:14.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.081 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:04:14.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-11-24T08:04:14.198 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:14.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:14.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.201 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:04:14.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-11-24T08:04:14.286 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:14.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:14.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.288 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:04:14.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-11-24T08:04:14.409 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2023-11-24T08:04:14.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:14.412 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-24T08:04:14.412 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:14.412 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:14.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:14.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.552+0000 7f0b8a31c640 1 Processor -- start 2023-11-24T08:04:14.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b8a31c640 1 -- start start 2023-11-24T08:04:14.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b8a31c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b8415d460 0x7f0b840cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b8a31c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b840cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b8a31c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b8406f3a0 0x7f0b840ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b8a31c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b84070f60 con 0x7f0b8415d460 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b8a31c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b84070070 con 0x7f0b8406f3a0 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b8a31c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84070350 con 0x7f0b8406d340 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b8415d460 0x7f0b840cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b8415d460 0x7f0b840cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56144/0 (socket says 172.21.15.57:56144) 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 -- 172.21.15.57:0/1590128457 learned_addr learned my addr 172.21.15.57:0/1590128457 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b837fe640 1 --2- 172.21.15.57:0/1590128457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b840cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b888b9640 1 --2- 172.21.15.57:0/1590128457 >> v2:172.21.15.132:3300/0 conn(0x7f0b8406f3a0 0x7f0b840ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 -- 172.21.15.57:0/1590128457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 msgr2=0x7f0b840cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:14.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 --2- 172.21.15.57:0/1590128457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b840cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 -- 172.21.15.57:0/1590128457 >> v2:172.21.15.132:3300/0 conn(0x7f0b8406f3a0 msgr2=0x7f0b840ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:14.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 --2- 172.21.15.57:0/1590128457 >> v2:172.21.15.132:3300/0 conn(0x7f0b8406f3a0 0x7f0b840ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.556+0000 7f0b83fff640 1 -- 172.21.15.57:0/1590128457 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84070630 con 0x7f0b8415d460 2023-11-24T08:04:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b83fff640 1 --2- 172.21.15.57:0/1590128457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b840cb920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b840741c0 tx=0x7f0b7401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0a12434c4293ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b82ffd640 1 -- 172.21.15.57:0/1590128457 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740aa5f0 con 0x7f0b8415d460 2023-11-24T08:04:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b82ffd640 1 -- 172.21.15.57:0/1590128457 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b740aa750 con 0x7f0b8415d460 2023-11-24T08:04:14.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b82ffd640 1 -- 172.21.15.57:0/1590128457 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740aaae0 con 0x7f0b8415d460 2023-11-24T08:04:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 -- 172.21.15.57:0/1590128457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 msgr2=0x7f0b840cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/1590128457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b840cb920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b840741c0 tx=0x7f0b7401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 -- 172.21.15.57:0/1590128457 shutdown_connections 2023-11-24T08:04:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/1590128457 >> v2:172.21.15.132:3300/0 conn(0x7f0b8406f3a0 0x7f0b840ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/1590128457 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b840cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/1590128457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b840cb920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 -- 172.21.15.57:0/1590128457 >> 172.21.15.57:0/1590128457 conn(0x7f0b8406e880 msgr2=0x7f0b8406ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 -- 172.21.15.57:0/1590128457 shutdown_connections 2023-11-24T08:04:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 -- 172.21.15.57:0/1590128457 wait complete. 2023-11-24T08:04:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 Processor -- start 2023-11-24T08:04:14.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.560+0000 7f0b8a31c640 1 -- start start 2023-11-24T08:04:14.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b84158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8406f3a0 0x7f0b8415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b84153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8415eb10 con 0x7f0b8415d460 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84157ca0 con 0x7f0b8406f3a0 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8415e550 con 0x7f0b8406d340 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b84153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b84153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56148/0 (socket says 172.21.15.57:56148) 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 -- 172.21.15.57:0/654873923 learned_addr learned my addr 172.21.15.57:0/654873923 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b83fff640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b84158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b837fe640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8406f3a0 0x7f0b8415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 -- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 msgr2=0x7f0b84158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b84158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 -- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8406f3a0 msgr2=0x7f0b8415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8406f3a0 0x7f0b8415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 -- 172.21.15.57:0/654873923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740094d0 con 0x7f0b8415d460 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b83fff640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b84158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b837fe640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8406f3a0 0x7f0b8415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b888b9640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b84153910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c007e70 tx=0x7f0b7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b80ff9640 1 -- 172.21.15.57:0/654873923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c014620 con 0x7f0b8415d460 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b80ff9640 1 -- 172.21.15.57:0/654873923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c0147a0 con 0x7f0b8415d460 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8415e830 con 0x7f0b8415d460 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b80ff9640 1 -- 172.21.15.57:0/654873923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c014b50 con 0x7f0b8415d460 2023-11-24T08:04:14.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b84158670 con 0x7f0b8415d460 2023-11-24T08:04:14.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.564+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b84157790 con 0x7f0b8415d460 2023-11-24T08:04:14.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.568+0000 7f0b80ff9640 1 -- 172.21.15.57:0/654873923 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b7c014cb0 con 0x7f0b8415d460 2023-11-24T08:04:14.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.568+0000 7f0b80ff9640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b70066470 0x7f0b70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:14.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.568+0000 7f0b80ff9640 1 -- 172.21.15.57:0/654873923 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b7c084800 con 0x7f0b8415d460 2023-11-24T08:04:14.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.568+0000 7f0b83fff640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b70066470 0x7f0b70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:14.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.568+0000 7f0b83fff640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b70066470 0x7f0b70068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b740ae000 tx=0x7f0b740a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:14.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.572+0000 7f0b80ff9640 1 -- 172.21.15.57:0/654873923 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b84157790 con 0x7f0b8415d460 2023-11-24T08:04:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0b84157790 con 0x7f0b8415d460 2023-11-24T08:04:14.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b80ff9640 1 -- 172.21.15.57:0/654873923 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0b84157790 con 0x7f0b8415d460 2023-11-24T08:04:14.769 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b70066470 msgr2=0x7f0b70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b70066470 0x7f0b70068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b740ae000 tx=0x7f0b740a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 msgr2=0x7f0b84153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b84153910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c007e70 tx=0x7f0b7c00e4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 shutdown_connections 2023-11-24T08:04:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b70066470 0x7f0b70068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b8415d460 0x7f0b84153910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8406f3a0 0x7f0b8415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 --2- 172.21.15.57:0/654873923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b8406d340 0x7f0b84158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:14.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 >> 172.21.15.57:0/654873923 conn(0x7f0b8406e880 msgr2=0x7f0b84160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:14.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 shutdown_connections 2023-11-24T08:04:14.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:14.768+0000 7f0b8a31c640 1 -- 172.21.15.57:0/654873923 wait complete. 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:14.790 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:04:14.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.791 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-11-24T08:04:14.800 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-11-24T08:04:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:14.802 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-11-24T08:04:14.802 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:04:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:79:99:46:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:04:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:14.803 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:04:14.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.803 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:14.804 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:14.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:04:14.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2023-11-24T08:04:14.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2023-11-24T08:04:14.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:04:14.804 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:14.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.921 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:14.940 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-11-24T08:04:14.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:14.942 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-11-24T08:04:15.010 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-11-24T08:04:15.011 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:15.011 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T08:04:15.011 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:04:15.011 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T08:04:15.011 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:15.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.012 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:15.012 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:15.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T08:04:15.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T08:04:15.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T08:04:15.012 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:15.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.104 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:04:15.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.114 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-11-24T08:04:15.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.165 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:15.165 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:15.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:04:15.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T08:04:15.165 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:15.249 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T08:04:15.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T08:04:15.250 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:15.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.419 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:15.419 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:15.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-11-24T08:04:15.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:04:15.419 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:15.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:15.461 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:15.512 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:04:15.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:15.512 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:15.564 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T08:04:15.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:15.665 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:15.666 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:15.774 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:15.775 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:15.775 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:04:15.776 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with new device syntax: 0@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:04:15.776 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:04:15.778 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:15.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:15.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.801 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:15.879 INFO:teuthology.orchestra.run.smithi057.stdout:client4645 2023-11-24T08:04:15.879 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:15.880 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:15.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.929 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:15.990 INFO:teuthology.orchestra.run.smithi057.stdout:client4645 2023-11-24T08:04:15.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:15.990 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:16.048 INFO:teuthology.orchestra.run.smithi057.stdout:client4645 2023-11-24T08:04:16.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.048 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/445cea61-e72c-4da9-979a-02ade002d7d6.client4645/status') 2023-11-24T08:04:16.117 INFO:teuthology.orchestra.run.smithi057.stdout:instance: client.4645 (3)172.21.15.57:0/402142756 2023-11-24T08:04:16.117 INFO:teuthology.orchestra.run.smithi057.stdout:blocklisted: false 2023-11-24T08:04:16.118 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2023-11-24T08:04:16.118 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2023-11-24T08:04:16.118 INFO:teuthology.orchestra.run.smithi057.stderr:69 bytes copied, 5.6671e-05 s, 1.2 MB/s 2023-11-24T08:04:16.119 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-11-24T08:04:16.120 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:16.120 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:16.120 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.304+0000 7fc13311d640 1 Processor -- start 2023-11-24T08:04:16.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.304+0000 7fc13311d640 1 -- start start 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc13311d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc12c0b36c0 0x7fc12c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc13311d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c070da0 0x7fc12c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc13311d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c15a700 con 0x7fc12c15a320 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc13311d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0b2430 con 0x7fc12c0b36c0 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc13311d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0b2620 con 0x7fc12c070da0 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc12bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc12c0b36c0 0x7fc12c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc12bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc12c0b36c0 0x7fc12c0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46878/0 (socket says 172.21.15.57:46878) 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc12bfff640 1 -- 172.21.15.57:0/2041724853 learned_addr learned my addr 172.21.15.57:0/2041724853 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc12bfff640 1 -- 172.21.15.57:0/2041724853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c070da0 msgr2=0x7fc12c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc1316ba640 1 --2- 172.21.15.57:0/2041724853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c070da0 0x7fc12c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc12bfff640 1 --2- 172.21.15.57:0/2041724853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c070da0 0x7fc12c15ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc12bfff640 1 -- 172.21.15.57:0/2041724853 >> v1:172.21.15.132:6789/0 conn(0x7fc12c15a320 legacy=0x7fc12c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc12bfff640 1 -- 172.21.15.57:0/2041724853 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0b2900 con 0x7fc12c0b36c0 2023-11-24T08:04:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.308+0000 7fc1316ba640 1 --2- 172.21.15.57:0/2041724853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c070da0 0x7fc12c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:16.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc12bfff640 1 --2- 172.21.15.57:0/2041724853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0b36c0 0x7fc12c0b1ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc118009870 tx=0x7fc11801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fb46f9c7f4c65d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc12b7fe640 1 -- 172.21.15.57:0/2041724853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180ac600 con 0x7fc12c0b36c0 2023-11-24T08:04:16.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc12b7fe640 1 -- 172.21.15.57:0/2041724853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1180a8050 con 0x7fc12c0b36c0 2023-11-24T08:04:16.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc12b7fe640 1 -- 172.21.15.57:0/2041724853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180ac980 con 0x7fc12c0b36c0 2023-11-24T08:04:16.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 -- 172.21.15.57:0/2041724853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0b36c0 msgr2=0x7fc12c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 --2- 172.21.15.57:0/2041724853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0b36c0 0x7fc12c0b1ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc118009870 tx=0x7fc11801c4d0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 -- 172.21.15.57:0/2041724853 shutdown_connections 2023-11-24T08:04:16.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 --2- 172.21.15.57:0/2041724853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c070da0 0x7fc12c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 --2- 172.21.15.57:0/2041724853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c0b36c0 0x7fc12c0b1ef0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 -- 172.21.15.57:0/2041724853 >> 172.21.15.57:0/2041724853 conn(0x7fc12c0b0bf0 msgr2=0x7fc12c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:16.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 -- 172.21.15.57:0/2041724853 shutdown_connections 2023-11-24T08:04:16.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 -- 172.21.15.57:0/2041724853 wait complete. 2023-11-24T08:04:16.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 Processor -- start 2023-11-24T08:04:16.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.312+0000 7fc13311d640 1 -- start start 2023-11-24T08:04:16.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc12c070da0 0x7fc12c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c0b36c0 0x7fc12c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c15a320 0x7fc12c0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c14d350 con 0x7fc12c15a320 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c14d630 con 0x7fc12c070da0 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c14d910 con 0x7fc12c0b36c0 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c15a320 0x7fc12c0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc130eb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc12c070da0 0x7fc12c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c15a320 0x7fc12c0af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46894/0 (socket says 172.21.15.57:46894) 2023-11-24T08:04:16.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 -- 172.21.15.57:0/2256129193 learned_addr learned my addr 172.21.15.57:0/2256129193 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc12bfff640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c0b36c0 0x7fc12c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 -- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c0b36c0 msgr2=0x7fc12c0aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c0b36c0 0x7fc12c0aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 -- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc12c070da0 msgr2=0x7fc12c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc12c070da0 0x7fc12c152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 -- 172.21.15.57:0/2256129193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180094d0 con 0x7fc12c15a320 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1316ba640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c15a320 0x7fc12c0af120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc12400cef0 tx=0x7fc12400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1297fa640 1 -- 172.21.15.57:0/2256129193 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12400d840 con 0x7fc12c15a320 2023-11-24T08:04:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1297fa640 1 -- 172.21.15.57:0/2256129193 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12400d9c0 con 0x7fc12c15a320 2023-11-24T08:04:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1297fa640 1 -- 172.21.15.57:0/2256129193 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12400dd70 con 0x7fc12c15a320 2023-11-24T08:04:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c14dbf0 con 0x7fc12c15a320 2023-11-24T08:04:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c1533c0 con 0x7fc12c15a320 2023-11-24T08:04:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c067520 con 0x7fc12c15a320 2023-11-24T08:04:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.316+0000 7fc1297fa640 1 -- 172.21.15.57:0/2256129193 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc12401e3b0 con 0x7fc12c15a320 2023-11-24T08:04:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.320+0000 7fc1297fa640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc110066470 0x7fc110068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.320+0000 7fc1297fa640 1 -- 172.21.15.57:0/2256129193 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc124084890 con 0x7fc12c15a320 2023-11-24T08:04:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.320+0000 7fc130eb9640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc110066470 0x7fc110068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.320+0000 7fc130eb9640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc110066470 0x7fc110068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1200098e0 tx=0x7fc120009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:16.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.324+0000 7fc1297fa640 1 -- 172.21.15.57:0/2256129193 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc124051e70 con 0x7fc12c15a320 2023-11-24T08:04:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.512+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc12c14d490 con 0x7fc12c15a320 2023-11-24T08:04:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.512+0000 7fc1297fa640 1 -- 172.21.15.57:0/2256129193 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc12c14d490 con 0x7fc12c15a320 2023-11-24T08:04:16.515 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc110066470 msgr2=0x7fc110068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc110066470 0x7fc110068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1200098e0 tx=0x7fc120009060 comp rx=0 tx=0).stop 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c15a320 msgr2=0x7fc12c0af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c15a320 0x7fc12c0af120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc12400cef0 tx=0x7fc12400a710 comp rx=0 tx=0).stop 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 shutdown_connections 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc110066470 0x7fc110068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc12c15a320 0x7fc12c0af120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc12c0b36c0 0x7fc12c0aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 --2- 172.21.15.57:0/2256129193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc12c070da0 0x7fc12c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 >> 172.21.15.57:0/2256129193 conn(0x7fc12c0b0bf0 msgr2=0x7fc12c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 shutdown_connections 2023-11-24T08:04:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:16.516+0000 7fc13311d640 1 -- 172.21.15.57:0/2256129193 wait complete. 2023-11-24T08:04:16.536 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:16.536 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:16.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-11-24T08:04:16.537 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T08:04:16.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:16.537 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:16.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:16.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:16.537 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:04:16.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.537 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-11-24T08:04:16.547 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.547 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-11-24T08:04:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:79:99:46:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.549 INFO:teuthology.orchestra.run.smithi057.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:04:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:04:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T08:04:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.551 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:16.614 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-11-24T08:04:16.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.617 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-11-24T08:04:16.669 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-11-24T08:04:16.669 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:16.669 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T08:04:16.669 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:04:16.669 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T08:04:16.669 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:16.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.670 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:16.670 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:16.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T08:04:16.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T08:04:16.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T08:04:16.670 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:16.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.764 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:04:16.774 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:04:16.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.775 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-11-24T08:04:16.829 INFO:teuthology.orchestra.run.smithi057.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T08:04:16.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.830 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:16.831 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:16.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:04:16.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T08:04:16.831 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:16.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.917 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:04:16.981 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:16.981 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:16.981 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:16.981 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.981 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:16.982 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.982 INFO:teuthology.orchestra.run.smithi057.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:16.982 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 72:2a:c4:75:0d:2e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:16.982 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:16.983 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.983 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::702a:c4ff:fe75:d2e/64 scope link 2023-11-24T08:04:16.983 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:16.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:16.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:04:17.049 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:17.049 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:17.049 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 72:2a:c4:75:0d:2e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::702a:c4ff:fe75:d2e/64 scope link 2023-11-24T08:04:17.050 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:17.051 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T08:04:17.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T08:04:17.052 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:17.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.196 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:17.196 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:17.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.1 up 2023-11-24T08:04:17.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:04:17.196 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:17.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:17.238 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:17.292 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:04:17.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:17.292 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:17.343 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-11-24T08:04:17.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:17.438 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:17.438 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:17.452 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:17.452 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:17.452 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:04:17.452 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with new device syntax: 2@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:04:17.452 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:04:17.456 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:17.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:04:17.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.519 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:17.576 INFO:teuthology.orchestra.run.smithi057.stdout:client4671 2023-11-24T08:04:17.577 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:17.577 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:17.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.632 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:17.687 INFO:teuthology.orchestra.run.smithi057.stdout:client4671 2023-11-24T08:04:17.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.687 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:17.742 INFO:teuthology.orchestra.run.smithi057.stdout:client4671 2023-11-24T08:04:17.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:17.743 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/445cea61-e72c-4da9-979a-02ade002d7d6.client4671/status') 2023-11-24T08:04:17.803 INFO:teuthology.orchestra.run.smithi057.stdout:instance: client.4671 (3)192.168.0.2:0/2001433222 2023-11-24T08:04:17.804 INFO:teuthology.orchestra.run.smithi057.stdout:blocklisted: false 2023-11-24T08:04:17.805 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2023-11-24T08:04:17.805 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2023-11-24T08:04:17.805 INFO:teuthology.orchestra.run.smithi057.stderr:69 bytes copied, 6.7648e-05 s, 1.0 MB/s 2023-11-24T08:04:17.807 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-11-24T08:04:17.807 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:17.807 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:17.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:17.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d33357640 1 Processor -- start 2023-11-24T08:04:17.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d33357640 1 -- start start 2023-11-24T08:04:17.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d33357640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2d2c144030 0x7f2d2c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d33357640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c0709c0 0x7f2d2c070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:17.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d33357640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c06d8b0 con 0x7f2d2c09cc20 2023-11-24T08:04:17.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d33357640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c145020 con 0x7f2d2c144030 2023-11-24T08:04:17.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d33357640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c09d0a0 con 0x7f2d2c0709c0 2023-11-24T08:04:17.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d310f3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2d2c144030 0x7f2d2c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d308f2640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2d2c09cc20 0x7f2d2c06dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42924/0 (socket says 172.21.15.57:42924) 2023-11-24T08:04:17.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.992+0000 7f2d308f2640 1 -- 172.21.15.57:0/1126146993 learned_addr learned my addr 172.21.15.57:0/1126146993 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:17.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d318f4640 1 --2- 172.21.15.57:0/1126146993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c0709c0 0x7f2d2c070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:17.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d310f3640 1 -- 172.21.15.57:0/1126146993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c0709c0 msgr2=0x7f2d2c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:17.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d310f3640 1 --2- 172.21.15.57:0/1126146993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c0709c0 0x7f2d2c070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:17.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d310f3640 1 -- 172.21.15.57:0/1126146993 >> v1:172.21.15.57:6789/0 conn(0x7f2d2c09cc20 legacy=0x7f2d2c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:17.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d310f3640 1 -- 172.21.15.57:0/1126146993 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c071390 con 0x7f2d2c144030 2023-11-24T08:04:17.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d318f4640 1 --2- 172.21.15.57:0/1126146993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c0709c0 0x7f2d2c070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:17.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d310f3640 1 --2- 172.21.15.57:0/1126146993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c144030 0x7f2d2c06c650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097c0 tx=0x7f2d2801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a927e6a050b2253 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:17.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d23fff640 1 -- 172.21.15.57:0/1126146993 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280ab650 con 0x7f2d2c144030 2023-11-24T08:04:17.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d23fff640 1 -- 172.21.15.57:0/1126146993 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280ab7b0 con 0x7f2d2c144030 2023-11-24T08:04:17.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d23fff640 1 -- 172.21.15.57:0/1126146993 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280abb40 con 0x7f2d2c144030 2023-11-24T08:04:18.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d33357640 1 -- 172.21.15.57:0/1126146993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c144030 msgr2=0x7f2d2c06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d33357640 1 --2- 172.21.15.57:0/1126146993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c144030 0x7f2d2c06c650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097c0 tx=0x7f2d2801c450 comp rx=0 tx=0).stop 2023-11-24T08:04:18.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d33357640 1 -- 172.21.15.57:0/1126146993 shutdown_connections 2023-11-24T08:04:18.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:17.996+0000 7f2d33357640 1 --2- 172.21.15.57:0/1126146993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c0709c0 0x7f2d2c070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 --2- 172.21.15.57:0/1126146993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c144030 0x7f2d2c06c650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 -- 172.21.15.57:0/1126146993 >> 172.21.15.57:0/1126146993 conn(0x7f2d2c0b0bf0 msgr2=0x7f2d2c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 -- 172.21.15.57:0/1126146993 shutdown_connections 2023-11-24T08:04:18.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 -- 172.21.15.57:0/1126146993 wait complete. 2023-11-24T08:04:18.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 Processor -- start 2023-11-24T08:04:18.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 -- start start 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0709c0 0x7f2d2c09a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c09cc20 0x7f2d2c141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c144030 0x7f2d2c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c140bd0 con 0x7f2d2c09cc20 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c13ffc0 con 0x7f2d2c0709c0 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d33357640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c1402a0 con 0x7f2d2c144030 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c09cc20 0x7f2d2c141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c09cc20 0x7f2d2c141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46908/0 (socket says 172.21.15.57:46908) 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 -- 172.21.15.57:0/3568824997 learned_addr learned my addr 172.21.15.57:0/3568824997 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d318f4640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c144030 0x7f2d2c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d310f3640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0709c0 0x7f2d2c09a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 -- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c144030 msgr2=0x7f2d2c1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c144030 0x7f2d2c1415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 -- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0709c0 msgr2=0x7f2d2c09a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0709c0 0x7f2d2c09a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 -- 172.21.15.57:0/3568824997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28009420 con 0x7f2d2c09cc20 2023-11-24T08:04:18.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d310f3640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0709c0 0x7f2d2c09a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:18.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d318f4640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c144030 0x7f2d2c1415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:18.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d308f2640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c09cc20 0x7f2d2c141060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c500 tx=0x7f2d1c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.000+0000 7f2d21ffb640 1 -- 172.21.15.57:0/3568824997 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c005cf0 con 0x7f2d2c09cc20 2023-11-24T08:04:18.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d21ffb640 1 -- 172.21.15.57:0/3568824997 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c005e50 con 0x7f2d2c09cc20 2023-11-24T08:04:18.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d21ffb640 1 -- 172.21.15.57:0/3568824997 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0072f0 con 0x7f2d2c09cc20 2023-11-24T08:04:18.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c140580 con 0x7f2d2c09cc20 2023-11-24T08:04:18.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c15a630 con 0x7f2d2c09cc20 2023-11-24T08:04:18.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c067520 con 0x7f2d2c09cc20 2023-11-24T08:04:18.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d21ffb640 1 -- 172.21.15.57:0/3568824997 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d1c007450 con 0x7f2d2c09cc20 2023-11-24T08:04:18.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d21ffb640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d10066470 0x7f2d10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:18.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d21ffb640 1 -- 172.21.15.57:0/3568824997 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d1c083370 con 0x7f2d2c09cc20 2023-11-24T08:04:18.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.004+0000 7f2d310f3640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d10066470 0x7f2d10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:18.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.008+0000 7f2d310f3640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d10066470 0x7f2d10068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d280af000 tx=0x7f2d280a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:18.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.008+0000 7f2d21ffb640 1 -- 172.21.15.57:0/3568824997 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d1c050890 con 0x7f2d2c09cc20 2023-11-24T08:04:18.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d2c13a040 con 0x7f2d2c09cc20 2023-11-24T08:04:18.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d21ffb640 1 -- 172.21.15.57:0/3568824997 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d1c017060 con 0x7f2d2c09cc20 2023-11-24T08:04:18.202 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:18.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d10066470 msgr2=0x7f2d10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d10066470 0x7f2d10068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d280af000 tx=0x7f2d280a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c09cc20 msgr2=0x7f2d2c141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c09cc20 0x7f2d2c141060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c500 tx=0x7f2d1c00c9c0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 shutdown_connections 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d10066470 0x7f2d10068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d2c144030 0x7f2d2c1415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.200+0000 7f2d33357640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d2c09cc20 0x7f2d2c141060 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.204+0000 7f2d33357640 1 --2- 172.21.15.57:0/3568824997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d2c0709c0 0x7f2d2c09a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.204+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 >> 172.21.15.57:0/3568824997 conn(0x7f2d2c0b0bf0 msgr2=0x7f2d2c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.204+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 shutdown_connections 2023-11-24T08:04:18.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:18.204+0000 7f2d33357640 1 -- 172.21.15.57:0/3568824997 wait complete. 2023-11-24T08:04:18.222 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:18.222 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:18.223 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-24T08:04:18.223 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:04:18.223 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:18.223 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:18.223 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:18.223 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:18.224 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:04:18.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.224 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-24T08:04:18.234 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:18.234 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:18.234 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-24T08:04:18.235 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42359sec preferred_lft 42359sec 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 02:42:35:0c:2c:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:04:18.236 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:18.238 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:04:18.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.238 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:18.238 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:18.238 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:04:18.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2023-11-24T08:04:18.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2023-11-24T08:04:18.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:04:18.239 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:18.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.356 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:18.376 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-24T08:04:18.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.378 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-24T08:04:18.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:18.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:18.475 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:04:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:18.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.477 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:18.477 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:18.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:04:18.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:04:18.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:04:18.480 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:18.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.584 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:04:18.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.594 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-11-24T08:04:18.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.650 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:18.650 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:18.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:04:18.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T08:04:18.651 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:18.737 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T08:04:18.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.737 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:18.737 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:18.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T08:04:18.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:18.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T08:04:18.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T08:04:18.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T08:04:18.738 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:18.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:18.906 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:18.906 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:18.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-24T08:04:18.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:04:18.906 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:18.948 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:18.948 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:19.004 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:04:19.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:19.005 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:19.056 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T08:04:19.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:19.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:19.162 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:19.162 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:19.281 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:19.281 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:19.282 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:04:19.282 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with new device syntax: 1@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:04:19.282 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:04:19.285 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:19.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:19.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:04:19.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:19.306 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:19.378 INFO:teuthology.orchestra.run.smithi132.stdout:client54458 2023-11-24T08:04:19.379 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:19.379 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:19.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:19.429 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:19.484 INFO:teuthology.orchestra.run.smithi132.stdout:client54458 2023-11-24T08:04:19.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:19.485 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:19.540 INFO:teuthology.orchestra.run.smithi132.stdout:client54458 2023-11-24T08:04:19.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:19.541 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/445cea61-e72c-4da9-979a-02ade002d7d6.client54458/status') 2023-11-24T08:04:19.604 INFO:teuthology.orchestra.run.smithi132.stdout:instance: client.54458 (3)192.168.0.1:0/1167544404 2023-11-24T08:04:19.605 INFO:teuthology.orchestra.run.smithi132.stdout:blocklisted: false 2023-11-24T08:04:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2023-11-24T08:04:19.605 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2023-11-24T08:04:19.606 INFO:teuthology.orchestra.run.smithi132.stderr:70 bytes copied, 6.952e-05 s, 1.0 MB/s 2023-11-24T08:04:19.607 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-11-24T08:04:19.607 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:04:19.607 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:19.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:19.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.760+0000 7f540738d640 1 Processor -- start 2023-11-24T08:04:19.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.760+0000 7f540738d640 1 -- start start 2023-11-24T08:04:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540738d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54000b1ef0 0x7f5400164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540738d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540015a700 con 0x7f54000b36c0 2023-11-24T08:04:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540738d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54000b2620 con 0x7f540015a320 2023-11-24T08:04:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540738d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54000b2900 con 0x7f54000b1ef0 2023-11-24T08:04:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540592a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54000b1ef0 0x7f5400164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f5404928640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f54000b36c0 0x7f5400070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42940/0 (socket says 172.21.15.57:42940) 2023-11-24T08:04:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540592a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54000b1ef0 0x7f5400164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46918/0 (socket says 172.21.15.57:46918) 2023-11-24T08:04:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f5404928640 1 -- 172.21.15.57:0/1266140369 learned_addr learned my addr 172.21.15.57:0/1266140369 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540592a640 1 -- 172.21.15.57:0/1266140369 >> v1:172.21.15.132:6789/0 conn(0x7f540015a320 legacy=0x7f5400070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540592a640 1 -- 172.21.15.57:0/1266140369 >> v1:172.21.15.57:6789/0 conn(0x7f54000b36c0 legacy=0x7f5400070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540592a640 1 -- 172.21.15.57:0/1266140369 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000b2be0 con 0x7f54000b1ef0 2023-11-24T08:04:19.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f53f7fff640 1 -- 172.21.15.57:0/1266140369 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632076050 0 0) 0x7f540015a700 con 0x7f54000b36c0 2023-11-24T08:04:19.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.764+0000 7f540592a640 1 --2- 172.21.15.57:0/1266140369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54000b1ef0 0x7f5400164f50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009d90 tx=0x7f53f801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d24df9e2b18d9fe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f53f7fff640 1 -- 172.21.15.57:0/1266140369 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80a5a10 con 0x7f54000b1ef0 2023-11-24T08:04:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f53f7fff640 1 -- 172.21.15.57:0/1266140369 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f80a5b70 con 0x7f54000b1ef0 2023-11-24T08:04:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f53f7fff640 1 -- 172.21.15.57:0/1266140369 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80ad440 con 0x7f54000b1ef0 2023-11-24T08:04:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- 172.21.15.57:0/1266140369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54000b1ef0 msgr2=0x7f5400164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 --2- 172.21.15.57:0/1266140369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54000b1ef0 0x7f5400164f50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009d90 tx=0x7f53f801c950 comp rx=0 tx=0).stop 2023-11-24T08:04:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- 172.21.15.57:0/1266140369 shutdown_connections 2023-11-24T08:04:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 --2- 172.21.15.57:0/1266140369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54000b1ef0 0x7f5400164f50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- 172.21.15.57:0/1266140369 >> 172.21.15.57:0/1266140369 conn(0x7f54000b0bf0 msgr2=0x7f54000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- 172.21.15.57:0/1266140369 shutdown_connections 2023-11-24T08:04:19.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- 172.21.15.57:0/1266140369 wait complete. 2023-11-24T08:04:19.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 Processor -- start 2023-11-24T08:04:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- start start 2023-11-24T08:04:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54000b1ef0 0x7f54000cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000b36c0 0x7f540015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f540015a320 0x7f5400153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540015ac40 con 0x7f540015a320 2023-11-24T08:04:19.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5400154100 con 0x7f54000b36c0 2023-11-24T08:04:19.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540738d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540015ae70 con 0x7f54000b1ef0 2023-11-24T08:04:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540592a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f540015a320 0x7f5400153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540592a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f540015a320 0x7f5400153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46922/0 (socket says 172.21.15.57:46922) 2023-11-24T08:04:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f540592a640 1 -- 172.21.15.57:0/3520829660 learned_addr learned my addr 172.21.15.57:0/3520829660 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f5405129640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54000b1ef0 0x7f54000cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.768+0000 7f5404928640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000b36c0 0x7f540015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540592a640 1 -- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54000b1ef0 msgr2=0x7f54000cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540592a640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54000b1ef0 0x7f54000cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540592a640 1 -- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000b36c0 msgr2=0x7f540015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540592a640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000b36c0 0x7f540015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540592a640 1 -- 172.21.15.57:0/3520829660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8009a70 con 0x7f540015a320 2023-11-24T08:04:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f5405129640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54000b1ef0 0x7f54000cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540592a640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f540015a320 0x7f5400153bc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53f8019560 tx=0x7f53f80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f53f5ffb640 1 -- 172.21.15.57:0/3520829660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80ade20 con 0x7f540015a320 2023-11-24T08:04:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f53f5ffb640 1 -- 172.21.15.57:0/3520829660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f80b9450 con 0x7f540015a320 2023-11-24T08:04:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f53f5ffb640 1 -- 172.21.15.57:0/3520829660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80b9800 con 0x7f540015a320 2023-11-24T08:04:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540015b150 con 0x7f540015a320 2023-11-24T08:04:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540015b710 con 0x7f540015a320 2023-11-24T08:04:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5400067520 con 0x7f540015a320 2023-11-24T08:04:19.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f53f5ffb640 1 -- 172.21.15.57:0/3520829660 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53f80b9960 con 0x7f540015a320 2023-11-24T08:04:19.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.772+0000 7f53f5ffb640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53e4066470 0x7f53e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.776+0000 7f53f5ffb640 1 -- 172.21.15.57:0/3520829660 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53f811f610 con 0x7f540015a320 2023-11-24T08:04:19.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.776+0000 7f5405129640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53e4066470 0x7f53e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.776+0000 7f5405129640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53e4066470 0x7f53e4068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f540009ccf0 tx=0x7f53fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.780+0000 7f53f5ffb640 1 -- 172.21.15.57:0/3520829660 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53f80ecb40 con 0x7f540015a320 2023-11-24T08:04:19.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.968+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f540006b670 con 0x7f540015a320 2023-11-24T08:04:19.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.968+0000 7f53f5ffb640 1 -- 172.21.15.57:0/3520829660 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53f80f0160 con 0x7f540015a320 2023-11-24T08:04:19.971 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:19.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53e4066470 msgr2=0x7f53e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53e4066470 0x7f53e4068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f540009ccf0 tx=0x7f53fc009040 comp rx=0 tx=0).stop 2023-11-24T08:04:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f540015a320 msgr2=0x7f5400153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f540015a320 0x7f5400153bc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53f8019560 tx=0x7f53f80196f0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 shutdown_connections 2023-11-24T08:04:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53e4066470 0x7f53e4068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f540015a320 0x7f5400153bc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000b36c0 0x7f540015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 --2- 172.21.15.57:0/3520829660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54000b1ef0 0x7f54000cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 >> 172.21.15.57:0/3520829660 conn(0x7f54000b0bf0 msgr2=0x7f54000aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 shutdown_connections 2023-11-24T08:04:19.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:19.972+0000 7f540738d640 1 -- 172.21.15.57:0/3520829660 wait complete. 2023-11-24T08:04:19.994 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:04:19.994 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:19.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-24T08:04:19.995 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T08:04:19.995 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:19.995 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:04:19.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:04:19.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:19.995 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:04:19.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:19.996 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-24T08:04:20.007 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:20.007 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:20.007 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:20.007 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.007 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:20.007 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.007 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:20.008 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:20.008 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-24T08:04:20.008 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:20.008 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:20.008 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-24T08:04:20.008 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:20.008 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42357sec preferred_lft 42357sec 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:04:20.009 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 02:42:35:0c:2c:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-24T08:04:20.010 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.011 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:04:20.011 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:04:20.011 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-24T08:04:20.011 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.011 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:20.067 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-24T08:04:20.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.070 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-24T08:04:20.123 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-24T08:04:20.123 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:20.123 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T08:04:20.123 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:04:20.123 INFO:teuthology.orchestra.run.smithi132.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:04:20.123 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:04:20.123 INFO:teuthology.orchestra.run.smithi132.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:04:20.124 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:04:20.124 INFO:teuthology.orchestra.run.smithi132.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:04:20.124 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:20.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.124 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:20.124 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:20.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:04:20.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:04:20.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:04:20.125 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:20.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.220 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:04:20.230 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:04:20.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.231 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-11-24T08:04:20.281 INFO:teuthology.orchestra.run.smithi132.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T08:04:20.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.282 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:20.282 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:20.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:04:20.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T08:04:20.282 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:20.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:04:20.431 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:20.431 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:20.431 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:20.431 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.431 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:20.432 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.432 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:20.432 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether a6:6b:28:d8:5e:7a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:20.432 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:20.432 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.433 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a46b:28ff:fed8:5e7a/64 scope link 2023-11-24T08:04:20.433 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:04:20.497 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:20.497 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:20.497 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:20.497 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.497 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:20.497 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.498 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:20.498 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether a6:6b:28:d8:5e:7a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:04:20.498 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:04:20.498 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.498 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::a46b:28ff:fed8:5e7a/64 scope link 2023-11-24T08:04:20.498 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:20.499 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T08:04:20.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T08:04:20.500 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:20.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.643 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:04:20.643 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:04:20.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.1 up 2023-11-24T08:04:20.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:04:20.643 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:04:20.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:20.683 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:04:20.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:20.737 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:20.788 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-11-24T08:04:20.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:20.881 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:20.881 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:20.895 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:20.895 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:20.895 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:04:20.895 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with new device syntax: 3@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:04:20.896 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:04:20.900 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:20.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:04:20.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:20.921 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:20.975 INFO:teuthology.orchestra.run.smithi132.stdout:client4660 2023-11-24T08:04:20.976 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:20.976 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:21.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:21.025 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:21.079 INFO:teuthology.orchestra.run.smithi132.stdout:client4660 2023-11-24T08:04:21.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:21.080 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:21.131 INFO:teuthology.orchestra.run.smithi132.stdout:client4660 2023-11-24T08:04:21.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:21.131 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/445cea61-e72c-4da9-979a-02ade002d7d6.client4660/status') 2023-11-24T08:04:21.192 INFO:teuthology.orchestra.run.smithi132.stdout:instance: client.4660 (3)192.168.0.2:0/1773617262 2023-11-24T08:04:21.192 INFO:teuthology.orchestra.run.smithi132.stdout:blocklisted: false 2023-11-24T08:04:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2023-11-24T08:04:21.193 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2023-11-24T08:04:21.193 INFO:teuthology.orchestra.run.smithi132.stderr:69 bytes copied, 5.3129e-05 s, 1.3 MB/s 2023-11-24T08:04:21.194 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T08:04:21.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:21.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.364+0000 7fd83069a640 1 Processor -- start 2023-11-24T08:04:21.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.364+0000 7fd83069a640 1 -- start start 2023-11-24T08:04:21.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.364+0000 7fd83069a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd82815a320 0x7fd8280b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.364+0000 7fd83069a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd828070da0 0x7fd82815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.364+0000 7fd83069a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82815a700 con 0x7fd8280b36c0 2023-11-24T08:04:21.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.364+0000 7fd83069a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8280b2430 con 0x7fd828070da0 2023-11-24T08:04:21.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.364+0000 7fd83069a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280b2620 con 0x7fd82815a320 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd828070da0 0x7fd82815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd828070da0 0x7fd82815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46924/0 (socket says 172.21.15.57:46924) 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 -- 172.21.15.57:0/3972873351 learned_addr learned my addr 172.21.15.57:0/3972873351 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82e436640 1 --2- 172.21.15.57:0/3972873351 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd82815a320 0x7fd8280b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 -- 172.21.15.57:0/3972873351 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd82815a320 msgr2=0x7fd8280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 --2- 172.21.15.57:0/3972873351 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd82815a320 0x7fd8280b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 -- 172.21.15.57:0/3972873351 >> v1:172.21.15.132:6789/0 conn(0x7fd8280b36c0 legacy=0x7fd828070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 -- 172.21.15.57:0/3972873351 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280b2900 con 0x7fd828070da0 2023-11-24T08:04:21.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82ec37640 1 --2- 172.21.15.57:0/3972873351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd828070da0 0x7fd82815ddd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd820009e50 tx=0x7fd82001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df9ced1df0d9be1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82d434640 1 -- 172.21.15.57:0/3972873351 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200a58d0 con 0x7fd828070da0 2023-11-24T08:04:21.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82d434640 1 -- 172.21.15.57:0/3972873351 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8200a5a30 con 0x7fd828070da0 2023-11-24T08:04:21.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.368+0000 7fd82d434640 1 -- 172.21.15.57:0/3972873351 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200a5dc0 con 0x7fd828070da0 2023-11-24T08:04:21.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- 172.21.15.57:0/3972873351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd828070da0 msgr2=0x7fd82815ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 --2- 172.21.15.57:0/3972873351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd828070da0 0x7fd82815ddd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd820009e50 tx=0x7fd82001c9e0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- 172.21.15.57:0/3972873351 shutdown_connections 2023-11-24T08:04:21.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 --2- 172.21.15.57:0/3972873351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd828070da0 0x7fd82815ddd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 --2- 172.21.15.57:0/3972873351 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd82815a320 0x7fd8280b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- 172.21.15.57:0/3972873351 >> 172.21.15.57:0/3972873351 conn(0x7fd8280b0bf0 msgr2=0x7fd8280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- 172.21.15.57:0/3972873351 shutdown_connections 2023-11-24T08:04:21.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- 172.21.15.57:0/3972873351 wait complete. 2023-11-24T08:04:21.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 Processor -- start 2023-11-24T08:04:21.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- start start 2023-11-24T08:04:21.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828070da0 0x7fd8281f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8280b36c0 0x7fd8281f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd82815a320 0x7fd828156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82809b270 con 0x7fd82815a320 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828163fa0 con 0x7fd828070da0 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd83069a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281f6f10 con 0x7fd8280b36c0 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd82ec37640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd82815a320 0x7fd828156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd82ec37640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd82815a320 0x7fd828156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46934/0 (socket says 172.21.15.57:46934) 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd82ec37640 1 -- 172.21.15.57:0/2741094307 learned_addr learned my addr 172.21.15.57:0/2741094307 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd82dc35640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8280b36c0 0x7fd8281f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.372+0000 7fd82e436640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828070da0 0x7fd8281f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd82ec37640 1 -- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8280b36c0 msgr2=0x7fd8281f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd82ec37640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8280b36c0 0x7fd8281f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd82ec37640 1 -- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828070da0 msgr2=0x7fd8281f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd82ec37640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828070da0 0x7fd8281f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd82ec37640 1 -- 172.21.15.57:0/2741094307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009b30 con 0x7fd82815a320 2023-11-24T08:04:21.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd82dc35640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8280b36c0 0x7fd8281f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:21.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd82ec37640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd82815a320 0x7fd828156230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8200af040 tx=0x7fd820019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd81effd640 1 -- 172.21.15.57:0/2741094307 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200b8670 con 0x7fd82815a320 2023-11-24T08:04:21.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd81effd640 1 -- 172.21.15.57:0/2741094307 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8200b87d0 con 0x7fd82815a320 2023-11-24T08:04:21.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd81effd640 1 -- 172.21.15.57:0/2741094307 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200b8b80 con 0x7fd82815a320 2023-11-24T08:04:21.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82815be80 con 0x7fd82815a320 2023-11-24T08:04:21.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82815c440 con 0x7fd82815a320 2023-11-24T08:04:21.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82809b3e0 con 0x7fd82815a320 2023-11-24T08:04:21.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd81effd640 1 -- 172.21.15.57:0/2741094307 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8200b8ce0 con 0x7fd82815a320 2023-11-24T08:04:21.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.376+0000 7fd81effd640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd80c066470 0x7fd80c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.380+0000 7fd81effd640 1 -- 172.21.15.57:0/2741094307 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd82011f410 con 0x7fd82815a320 2023-11-24T08:04:21.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.380+0000 7fd82e436640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd80c066470 0x7fd80c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.380+0000 7fd82e436640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd80c066470 0x7fd80c068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd8240079c0 tx=0x7fd824008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.384+0000 7fd81effd640 1 -- 172.21.15.57:0/2741094307 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8200ec880 con 0x7fd82815a320 2023-11-24T08:04:21.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.544+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd828067520 con 0x7fd82815a320 2023-11-24T08:04:21.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.544+0000 7fd81effd640 1 -- 172.21.15.57:0/2741094307 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fd8200efea0 con 0x7fd82815a320 2023-11-24T08:04:21.546 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:21.547 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:21.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd80c066470 msgr2=0x7fd80c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd80c066470 0x7fd80c068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd8240079c0 tx=0x7fd824008040 comp rx=0 tx=0).stop 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd82815a320 msgr2=0x7fd828156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd82815a320 0x7fd828156230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8200af040 tx=0x7fd820019780 comp rx=0 tx=0).stop 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 shutdown_connections 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd80c066470 0x7fd80c068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd82815a320 0x7fd828156230 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8280b36c0 0x7fd8281f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 --2- 172.21.15.57:0/2741094307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd828070da0 0x7fd8281f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 >> 172.21.15.57:0/2741094307 conn(0x7fd8280b0bf0 msgr2=0x7fd8280b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 shutdown_connections 2023-11-24T08:04:21.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.548+0000 7fd83069a640 1 -- 172.21.15.57:0/2741094307 wait complete. 2023-11-24T08:04:21.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:21.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:21.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.712+0000 7f1e7ab32640 1 Processor -- start 2023-11-24T08:04:21.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.712+0000 7f1e7ab32640 1 -- start start 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7ab32640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e74160970 0x7f1e740d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7ab32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e740cdc60 0x7f1e740d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7ab32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e740d1c10 0x7f1e740b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7ab32640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e740d2060 con 0x7f1e74160970 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7ab32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e740cf0a0 con 0x7f1e740d1c10 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7ab32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740ce490 con 0x7f1e740cdc60 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e74160970 0x7f1e740d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e74160970 0x7f1e740d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46940/0 (socket says 172.21.15.57:46940) 2023-11-24T08:04:21.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 -- 172.21.15.57:0/3168107054 learned_addr learned my addr 172.21.15.57:0/3168107054 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7a331640 1 --2- 172.21.15.57:0/3168107054 >> v2:172.21.15.132:3300/0 conn(0x7f1e740d1c10 0x7f1e740b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 -- 172.21.15.57:0/3168107054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e740cdc60 msgr2=0x7f1e740d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7932f640 1 --2- 172.21.15.57:0/3168107054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e740cdc60 0x7f1e740d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 --2- 172.21.15.57:0/3168107054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e740cdc60 0x7f1e740d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 -- 172.21.15.57:0/3168107054 >> v2:172.21.15.132:3300/0 conn(0x7f1e740d1c10 msgr2=0x7f1e740b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 --2- 172.21.15.57:0/3168107054 >> v2:172.21.15.132:3300/0 conn(0x7f1e740d1c10 0x7f1e740b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 -- 172.21.15.57:0/3168107054 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740ce770 con 0x7f1e74160970 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7a331640 1 --2- 172.21.15.57:0/3168107054 >> v2:172.21.15.132:3300/0 conn(0x7f1e740d1c10 0x7f1e740b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:21.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e7932f640 1 --2- 172.21.15.57:0/3168107054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e740cdc60 0x7f1e740d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:21.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.716+0000 7f1e79b30640 1 --2- 172.21.15.57:0/3168107054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e74160970 0x7f1e740d3d20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e74061db0 tx=0x7f1e7001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e9d7ed5f17ffd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e78b2e640 1 -- 172.21.15.57:0/3168107054 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700ab600 con 0x7f1e74160970 2023-11-24T08:04:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e78b2e640 1 -- 172.21.15.57:0/3168107054 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e700a7050 con 0x7f1e74160970 2023-11-24T08:04:21.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e78b2e640 1 -- 172.21.15.57:0/3168107054 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700ab980 con 0x7f1e74160970 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- 172.21.15.57:0/3168107054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e74160970 msgr2=0x7f1e740d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/3168107054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e74160970 0x7f1e740d3d20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e74061db0 tx=0x7f1e7001c210 comp rx=0 tx=0).stop 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- 172.21.15.57:0/3168107054 shutdown_connections 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/3168107054 >> v2:172.21.15.132:3300/0 conn(0x7f1e740d1c10 0x7f1e740b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/3168107054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e740cdc60 0x7f1e740d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/3168107054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e74160970 0x7f1e740d3d20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- 172.21.15.57:0/3168107054 >> 172.21.15.57:0/3168107054 conn(0x7f1e7409c5c0 msgr2=0x7f1e740d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- 172.21.15.57:0/3168107054 shutdown_connections 2023-11-24T08:04:21.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- 172.21.15.57:0/3168107054 wait complete. 2023-11-24T08:04:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 Processor -- start 2023-11-24T08:04:21.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- start start 2023-11-24T08:04:21.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e740cdc60 0x7f1e7414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e740d1c10 0x7f1e740c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e74160970 0x7f1e740b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741583c0 con 0x7f1e740d1c10 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740c8130 con 0x7f1e740cdc60 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7ab32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740c8410 con 0x7f1e74160970 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7932f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e740d1c10 0x7f1e740c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7932f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e740d1c10 0x7f1e740c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46946/0 (socket says 172.21.15.57:46946) 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7932f640 1 -- 172.21.15.57:0/2171943737 learned_addr learned my addr 172.21.15.57:0/2171943737 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e79b30640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e740cdc60 0x7f1e7414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.720+0000 7f1e7a331640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e74160970 0x7f1e740b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7932f640 1 -- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e74160970 msgr2=0x7f1e740b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7932f640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e74160970 0x7f1e740b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7932f640 1 -- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e740cdc60 msgr2=0x7f1e7414fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7932f640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e740cdc60 0x7f1e7414fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7932f640 1 -- 172.21.15.57:0/2171943737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e700094d0 con 0x7f1e740d1c10 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e79b30640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e740cdc60 0x7f1e7414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7932f640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e740d1c10 0x7f1e740c77c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400c7c0 tx=0x7f1e6400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e6a7fc640 1 -- 172.21.15.57:0/2171943737 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64007a30 con 0x7f1e740d1c10 2023-11-24T08:04:21.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e6a7fc640 1 -- 172.21.15.57:0/2171943737 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64007b90 con 0x7f1e740d1c10 2023-11-24T08:04:21.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e6a7fc640 1 -- 172.21.15.57:0/2171943737 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400ce70 con 0x7f1e740d1c10 2023-11-24T08:04:21.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e74158050 con 0x7f1e740d1c10 2023-11-24T08:04:21.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e74150380 con 0x7f1e740d1c10 2023-11-24T08:04:21.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74157eb0 con 0x7f1e740d1c10 2023-11-24T08:04:21.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e6a7fc640 1 -- 172.21.15.57:0/2171943737 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e640113f0 con 0x7f1e740d1c10 2023-11-24T08:04:21.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e6a7fc640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e58066470 0x7f1e58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:21.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.724+0000 7f1e6a7fc640 1 -- 172.21.15.57:0/2171943737 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e64083f30 con 0x7f1e740d1c10 2023-11-24T08:04:21.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.728+0000 7f1e79b30640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e58066470 0x7f1e58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:21.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.728+0000 7f1e79b30640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e58066470 0x7f1e58068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e700ad000 tx=0x7f1e70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:21.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.728+0000 7f1e6a7fc640 1 -- 172.21.15.57:0/2171943737 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e74157eb0 con 0x7f1e740d1c10 2023-11-24T08:04:21.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e740cf510 con 0x7f1e740d1c10 2023-11-24T08:04:21.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e6a7fc640 1 -- 172.21.15.57:0/2171943737 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e740cf510 con 0x7f1e740d1c10 2023-11-24T08:04:21.890 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e58066470 msgr2=0x7f1e58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e58066470 0x7f1e58068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e700ad000 tx=0x7f1e70008040 comp rx=0 tx=0).stop 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e740d1c10 msgr2=0x7f1e740c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e740d1c10 0x7f1e740c77c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400c7c0 tx=0x7f1e6400cc80 comp rx=0 tx=0).stop 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 shutdown_connections 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e58066470 0x7f1e58068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1e74160970 0x7f1e740b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e740d1c10 0x7f1e740c77c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 --2- 172.21.15.57:0/2171943737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e740cdc60 0x7f1e7414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 >> 172.21.15.57:0/2171943737 conn(0x7f1e7409c5c0 msgr2=0x7f1e74159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 shutdown_connections 2023-11-24T08:04:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:21.888+0000 7f1e7ab32640 1 -- 172.21.15.57:0/2171943737 wait complete. 2023-11-24T08:04:21.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:22.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 Processor -- start 2023-11-24T08:04:22.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 -- start start 2023-11-24T08:04:22.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ae415ec60 0x7f3ae40cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ae40cc6b0 0x7f3ae40b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae4071170 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae40cb690 con 0x7f3ae415ec60 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aec679640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40cb970 con 0x7f3ae415a290 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ae40cc6b0 0x7f3ae40b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ae40cc6b0 0x7f3ae40b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46952/0 (socket says 172.21.15.57:46952) 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 -- 172.21.15.57:0/145316410 learned_addr learned my addr 172.21.15.57:0/145316410 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3ae9c14640 1 --2- 172.21.15.57:0/145316410 >> v2:172.21.15.132:3300/0 conn(0x7f3ae415ec60 0x7f3ae40cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aea415640 1 --2- 172.21.15.57:0/145316410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 -- 172.21.15.57:0/145316410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 msgr2=0x7f3ae40707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 --2- 172.21.15.57:0/145316410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae40707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 -- 172.21.15.57:0/145316410 >> v2:172.21.15.132:3300/0 conn(0x7f3ae415ec60 msgr2=0x7f3ae40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 --2- 172.21.15.57:0/145316410 >> v2:172.21.15.132:3300/0 conn(0x7f3ae415ec60 0x7f3ae40cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.056+0000 7f3aeac16640 1 -- 172.21.15.57:0/145316410 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae40cbc50 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aeac16640 1 --2- 172.21.15.57:0/145316410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40b1f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ae406f9f0 tx=0x7f3adc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7a2ad5c93fba00 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3ae9413640 1 -- 172.21.15.57:0/145316410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0a56d0 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3ae9413640 1 -- 172.21.15.57:0/145316410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc0a5830 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3ae9413640 1 -- 172.21.15.57:0/145316410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0a5bc0 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 -- 172.21.15.57:0/145316410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 msgr2=0x7f3ae40b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 --2- 172.21.15.57:0/145316410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40b1f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ae406f9f0 tx=0x7f3adc01c940 comp rx=0 tx=0).stop 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 -- 172.21.15.57:0/145316410 shutdown_connections 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 --2- 172.21.15.57:0/145316410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40b1f80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 --2- 172.21.15.57:0/145316410 >> v2:172.21.15.132:3300/0 conn(0x7f3ae415ec60 0x7f3ae40cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 --2- 172.21.15.57:0/145316410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae40707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 -- 172.21.15.57:0/145316410 >> 172.21.15.57:0/145316410 conn(0x7f3ae40b0c80 msgr2=0x7f3ae40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 -- 172.21.15.57:0/145316410 shutdown_connections 2023-11-24T08:04:22.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.060+0000 7f3aec679640 1 -- 172.21.15.57:0/145316410 wait complete. 2023-11-24T08:04:22.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 Processor -- start 2023-11-24T08:04:22.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 -- start start 2023-11-24T08:04:22.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae415ec60 0x7f3ae415d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae415aa30 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae413c880 con 0x7f3ae415ec60 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae413cb60 con 0x7f3ae415a290 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46962/0 (socket says 172.21.15.57:46962) 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 -- 172.21.15.57:0/4290302208 learned_addr learned my addr 172.21.15.57:0/4290302208 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aeac16640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae415ec60 0x7f3ae415d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3ae9c14640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 -- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 msgr2=0x7f3ae415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 -- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae415ec60 msgr2=0x7f3ae415d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae415ec60 0x7f3ae415d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 -- 172.21.15.57:0/4290302208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc009b30 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aea415640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40ac1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000d800 tx=0x7f3ae000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3adaffd640 1 -- 172.21.15.57:0/4290302208 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00096a0 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3adaffd640 1 -- 172.21.15.57:0/4290302208 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae0009800 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3adaffd640 1 -- 172.21.15.57:0/4290302208 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0009b70 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae4070f40 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae413d120 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.064+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae413d770 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.068+0000 7f3adaffd640 1 -- 172.21.15.57:0/4290302208 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ae0009cd0 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.068+0000 7f3adaffd640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.068+0000 7f3adaffd640 1 -- 172.21.15.57:0/4290302208 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ae0084490 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.068+0000 7f3ae9c14640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.068+0000 7f3ae9c14640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ac8066470 0x7f3ac8068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4071f00 tx=0x7f3ad4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.072+0000 7f3adaffd640 1 -- 172.21.15.57:0/4290302208 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ae00519b0 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.228+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ae404e8c0 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.228+0000 7f3adaffd640 1 -- 172.21.15.57:0/4290302208 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ae0054fd0 con 0x7f3ae40cc6b0 2023-11-24T08:04:22.231 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:22.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ac8066470 msgr2=0x7f3ac8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ac8066470 0x7f3ac8068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4071f00 tx=0x7f3ad4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:22.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 msgr2=0x7f3ae40ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40ac1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000d800 tx=0x7f3ae000dcc0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 shutdown_connections 2023-11-24T08:04:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae415ec60 0x7f3ae415d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ae415a290 0x7f3ae415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 --2- 172.21.15.57:0/4290302208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ae40cc6b0 0x7f3ae40ac1c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 >> 172.21.15.57:0/4290302208 conn(0x7f3ae40b0c80 msgr2=0x7f3ae40af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 shutdown_connections 2023-11-24T08:04:22.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.232+0000 7f3aec679640 1 -- 172.21.15.57:0/4290302208 wait complete. 2023-11-24T08:04:22.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:22.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd090b01640 1 Processor -- start 2023-11-24T08:04:22.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd090b01640 1 -- start start 2023-11-24T08:04:22.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd090b01640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd08c0d39b0 0x7fd08c06bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd090b01640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd08c0b2100 0x7fd08c06c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd090b01640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0b0090 con 0x7fd08c15d7f0 2023-11-24T08:04:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd090b01640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c06b980 con 0x7fd08c0b2100 2023-11-24T08:04:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd090b01640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0b0330 con 0x7fd08c0d39b0 2023-11-24T08:04:22.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd08ad9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd08c0b2100 0x7fd08c06c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd08ad9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd08c0b2100 0x7fd08c06c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46974/0 (socket says 172.21.15.57:46974) 2023-11-24T08:04:22.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.396+0000 7fd08ad9d640 1 -- 172.21.15.57:0/3183601845 learned_addr learned my addr 172.21.15.57:0/3183601845 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:22.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd083fff640 1 --2- 172.21.15.57:0/3183601845 >> v2:172.21.15.132:3300/0 conn(0x7fd08c0d39b0 0x7fd08c06bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd08ad9d640 1 -- 172.21.15.57:0/3183601845 >> v2:172.21.15.132:3300/0 conn(0x7fd08c0d39b0 msgr2=0x7fd08c06bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd08ad9d640 1 --2- 172.21.15.57:0/3183601845 >> v2:172.21.15.132:3300/0 conn(0x7fd08c0d39b0 0x7fd08c06bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd08ad9d640 1 -- 172.21.15.57:0/3183601845 >> v1:172.21.15.132:6789/0 conn(0x7fd08c15d7f0 legacy=0x7fd08c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd08ad9d640 1 -- 172.21.15.57:0/3183601845 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0b0610 con 0x7fd08c0b2100 2023-11-24T08:04:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd08ad9d640 1 --2- 172.21.15.57:0/3183601845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c06c210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd08c08bf80 tx=0x7fd08401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb082767dc8a86c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd089d9b640 1 -- 172.21.15.57:0/3183601845 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840a5780 con 0x7fd08c0b2100 2023-11-24T08:04:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd089d9b640 1 -- 172.21.15.57:0/3183601845 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0840a58e0 con 0x7fd08c0b2100 2023-11-24T08:04:22.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd089d9b640 1 -- 172.21.15.57:0/3183601845 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840a5c70 con 0x7fd08c0b2100 2023-11-24T08:04:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd090b01640 1 -- 172.21.15.57:0/3183601845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 msgr2=0x7fd08c06c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.400+0000 7fd090b01640 1 --2- 172.21.15.57:0/3183601845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c06c210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd08c08bf80 tx=0x7fd08401c9d0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- 172.21.15.57:0/3183601845 shutdown_connections 2023-11-24T08:04:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 --2- 172.21.15.57:0/3183601845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c06c210 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 --2- 172.21.15.57:0/3183601845 >> v2:172.21.15.132:3300/0 conn(0x7fd08c0d39b0 0x7fd08c06bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- 172.21.15.57:0/3183601845 >> 172.21.15.57:0/3183601845 conn(0x7fd08c09c790 msgr2=0x7fd08c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- 172.21.15.57:0/3183601845 shutdown_connections 2023-11-24T08:04:22.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- 172.21.15.57:0/3183601845 wait complete. 2023-11-24T08:04:22.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 Processor -- start 2023-11-24T08:04:22.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- start start 2023-11-24T08:04:22.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd08c0d39b0 0x7fd08c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd08c15d7f0 0x7fd08c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0cb5e0 con 0x7fd08c0b2100 2023-11-24T08:04:22.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0cb8c0 con 0x7fd08c15d7f0 2023-11-24T08:04:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd090b01640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0cbba0 con 0x7fd08c0d39b0 2023-11-24T08:04:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46976/0 (socket says 172.21.15.57:46976) 2023-11-24T08:04:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 -- 172.21.15.57:0/1684339144 learned_addr learned my addr 172.21.15.57:0/1684339144 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd083fff640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd08c0d39b0 0x7fd08c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 -- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd08c0d39b0 msgr2=0x7fd08c14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd08c0d39b0 0x7fd08c14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08ad9d640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd08c15d7f0 0x7fd08c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 -- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd08c15d7f0 msgr2=0x7fd08c155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd08c15d7f0 0x7fd08c155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08a59c640 1 -- 172.21.15.57:0/1684339144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084009b30 con 0x7fd08c0b2100 2023-11-24T08:04:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd083fff640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd08c0d39b0 0x7fd08c14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.404+0000 7fd08ad9d640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd08c15d7f0 0x7fd08c155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd08a59c640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c155300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00c3c0 tx=0x7fd07c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd082ffd640 1 -- 172.21.15.57:0/1684339144 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0052d0 con 0x7fd08c0b2100 2023-11-24T08:04:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd082ffd640 1 -- 172.21.15.57:0/1684339144 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c005430 con 0x7fd08c0b2100 2023-11-24T08:04:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c0cbe80 con 0x7fd08c0b2100 2023-11-24T08:04:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd082ffd640 1 -- 172.21.15.57:0/1684339144 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c003840 con 0x7fd08c0b2100 2023-11-24T08:04:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c0cb2d0 con 0x7fd08c0b2100 2023-11-24T08:04:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c04e8c0 con 0x7fd08c0b2100 2023-11-24T08:04:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd082ffd640 1 -- 172.21.15.57:0/1684339144 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd07c0039a0 con 0x7fd08c0b2100 2023-11-24T08:04:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd082ffd640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd06c066470 0x7fd06c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd082ffd640 1 -- 172.21.15.57:0/1684339144 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd07c0833b0 con 0x7fd08c0b2100 2023-11-24T08:04:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.408+0000 7fd083fff640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd06c066470 0x7fd06c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.412+0000 7fd083fff640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd06c066470 0x7fd06c068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd08c155840 tx=0x7fd074008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.412+0000 7fd082ffd640 1 -- 172.21.15.57:0/1684339144 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd07c050820 con 0x7fd08c0b2100 2023-11-24T08:04:22.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd08c151420 con 0x7fd08c0b2100 2023-11-24T08:04:22.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd082ffd640 1 -- 172.21.15.57:0/1684339144 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd07c053e40 con 0x7fd08c0b2100 2023-11-24T08:04:22.573 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd06c066470 msgr2=0x7fd06c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd06c066470 0x7fd06c068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd08c155840 tx=0x7fd074008040 comp rx=0 tx=0).stop 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 msgr2=0x7fd08c155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c155300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00c3c0 tx=0x7fd07c00c880 comp rx=0 tx=0).stop 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 shutdown_connections 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd06c066470 0x7fd06c068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd08c15d7f0 0x7fd08c155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd08c0d39b0 0x7fd08c14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 --2- 172.21.15.57:0/1684339144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd08c0b2100 0x7fd08c155300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 >> 172.21.15.57:0/1684339144 conn(0x7fd08c09c790 msgr2=0x7fd08c159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 shutdown_connections 2023-11-24T08:04:22.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.572+0000 7fd090b01640 1 -- 172.21.15.57:0/1684339144 wait complete. 2023-11-24T08:04:22.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:22.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.736+0000 7f2ff3a9a640 1 Processor -- start 2023-11-24T08:04:22.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff3a9a640 1 -- start start 2023-11-24T08:04:22.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff3a9a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2fec15a320 0x7f2fec0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff3a9a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fec0b36c0 0x7f2fec070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff3a9a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec15a700 con 0x7f2fec070bd0 2023-11-24T08:04:22.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff3a9a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0b2430 con 0x7f2fec0b36c0 2023-11-24T08:04:22.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff3a9a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0b2620 con 0x7f2fec15a320 2023-11-24T08:04:22.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff1035640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fec0b36c0 0x7f2fec070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff2037640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2fec070bd0 0x7f2fec071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42948/0 (socket says 172.21.15.57:42948) 2023-11-24T08:04:22.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff2037640 1 -- 172.21.15.57:0/1944768245 learned_addr learned my addr 172.21.15.57:0/1944768245 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:22.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff1836640 1 --2- 172.21.15.57:0/1944768245 >> v2:172.21.15.132:3300/0 conn(0x7f2fec15a320 0x7f2fec0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff1035640 1 -- 172.21.15.57:0/1944768245 >> v2:172.21.15.132:3300/0 conn(0x7f2fec15a320 msgr2=0x7f2fec0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:22.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff1035640 1 --2- 172.21.15.57:0/1944768245 >> v2:172.21.15.132:3300/0 conn(0x7f2fec15a320 0x7f2fec0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff1035640 1 -- 172.21.15.57:0/1944768245 >> v1:172.21.15.57:6789/0 conn(0x7f2fec070bd0 legacy=0x7f2fec071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff0834640 1 -- 172.21.15.57:0/1944768245 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182050606 0 0) 0x7f2fec15a700 con 0x7f2fec070bd0 2023-11-24T08:04:22.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.740+0000 7f2ff1035640 1 -- 172.21.15.57:0/1944768245 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0b2900 con 0x7f2fec0b36c0 2023-11-24T08:04:22.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff1035640 1 --2- 172.21.15.57:0/1944768245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec0b36c0 0x7f2fec070690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2fec06c0c0 tx=0x7f2fdc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75bf2804daf480a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff0834640 1 -- 172.21.15.57:0/1944768245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0a7070 con 0x7f2fec0b36c0 2023-11-24T08:04:22.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff0834640 1 -- 172.21.15.57:0/1944768245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0ab430 con 0x7f2fec0b36c0 2023-11-24T08:04:22.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff0834640 1 -- 172.21.15.57:0/1944768245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0ab7c0 con 0x7f2fec0b36c0 2023-11-24T08:04:22.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1944768245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec0b36c0 msgr2=0x7f2fec070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1944768245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec0b36c0 0x7f2fec070690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2fec06c0c0 tx=0x7f2fdc01c430 comp rx=0 tx=0).stop 2023-11-24T08:04:22.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1944768245 shutdown_connections 2023-11-24T08:04:22.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1944768245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec0b36c0 0x7f2fec070690 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1944768245 >> v2:172.21.15.132:3300/0 conn(0x7f2fec15a320 0x7f2fec0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1944768245 >> 172.21.15.57:0/1944768245 conn(0x7f2fec0b0bf0 msgr2=0x7f2fec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1944768245 shutdown_connections 2023-11-24T08:04:22.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1944768245 wait complete. 2023-11-24T08:04:22.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 Processor -- start 2023-11-24T08:04:22.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.744+0000 7f2ff3a9a640 1 -- start start 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec070bd0 0x7f2fec14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fec0b36c0 0x7f2fec149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fec15a320 0x7f2fec14a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec14e600 con 0x7f2fec070bd0 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec14dff0 con 0x7f2fec0b36c0 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0afbf0 con 0x7f2fec15a320 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec070bd0 0x7f2fec14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec070bd0 0x7f2fec14c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46992/0 (socket says 172.21.15.57:46992) 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 -- 172.21.15.57:0/1770090003 learned_addr learned my addr 172.21.15.57:0/1770090003 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff2037640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fec15a320 0x7f2fec14a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1035640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fec0b36c0 0x7f2fec149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 -- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fec15a320 msgr2=0x7f2fec14a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fec15a320 0x7f2fec14a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 -- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fec0b36c0 msgr2=0x7f2fec149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fec0b36c0 0x7f2fec149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 -- 172.21.15.57:0/1770090003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc009420 con 0x7f2fec070bd0 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1035640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fec0b36c0 0x7f2fec149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff1836640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec070bd0 0x7f2fec14c800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800e870 tx=0x7f2fe800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2fe27fc640 1 -- 172.21.15.57:0/1770090003 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8009510 con 0x7f2fec070bd0 2023-11-24T08:04:22.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2fe27fc640 1 -- 172.21.15.57:0/1770090003 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe800eec0 con 0x7f2fec070bd0 2023-11-24T08:04:22.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2fe27fc640 1 -- 172.21.15.57:0/1770090003 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800cb40 con 0x7f2fec070bd0 2023-11-24T08:04:22.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec14fd10 con 0x7f2fec070bd0 2023-11-24T08:04:22.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec14a080 con 0x7f2fec070bd0 2023-11-24T08:04:22.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec067520 con 0x7f2fec070bd0 2023-11-24T08:04:22.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.748+0000 7f2fe27fc640 1 -- 172.21.15.57:0/1770090003 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fe800cca0 con 0x7f2fec070bd0 2023-11-24T08:04:22.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.752+0000 7f2fe27fc640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2fd00664a0 0x7f2fd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:22.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.752+0000 7f2fe27fc640 1 -- 172.21.15.57:0/1770090003 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fe8083f60 con 0x7f2fec070bd0 2023-11-24T08:04:22.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.752+0000 7f2ff1035640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2fd00664a0 0x7f2fd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:22.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.752+0000 7f2ff1035640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2fd00664a0 0x7f2fd0068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0af000 tx=0x7f2fdc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:22.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.756+0000 7f2fe27fc640 1 -- 172.21.15.57:0/1770090003 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fe80513d0 con 0x7f2fec070bd0 2023-11-24T08:04:22.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.912+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fec1649f0 con 0x7f2fec070bd0 2023-11-24T08:04:22.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2fe27fc640 1 -- 172.21.15.57:0/1770090003 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f2fe80549f0 con 0x7f2fec070bd0 2023-11-24T08:04:22.916 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:22.916 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2fd00664a0 msgr2=0x7f2fd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2fd00664a0 0x7f2fd0068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0af000 tx=0x7f2fdc0a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec070bd0 msgr2=0x7f2fec14c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:22.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec070bd0 0x7f2fec14c800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800e870 tx=0x7f2fe800ec70 comp rx=0 tx=0).stop 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 shutdown_connections 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2fd00664a0 0x7f2fd0068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fec15a320 0x7f2fec14a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fec0b36c0 0x7f2fec149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 --2- 172.21.15.57:0/1770090003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fec070bd0 0x7f2fec14c800 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 >> 172.21.15.57:0/1770090003 conn(0x7f2fec0b0bf0 msgr2=0x7f2fec0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 shutdown_connections 2023-11-24T08:04:22.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:22.916+0000 7f2ff3a9a640 1 -- 172.21.15.57:0/1770090003 wait complete. 2023-11-24T08:04:22.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:22.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 Processor -- start 2023-11-24T08:04:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 -- start start 2023-11-24T08:04:23.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbb781624f0 0x7fbb781628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb780ccef0 0x7fbb78071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780cd380 0x7fbb780cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb78072980 con 0x7fbb781624f0 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb780723c0 con 0x7fbb780ccef0 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb801df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780726a0 con 0x7fbb780cd380 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbb781624f0 0x7fbb781628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbb781624f0 0x7fbb781628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46994/0 (socket says 172.21.15.57:46994) 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 -- 172.21.15.57:0/70498196 learned_addr learned my addr 172.21.15.57:0/70498196 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7e77c640 1 --2- 172.21.15.57:0/70498196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780cd380 0x7fbb780cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7d77a640 1 --2- 172.21.15.57:0/70498196 >> v2:172.21.15.132:3300/0 conn(0x7fbb780ccef0 0x7fbb78071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 -- 172.21.15.57:0/70498196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780cd380 msgr2=0x7fbb780cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 --2- 172.21.15.57:0/70498196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780cd380 0x7fbb780cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 -- 172.21.15.57:0/70498196 >> v2:172.21.15.132:3300/0 conn(0x7fbb780ccef0 msgr2=0x7fbb78071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 --2- 172.21.15.57:0/70498196 >> v2:172.21.15.132:3300/0 conn(0x7fbb780ccef0 0x7fbb78071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.084+0000 7fbb7df7b640 1 -- 172.21.15.57:0/70498196 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7806c7e0 con 0x7fbb781624f0 2023-11-24T08:04:23.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb7df7b640 1 --2- 172.21.15.57:0/70498196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb781628d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbb780ceea0 tx=0x7fbb7401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eca6f10bd5a919f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb7cf79640 1 -- 172.21.15.57:0/70498196 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740ac600 con 0x7fbb781624f0 2023-11-24T08:04:23.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb7cf79640 1 -- 172.21.15.57:0/70498196 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb740a8050 con 0x7fbb781624f0 2023-11-24T08:04:23.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb7cf79640 1 -- 172.21.15.57:0/70498196 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740ac980 con 0x7fbb781624f0 2023-11-24T08:04:23.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 -- 172.21.15.57:0/70498196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 msgr2=0x7fbb781628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 --2- 172.21.15.57:0/70498196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb781628d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbb780ceea0 tx=0x7fbb7401c440 comp rx=0 tx=0).stop 2023-11-24T08:04:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 -- 172.21.15.57:0/70498196 shutdown_connections 2023-11-24T08:04:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 --2- 172.21.15.57:0/70498196 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780cd380 0x7fbb780cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 --2- 172.21.15.57:0/70498196 >> v2:172.21.15.132:3300/0 conn(0x7fbb780ccef0 0x7fbb78071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 --2- 172.21.15.57:0/70498196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb781628d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 -- 172.21.15.57:0/70498196 >> 172.21.15.57:0/70498196 conn(0x7fbb780b0c80 msgr2=0x7fbb780b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 -- 172.21.15.57:0/70498196 shutdown_connections 2023-11-24T08:04:23.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.088+0000 7fbb801df640 1 -- 172.21.15.57:0/70498196 wait complete. 2023-11-24T08:04:23.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 Processor -- start 2023-11-24T08:04:23.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 -- start start 2023-11-24T08:04:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780ccef0 0x7fbb7815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb780cd380 0x7fbb78160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb780aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7815e190 con 0x7fbb781624f0 2023-11-24T08:04:23.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7814edd0 con 0x7fbb780cd380 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78164600 con 0x7fbb780ccef0 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb780aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb780aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46996/0 (socket says 172.21.15.57:46996) 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 -- 172.21.15.57:0/2844818821 learned_addr learned my addr 172.21.15.57:0/2844818821 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7d77a640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb780cd380 0x7fbb78160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7df7b640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780ccef0 0x7fbb7815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 -- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780ccef0 msgr2=0x7fbb7815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780ccef0 0x7fbb7815f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 -- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb780cd380 msgr2=0x7fbb78160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb780cd380 0x7fbb78160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 -- 172.21.15.57:0/2844818821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb740094d0 con 0x7fbb781624f0 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7df7b640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780ccef0 0x7fbb7815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb7e77c640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb780aee90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb70007e30 tx=0x7fbb7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb6e7fc640 1 -- 172.21.15.57:0/2844818821 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70014620 con 0x7fbb781624f0 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb6e7fc640 1 -- 172.21.15.57:0/2844818821 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7000ee90 con 0x7fbb781624f0 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb6e7fc640 1 -- 172.21.15.57:0/2844818821 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700149c0 con 0x7fbb781624f0 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb78160600 con 0x7fbb781624f0 2023-11-24T08:04:23.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.092+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb78160290 con 0x7fbb781624f0 2023-11-24T08:04:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.096+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7804e8c0 con 0x7fbb781624f0 2023-11-24T08:04:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.096+0000 7fbb6e7fc640 1 -- 172.21.15.57:0/2844818821 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbb70014b20 con 0x7fbb781624f0 2023-11-24T08:04:23.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.096+0000 7fbb6e7fc640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb5c066470 0x7fbb5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.096+0000 7fbb6e7fc640 1 -- 172.21.15.57:0/2844818821 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb700847f0 con 0x7fbb781624f0 2023-11-24T08:04:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.096+0000 7fbb7df7b640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb5c066470 0x7fbb5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.096+0000 7fbb7df7b640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb5c066470 0x7fbb5c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb740ae000 tx=0x7fbb74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.100+0000 7fbb6e7fc640 1 -- 172.21.15.57:0/2844818821 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb70051c70 con 0x7fbb781624f0 2023-11-24T08:04:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb780cc890 con 0x7fbb781624f0 2023-11-24T08:04:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb6e7fc640 1 -- 172.21.15.57:0/2844818821 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb70055290 con 0x7fbb781624f0 2023-11-24T08:04:23.264 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:23.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb5c066470 msgr2=0x7fbb5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb5c066470 0x7fbb5c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb740ae000 tx=0x7fbb74008040 comp rx=0 tx=0).stop 2023-11-24T08:04:23.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 msgr2=0x7fbb780aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb780aee90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb70007e30 tx=0x7fbb7000e4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 shutdown_connections 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb5c066470 0x7fbb5c068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb781624f0 0x7fbb780aee90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb780cd380 0x7fbb78160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 --2- 172.21.15.57:0/2844818821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb780ccef0 0x7fbb7815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 >> 172.21.15.57:0/2844818821 conn(0x7fbb780b0c80 msgr2=0x7fbb78157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 shutdown_connections 2023-11-24T08:04:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.264+0000 7fbb801df640 1 -- 172.21.15.57:0/2844818821 wait complete. 2023-11-24T08:04:23.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:23.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.428+0000 7f5ce710f640 1 Processor -- start 2023-11-24T08:04:23.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.428+0000 7f5ce710f640 1 -- start start 2023-11-24T08:04:23.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce710f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00ae4a0 0x7f5ce015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce710f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ce00ce420 0x7f5ce006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce710f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00b3510 con 0x7f5ce00cd850 2023-11-24T08:04:23.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce710f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00b37f0 con 0x7f5ce00ce420 2023-11-24T08:04:23.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce710f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00b3ad0 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5cdffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ce00cd850 0x7f5ce00cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42956/0 (socket says 172.21.15.57:42956) 2023-11-24T08:04:23.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5cdffff640 1 -- 172.21.15.57:0/2804842637 learned_addr learned my addr 172.21.15.57:0/2804842637 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:23.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce4eab640 1 --2- 172.21.15.57:0/2804842637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00ae4a0 0x7f5ce015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce56ac640 1 --2- 172.21.15.57:0/2804842637 >> v2:172.21.15.132:3300/0 conn(0x7f5ce00ce420 0x7f5ce006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5cdf7fe640 1 -- 172.21.15.57:0/2804842637 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656927432 0 0) 0x7f5ce00b3510 con 0x7f5ce00cd850 2023-11-24T08:04:23.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5cdf7fe640 1 -- 172.21.15.57:0/2804842637 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd0003530 con 0x7f5ce00cd850 2023-11-24T08:04:23.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce4eab640 1 -- 172.21.15.57:0/2804842637 >> v2:172.21.15.132:3300/0 conn(0x7f5ce00ce420 msgr2=0x7f5ce006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce4eab640 1 --2- 172.21.15.57:0/2804842637 >> v2:172.21.15.132:3300/0 conn(0x7f5ce00ce420 0x7f5ce006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce4eab640 1 -- 172.21.15.57:0/2804842637 >> v1:172.21.15.57:6789/0 conn(0x7f5ce00cd850 legacy=0x7f5ce00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce4eab640 1 -- 172.21.15.57:0/2804842637 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00b3db0 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.432+0000 7f5ce56ac640 1 --2- 172.21.15.57:0/2804842637 >> v2:172.21.15.132:3300/0 conn(0x7f5ce00ce420 0x7f5ce006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:23.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce4eab640 1 --2- 172.21.15.57:0/2804842637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00ae4a0 0x7f5ce015ba00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40097c0 tx=0x7f5cd401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81506ce988fd482f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5cdf7fe640 1 -- 172.21.15.57:0/2804842637 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40ab670 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5cdf7fe640 1 -- 172.21.15.57:0/2804842637 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd40ab7d0 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5cdf7fe640 1 -- 172.21.15.57:0/2804842637 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40abb40 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 -- 172.21.15.57:0/2804842637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00ae4a0 msgr2=0x7f5ce015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2804842637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00ae4a0 0x7f5ce015ba00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40097c0 tx=0x7f5cd401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:23.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 -- 172.21.15.57:0/2804842637 shutdown_connections 2023-11-24T08:04:23.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2804842637 >> v2:172.21.15.132:3300/0 conn(0x7f5ce00ce420 0x7f5ce006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2804842637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00ae4a0 0x7f5ce015ba00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 -- 172.21.15.57:0/2804842637 >> 172.21.15.57:0/2804842637 conn(0x7f5ce00b0c80 msgr2=0x7f5ce00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 -- 172.21.15.57:0/2804842637 shutdown_connections 2023-11-24T08:04:23.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 -- 172.21.15.57:0/2804842637 wait complete. 2023-11-24T08:04:23.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 Processor -- start 2023-11-24T08:04:23.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.436+0000 7f5ce710f640 1 -- start start 2023-11-24T08:04:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce00ae4a0 0x7f5ce01501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00cd850 0x7f5ce014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ce00ce420 0x7f5ce0154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0151440 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce015f090 con 0x7f5ce00ce420 2023-11-24T08:04:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0150830 con 0x7f5ce00cd850 2023-11-24T08:04:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce00ae4a0 0x7f5ce01501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce00ae4a0 0x7f5ce01501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47004/0 (socket says 172.21.15.57:47004) 2023-11-24T08:04:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 -- 172.21.15.57:0/2940952569 learned_addr learned my addr 172.21.15.57:0/2940952569 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 -- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00cd850 msgr2=0x7f5ce014f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00cd850 0x7f5ce014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 -- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ce00ce420 msgr2=0x7f5ce0154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ce00ce420 0x7f5ce0154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 -- 172.21.15.57:0/2940952569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009a70 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce4eab640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce00ae4a0 0x7f5ce01501a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40ad040 tx=0x7f5cd401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5cdd7fa640 1 -- 172.21.15.57:0/2940952569 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40bf610 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5cdd7fa640 1 -- 172.21.15.57:0/2940952569 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd40bf770 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5cdd7fa640 1 -- 172.21.15.57:0/2940952569 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40bfae0 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd4009420 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce0150df0 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.440+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce004e8c0 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.444+0000 7f5cdd7fa640 1 -- 172.21.15.57:0/2940952569 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5cd40b5400 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.444+0000 7f5cdd7fa640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc40664a0 0x7f5cc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.444+0000 7f5cdd7fa640 1 -- 172.21.15.57:0/2940952569 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cd411e740 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.444+0000 7f5cdffff640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc40664a0 0x7f5cc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.444+0000 7f5cdffff640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc40664a0 0x7f5cc4068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc007fd0 tx=0x7f5ccc007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.448+0000 7f5cdd7fa640 1 -- 172.21.15.57:0/2940952569 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5cd40ebb20 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.608+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ce00ade40 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.608+0000 7f5cdd7fa640 1 -- 172.21.15.57:0/2940952569 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5cd40ef140 con 0x7f5ce00ae4a0 2023-11-24T08:04:23.610 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc40664a0 msgr2=0x7f5cc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc40664a0 0x7f5cc4068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc007fd0 tx=0x7f5ccc007900 comp rx=0 tx=0).stop 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce00ae4a0 msgr2=0x7f5ce01501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce00ae4a0 0x7f5ce01501a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40ad040 tx=0x7f5cd401ac90 comp rx=0 tx=0).stop 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 shutdown_connections 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc40664a0 0x7f5cc4068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ce00ce420 0x7f5ce0154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ce00cd850 0x7f5ce014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 --2- 172.21.15.57:0/2940952569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ce00ae4a0 0x7f5ce01501a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 >> 172.21.15.57:0/2940952569 conn(0x7f5ce00b0c80 msgr2=0x7f5ce00abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 shutdown_connections 2023-11-24T08:04:23.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.612+0000 7f5ce710f640 1 -- 172.21.15.57:0/2940952569 wait complete. 2023-11-24T08:04:23.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd212413640 1 Processor -- start 2023-11-24T08:04:23.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd212413640 1 -- start start 2023-11-24T08:04:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd212413640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd20c0ae4a0 0x7fd20c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd212413640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0b3510 con 0x7fd20c0ce420 2023-11-24T08:04:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd212413640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0b37f0 con 0x7fd20c0cd850 2023-11-24T08:04:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd212413640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c0b3ad0 con 0x7fd20c0ae4a0 2023-11-24T08:04:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd2109b0640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd20c0ce420 0x7fd20c06c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42972/0 (socket says 172.21.15.57:42972) 2023-11-24T08:04:23.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd2109b0640 1 -- 172.21.15.57:0/1320310750 learned_addr learned my addr 172.21.15.57:0/1320310750 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:23.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20bfff640 1 --2- 172.21.15.57:0/1320310750 >> v2:172.21.15.132:3300/0 conn(0x7fd20c0ae4a0 0x7fd20c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742866718 0 0) 0x7fd20c0b3510 con 0x7fd20c0ce420 2023-11-24T08:04:23.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f4003530 con 0x7fd20c0ce420 2023-11-24T08:04:23.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1039187094 0 0) 0x7fd1f4003530 con 0x7fd20c0ce420 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 >> v2:172.21.15.132:3300/0 conn(0x7fd20c0ae4a0 msgr2=0x7fd20c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20affd640 1 --2- 172.21.15.57:0/1320310750 >> v2:172.21.15.132:3300/0 conn(0x7fd20c0ae4a0 0x7fd20c15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 >> v1:172.21.15.132:6789/0 conn(0x7fd20c0cd850 legacy=0x7fd20c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.776+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0b3db0 con 0x7fd20c0ce420 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fd204001a00 con 0x7fd20c0ce420 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 >> v1:172.21.15.57:6789/0 conn(0x7fd20c0ce420 legacy=0x7fd20c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f4003980 0x7fd1f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1f40047d0 0x7fd1f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f4005190 0x7fd1f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0b3ad0 con 0x7fd1f40047d0 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f400c030 con 0x7fd1f4005190 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f400c1f0 con 0x7fd1f4003980 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20b7fe640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1f40047d0 0x7fd1f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd2109b0640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f4005190 0x7fd1f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20bfff640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f4003980 0x7fd1f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20b7fe640 1 -- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f4003980 msgr2=0x7fd1f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20b7fe640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f4003980 0x7fd1f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20b7fe640 1 -- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f4005190 msgr2=0x7fd1f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20b7fe640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f4005190 0x7fd1f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20b7fe640 1 -- 172.21.15.57:0/1320310750 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4003530 con 0x7fd1f40047d0 2023-11-24T08:04:23.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd2109b0640 1 -- 172.21.15.57:0/1320310750 reap_dead start 2023-11-24T08:04:23.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20b7fe640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1f40047d0 0x7fd1f4004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd20c06be60 tx=0x7fd20001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc04e7b57c25f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000052d0 con 0x7fd1f40047d0 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2000a7050 con 0x7fd1f40047d0 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.780+0000 7fd20affd640 1 -- 172.21.15.57:0/1320310750 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200003600 con 0x7fd1f40047d0 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- 172.21.15.57:0/1320310750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1f40047d0 msgr2=0x7fd1f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1f40047d0 0x7fd1f4004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd20c06be60 tx=0x7fd20001c380 comp rx=0 tx=0).stop 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- 172.21.15.57:0/1320310750 shutdown_connections 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 --2- 172.21.15.57:0/1320310750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1f40047d0 0x7fd1f4004c50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- 172.21.15.57:0/1320310750 >> 172.21.15.57:0/1320310750 conn(0x7fd20c0b0c80 msgr2=0x7fd20c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- 172.21.15.57:0/1320310750 shutdown_connections 2023-11-24T08:04:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- 172.21.15.57:0/1320310750 wait complete. 2023-11-24T08:04:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 Processor -- start 2023-11-24T08:04:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- start start 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f40047d0 0x7fd20c099be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c1e9780 0x7fd20c09c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd20c15d1e0 0x7fd20c09cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c140fa0 con 0x7fd20c1e9780 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c09a120 con 0x7fd20c15d1e0 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd212413640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15d7a0 con 0x7fd1f40047d0 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd20b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c1e9780 0x7fd20c09c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd20b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c1e9780 0x7fd20c09c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47018/0 (socket says 172.21.15.57:47018) 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.784+0000 7fd20b7fe640 1 -- 172.21.15.57:0/729408774 learned_addr learned my addr 172.21.15.57:0/729408774 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd2109b0640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd20c15d1e0 0x7fd20c09cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20bfff640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f40047d0 0x7fd20c099be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20b7fe640 1 -- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f40047d0 msgr2=0x7fd20c099be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20b7fe640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f40047d0 0x7fd20c099be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20b7fe640 1 -- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd20c15d1e0 msgr2=0x7fd20c09cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20b7fe640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd20c15d1e0 0x7fd20c09cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20b7fe640 1 -- 172.21.15.57:0/729408774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c15da80 con 0x7fd20c1e9780 2023-11-24T08:04:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20bfff640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f40047d0 0x7fd20c099be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:23.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd20b7fe640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c1e9780 0x7fd20c09c5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd200000c10 tx=0x7fd1f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd208ff9640 1 -- 172.21.15.57:0/729408774 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000b9070 con 0x7fd20c1e9780 2023-11-24T08:04:23.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd208ff9640 1 -- 172.21.15.57:0/729408774 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200003c40 con 0x7fd20c1e9780 2023-11-24T08:04:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c15dd60 con 0x7fd20c1e9780 2023-11-24T08:04:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd208ff9640 1 -- 172.21.15.57:0/729408774 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200007030 con 0x7fd20c1e9780 2023-11-24T08:04:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c142fe0 con 0x7fd20c1e9780 2023-11-24T08:04:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c0b3080 con 0x7fd20c1e9780 2023-11-24T08:04:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd208ff9640 1 -- 172.21.15.57:0/729408774 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd200007190 con 0x7fd20c1e9780 2023-11-24T08:04:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.788+0000 7fd208ff9640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd1f80664a0 0x7fd1f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.792+0000 7fd208ff9640 1 -- 172.21.15.57:0/729408774 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2000a4e40 con 0x7fd20c1e9780 2023-11-24T08:04:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.792+0000 7fd20bfff640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd1f80664a0 0x7fd1f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.792+0000 7fd20bfff640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd1f80664a0 0x7fd1f8068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0682a0 tx=0x7fd1fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:23.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.792+0000 7fd208ff9640 1 -- 172.21.15.57:0/729408774 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2000eb000 con 0x7fd20c1e9780 2023-11-24T08:04:23.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.948+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd20c04e8c0 con 0x7fd20c1e9780 2023-11-24T08:04:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.948+0000 7fd208ff9640 1 -- 172.21.15.57:0/729408774 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2000ee620 con 0x7fd20c1e9780 2023-11-24T08:04:23.952 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd1f80664a0 msgr2=0x7fd1f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd1f80664a0 0x7fd1f8068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0682a0 tx=0x7fd1fc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c1e9780 msgr2=0x7fd20c09c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c1e9780 0x7fd20c09c5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd200000c10 tx=0x7fd1f4005800 comp rx=0 tx=0).stop 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 shutdown_connections 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd1f80664a0 0x7fd1f8068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd20c15d1e0 0x7fd20c09cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c1e9780 0x7fd20c09c5d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 --2- 172.21.15.57:0/729408774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd1f40047d0 0x7fd20c099be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 >> 172.21.15.57:0/729408774 conn(0x7fd20c0b0c80 msgr2=0x7fd20c0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 shutdown_connections 2023-11-24T08:04:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:23.952+0000 7fd212413640 1 -- 172.21.15.57:0/729408774 wait complete. 2023-11-24T08:04:23.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:24.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.112+0000 7fc63c06b640 1 Processor -- start 2023-11-24T08:04:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.112+0000 7fc63c06b640 1 -- start start 2023-11-24T08:04:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63c06b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc6340707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63c06b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc634070cf0 0x7fc6340b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63c06b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63406dc20 con 0x7fc634158a50 2023-11-24T08:04:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63c06b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63406e0b0 con 0x7fc634070cf0 2023-11-24T08:04:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63c06b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc634071160 con 0x7fc63406e340 2023-11-24T08:04:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc639e07640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc634158a50 0x7fc63406c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42974/0 (socket says 172.21.15.57:42974) 2023-11-24T08:04:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc639e07640 1 -- 172.21.15.57:0/3792831326 learned_addr learned my addr 172.21.15.57:0/3792831326 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc639606640 1 --2- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc6340707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63a608640 1 --2- 172.21.15.57:0/3792831326 >> v2:172.21.15.132:3300/0 conn(0x7fc634070cf0 0x7fc6340b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc638e05640 1 -- 172.21.15.57:0/3792831326 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694519833 0 0) 0x7fc63406dc20 con 0x7fc634158a50 2023-11-24T08:04:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc638e05640 1 -- 172.21.15.57:0/3792831326 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc620003530 con 0x7fc634158a50 2023-11-24T08:04:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63a608640 1 -- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 msgr2=0x7fc6340707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63a608640 1 --2- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc6340707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63a608640 1 -- 172.21.15.57:0/3792831326 >> v1:172.21.15.57:6789/0 conn(0x7fc634158a50 legacy=0x7fc63406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.116+0000 7fc63a608640 1 -- 172.21.15.57:0/3792831326 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63406cd60 con 0x7fc634070cf0 2023-11-24T08:04:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63a608640 1 --2- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 0x7fc6340b24c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009d90 tx=0x7fc62c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4442a6b3d6935700 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc638e05640 1 -- 172.21.15.57:0/3792831326 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0a5a10 con 0x7fc634070cf0 2023-11-24T08:04:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc638e05640 1 -- 172.21.15.57:0/3792831326 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0a5b70 con 0x7fc634070cf0 2023-11-24T08:04:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc638e05640 1 -- 172.21.15.57:0/3792831326 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0ad440 con 0x7fc634070cf0 2023-11-24T08:04:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 -- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 msgr2=0x7fc6340b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 --2- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 0x7fc6340b24c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009d90 tx=0x7fc62c01c950 comp rx=0 tx=0).stop 2023-11-24T08:04:24.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 -- 172.21.15.57:0/3792831326 shutdown_connections 2023-11-24T08:04:24.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 --2- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 0x7fc6340b24c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 --2- 172.21.15.57:0/3792831326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc6340707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 -- 172.21.15.57:0/3792831326 >> 172.21.15.57:0/3792831326 conn(0x7fc6340b0bf0 msgr2=0x7fc6340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 -- 172.21.15.57:0/3792831326 shutdown_connections 2023-11-24T08:04:24.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 -- 172.21.15.57:0/3792831326 wait complete. 2023-11-24T08:04:24.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.120+0000 7fc63c06b640 1 Processor -- start 2023-11-24T08:04:24.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 -- start start 2023-11-24T08:04:24.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc634156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 0x7fc634156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc634158a50 0x7fc6341573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc634163b10 con 0x7fc634158a50 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc634163d80 con 0x7fc634070cf0 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc634164060 con 0x7fc63406e340 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc634158a50 0x7fc6341573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc634158a50 0x7fc6341573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47024/0 (socket says 172.21.15.57:47024) 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 -- 172.21.15.57:0/1722253040 learned_addr learned my addr 172.21.15.57:0/1722253040 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc639606640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 0x7fc634156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc639e07640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc634156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 -- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 msgr2=0x7fc634156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc634156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 -- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 msgr2=0x7fc634156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 0x7fc634156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 -- 172.21.15.57:0/1722253040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c009a70 con 0x7fc634158a50 2023-11-24T08:04:24.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63a608640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc634158a50 0x7fc6341573b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc62c01a580 tx=0x7fc62c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc62a7fc640 1 -- 172.21.15.57:0/1722253040 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0a5a10 con 0x7fc634158a50 2023-11-24T08:04:24.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc62a7fc640 1 -- 172.21.15.57:0/1722253040 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c009450 con 0x7fc634158a50 2023-11-24T08:04:24.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc62a7fc640 1 -- 172.21.15.57:0/1722253040 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b7610 con 0x7fc634158a50 2023-11-24T08:04:24.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc634164340 con 0x7fc634158a50 2023-11-24T08:04:24.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6341578f0 con 0x7fc634158a50 2023-11-24T08:04:24.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.124+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc634067520 con 0x7fc634158a50 2023-11-24T08:04:24.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.128+0000 7fc62a7fc640 1 -- 172.21.15.57:0/1722253040 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc62c0b4050 con 0x7fc634158a50 2023-11-24T08:04:24.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.128+0000 7fc62a7fc640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc618066470 0x7fc618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.128+0000 7fc62a7fc640 1 -- 172.21.15.57:0/1722253040 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc62c11f1d0 con 0x7fc634158a50 2023-11-24T08:04:24.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.128+0000 7fc639e07640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc618066470 0x7fc618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.128+0000 7fc639e07640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc618066470 0x7fc618068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc630005890 tx=0x7fc630009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.132+0000 7fc62a7fc640 1 -- 172.21.15.57:0/1722253040 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc62c0ec5b0 con 0x7fc634158a50 2023-11-24T08:04:24.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.292+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6341647f0 con 0x7fc634158a50 2023-11-24T08:04:24.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.292+0000 7fc62a7fc640 1 -- 172.21.15.57:0/1722253040 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fc62c0efbd0 con 0x7fc634158a50 2023-11-24T08:04:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:24.294 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:24.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc618066470 msgr2=0x7fc618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc618066470 0x7fc618068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc630005890 tx=0x7fc630009040 comp rx=0 tx=0).stop 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc634158a50 msgr2=0x7fc6341573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc634158a50 0x7fc6341573b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc62c01a580 tx=0x7fc62c0196f0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 shutdown_connections 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc618066470 0x7fc618068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc634158a50 0x7fc6341573b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc634070cf0 0x7fc634156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 --2- 172.21.15.57:0/1722253040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc63406e340 0x7fc634156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 >> 172.21.15.57:0/1722253040 conn(0x7fc6340b0bf0 msgr2=0x7fc6340b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 shutdown_connections 2023-11-24T08:04:24.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.296+0000 7fc63c06b640 1 -- 172.21.15.57:0/1722253040 wait complete. 2023-11-24T08:04:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:24.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:24.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.460+0000 7f07ed58d640 1 Processor -- start 2023-11-24T08:04:24.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.460+0000 7f07ed58d640 1 -- start start 2023-11-24T08:04:24.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07ed58d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07e80ae4a0 0x7f07e815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07ed58d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 0x7f07e806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07ed58d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e80b3510 con 0x7f07e80cd850 2023-11-24T08:04:24.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07ed58d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80b37f0 con 0x7f07e80ae4a0 2023-11-24T08:04:24.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07ed58d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80b3ad0 con 0x7f07e80ce420 2023-11-24T08:04:24.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07de7fc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f07e80cd850 0x7f07e80cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42984/0 (socket says 172.21.15.57:42984) 2023-11-24T08:04:24.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07de7fc640 1 -- 172.21.15.57:0/3483136885 learned_addr learned my addr 172.21.15.57:0/3483136885 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3483136885 >> v2:172.21.15.132:3300/0 conn(0x7f07e80ae4a0 0x7f07e815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e77fe640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 0x7f07e806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139685713 0 0) 0x7f07e80b3510 con 0x7f07e80cd850 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d4003530 con 0x7f07e80cd850 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2018527556 0 0) 0x7f07d4003530 con 0x7f07e80cd850 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 msgr2=0x7f07e806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 0x7f07e806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 >> v2:172.21.15.132:3300/0 conn(0x7f07e80ae4a0 msgr2=0x7f07e815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 --2- 172.21.15.57:0/3483136885 >> v2:172.21.15.132:3300/0 conn(0x7f07e80ae4a0 0x7f07e815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80b3db0 con 0x7f07e80cd850 2023-11-24T08:04:24.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f07d0001680 con 0x7f07e80cd850 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3483136885 >> v2:172.21.15.132:3300/0 conn(0x7f07e80ae4a0 0x7f07e815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 >> v1:172.21.15.57:6789/0 conn(0x7f07e80cd850 legacy=0x7f07e80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 0x7f07d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07d4004d10 0x7f07d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80b37f0 con 0x7f07d4003980 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80b3ad0 con 0x7f07d4004d10 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d400b990 con 0x7f07e80ce420 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e77fe640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07d4004d10 0x7f07d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07de7fc640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 0x7f07d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 -- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 msgr2=0x7f07d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 0x7f07d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 -- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07d4004d10 msgr2=0x7f07d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07d4004d10 0x7f07d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07e6ffd640 1 -- 172.21.15.57:0/3483136885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4003530 con 0x7f07d4003980 2023-11-24T08:04:24.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.464+0000 7f07de7fc640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e80ce420 0x7f07d40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07d4003da0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009ce0 tx=0x7f07d801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504a2a98a93db289 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80a58e0 con 0x7f07d4003980 2023-11-24T08:04:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d80a5a40 con 0x7f07d4003980 2023-11-24T08:04:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07e67fc640 1 -- 172.21.15.57:0/3483136885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80a5df0 con 0x7f07d4003980 2023-11-24T08:04:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07ed58d640 1 -- 172.21.15.57:0/3483136885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 msgr2=0x7f07d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07ed58d640 1 --2- 172.21.15.57:0/3483136885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07d4003da0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009ce0 tx=0x7f07d801cc20 comp rx=0 tx=0).stop 2023-11-24T08:04:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07e77fe640 1 -- 172.21.15.57:0/3483136885 reap_dead start 2023-11-24T08:04:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07ed58d640 1 -- 172.21.15.57:0/3483136885 shutdown_connections 2023-11-24T08:04:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07ed58d640 1 -- 172.21.15.57:0/3483136885 >> 172.21.15.57:0/3483136885 conn(0x7f07e80b0c80 msgr2=0x7f07e80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07ed58d640 1 -- 172.21.15.57:0/3483136885 shutdown_connections 2023-11-24T08:04:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07ed58d640 1 -- 172.21.15.57:0/3483136885 wait complete. 2023-11-24T08:04:24.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.468+0000 7f07ed58d640 1 Processor -- start 2023-11-24T08:04:24.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 -- start start 2023-11-24T08:04:24.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07e814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e8146d00 0x7f07e81464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e80cef80 0x7f07e80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80cf940 con 0x7f07d4003980 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e809a470 con 0x7f07e80cef80 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e809ad10 con 0x7f07e8146d00 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07e814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07e814e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47046/0 (socket says 172.21.15.57:47046) 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 -- 172.21.15.57:0/3664031168 learned_addr learned my addr 172.21.15.57:0/3664031168 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e77fe640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e80cef80 0x7f07e80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07de7fc640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e8146d00 0x7f07e81464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 -- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e8146d00 msgr2=0x7f07e81464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e8146d00 0x7f07e81464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 -- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e80cef80 msgr2=0x7f07e80cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e80cef80 0x7f07e80cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 -- 172.21.15.57:0/3664031168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8099fb0 con 0x7f07d4003980 2023-11-24T08:04:24.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07e6ffd640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07e814e0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f07d801ca50 tx=0x7f07d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07dffff640 1 -- 172.21.15.57:0/3664031168 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8004020 con 0x7f07d4003980 2023-11-24T08:04:24.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07dffff640 1 -- 172.21.15.57:0/3664031168 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d80041a0 con 0x7f07d4003980 2023-11-24T08:04:24.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07dffff640 1 -- 172.21.15.57:0/3664031168 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8003620 con 0x7f07d4003980 2023-11-24T08:04:24.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e809a6c0 con 0x7f07d4003980 2023-11-24T08:04:24.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e8146a30 con 0x7f07d4003980 2023-11-24T08:04:24.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.472+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e804e8c0 con 0x7f07d4003980 2023-11-24T08:04:24.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.476+0000 7f07dffff640 1 -- 172.21.15.57:0/3664031168 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07d80b4040 con 0x7f07d4003980 2023-11-24T08:04:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.476+0000 7f07dffff640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f07c8066470 0x7f07c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.476+0000 7f07dffff640 1 -- 172.21.15.57:0/3664031168 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07d811d660 con 0x7f07d4003980 2023-11-24T08:04:24.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.476+0000 7f07de7fc640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f07c8066470 0x7f07c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.476+0000 7f07de7fc640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f07c8066470 0x7f07c8068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07d0001830 tx=0x7f07d0007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.480+0000 7f07dffff640 1 -- 172.21.15.57:0/3664031168 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07d80eac70 con 0x7f07d4003980 2023-11-24T08:04:24.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.636+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07e81487c0 con 0x7f07d4003980 2023-11-24T08:04:24.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.636+0000 7f07dffff640 1 -- 172.21.15.57:0/3664031168 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07d80ee290 con 0x7f07d4003980 2023-11-24T08:04:24.640 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f07c8066470 msgr2=0x7f07c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f07c8066470 0x7f07c8068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07d0001830 tx=0x7f07d0007040 comp rx=0 tx=0).stop 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 msgr2=0x7f07e814e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07e814e0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f07d801ca50 tx=0x7f07d4005800 comp rx=0 tx=0).stop 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 shutdown_connections 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f07c8066470 0x7f07c8068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e80cef80 0x7f07e80cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e8146d00 0x7f07e81464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 --2- 172.21.15.57:0/3664031168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07d4003980 0x7f07e814e0e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 >> 172.21.15.57:0/3664031168 conn(0x7f07e80b0c80 msgr2=0x7f07e80ac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 shutdown_connections 2023-11-24T08:04:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.640+0000 7f07ed58d640 1 -- 172.21.15.57:0/3664031168 wait complete. 2023-11-24T08:04:24.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.804+0000 7f8bab10e640 1 Processor -- start 2023-11-24T08:04:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.804+0000 7f8bab10e640 1 -- start start 2023-11-24T08:04:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8bab10e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8ba415a290 0x7f8ba40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8bab10e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba415ec60 0x7f8ba40cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8bab10e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ba40cc6b0 0x7f8ba40b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8bab10e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba4071170 con 0x7f8ba40cc6b0 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8bab10e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba40cb690 con 0x7f8ba415a290 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8bab10e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40cb970 con 0x7f8ba415ec60 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ba40cc6b0 0x7f8ba40b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ba40cc6b0 0x7f8ba40b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47048/0 (socket says 172.21.15.57:47048) 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 -- 172.21.15.57:0/3675951643 learned_addr learned my addr 172.21.15.57:0/3675951643 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba3fff640 1 --2- 172.21.15.57:0/3675951643 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba415ec60 0x7f8ba40cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba8eaa640 1 --2- 172.21.15.57:0/3675951643 >> v2:172.21.15.132:3300/0 conn(0x7f8ba415a290 0x7f8ba40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 -- 172.21.15.57:0/3675951643 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba415ec60 msgr2=0x7f8ba40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 --2- 172.21.15.57:0/3675951643 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba415ec60 0x7f8ba40cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 -- 172.21.15.57:0/3675951643 >> v2:172.21.15.132:3300/0 conn(0x7f8ba415a290 msgr2=0x7f8ba40707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 --2- 172.21.15.57:0/3675951643 >> v2:172.21.15.132:3300/0 conn(0x7f8ba415a290 0x7f8ba40707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba96ab640 1 -- 172.21.15.57:0/3675951643 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba40cbc50 con 0x7f8ba40cc6b0 2023-11-24T08:04:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.808+0000 7f8ba8eaa640 1 --2- 172.21.15.57:0/3675951643 >> v2:172.21.15.132:3300/0 conn(0x7f8ba415a290 0x7f8ba40707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8ba96ab640 1 --2- 172.21.15.57:0/3675951643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba40cc6b0 0x7f8ba40b1f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ba406c0d0 tx=0x7f8b9c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8e5a43cd589d4e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8ba37fe640 1 -- 172.21.15.57:0/3675951643 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0a78f0 con 0x7f8ba40cc6b0 2023-11-24T08:04:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8ba37fe640 1 -- 172.21.15.57:0/3675951643 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c0a7a50 con 0x7f8ba40cc6b0 2023-11-24T08:04:24.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8ba37fe640 1 -- 172.21.15.57:0/3675951643 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0a7de0 con 0x7f8ba40cc6b0 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 -- 172.21.15.57:0/3675951643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba40cc6b0 msgr2=0x7f8ba40b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3675951643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba40cc6b0 0x7f8ba40b1f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ba406c0d0 tx=0x7f8b9c01eb50 comp rx=0 tx=0).stop 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 -- 172.21.15.57:0/3675951643 shutdown_connections 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3675951643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba40cc6b0 0x7f8ba40b1f80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3675951643 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba415ec60 0x7f8ba40cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3675951643 >> v2:172.21.15.132:3300/0 conn(0x7f8ba415a290 0x7f8ba40707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 -- 172.21.15.57:0/3675951643 >> 172.21.15.57:0/3675951643 conn(0x7f8ba40b0c80 msgr2=0x7f8ba40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 -- 172.21.15.57:0/3675951643 shutdown_connections 2023-11-24T08:04:24.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 -- 172.21.15.57:0/3675951643 wait complete. 2023-11-24T08:04:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 Processor -- start 2023-11-24T08:04:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.812+0000 7f8bab10e640 1 -- start start 2023-11-24T08:04:24.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba40cc6b0 0x7f8ba415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba415a290 0x7f8ba4164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba415ec60 0x7f8ba4146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba4165110 con 0x7f8ba415a290 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba4152810 con 0x7f8ba415ec60 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba415af30 con 0x7f8ba40cc6b0 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba415a290 0x7f8ba4164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba415a290 0x7f8ba4164bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47054/0 (socket says 172.21.15.57:47054) 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 -- 172.21.15.57:0/3349978863 learned_addr learned my addr 172.21.15.57:0/3349978863 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba8eaa640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba40cc6b0 0x7f8ba415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba96ab640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba415ec60 0x7f8ba4146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 -- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba40cc6b0 msgr2=0x7f8ba415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba40cc6b0 0x7f8ba415bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 -- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba415ec60 msgr2=0x7f8ba4146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba415ec60 0x7f8ba4146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 -- 172.21.15.57:0/3349978863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c009b30 con 0x7f8ba415a290 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba96ab640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba415ec60 0x7f8ba4146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba8eaa640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba40cc6b0 0x7f8ba415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba3fff640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba415a290 0x7f8ba4164bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000d7d0 tx=0x7f8b9000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba17fa640 1 -- 172.21.15.57:0/3349978863 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000b6c0 con 0x7f8ba415a290 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba17fa640 1 -- 172.21.15.57:0/3349978863 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000b820 con 0x7f8ba415a290 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba17fa640 1 -- 172.21.15.57:0/3349978863 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000bbb0 con 0x7f8ba415a290 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba4070f40 con 0x7f8ba415a290 2023-11-24T08:04:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba415b4f0 con 0x7f8ba415a290 2023-11-24T08:04:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba404e8c0 con 0x7f8ba415a290 2023-11-24T08:04:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.816+0000 7f8ba17fa640 1 -- 172.21.15.57:0/3349978863 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b9000bd10 con 0x7f8ba415a290 2023-11-24T08:04:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.820+0000 7f8ba17fa640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8b880664a0 0x7f8b88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.820+0000 7f8ba17fa640 1 -- 172.21.15.57:0/3349978863 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b900843d0 con 0x7f8ba415a290 2023-11-24T08:04:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.820+0000 7f8ba8eaa640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8b880664a0 0x7f8b88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.820+0000 7f8ba8eaa640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8b880664a0 0x7f8b88068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b98006fd0 tx=0x7f8b98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.824+0000 7f8ba17fa640 1 -- 172.21.15.57:0/3349978863 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b900517b0 con 0x7f8ba415a290 2023-11-24T08:04:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ba4073910 con 0x7f8ba415a290 2023-11-24T08:04:24.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8ba17fa640 1 -- 172.21.15.57:0/3349978863 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b90054dd0 con 0x7f8ba415a290 2023-11-24T08:04:24.982 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:24.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8b880664a0 msgr2=0x7f8b88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8b880664a0 0x7f8b88068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b98006fd0 tx=0x7f8b98008040 comp rx=0 tx=0).stop 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba415a290 msgr2=0x7f8ba4164bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba415a290 0x7f8ba4164bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000d7d0 tx=0x7f8b9000dc90 comp rx=0 tx=0).stop 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 shutdown_connections 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8b880664a0 0x7f8b88068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ba415ec60 0x7f8ba4146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ba415a290 0x7f8ba4164bd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 --2- 172.21.15.57:0/3349978863 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ba40cc6b0 0x7f8ba415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 >> 172.21.15.57:0/3349978863 conn(0x7f8ba40b0c80 msgr2=0x7f8ba40afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 shutdown_connections 2023-11-24T08:04:24.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:24.980+0000 7f8bab10e640 1 -- 172.21.15.57:0/3349978863 wait complete. 2023-11-24T08:04:25.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:25.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.148+0000 7f5b66654640 1 Processor -- start 2023-11-24T08:04:25.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b66654640 1 -- start start 2023-11-24T08:04:25.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b66654640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b6015a290 0x7f5b600707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b66654640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b6015ec60 0x7f5b600cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b66654640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b60071170 con 0x7f5b600cc6b0 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b66654640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600cb690 con 0x7f5b6015a290 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b66654640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600cb970 con 0x7f5b6015ec60 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b64bf1640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5b600cc6b0 0x7f5b600b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:42990/0 (socket says 172.21.15.57:42990) 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b6015a290 0x7f5b600707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b64bf1640 1 -- 172.21.15.57:0/588655969 learned_addr learned my addr 172.21.15.57:0/588655969 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:25.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5f7fe640 1 --2- 172.21.15.57:0/588655969 >> v2:172.21.15.132:3300/0 conn(0x7f5b6015ec60 0x7f5b600cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5ffff640 1 -- 172.21.15.57:0/588655969 >> v2:172.21.15.132:3300/0 conn(0x7f5b6015ec60 msgr2=0x7f5b600cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5ffff640 1 --2- 172.21.15.57:0/588655969 >> v2:172.21.15.132:3300/0 conn(0x7f5b6015ec60 0x7f5b600cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5ffff640 1 -- 172.21.15.57:0/588655969 >> v1:172.21.15.57:6789/0 conn(0x7f5b600cc6b0 legacy=0x7f5b600b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5ffff640 1 -- 172.21.15.57:0/588655969 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600cbc50 con 0x7f5b6015a290 2023-11-24T08:04:25.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5effd640 1 -- 172.21.15.57:0/588655969 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50097587 0 0) 0x7f5b60071170 con 0x7f5b600cc6b0 2023-11-24T08:04:25.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.152+0000 7f5b5f7fe640 1 --2- 172.21.15.57:0/588655969 >> v2:172.21.15.132:3300/0 conn(0x7f5b6015ec60 0x7f5b600cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:25.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b5ffff640 1 --2- 172.21.15.57:0/588655969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015a290 0x7f5b600707f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5b6006be60 tx=0x7f5b5001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb2a7e5cd925a45 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b5effd640 1 -- 172.21.15.57:0/588655969 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500ab5f0 con 0x7f5b6015a290 2023-11-24T08:04:25.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b5effd640 1 -- 172.21.15.57:0/588655969 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b500ab750 con 0x7f5b6015a290 2023-11-24T08:04:25.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b5effd640 1 -- 172.21.15.57:0/588655969 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500abae0 con 0x7f5b6015a290 2023-11-24T08:04:25.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 -- 172.21.15.57:0/588655969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015a290 msgr2=0x7f5b600707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 --2- 172.21.15.57:0/588655969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015a290 0x7f5b600707f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5b6006be60 tx=0x7f5b5001c3d0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 -- 172.21.15.57:0/588655969 shutdown_connections 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 --2- 172.21.15.57:0/588655969 >> v2:172.21.15.132:3300/0 conn(0x7f5b6015ec60 0x7f5b600cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 --2- 172.21.15.57:0/588655969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015a290 0x7f5b600707f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 -- 172.21.15.57:0/588655969 >> 172.21.15.57:0/588655969 conn(0x7f5b600b0c80 msgr2=0x7f5b600b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 -- 172.21.15.57:0/588655969 shutdown_connections 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 -- 172.21.15.57:0/588655969 wait complete. 2023-11-24T08:04:25.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.156+0000 7f5b66654640 1 Processor -- start 2023-11-24T08:04:25.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 -- start start 2023-11-24T08:04:25.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b600cc6b0 0x7f5b6009caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5b6015a290 0x7f5b6006c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015ec60 0x7f5b6006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60155aa0 con 0x7f5b6015ec60 2023-11-24T08:04:25.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6009d030 con 0x7f5b600cc6b0 2023-11-24T08:04:25.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b601554e0 con 0x7f5b6015a290 2023-11-24T08:04:25.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015ec60 0x7f5b6006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015ec60 0x7f5b6006cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47066/0 (socket says 172.21.15.57:47066) 2023-11-24T08:04:25.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 -- 172.21.15.57:0/1684045207 learned_addr learned my addr 172.21.15.57:0/1684045207 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:25.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b5ffff640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b600cc6b0 0x7f5b6009caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b5f7fe640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5b6015a290 0x7f5b6006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 -- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5b6015a290 msgr2=0x7f5b6006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5b6015a290 0x7f5b6006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 -- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b600cc6b0 msgr2=0x7f5b6009caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b600cc6b0 0x7f5b6009caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 -- 172.21.15.57:0/1684045207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b50009420 con 0x7f5b6015ec60 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b64bf1640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015ec60 0x7f5b6006cb80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c7b0 tx=0x7f5b5800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b5cff9640 1 -- 172.21.15.57:0/1684045207 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800a640 con 0x7f5b6015ec60 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b5cff9640 1 -- 172.21.15.57:0/1684045207 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5800a7c0 con 0x7f5b6015ec60 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b601557c0 con 0x7f5b6015ec60 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b5cff9640 1 -- 172.21.15.57:0/1684045207 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800ab70 con 0x7f5b6015ec60 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b601502a0 con 0x7f5b6015ec60 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.160+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b601504c0 con 0x7f5b6015ec60 2023-11-24T08:04:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.164+0000 7f5b5cff9640 1 -- 172.21.15.57:0/1684045207 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b5800acd0 con 0x7f5b6015ec60 2023-11-24T08:04:25.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.164+0000 7f5b5cff9640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5b4c0664a0 0x7f5b4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.164+0000 7f5b5cff9640 1 -- 172.21.15.57:0/1684045207 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b58083550 con 0x7f5b6015ec60 2023-11-24T08:04:25.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.164+0000 7f5b5ffff640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5b4c0664a0 0x7f5b4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.164+0000 7f5b5ffff640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5b4c0664a0 0x7f5b4c068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b500af000 tx=0x7f5b500a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.168+0000 7f5b5cff9640 1 -- 172.21.15.57:0/1684045207 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b58050a80 con 0x7f5b6015ec60 2023-11-24T08:04:25.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b6004e8c0 con 0x7f5b6015ec60 2023-11-24T08:04:25.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b5cff9640 1 -- 172.21.15.57:0/1684045207 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b580540a0 con 0x7f5b6015ec60 2023-11-24T08:04:25.326 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5b4c0664a0 msgr2=0x7f5b4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5b4c0664a0 0x7f5b4c068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b500af000 tx=0x7f5b500a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015ec60 msgr2=0x7f5b6006cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015ec60 0x7f5b6006cb80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c7b0 tx=0x7f5b5800cc70 comp rx=0 tx=0).stop 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 shutdown_connections 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5b4c0664a0 0x7f5b4c068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b6015ec60 0x7f5b6006cb80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5b6015a290 0x7f5b6006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 --2- 172.21.15.57:0/1684045207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b600cc6b0 0x7f5b6009caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 >> 172.21.15.57:0/1684045207 conn(0x7f5b600b0c80 msgr2=0x7f5b600b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 shutdown_connections 2023-11-24T08:04:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.324+0000 7f5b66654640 1 -- 172.21.15.57:0/1684045207 wait complete. 2023-11-24T08:04:25.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:25.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bfc17640 1 Processor -- start 2023-11-24T08:04:25.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bfc17640 1 -- start start 2023-11-24T08:04:25.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bfc17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 0x7f99b8145630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bfc17640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80b1b70 con 0x7f99b80b0a00 2023-11-24T08:04:25.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bfc17640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80b15b0 con 0x7f99b806acc0 2023-11-24T08:04:25.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bfc17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b1890 con 0x7f99b80b30a0 2023-11-24T08:04:25.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bd9b3640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f99b80b0a00 0x7f99b806a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43002/0 (socket says 172.21.15.57:43002) 2023-11-24T08:04:25.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.488+0000 7f99bd9b3640 1 -- 172.21.15.57:0/2954466987 learned_addr learned my addr 172.21.15.57:0/2954466987 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99be1b4640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 0x7f99b8145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150594292 0 0) 0x7f99b80b1b70 con 0x7f99b80b0a00 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a4003530 con 0x7f99b80b0a00 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035944083 0 0) 0x7f99b80b15b0 con 0x7f99b806acc0 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b80b1b70 con 0x7f99b806acc0 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1524414402 0 0) 0x7f99a4003530 con 0x7f99b80b0a00 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 msgr2=0x7f99b8145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 0x7f99b8145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 >> v1:172.21.15.132:6789/0 conn(0x7f99b806acc0 legacy=0x7f99b8144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80b4ca0 con 0x7f99b80b0a00 2023-11-24T08:04:25.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f99b4001680 con 0x7f99b80b0a00 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 >> v1:172.21.15.57:6789/0 conn(0x7f99b80b0a00 legacy=0x7f99b806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 0x7f99a4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99a40040f0 0x7f99a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a4004d10 0x7f99a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b1890 con 0x7f99a40040f0 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a400bad0 con 0x7f99a4004d10 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a400bc90 con 0x7f99b80b30a0 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bd1b2640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99a40040f0 0x7f99a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99be1b4640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a4004d10 0x7f99a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bd9b3640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 0x7f99a4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bd1b2640 1 -- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 msgr2=0x7f99a4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bd1b2640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99b80b30a0 0x7f99a4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bd1b2640 1 -- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a4004d10 msgr2=0x7f99a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bd1b2640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a4004d10 0x7f99a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.492+0000 7f99bd1b2640 1 -- 172.21.15.57:0/2954466987 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4003530 con 0x7f99a40040f0 2023-11-24T08:04:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bd1b2640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99a40040f0 0x7f99a40047d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99a80018d0 tx=0x7f99a801ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e8d191168a8496 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80052d0 con 0x7f99a40040f0 2023-11-24T08:04:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a8005450 con 0x7f99a40040f0 2023-11-24T08:04:25.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bc9b1640 1 -- 172.21.15.57:0/2954466987 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80a8870 con 0x7f99a40040f0 2023-11-24T08:04:25.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 -- 172.21.15.57:0/2954466987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99a40040f0 msgr2=0x7f99a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 --2- 172.21.15.57:0/2954466987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99a40040f0 0x7f99a40047d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99a80018d0 tx=0x7f99a801ec10 comp rx=0 tx=0).stop 2023-11-24T08:04:25.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99be1b4640 1 -- 172.21.15.57:0/2954466987 reap_dead start 2023-11-24T08:04:25.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 -- 172.21.15.57:0/2954466987 shutdown_connections 2023-11-24T08:04:25.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 -- 172.21.15.57:0/2954466987 >> 172.21.15.57:0/2954466987 conn(0x7f99b80b55c0 msgr2=0x7f99b80b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 -- 172.21.15.57:0/2954466987 shutdown_connections 2023-11-24T08:04:25.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 -- 172.21.15.57:0/2954466987 wait complete. 2023-11-24T08:04:25.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 Processor -- start 2023-11-24T08:04:25.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.496+0000 7f99bfc17640 1 -- start start 2023-11-24T08:04:25.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99a40040f0 0x7f99b809a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99b8133600 0x7f99b8134040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b8131720 0x7f99b809c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b809a850 con 0x7f99b8133600 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b809ab30 con 0x7f99b8131720 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b809ae10 con 0x7f99a40040f0 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99b8133600 0x7f99b8134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99b8133600 0x7f99b8134040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47090/0 (socket says 172.21.15.57:47090) 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 -- 172.21.15.57:0/2872231015 learned_addr learned my addr 172.21.15.57:0/2872231015 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd9b3640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99a40040f0 0x7f99b809a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99be1b4640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b8131720 0x7f99b809c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 -- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99a40040f0 msgr2=0x7f99b809a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99a40040f0 0x7f99b809a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 -- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b8131720 msgr2=0x7f99b809c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b8131720 0x7f99b809c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 -- 172.21.15.57:0/2872231015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b809b0f0 con 0x7f99b8133600 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bd1b2640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99b8133600 0x7f99b8134040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99a801ea40 tx=0x7f99a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99ae7fc640 1 -- 172.21.15.57:0/2872231015 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80a8d80 con 0x7f99b8133600 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99ae7fc640 1 -- 172.21.15.57:0/2872231015 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80050d0 con 0x7f99b8133600 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b809b3d0 con 0x7f99b8133600 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99ae7fc640 1 -- 172.21.15.57:0/2872231015 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8003600 con 0x7f99b8133600 2023-11-24T08:04:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b8133a80 con 0x7f99b8133600 2023-11-24T08:04:25.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b8133a80 con 0x7f99b8133600 2023-11-24T08:04:25.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.500+0000 7f99ae7fc640 1 -- 172.21.15.57:0/2872231015 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99a8003760 con 0x7f99b8133600 2023-11-24T08:04:25.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.504+0000 7f99ae7fc640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f999c066470 0x7f999c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.504+0000 7f99ae7fc640 1 -- 172.21.15.57:0/2872231015 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99a81215a0 con 0x7f99b8133600 2023-11-24T08:04:25.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.504+0000 7f99bd9b3640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f999c066470 0x7f999c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.504+0000 7f99bd9b3640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f999c066470 0x7f999c068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99b4001ec0 tx=0x7f99b4000bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.508+0000 7f99ae7fc640 1 -- 172.21.15.57:0/2872231015 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99a80eebf0 con 0x7f99b8133600 2023-11-24T08:04:25.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.668+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b8133a80 con 0x7f99b8133600 2023-11-24T08:04:25.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.668+0000 7f99ae7fc640 1 -- 172.21.15.57:0/2872231015 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f99a80f2210 con 0x7f99b8133600 2023-11-24T08:04:25.670 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:25.671 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:25.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f999c066470 msgr2=0x7f999c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f999c066470 0x7f999c068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99b4001ec0 tx=0x7f99b4000bd0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99b8133600 msgr2=0x7f99b8134040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99b8133600 0x7f99b8134040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99a801ea40 tx=0x7f99a4005800 comp rx=0 tx=0).stop 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 shutdown_connections 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f999c066470 0x7f999c068930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b8131720 0x7f99b809c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99b8133600 0x7f99b8134040 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 --2- 172.21.15.57:0/2872231015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99a40040f0 0x7f99b809a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 >> 172.21.15.57:0/2872231015 conn(0x7f99b80b55c0 msgr2=0x7f99b80ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 shutdown_connections 2023-11-24T08:04:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.672+0000 7f99bfc17640 1 -- 172.21.15.57:0/2872231015 wait complete. 2023-11-24T08:04:25.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:25.693 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:25.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f863a32a640 1 Processor -- start 2023-11-24T08:04:25.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f863a32a640 1 -- start start 2023-11-24T08:04:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f863a32a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f863415d7f0 0x7f86340d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f863a32a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86340d37e0 0x7f86340b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f863a32a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340d3c60 con 0x7f86340b1630 2023-11-24T08:04:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f863a32a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863406b980 con 0x7f86340d37e0 2023-11-24T08:04:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f863a32a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86340b0090 con 0x7f863415d7f0 2023-11-24T08:04:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f86388c7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f86340b1630 0x7f86340b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:57692/0 (socket says 172.21.15.57:57692) 2023-11-24T08:04:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f8633fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f863415d7f0 0x7f86340d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f86388c7640 1 -- 172.21.15.57:0/3733623562 learned_addr learned my addr 172.21.15.57:0/3733623562 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f86337fe640 1 --2- 172.21.15.57:0/3733623562 >> v2:172.21.15.132:3300/0 conn(0x7f86340d37e0 0x7f86340b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f86337fe640 1 -- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f863415d7f0 msgr2=0x7f86340d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f86337fe640 1 --2- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f863415d7f0 0x7f86340d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f86337fe640 1 -- 172.21.15.57:0/3733623562 >> v1:172.21.15.132:6789/0 conn(0x7f86340b1630 legacy=0x7f86340b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f86337fe640 1 -- 172.21.15.57:0/3733623562 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340b0330 con 0x7f86340d37e0 2023-11-24T08:04:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.840+0000 7f8633fff640 1 --2- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f863415d7f0 0x7f86340d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f86337fe640 1 --2- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340d37e0 0x7f86340b10f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f86280097c0 tx=0x7f862801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e5f9f0a164a5d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f8632ffd640 1 -- 172.21.15.57:0/3733623562 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280ab600 con 0x7f86340d37e0 2023-11-24T08:04:25.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f8632ffd640 1 -- 172.21.15.57:0/3733623562 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86280a7050 con 0x7f86340d37e0 2023-11-24T08:04:25.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f8632ffd640 1 -- 172.21.15.57:0/3733623562 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280ab980 con 0x7f86340d37e0 2023-11-24T08:04:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 -- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340d37e0 msgr2=0x7f86340b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 --2- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340d37e0 0x7f86340b10f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f86280097c0 tx=0x7f862801c310 comp rx=0 tx=0).stop 2023-11-24T08:04:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 -- 172.21.15.57:0/3733623562 shutdown_connections 2023-11-24T08:04:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 --2- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340d37e0 0x7f86340b10f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 --2- 172.21.15.57:0/3733623562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f863415d7f0 0x7f86340d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 -- 172.21.15.57:0/3733623562 >> 172.21.15.57:0/3733623562 conn(0x7f863409c790 msgr2=0x7f863408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 -- 172.21.15.57:0/3733623562 shutdown_connections 2023-11-24T08:04:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.844+0000 7f863a32a640 1 -- 172.21.15.57:0/3733623562 wait complete. 2023-11-24T08:04:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 Processor -- start 2023-11-24T08:04:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 -- start start 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340b1630 0x7f86341f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86340d37e0 0x7f8634152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863415d7f0 0x7f8634153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8634154230 con 0x7f863415d7f0 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863414f360 con 0x7f86340b1630 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86341f7710 con 0x7f86340d37e0 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863415d7f0 0x7f8634153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863415d7f0 0x7f8634153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58346/0 (socket says 172.21.15.57:58346) 2023-11-24T08:04:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 -- 172.21.15.57:0/4293071609 learned_addr learned my addr 172.21.15.57:0/4293071609 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:25.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f8633fff640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340b1630 0x7f86341f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86337fe640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86340d37e0 0x7f8634152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 -- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86340d37e0 msgr2=0x7f8634152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86340d37e0 0x7f8634152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 -- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340b1630 msgr2=0x7f86341f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340b1630 0x7f86341f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 -- 172.21.15.57:0/4293071609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624009420 con 0x7f863415d7f0 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86337fe640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86340d37e0 0x7f8634152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f8633fff640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340b1630 0x7f86341f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f86388c7640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863415d7f0 0x7f8634153310 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e550 tx=0x7f862c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f8630ff9640 1 -- 172.21.15.57:0/4293071609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0094e0 con 0x7f863415d7f0 2023-11-24T08:04:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f8630ff9640 1 -- 172.21.15.57:0/4293071609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c009640 con 0x7f863415d7f0 2023-11-24T08:04:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f8630ff9640 1 -- 172.21.15.57:0/4293071609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0099d0 con 0x7f863415d7f0 2023-11-24T08:04:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8628009420 con 0x7f863415d7f0 2023-11-24T08:04:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.848+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8634153c70 con 0x7f863415d7f0 2023-11-24T08:04:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.852+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8634071b20 con 0x7f863415d7f0 2023-11-24T08:04:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.852+0000 7f8630ff9640 1 -- 172.21.15.57:0/4293071609 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f862c01c460 con 0x7f863415d7f0 2023-11-24T08:04:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.852+0000 7f8630ff9640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8620066470 0x7f8620068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.852+0000 7f8630ff9640 1 -- 172.21.15.57:0/4293071609 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f862c086d10 con 0x7f863415d7f0 2023-11-24T08:04:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.852+0000 7f8633fff640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8620066470 0x7f8620068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.852+0000 7f8633fff640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8620066470 0x7f8620068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8624009bd0 tx=0x7f8624008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:25.856+0000 7f8630ff9640 1 -- 172.21.15.57:0/4293071609 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f862c054190 con 0x7f863415d7f0 2023-11-24T08:04:26.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.016+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f863404e8c0 con 0x7f863415d7f0 2023-11-24T08:04:26.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.016+0000 7f8630ff9640 1 -- 172.21.15.57:0/4293071609 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f862c0577b0 con 0x7f863415d7f0 2023-11-24T08:04:26.018 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:26.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8620066470 msgr2=0x7f8620068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8620066470 0x7f8620068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8624009bd0 tx=0x7f8624008040 comp rx=0 tx=0).stop 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863415d7f0 msgr2=0x7f8634153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863415d7f0 0x7f8634153310 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e550 tx=0x7f862c00ea10 comp rx=0 tx=0).stop 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 shutdown_connections 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8620066470 0x7f8620068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863415d7f0 0x7f8634153310 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86340d37e0 0x7f8634152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 --2- 172.21.15.57:0/4293071609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86340b1630 0x7f86341f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 >> 172.21.15.57:0/4293071609 conn(0x7f863409c790 msgr2=0x7f8634158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 shutdown_connections 2023-11-24T08:04:26.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.020+0000 7f863a32a640 1 -- 172.21.15.57:0/4293071609 wait complete. 2023-11-24T08:04:26.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:26.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd9439ec640 1 Processor -- start 2023-11-24T08:04:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd9439ec640 1 -- start start 2023-11-24T08:04:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd9439ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd93c0d39b0 0x7fd93c06bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd9439ec640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0b0090 con 0x7fd93c15d7f0 2023-11-24T08:04:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd9439ec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0b0330 con 0x7fd93c0b2100 2023-11-24T08:04:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd9439ec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93c06b980 con 0x7fd93c0d39b0 2023-11-24T08:04:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd941788640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd93c15d7f0 0x7fd93c0d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39182/0 (socket says 172.21.15.57:39182) 2023-11-24T08:04:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd941788640 1 -- 172.21.15.57:0/1282274805 learned_addr learned my addr 172.21.15.57:0/1282274805 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:26.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd940f87640 1 --2- 172.21.15.57:0/1282274805 >> v2:172.21.15.132:3300/0 conn(0x7fd93c0d39b0 0x7fd93c06bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd933fff640 1 -- 172.21.15.57:0/1282274805 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022856670 0 0) 0x7fd93c0b0090 con 0x7fd93c15d7f0 2023-11-24T08:04:26.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd933fff640 1 -- 172.21.15.57:0/1282274805 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd928003530 con 0x7fd93c15d7f0 2023-11-24T08:04:26.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd933fff640 1 -- 172.21.15.57:0/1282274805 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007634208 0 0) 0x7fd93c0b0330 con 0x7fd93c0b2100 2023-11-24T08:04:26.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd933fff640 1 -- 172.21.15.57:0/1282274805 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c0b0090 con 0x7fd93c0b2100 2023-11-24T08:04:26.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd940f87640 1 -- 172.21.15.57:0/1282274805 >> v1:172.21.15.132:6789/0 conn(0x7fd93c0b2100 legacy=0x7fd93c06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd940f87640 1 -- 172.21.15.57:0/1282274805 >> v1:172.21.15.57:6789/0 conn(0x7fd93c15d7f0 legacy=0x7fd93c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.184+0000 7fd940f87640 1 -- 172.21.15.57:0/1282274805 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0b0610 con 0x7fd93c0d39b0 2023-11-24T08:04:26.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd940f87640 1 --2- 172.21.15.57:0/1282274805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c0d39b0 0x7fd93c06bcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0097c0 tx=0x7fd92c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=960bf1667bfda095 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd933fff640 1 -- 172.21.15.57:0/1282274805 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0ab600 con 0x7fd93c0d39b0 2023-11-24T08:04:26.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd933fff640 1 -- 172.21.15.57:0/1282274805 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0a7050 con 0x7fd93c0d39b0 2023-11-24T08:04:26.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd933fff640 1 -- 172.21.15.57:0/1282274805 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0ab980 con 0x7fd93c0d39b0 2023-11-24T08:04:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd9439ec640 1 -- 172.21.15.57:0/1282274805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c0d39b0 msgr2=0x7fd93c06bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1282274805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c0d39b0 0x7fd93c06bcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0097c0 tx=0x7fd92c01c480 comp rx=0 tx=0).stop 2023-11-24T08:04:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd9439ec640 1 -- 172.21.15.57:0/1282274805 shutdown_connections 2023-11-24T08:04:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1282274805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c0d39b0 0x7fd93c06bcd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd9439ec640 1 -- 172.21.15.57:0/1282274805 >> 172.21.15.57:0/1282274805 conn(0x7fd93c09c790 msgr2=0x7fd93c08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd9439ec640 1 -- 172.21.15.57:0/1282274805 shutdown_connections 2023-11-24T08:04:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.188+0000 7fd9439ec640 1 -- 172.21.15.57:0/1282274805 wait complete. 2023-11-24T08:04:26.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 Processor -- start 2023-11-24T08:04:26.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 -- start start 2023-11-24T08:04:26.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd93c0b2100 0x7fd93c153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd93c0d39b0 0x7fd93c14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c15d7f0 0x7fd93c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c153e50 con 0x7fd93c0d39b0 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0cbb60 con 0x7fd93c15d7f0 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0cbe40 con 0x7fd93c0b2100 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd93c0d39b0 0x7fd93c14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd93c0d39b0 0x7fd93c14ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58354/0 (socket says 172.21.15.57:58354) 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 -- 172.21.15.57:0/1012687651 learned_addr learned my addr 172.21.15.57:0/1012687651 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd941f89640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c15d7f0 0x7fd93c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd941788640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd93c0b2100 0x7fd93c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 -- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd93c0b2100 msgr2=0x7fd93c153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd93c0b2100 0x7fd93c153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 -- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c15d7f0 msgr2=0x7fd93c150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c15d7f0 0x7fd93c150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 -- 172.21.15.57:0/1012687651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c009420 con 0x7fd93c0d39b0 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd941f89640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c15d7f0 0x7fd93c150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd940f87640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd93c0d39b0 0x7fd93c14ba20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0ae040 tx=0x7fd92c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd931ffb640 1 -- 172.21.15.57:0/1012687651 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b4430 con 0x7fd93c0d39b0 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd931ffb640 1 -- 172.21.15.57:0/1012687651 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0b45b0 con 0x7fd93c0d39b0 2023-11-24T08:04:26.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c0cc120 con 0x7fd93c0d39b0 2023-11-24T08:04:26.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd931ffb640 1 -- 172.21.15.57:0/1012687651 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b4960 con 0x7fd93c0d39b0 2023-11-24T08:04:26.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.192+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c0cc6e0 con 0x7fd93c0d39b0 2023-11-24T08:04:26.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.196+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c0cc8d0 con 0x7fd93c0d39b0 2023-11-24T08:04:26.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.196+0000 7fd931ffb640 1 -- 172.21.15.57:0/1012687651 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd92c0b2040 con 0x7fd93c0d39b0 2023-11-24T08:04:26.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.196+0000 7fd931ffb640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd920066470 0x7fd920068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.196+0000 7fd931ffb640 1 -- 172.21.15.57:0/1012687651 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd92c11dc50 con 0x7fd93c0d39b0 2023-11-24T08:04:26.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.196+0000 7fd941788640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd920066470 0x7fd920068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.196+0000 7fd941788640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd920066470 0x7fd920068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd938007fd0 tx=0x7fd938007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.200+0000 7fd931ffb640 1 -- 172.21.15.57:0/1012687651 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd92c0eb030 con 0x7fd93c0d39b0 2023-11-24T08:04:26.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.355+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd93c04e8c0 con 0x7fd93c0d39b0 2023-11-24T08:04:26.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.355+0000 7fd931ffb640 1 -- 172.21.15.57:0/1012687651 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd92c0ee650 con 0x7fd93c0d39b0 2023-11-24T08:04:26.359 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd920066470 msgr2=0x7fd920068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd920066470 0x7fd920068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd938007fd0 tx=0x7fd938007d80 comp rx=0 tx=0).stop 2023-11-24T08:04:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd93c0d39b0 msgr2=0x7fd93c14ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd93c0d39b0 0x7fd93c14ba20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0ae040 tx=0x7fd92c019220 comp rx=0 tx=0).stop 2023-11-24T08:04:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 shutdown_connections 2023-11-24T08:04:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd920066470 0x7fd920068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd93c15d7f0 0x7fd93c150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd93c0d39b0 0x7fd93c14ba20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 --2- 172.21.15.57:0/1012687651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd93c0b2100 0x7fd93c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 >> 172.21.15.57:0/1012687651 conn(0x7fd93c09c790 msgr2=0x7fd93c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 shutdown_connections 2023-11-24T08:04:26.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.359+0000 7fd9439ec640 1 -- 172.21.15.57:0/1012687651 wait complete. 2023-11-24T08:04:26.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:26.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.523+0000 7fc5b2ff8640 1 Processor -- start 2023-11-24T08:04:26.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.523+0000 7fc5b2ff8640 1 -- start start 2023-11-24T08:04:26.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b2ff8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5ac0cfe90 0x7fc5ac0d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b2ff8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0b21f0 0x7fc5ac160a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b2ff8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac0cec40 con 0x7fc5ac0d0270 2023-11-24T08:04:26.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b2ff8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ce030 con 0x7fc5ac0cfe90 2023-11-24T08:04:26.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b2ff8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ce310 con 0x7fc5ac0b21f0 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b27f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0b21f0 0x7fc5ac160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b27f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0b21f0 0x7fc5ac160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:38690/0 (socket says 172.21.15.57:38690) 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1098759042 learned_addr learned my addr 172.21.15.57:0/1098759042 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b1ff6640 1 --2- 172.21.15.57:0/1098759042 >> v2:172.21.15.132:3300/0 conn(0x7fc5ac0cfe90 0x7fc5ac0d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1098759042 >> v2:172.21.15.132:3300/0 conn(0x7fc5ac0cfe90 msgr2=0x7fc5ac0d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b27f7640 1 --2- 172.21.15.57:0/1098759042 >> v2:172.21.15.132:3300/0 conn(0x7fc5ac0cfe90 0x7fc5ac0d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1098759042 >> v1:172.21.15.132:6789/0 conn(0x7fc5ac0d0270 legacy=0x7fc5ac0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1098759042 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0ce5f0 con 0x7fc5ac0b21f0 2023-11-24T08:04:26.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.527+0000 7fc5b0ff4640 1 -- 172.21.15.57:0/1098759042 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653757402 0 0) 0x7fc5ac0cec40 con 0x7fc5ac0d0270 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b27f7640 1 --2- 172.21.15.57:0/1098759042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0b21f0 0x7fc5ac160a70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94e148db5169c635 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b0ff4640 1 -- 172.21.15.57:0/1098759042 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40a57f0 con 0x7fc5ac0b21f0 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b0ff4640 1 -- 172.21.15.57:0/1098759042 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40a5950 con 0x7fc5ac0b21f0 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b0ff4640 1 -- 172.21.15.57:0/1098759042 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40a5ce0 con 0x7fc5ac0b21f0 2023-11-24T08:04:26.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1098759042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0b21f0 msgr2=0x7fc5ac160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1098759042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0b21f0 0x7fc5ac160a70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a401ca10 comp rx=0 tx=0).stop 2023-11-24T08:04:26.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1098759042 shutdown_connections 2023-11-24T08:04:26.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1098759042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0b21f0 0x7fc5ac160a70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1098759042 >> v2:172.21.15.132:3300/0 conn(0x7fc5ac0cfe90 0x7fc5ac0d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1098759042 >> 172.21.15.57:0/1098759042 conn(0x7fc5ac09c5c0 msgr2=0x7fc5ac0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1098759042 shutdown_connections 2023-11-24T08:04:26.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1098759042 wait complete. 2023-11-24T08:04:26.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 Processor -- start 2023-11-24T08:04:26.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.531+0000 7fc5b2ff8640 1 -- start start 2023-11-24T08:04:26.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5ac0b21f0 0x7fc5ac15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0cfe90 0x7fc5ac152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5ac0d0270 0x7fc5ac15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac153850 con 0x7fc5ac0d0270 2023-11-24T08:04:26.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac152c40 con 0x7fc5ac0b21f0 2023-11-24T08:04:26.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac152f20 con 0x7fc5ac0cfe90 2023-11-24T08:04:26.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5ac0d0270 0x7fc5ac15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5ac0d0270 0x7fc5ac15ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58356/0 (socket says 172.21.15.57:58356) 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1360339632 learned_addr learned my addr 172.21.15.57:0/1360339632 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b17f5640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0cfe90 0x7fc5ac152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b1ff6640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5ac0b21f0 0x7fc5ac15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0cfe90 msgr2=0x7fc5ac152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0cfe90 0x7fc5ac152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5ac0b21f0 msgr2=0x7fc5ac15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5ac0b21f0 0x7fc5ac15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 -- 172.21.15.57:0/1360339632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009b30 con 0x7fc5ac0d0270 2023-11-24T08:04:26.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b27f7640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5ac0d0270 0x7fc5ac15ba80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40af040 tx=0x7fc5a40197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5a27fc640 1 -- 172.21.15.57:0/1360339632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40b8670 con 0x7fc5ac0d0270 2023-11-24T08:04:26.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5a27fc640 1 -- 172.21.15.57:0/1360339632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40b87d0 con 0x7fc5ac0d0270 2023-11-24T08:04:26.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5a27fc640 1 -- 172.21.15.57:0/1360339632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40b8b80 con 0x7fc5ac0d0270 2023-11-24T08:04:26.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac153200 con 0x7fc5ac0d0270 2023-11-24T08:04:26.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac154d10 con 0x7fc5ac0d0270 2023-11-24T08:04:26.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac04e850 con 0x7fc5ac0d0270 2023-11-24T08:04:26.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.535+0000 7fc5a27fc640 1 -- 172.21.15.57:0/1360339632 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5a40b8ce0 con 0x7fc5ac0d0270 2023-11-24T08:04:26.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.539+0000 7fc5a27fc640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc590066470 0x7fc590068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.539+0000 7fc5a27fc640 1 -- 172.21.15.57:0/1360339632 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5a411f3f0 con 0x7fc5ac0d0270 2023-11-24T08:04:26.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.539+0000 7fc5b1ff6640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc590066470 0x7fc590068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.539+0000 7fc5b1ff6640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc590066470 0x7fc590068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009ac0 tx=0x7fc5a8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.543+0000 7fc5a27fc640 1 -- 172.21.15.57:0/1360339632 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5a40ec9a0 con 0x7fc5ac0d0270 2023-11-24T08:04:26.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.699+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5ac0cf270 con 0x7fc5ac0d0270 2023-11-24T08:04:26.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.699+0000 7fc5a27fc640 1 -- 172.21.15.57:0/1360339632 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5a40effc0 con 0x7fc5ac0d0270 2023-11-24T08:04:26.704 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc590066470 msgr2=0x7fc590068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc590066470 0x7fc590068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009ac0 tx=0x7fc5a8009190 comp rx=0 tx=0).stop 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5ac0d0270 msgr2=0x7fc5ac15ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5ac0d0270 0x7fc5ac15ba80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40af040 tx=0x7fc5a40197b0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 shutdown_connections 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc590066470 0x7fc590068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5ac0d0270 0x7fc5ac15ba80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5ac0cfe90 0x7fc5ac152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 --2- 172.21.15.57:0/1360339632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5ac0b21f0 0x7fc5ac15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 >> 172.21.15.57:0/1360339632 conn(0x7fc5ac09c5c0 msgr2=0x7fc5ac15ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 shutdown_connections 2023-11-24T08:04:26.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.703+0000 7fc5b2ff8640 1 -- 172.21.15.57:0/1360339632 wait complete. 2023-11-24T08:04:26.787 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2023-11-24T08:04:26.787 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:04:26.787 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:26.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.927+0000 7f15fe6d6640 1 Processor -- start 2023-11-24T08:04:26.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.927+0000 7f15fe6d6640 1 -- start start 2023-11-24T08:04:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.927+0000 7f15fe6d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fe6d6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15f80d3a50 0x7f15f80cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fe6d6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f806d050 con 0x7f15f80b25c0 2023-11-24T08:04:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fe6d6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80d2240 con 0x7f15f80d3a50 2023-11-24T08:04:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fe6d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f806d4e0 con 0x7f15f815d720 2023-11-24T08:04:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fcc73640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15f80d3a50 0x7f15f80cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15f77fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f15f80b25c0 0x7f15f80d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39194/0 (socket says 172.21.15.57:39194) 2023-11-24T08:04:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15f77fe640 1 -- 172.21.15.57:0/3927984470 learned_addr learned my addr 172.21.15.57:0/3927984470 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15f7fff640 1 --2- 172.21.15.57:0/3927984470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fcc73640 1 -- 172.21.15.57:0/3927984470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 msgr2=0x7f15f80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:26.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fcc73640 1 --2- 172.21.15.57:0/3927984470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fcc73640 1 -- 172.21.15.57:0/3927984470 >> v1:172.21.15.57:6789/0 conn(0x7f15f80b25c0 legacy=0x7f15f80d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fcc73640 1 -- 172.21.15.57:0/3927984470 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f806c720 con 0x7f15f80d3a50 2023-11-24T08:04:26.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15f6ffd640 1 -- 172.21.15.57:0/3927984470 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672678738 0 0) 0x7f15f806d050 con 0x7f15f80b25c0 2023-11-24T08:04:26.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.931+0000 7f15fcc73640 1 --2- 172.21.15.57:0/3927984470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80d3a50 0x7f15f80cde10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009dc0 tx=0x7f15f001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f6d4a3a029c7e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15f6ffd640 1 -- 172.21.15.57:0/3927984470 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f00a59c0 con 0x7f15f80d3a50 2023-11-24T08:04:26.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15f6ffd640 1 -- 172.21.15.57:0/3927984470 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f00a5b20 con 0x7f15f80d3a50 2023-11-24T08:04:26.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15f6ffd640 1 -- 172.21.15.57:0/3927984470 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f00ad440 con 0x7f15f80d3a50 2023-11-24T08:04:26.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- 172.21.15.57:0/3927984470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80d3a50 msgr2=0x7f15f80cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/3927984470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80d3a50 0x7f15f80cde10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009dc0 tx=0x7f15f001c900 comp rx=0 tx=0).stop 2023-11-24T08:04:26.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- 172.21.15.57:0/3927984470 shutdown_connections 2023-11-24T08:04:26.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/3927984470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80d3a50 0x7f15f80cde10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/3927984470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- 172.21.15.57:0/3927984470 >> 172.21.15.57:0/3927984470 conn(0x7f15f808af70 msgr2=0x7f15f809c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:26.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- 172.21.15.57:0/3927984470 shutdown_connections 2023-11-24T08:04:26.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- 172.21.15.57:0/3927984470 wait complete. 2023-11-24T08:04:26.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 Processor -- start 2023-11-24T08:04:26.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- start start 2023-11-24T08:04:26.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80b25c0 0x7f15f815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15f80d3a50 0x7f15f806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8156df0 con 0x7f15f80b25c0 2023-11-24T08:04:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f81558c0 con 0x7f15f80d3a50 2023-11-24T08:04:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15fe6d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8156b10 con 0x7f15f815d720 2023-11-24T08:04:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15f7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80b25c0 0x7f15f815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15f7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80b25c0 0x7f15f815a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58378/0 (socket says 172.21.15.57:58378) 2023-11-24T08:04:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.935+0000 7f15f7fff640 1 -- 172.21.15.57:0/1497562744 learned_addr learned my addr 172.21.15.57:0/1497562744 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15fcc73640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f77fe640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15f80d3a50 0x7f15f806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f7fff640 1 -- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 msgr2=0x7f15f814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f7fff640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f7fff640 1 -- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15f80d3a50 msgr2=0x7f15f806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:26.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f7fff640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15f80d3a50 0x7f15f806bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f7fff640 1 -- 172.21.15.57:0/1497562744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0009a70 con 0x7f15f80b25c0 2023-11-24T08:04:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f7fff640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80b25c0 0x7f15f815a620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15e800e8a0 tx=0x7f15e800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f4ff9640 1 -- 172.21.15.57:0/1497562744 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8009510 con 0x7f15f80b25c0 2023-11-24T08:04:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f4ff9640 1 -- 172.21.15.57:0/1497562744 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e800c940 con 0x7f15f80b25c0 2023-11-24T08:04:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f8155270 con 0x7f15f80b25c0 2023-11-24T08:04:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f4ff9640 1 -- 172.21.15.57:0/1497562744 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e800ccb0 con 0x7f15f80b25c0 2023-11-24T08:04:26.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f806c310 con 0x7f15f80b25c0 2023-11-24T08:04:26.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f8067520 con 0x7f15f80b25c0 2023-11-24T08:04:26.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f4ff9640 1 -- 172.21.15.57:0/1497562744 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15e8013470 con 0x7f15f80b25c0 2023-11-24T08:04:26.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f4ff9640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f15e4066470 0x7f15e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:26.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.939+0000 7f15f4ff9640 1 -- 172.21.15.57:0/1497562744 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15e8083f00 con 0x7f15f80b25c0 2023-11-24T08:04:26.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.943+0000 7f15f77fe640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f15e4066470 0x7f15e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:26.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.943+0000 7f15f77fe640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f15e4066470 0x7f15e4068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f15f80c6df0 tx=0x7f15ec007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:26.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:26.943+0000 7f15f4ff9640 1 -- 172.21.15.57:0/1497562744 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15e8051420 con 0x7f15f80b25c0 2023-11-24T08:04:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.103+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15f80d29f0 con 0x7f15f80b25c0 2023-11-24T08:04:27.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.103+0000 7f15f4ff9640 1 -- 172.21.15.57:0/1497562744 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f15e8054a40 con 0x7f15f80b25c0 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:27.107 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f15e4066470 msgr2=0x7f15e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f15e4066470 0x7f15e4068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f15f80c6df0 tx=0x7f15ec007d60 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80b25c0 msgr2=0x7f15f815a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80b25c0 0x7f15f815a620 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15e800e8a0 tx=0x7f15e800eca0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 shutdown_connections 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f15e4066470 0x7f15e4068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f15f815d720 0x7f15f814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15f80d3a50 0x7f15f806bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 --2- 172.21.15.57:0/1497562744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15f80b25c0 0x7f15f815a620 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 >> 172.21.15.57:0/1497562744 conn(0x7f15f808af70 msgr2=0x7f15f80affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 shutdown_connections 2023-11-24T08:04:27.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.107+0000 7f15fe6d6640 1 -- 172.21.15.57:0/1497562744 wait complete. 2023-11-24T08:04:27.128 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:27.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:27.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.271+0000 7f3cfe416640 1 Processor -- start 2023-11-24T08:04:27.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.271+0000 7f3cfe416640 1 -- start start 2023-11-24T08:04:27.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cfe416640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3cf80ce420 0x7f3cf815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cfe416640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf80b3510 con 0x7f3cf80cd850 2023-11-24T08:04:27.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cfe416640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf80b37f0 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cfe416640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80b3ad0 con 0x7f3cf80ce420 2023-11-24T08:04:27.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cf77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3cf80ce420 0x7f3cf815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cfc9b3640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3cf80cd850 0x7f3cf806c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39208/0 (socket says 172.21.15.57:39208) 2023-11-24T08:04:27.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cfc9b3640 1 -- 172.21.15.57:0/1208694186 learned_addr learned my addr 172.21.15.57:0/1208694186 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:27.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cf77fe640 1 -- 172.21.15.57:0/1208694186 >> v1:172.21.15.132:6789/0 conn(0x7f3cf80ae4a0 legacy=0x7f3cf80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cf77fe640 1 -- 172.21.15.57:0/1208694186 >> v1:172.21.15.57:6789/0 conn(0x7f3cf80cd850 legacy=0x7f3cf806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cf77fe640 1 -- 172.21.15.57:0/1208694186 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80b3db0 con 0x7f3cf80ce420 2023-11-24T08:04:27.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cf6ffd640 1 -- 172.21.15.57:0/1208694186 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792496798 0 0) 0x7f3cf80b3510 con 0x7f3cf80cd850 2023-11-24T08:04:27.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cf77fe640 1 --2- 172.21.15.57:0/1208694186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ce420 0x7f3cf815ba00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0097c0 tx=0x7f3cec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd8b52e055b4990 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.275+0000 7f3cf6ffd640 1 -- 172.21.15.57:0/1208694186 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0ab670 con 0x7f3cf80ce420 2023-11-24T08:04:27.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cf6ffd640 1 -- 172.21.15.57:0/1208694186 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec0ab7d0 con 0x7f3cf80ce420 2023-11-24T08:04:27.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cf6ffd640 1 -- 172.21.15.57:0/1208694186 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0abb60 con 0x7f3cf80ce420 2023-11-24T08:04:27.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- 172.21.15.57:0/1208694186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ce420 msgr2=0x7f3cf815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 --2- 172.21.15.57:0/1208694186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ce420 0x7f3cf815ba00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0097c0 tx=0x7f3cec01c450 comp rx=0 tx=0).stop 2023-11-24T08:04:27.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- 172.21.15.57:0/1208694186 shutdown_connections 2023-11-24T08:04:27.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 --2- 172.21.15.57:0/1208694186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ce420 0x7f3cf815ba00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- 172.21.15.57:0/1208694186 >> 172.21.15.57:0/1208694186 conn(0x7f3cf80b0c80 msgr2=0x7f3cf80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- 172.21.15.57:0/1208694186 shutdown_connections 2023-11-24T08:04:27.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- 172.21.15.57:0/1208694186 wait complete. 2023-11-24T08:04:27.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 Processor -- start 2023-11-24T08:04:27.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- start start 2023-11-24T08:04:27.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ae4a0 0x7f3cf8070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3cf80cd850 0x7f3cf814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cf80ce420 0x7f3cf8153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80715d0 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80718b0 con 0x7f3cf80ce420 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfe416640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8071b90 con 0x7f3cf80cd850 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ae4a0 0x7f3cf8070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ae4a0 0x7f3cf8070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58388/0 (socket says 172.21.15.57:58388) 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cf7fff640 1 -- 172.21.15.57:0/149823087 learned_addr learned my addr 172.21.15.57:0/149823087 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cfc9b3640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cf80ce420 0x7f3cf8153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.279+0000 7f3cf77fe640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3cf80cd850 0x7f3cf814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf7fff640 1 -- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3cf80cd850 msgr2=0x7f3cf814e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf7fff640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3cf80cd850 0x7f3cf814e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf7fff640 1 -- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cf80ce420 msgr2=0x7f3cf8153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf7fff640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cf80ce420 0x7f3cf8153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf7fff640 1 -- 172.21.15.57:0/149823087 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec009420 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf7fff640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ae4a0 0x7f3cf8070ff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c500 tx=0x7f3ce800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf4ff9640 1 -- 172.21.15.57:0/149823087 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8005220 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf4ff9640 1 -- 172.21.15.57:0/149823087 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8005380 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf4ff9640 1 -- 172.21.15.57:0/149823087 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8007270 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf8071e70 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf81544f0 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf804e8c0 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf4ff9640 1 -- 172.21.15.57:0/149823087 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ce80073d0 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.283+0000 7f3cf4ff9640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ce4066470 0x7f3ce4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.287+0000 7f3cf4ff9640 1 -- 172.21.15.57:0/149823087 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ce8083630 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.287+0000 7f3cf77fe640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ce4066470 0x7f3ce4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.287+0000 7f3cf77fe640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ce4066470 0x7f3ce4068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0af000 tx=0x7f3cec0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.287+0000 7f3cf4ff9640 1 -- 172.21.15.57:0/149823087 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ce8050b70 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.447+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cf815b9c0 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.447+0000 7f3cf4ff9640 1 -- 172.21.15.57:0/149823087 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ce8054190 con 0x7f3cf80ae4a0 2023-11-24T08:04:27.452 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ce4066470 msgr2=0x7f3ce4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ce4066470 0x7f3ce4068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0af000 tx=0x7f3cec0b6040 comp rx=0 tx=0).stop 2023-11-24T08:04:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ae4a0 msgr2=0x7f3cf8070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ae4a0 0x7f3cf8070ff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c500 tx=0x7f3ce800c9c0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 shutdown_connections 2023-11-24T08:04:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3ce4066470 0x7f3ce4068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cf80ce420 0x7f3cf8153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3cf80cd850 0x7f3cf814e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 --2- 172.21.15.57:0/149823087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cf80ae4a0 0x7f3cf8070ff0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 >> 172.21.15.57:0/149823087 conn(0x7f3cf80b0c80 msgr2=0x7f3cf806c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 shutdown_connections 2023-11-24T08:04:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.451+0000 7f3cfe416640 1 -- 172.21.15.57:0/149823087 wait complete. 2023-11-24T08:04:27.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:27.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.615+0000 7fbd39016640 1 Processor -- start 2023-11-24T08:04:27.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.615+0000 7fbd39016640 1 -- start start 2023-11-24T08:04:27.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd39016640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd34071180 0x7fbd34168320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd39016640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd340b23a0 con 0x7fbd340ad900 2023-11-24T08:04:27.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd39016640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3415e490 con 0x7fbd340adce0 2023-11-24T08:04:27.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd39016640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3415e770 con 0x7fbd34071180 2023-11-24T08:04:27.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd3359e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd34071180 0x7fbd34168320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd32d9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbd340ad900 0x7fbd3415dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39212/0 (socket says 172.21.15.57:39212) 2023-11-24T08:04:27.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd32d9d640 1 -- 172.21.15.57:0/2264073856 learned_addr learned my addr 172.21.15.57:0/2264073856 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:27.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd3359e640 1 -- 172.21.15.57:0/2264073856 >> v1:172.21.15.132:6789/0 conn(0x7fbd340adce0 legacy=0x7fbd34070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd3359e640 1 -- 172.21.15.57:0/2264073856 >> v1:172.21.15.57:6789/0 conn(0x7fbd340ad900 legacy=0x7fbd3415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd3359e640 1 -- 172.21.15.57:0/2264073856 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3415ea50 con 0x7fbd34071180 2023-11-24T08:04:27.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd3259c640 1 -- 172.21.15.57:0/2264073856 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992496223 0 0) 0x7fbd340b23a0 con 0x7fbd340ad900 2023-11-24T08:04:27.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.619+0000 7fbd3359e640 1 --2- 172.21.15.57:0/2264073856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd34071180 0x7fbd34168320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009d90 tx=0x7fbd2c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1613fd6c1c75dd84 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd3259c640 1 -- 172.21.15.57:0/2264073856 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0a5920 con 0x7fbd34071180 2023-11-24T08:04:27.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd3259c640 1 -- 172.21.15.57:0/2264073856 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0a5a80 con 0x7fbd34071180 2023-11-24T08:04:27.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd3259c640 1 -- 172.21.15.57:0/2264073856 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0a5e10 con 0x7fbd34071180 2023-11-24T08:04:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 -- 172.21.15.57:0/2264073856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd34071180 msgr2=0x7fbd34168320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 --2- 172.21.15.57:0/2264073856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd34071180 0x7fbd34168320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009d90 tx=0x7fbd2c01c950 comp rx=0 tx=0).stop 2023-11-24T08:04:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 -- 172.21.15.57:0/2264073856 shutdown_connections 2023-11-24T08:04:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 --2- 172.21.15.57:0/2264073856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd34071180 0x7fbd34168320 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 -- 172.21.15.57:0/2264073856 >> 172.21.15.57:0/2264073856 conn(0x7fbd340cf410 msgr2=0x7fbd340cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 -- 172.21.15.57:0/2264073856 shutdown_connections 2023-11-24T08:04:27.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 -- 172.21.15.57:0/2264073856 wait complete. 2023-11-24T08:04:27.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 Processor -- start 2023-11-24T08:04:27.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 -- start start 2023-11-24T08:04:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.623+0000 7fbd39016640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34071180 0x7fbd34153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd340ad900 0x7fbd3414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd340adce0 0x7fbd34151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340ccf70 con 0x7fbd340ad900 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340cc360 con 0x7fbd340adce0 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340cc640 con 0x7fbd34071180 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd340ad900 0x7fbd3414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd340ad900 0x7fbd3414cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58410/0 (socket says 172.21.15.57:58410) 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 -- 172.21.15.57:0/2415001530 learned_addr learned my addr 172.21.15.57:0/2415001530 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd3359e640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd340adce0 0x7fbd34151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd32d9d640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34071180 0x7fbd34153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 -- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34071180 msgr2=0x7fbd34153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34071180 0x7fbd34153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 -- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd340adce0 msgr2=0x7fbd34151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd340adce0 0x7fbd34151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 -- 172.21.15.57:0/2415001530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c009a70 con 0x7fbd340ad900 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2bfff640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd340ad900 0x7fbd3414cf70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c3c0 tx=0x7fbd1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2b7fe640 1 -- 172.21.15.57:0/2415001530 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0052d0 con 0x7fbd340ad900 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2b7fe640 1 -- 172.21.15.57:0/2415001530 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c005430 con 0x7fbd340ad900 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd340cc920 con 0x7fbd340ad900 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2b7fe640 1 -- 172.21.15.57:0/2415001530 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c003840 con 0x7fbd340ad900 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3414d4b0 con 0x7fbd340ad900 2023-11-24T08:04:27.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3404e8c0 con 0x7fbd340ad900 2023-11-24T08:04:27.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.627+0000 7fbd2b7fe640 1 -- 172.21.15.57:0/2415001530 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd1c0039a0 con 0x7fbd340ad900 2023-11-24T08:04:27.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.631+0000 7fbd2b7fe640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd14066470 0x7fbd14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.631+0000 7fbd2b7fe640 1 -- 172.21.15.57:0/2415001530 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd1c083310 con 0x7fbd340ad900 2023-11-24T08:04:27.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.631+0000 7fbd32d9d640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd14066470 0x7fbd14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.631+0000 7fbd32d9d640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd14066470 0x7fbd14068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbd24007a90 tx=0x7fbd240079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.631+0000 7fbd2b7fe640 1 -- 172.21.15.57:0/2415001530 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd1c050840 con 0x7fbd340ad900 2023-11-24T08:04:27.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.787+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd340ce9a0 con 0x7fbd340ad900 2023-11-24T08:04:27.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd2b7fe640 1 -- 172.21.15.57:0/2415001530 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd1c053e60 con 0x7fbd340ad900 2023-11-24T08:04:27.792 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:27.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd14066470 msgr2=0x7fbd14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd14066470 0x7fbd14068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbd24007a90 tx=0x7fbd240079e0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd340ad900 msgr2=0x7fbd3414cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd340ad900 0x7fbd3414cf70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c3c0 tx=0x7fbd1c00c880 comp rx=0 tx=0).stop 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 shutdown_connections 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd14066470 0x7fbd14068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd340adce0 0x7fbd34151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd340ad900 0x7fbd3414cf70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 --2- 172.21.15.57:0/2415001530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd34071180 0x7fbd34153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 >> 172.21.15.57:0/2415001530 conn(0x7fbd340cf410 msgr2=0x7fbd340b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 shutdown_connections 2023-11-24T08:04:27.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.791+0000 7fbd39016640 1 -- 172.21.15.57:0/2415001530 wait complete. 2023-11-24T08:04:27.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.955+0000 7fbdb80d6640 1 Processor -- start 2023-11-24T08:04:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.955+0000 7fbdb80d6640 1 -- start start 2023-11-24T08:04:27.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb80d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 0x7fbdb00cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb80d6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb006c620 con 0x7fbdb015d630 2023-11-24T08:04:27.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb80d6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb006ba10 con 0x7fbdb00cf300 2023-11-24T08:04:27.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb80d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00cf790 con 0x7fbdb00ce200 2023-11-24T08:04:27.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbdb015d630 0x7fbdb00cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39216/0 (socket says 172.21.15.57:39216) 2023-11-24T08:04:27.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 -- 172.21.15.57:0/1401203917 learned_addr learned my addr 172.21.15.57:0/1401203917 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:27.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5671640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 0x7fbdb00cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005244624 0 0) 0x7fbdb006c620 con 0x7fbdb015d630 2023-11-24T08:04:27.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd9c003530 con 0x7fbdb015d630 2023-11-24T08:04:27.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1407065787 0 0) 0x7fbd9c003530 con 0x7fbdb015d630 2023-11-24T08:04:27.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 msgr2=0x7fbdb00cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 0x7fbdb00cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 >> v1:172.21.15.132:6789/0 conn(0x7fbdb00cf300 legacy=0x7fbdb006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb006bcf0 con 0x7fbdb015d630 2023-11-24T08:04:27.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fbdac001680 con 0x7fbdb015d630 2023-11-24T08:04:27.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 >> v1:172.21.15.57:6789/0 conn(0x7fbdb015d630 legacy=0x7fbdb00cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 0x7fbd9c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9c004d10 0x7fbd9c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb00cf790 con 0x7fbd9c0039b0 2023-11-24T08:04:27.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c00b990 con 0x7fbd9c004d10 2023-11-24T08:04:27.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c00bb50 con 0x7fbdb00ce200 2023-11-24T08:04:27.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5671640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 0x7fbd9c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb6673640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9c004d10 0x7fbd9c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 -- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 msgr2=0x7fbd9c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb00ce200 0x7fbd9c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 -- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9c004d10 msgr2=0x7fbd9c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:27.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9c004d10 0x7fbd9c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.959+0000 7fbdb5e72640 1 -- 172.21.15.57:0/1401203917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c003530 con 0x7fbd9c0039b0 2023-11-24T08:04:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb5e72640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c190 tx=0x7fbdac01caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6e58c08351f313 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac005ae0 con 0x7fbd9c0039b0 2023-11-24T08:04:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac005c60 con 0x7fbd9c0039b0 2023-11-24T08:04:27.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb4e70640 1 -- 172.21.15.57:0/1401203917 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac007070 con 0x7fbd9c0039b0 2023-11-24T08:04:27.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 -- 172.21.15.57:0/1401203917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 msgr2=0x7fbd9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 --2- 172.21.15.57:0/1401203917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c190 tx=0x7fbdac01caf0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb6673640 1 -- 172.21.15.57:0/1401203917 reap_dead start 2023-11-24T08:04:27.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 -- 172.21.15.57:0/1401203917 shutdown_connections 2023-11-24T08:04:27.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 -- 172.21.15.57:0/1401203917 >> 172.21.15.57:0/1401203917 conn(0x7fbdb006e860 msgr2=0x7fbdb006ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:27.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 -- 172.21.15.57:0/1401203917 shutdown_connections 2023-11-24T08:04:27.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 -- 172.21.15.57:0/1401203917 wait complete. 2023-11-24T08:04:27.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 Processor -- start 2023-11-24T08:04:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.963+0000 7fbdb80d6640 1 -- start start 2023-11-24T08:04:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbdb0155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb01630e0 0x7fbdb0157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdb0160ed0 0x7fbdb0161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb01561b0 con 0x7fbd9c0039b0 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0158ca0 con 0x7fbdb0160ed0 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0163610 con 0x7fbdb01630e0 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbdb0155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbdb0155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58422/0 (socket says 172.21.15.57:58422) 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 -- 172.21.15.57:0/3119132247 learned_addr learned my addr 172.21.15.57:0/3119132247 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5671640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb01630e0 0x7fbdb0157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb6673640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdb0160ed0 0x7fbdb0161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 -- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb01630e0 msgr2=0x7fbdb0157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb01630e0 0x7fbdb0157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 -- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdb0160ed0 msgr2=0x7fbdb0161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdb0160ed0 0x7fbdb0161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 -- 172.21.15.57:0/3119132247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb01638f0 con 0x7fbd9c0039b0 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5671640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb01630e0 0x7fbdb0157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb6673640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdb0160ed0 0x7fbdb0161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb5e72640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbdb0155650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbdac01c920 tx=0x7fbd9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbda67fc640 1 -- 172.21.15.57:0/3119132247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0b4070 con 0x7fbd9c0039b0 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbda67fc640 1 -- 172.21.15.57:0/3119132247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac001440 con 0x7fbd9c0039b0 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb0163bd0 con 0x7fbd9c0039b0 2023-11-24T08:04:27.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbda67fc640 1 -- 172.21.15.57:0/3119132247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0070a0 con 0x7fbd9c0039b0 2023-11-24T08:04:27.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb0155b90 con 0x7fbd9c0039b0 2023-11-24T08:04:27.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb0067a40 con 0x7fbd9c0039b0 2023-11-24T08:04:27.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.967+0000 7fbda67fc640 1 -- 172.21.15.57:0/3119132247 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdac007200 con 0x7fbd9c0039b0 2023-11-24T08:04:27.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.971+0000 7fbda67fc640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd94066470 0x7fbd94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:27.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.971+0000 7fbda67fc640 1 -- 172.21.15.57:0/3119132247 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdac11d550 con 0x7fbd9c0039b0 2023-11-24T08:04:27.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.971+0000 7fbdb5671640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd94066470 0x7fbd94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:27.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.971+0000 7fbdb5671640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd94066470 0x7fbd94068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0163540 tx=0x7fbda0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:27.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:27.975+0000 7fbda67fc640 1 -- 172.21.15.57:0/3119132247 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbdac0ea930 con 0x7fbd9c0039b0 2023-11-24T08:04:28.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.131+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbdb0158e60 con 0x7fbd9c0039b0 2023-11-24T08:04:28.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.131+0000 7fbda67fc640 1 -- 172.21.15.57:0/3119132247 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdac0edf50 con 0x7fbd9c0039b0 2023-11-24T08:04:28.136 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd94066470 msgr2=0x7fbd94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd94066470 0x7fbd94068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0163540 tx=0x7fbda0008040 comp rx=0 tx=0).stop 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 msgr2=0x7fbdb0155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbdb0155650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbdac01c920 tx=0x7fbd9c005800 comp rx=0 tx=0).stop 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 shutdown_connections 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd94066470 0x7fbd94068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdb0160ed0 0x7fbdb0161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdb01630e0 0x7fbdb0157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 --2- 172.21.15.57:0/3119132247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd9c0039b0 0x7fbdb0155650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 >> 172.21.15.57:0/3119132247 conn(0x7fbdb006e860 msgr2=0x7fbdb01583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:28.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 shutdown_connections 2023-11-24T08:04:28.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.135+0000 7fbdb80d6640 1 -- 172.21.15.57:0/3119132247 wait complete. 2023-11-24T08:04:28.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:04:28.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709e710640 1 Processor -- start 2023-11-24T08:04:28.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709e710640 1 -- start start 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709e710640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70980d17c0 0x7f70980d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709e710640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f70980b3560 0x7f70980b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709e710640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709815d9c0 con 0x7f709815d5e0 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709e710640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980d2190 con 0x7f70980d17c0 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709e710640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980d40b0 con 0x7f70980b3560 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709cf0d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70980d17c0 0x7f70980d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709cf0d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70980d17c0 0x7f70980d1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58430/0 (socket says 172.21.15.57:58430) 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709cf0d640 1 -- 172.21.15.57:0/883918146 learned_addr learned my addr 172.21.15.57:0/883918146 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709df0f640 1 --2- 172.21.15.57:0/883918146 >> v2:172.21.15.132:3300/0 conn(0x7f70980b3560 0x7f70980b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709cf0d640 1 -- 172.21.15.57:0/883918146 >> v2:172.21.15.132:3300/0 conn(0x7f70980b3560 msgr2=0x7f70980b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709cf0d640 1 --2- 172.21.15.57:0/883918146 >> v2:172.21.15.132:3300/0 conn(0x7f70980b3560 0x7f70980b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709cf0d640 1 -- 172.21.15.57:0/883918146 >> v1:172.21.15.132:6789/0 conn(0x7f709815d5e0 legacy=0x7f70980d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.299+0000 7f709cf0d640 1 -- 172.21.15.57:0/883918146 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980d1190 con 0x7f70980d17c0 2023-11-24T08:04:28.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709cf0d640 1 --2- 172.21.15.57:0/883918146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70980d17c0 0x7f70980d1c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f709808d0c0 tx=0x7f708801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e80623be3695d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:28.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f708ffff640 1 -- 172.21.15.57:0/883918146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880aa430 con 0x7f70980d17c0 2023-11-24T08:04:28.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f708ffff640 1 -- 172.21.15.57:0/883918146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70880aa590 con 0x7f70980d17c0 2023-11-24T08:04:28.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f708ffff640 1 -- 172.21.15.57:0/883918146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880aa920 con 0x7f70980d17c0 2023-11-24T08:04:28.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 -- 172.21.15.57:0/883918146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70980d17c0 msgr2=0x7f70980d1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:28.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 --2- 172.21.15.57:0/883918146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70980d17c0 0x7f70980d1c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f709808d0c0 tx=0x7f708801c4d0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 -- 172.21.15.57:0/883918146 shutdown_connections 2023-11-24T08:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 --2- 172.21.15.57:0/883918146 >> v2:172.21.15.132:3300/0 conn(0x7f70980b3560 0x7f70980b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 --2- 172.21.15.57:0/883918146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70980d17c0 0x7f70980d1c50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 -- 172.21.15.57:0/883918146 >> 172.21.15.57:0/883918146 conn(0x7f709809c520 msgr2=0x7f70980d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 -- 172.21.15.57:0/883918146 shutdown_connections 2023-11-24T08:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.303+0000 7f709e710640 1 -- 172.21.15.57:0/883918146 wait complete. 2023-11-24T08:04:28.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 Processor -- start 2023-11-24T08:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 -- start start 2023-11-24T08:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70980b3560 0x7f709815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70980d17c0 0x7f709815f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f709815d5e0 0x7f709815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7098145a50 con 0x7f709815d5e0 2023-11-24T08:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709815b860 con 0x7f70980d17c0 2023-11-24T08:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709815bb00 con 0x7f70980b3560 2023-11-24T08:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f709815d5e0 0x7f709815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f709815d5e0 0x7f709815fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58438/0 (socket says 172.21.15.57:58438) 2023-11-24T08:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 -- 172.21.15.57:0/1603657262 learned_addr learned my addr 172.21.15.57:0/1603657262 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709d70e640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70980b3560 0x7f709815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709cf0d640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70980d17c0 0x7f709815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:28.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 -- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70980b3560 msgr2=0x7f709815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70980b3560 0x7f709815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 -- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70980d17c0 msgr2=0x7f709815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70980d17c0 0x7f709815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 -- 172.21.15.57:0/1603657262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880094d0 con 0x7f709815d5e0 2023-11-24T08:04:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709df0f640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f709815d5e0 0x7f709815fea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7090007cf0 tx=0x7f709000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f708dffb640 1 -- 172.21.15.57:0/1603657262 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090014420 con 0x7f709815d5e0 2023-11-24T08:04:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f708dffb640 1 -- 172.21.15.57:0/1603657262 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70900145a0 con 0x7f709815d5e0 2023-11-24T08:04:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709815bde0 con 0x7f709815d5e0 2023-11-24T08:04:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f708dffb640 1 -- 172.21.15.57:0/1603657262 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090014950 con 0x7f709815d5e0 2023-11-24T08:04:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709815f440 con 0x7f709815d5e0 2023-11-24T08:04:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.307+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709804e850 con 0x7f709815d5e0 2023-11-24T08:04:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.311+0000 7f708dffb640 1 -- 172.21.15.57:0/1603657262 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7090014ab0 con 0x7f709815d5e0 2023-11-24T08:04:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.311+0000 7f708dffb640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f707c066470 0x7f707c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.311+0000 7f708dffb640 1 -- 172.21.15.57:0/1603657262 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7090084610 con 0x7f709815d5e0 2023-11-24T08:04:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.311+0000 7f709d70e640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f707c066470 0x7f707c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:28.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.311+0000 7f709d70e640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f707c066470 0x7f707c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7094007fd0 tx=0x7f7094009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:28.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.315+0000 7f708dffb640 1 -- 172.21.15.57:0/1603657262 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7090051aa0 con 0x7f709815d5e0 2023-11-24T08:04:28.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:28.527+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f70980d09b0 con 0x7f709815d5e0 2023-11-24T08:04:29.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.455+0000 7f708dffb640 1 -- 172.21.15.57:0/1603657262 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f70900550c0 con 0x7f709815d5e0 2023-11-24T08:04:29.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.455+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f707c066470 msgr2=0x7f707c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.455+0000 7f709e710640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f707c066470 0x7f707c068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7094007fd0 tx=0x7f7094009040 comp rx=0 tx=0).stop 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f709815d5e0 msgr2=0x7f709815fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f709815d5e0 0x7f709815fea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7090007cf0 tx=0x7f709000e4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 shutdown_connections 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f707c066470 0x7f707c068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f709815d5e0 0x7f709815fea0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70980d17c0 0x7f709815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 --2- 172.21.15.57:0/1603657262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70980b3560 0x7f709815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 >> 172.21.15.57:0/1603657262 conn(0x7f709809c520 msgr2=0x7f70980afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 shutdown_connections 2023-11-24T08:04:29.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.459+0000 7f709e710640 1 -- 172.21.15.57:0/1603657262 wait complete. 2023-11-24T08:04:29.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:04:29.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 Processor -- start 2023-11-24T08:04:29.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 -- start start 2023-11-24T08:04:29.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ea815ec60 0x7f1ea80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1ea80cc6b0 0x7f1ea80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea8071170 con 0x7f1ea815ec60 2023-11-24T08:04:29.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80cb690 con 0x7f1ea80cc6b0 2023-11-24T08:04:29.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1eac86b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80cb970 con 0x7f1ea815a290 2023-11-24T08:04:29.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ea815ec60 0x7f1ea80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ea815ec60 0x7f1ea80cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58448/0 (socket says 172.21.15.57:58448) 2023-11-24T08:04:29.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 -- 172.21.15.57:0/878946216 learned_addr learned my addr 172.21.15.57:0/878946216 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:29.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 -- 172.21.15.57:0/878946216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 msgr2=0x7f1ea80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:29.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1ea659c640 1 --2- 172.21.15.57:0/878946216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1ea6d9d640 1 --2- 172.21.15.57:0/878946216 >> v2:172.21.15.132:3300/0 conn(0x7f1ea80cc6b0 0x7f1ea80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 --2- 172.21.15.57:0/878946216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 -- 172.21.15.57:0/878946216 >> v2:172.21.15.132:3300/0 conn(0x7f1ea80cc6b0 msgr2=0x7f1ea80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:29.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 --2- 172.21.15.57:0/878946216 >> v2:172.21.15.132:3300/0 conn(0x7f1ea80cc6b0 0x7f1ea80b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1e9ffff640 1 -- 172.21.15.57:0/878946216 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80cbc50 con 0x7f1ea815ec60 2023-11-24T08:04:29.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1ea659c640 1 --2- 172.21.15.57:0/878946216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:29.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.635+0000 7f1ea6d9d640 1 --2- 172.21.15.57:0/878946216 >> v2:172.21.15.132:3300/0 conn(0x7f1ea80cc6b0 0x7f1ea80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:29.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1e9ffff640 1 --2- 172.21.15.57:0/878946216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80cc170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1ea806be30 tx=0x7f1e9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b471afa655c1bfe9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:29.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1ea5d9b640 1 -- 172.21.15.57:0/878946216 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900ab600 con 0x7f1ea815ec60 2023-11-24T08:04:29.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1ea5d9b640 1 -- 172.21.15.57:0/878946216 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e900a7050 con 0x7f1ea815ec60 2023-11-24T08:04:29.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1ea5d9b640 1 -- 172.21.15.57:0/878946216 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900ab980 con 0x7f1ea815ec60 2023-11-24T08:04:29.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 -- 172.21.15.57:0/878946216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 msgr2=0x7f1ea80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 --2- 172.21.15.57:0/878946216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80cc170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1ea806be30 tx=0x7f1e9001c470 comp rx=0 tx=0).stop 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 -- 172.21.15.57:0/878946216 shutdown_connections 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 --2- 172.21.15.57:0/878946216 >> v2:172.21.15.132:3300/0 conn(0x7f1ea80cc6b0 0x7f1ea80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 --2- 172.21.15.57:0/878946216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80cc170 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 --2- 172.21.15.57:0/878946216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 -- 172.21.15.57:0/878946216 >> 172.21.15.57:0/878946216 conn(0x7f1ea80b0c80 msgr2=0x7f1ea80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 -- 172.21.15.57:0/878946216 shutdown_connections 2023-11-24T08:04:29.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.639+0000 7f1eac86b640 1 -- 172.21.15.57:0/878946216 wait complete. 2023-11-24T08:04:29.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 Processor -- start 2023-11-24T08:04:29.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 -- start start 2023-11-24T08:04:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea80cc6b0 0x7f1ea8145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea81634d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea8145890 con 0x7f1ea815ec60 2023-11-24T08:04:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80abf60 con 0x7f1ea80cc6b0 2023-11-24T08:04:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80adc30 con 0x7f1ea815a290 2023-11-24T08:04:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58458/0 (socket says 172.21.15.57:58458) 2023-11-24T08:04:29.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 -- 172.21.15.57:0/379529194 learned_addr learned my addr 172.21.15.57:0/379529194 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1e9ffff640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea81634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea659c640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea80cc6b0 0x7f1ea8145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 -- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 msgr2=0x7f1ea81634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea81634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 -- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea80cc6b0 msgr2=0x7f1ea8145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea80cc6b0 0x7f1ea8145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 -- 172.21.15.57:0/379529194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e900094d0 con 0x7f1ea815ec60 2023-11-24T08:04:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1ea6d9d640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80ac6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000cef0 tx=0x7f1ea000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1e9effd640 1 -- 172.21.15.57:0/379529194 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000d840 con 0x7f1ea815ec60 2023-11-24T08:04:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1e9effd640 1 -- 172.21.15.57:0/379529194 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea000d9a0 con 0x7f1ea815ec60 2023-11-24T08:04:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea8070f40 con 0x7f1ea815ec60 2023-11-24T08:04:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1e9effd640 1 -- 172.21.15.57:0/379529194 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000dd50 con 0x7f1ea815ec60 2023-11-24T08:04:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.643+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea80ac1b0 con 0x7f1ea815ec60 2023-11-24T08:04:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.647+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea80ac3a0 con 0x7f1ea815ec60 2023-11-24T08:04:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.647+0000 7f1e9effd640 1 -- 172.21.15.57:0/379529194 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ea001e3b0 con 0x7f1ea815ec60 2023-11-24T08:04:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.647+0000 7f1e9effd640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e880664a0 0x7f1e88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.647+0000 7f1e9effd640 1 -- 172.21.15.57:0/379529194 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ea0084920 con 0x7f1ea815ec60 2023-11-24T08:04:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.647+0000 7f1ea659c640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e880664a0 0x7f1e88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.647+0000 7f1ea659c640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e880664a0 0x7f1e88068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800a9a0 tx=0x7f1e98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.651+0000 7f1e9effd640 1 -- 172.21.15.57:0/379529194 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ea0051d00 con 0x7f1ea815ec60 2023-11-24T08:04:29.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.811+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1ea804e8c0 con 0x7f1ea815ec60 2023-11-24T08:04:29.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.819+0000 7f1e9effd640 1 -- 172.21.15.57:0/379529194 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1ea001a020 con 0x7f1ea815ec60 2023-11-24T08:04:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e880664a0 msgr2=0x7f1e88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e880664a0 0x7f1e88068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800a9a0 tx=0x7f1e98008040 comp rx=0 tx=0).stop 2023-11-24T08:04:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 msgr2=0x7f1ea80ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:29.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80ac6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000cef0 tx=0x7f1ea000a710 comp rx=0 tx=0).stop 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 shutdown_connections 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1e880664a0 0x7f1e88068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ea815ec60 0x7f1ea80ac6d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ea815a290 0x7f1ea81634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 --2- 172.21.15.57:0/379529194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ea80cc6b0 0x7f1ea8145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 >> 172.21.15.57:0/379529194 conn(0x7f1ea80b0c80 msgr2=0x7f1ea8157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 shutdown_connections 2023-11-24T08:04:29.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:29.823+0000 7f1eac86b640 1 -- 172.21.15.57:0/379529194 wait complete. 2023-11-24T08:04:29.844 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:04:29.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:29.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:30.043 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:04:30.044 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:30.044 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:30.053 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:30.053 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:30.105 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:30.105 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:30.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:30.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77e090f640 1 Processor -- start 2023-11-24T08:04:30.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77e090f640 1 -- start start 2023-11-24T08:04:30.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77e090f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f77dc06c650 0x7f77dc09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77e090f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77dc06d8b0 con 0x7f77dc144030 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77e090f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77dc06cca0 con 0x7f77dc0709c0 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77e090f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc145020 con 0x7f77dc06c650 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77d3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f77dc06c650 0x7f77dc09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77da59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f77dc144030 0x7f77dc06dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39220/0 (socket says 172.21.15.57:39220) 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77da59c640 1 -- 172.21.15.57:0/367873144 learned_addr learned my addr 172.21.15.57:0/367873144 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77d3fff640 1 -- 172.21.15.57:0/367873144 >> v1:172.21.15.132:6789/0 conn(0x7f77dc0709c0 legacy=0x7f77dc070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77d3fff640 1 -- 172.21.15.57:0/367873144 >> v1:172.21.15.57:6789/0 conn(0x7f77dc144030 legacy=0x7f77dc06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77d3fff640 1 -- 172.21.15.57:0/367873144 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc06cf80 con 0x7f77dc06c650 2023-11-24T08:04:30.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.343+0000 7f77d9d9b640 1 -- 172.21.15.57:0/367873144 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570155844 0 0) 0x7f77dc06d8b0 con 0x7f77dc144030 2023-11-24T08:04:30.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77d3fff640 1 --2- 172.21.15.57:0/367873144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc06c650 0x7f77dc09cc20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36794079cb0bcc71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77d9d9b640 1 -- 172.21.15.57:0/367873144 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40ab600 con 0x7f77dc06c650 2023-11-24T08:04:30.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77d9d9b640 1 -- 172.21.15.57:0/367873144 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c40a7050 con 0x7f77dc06c650 2023-11-24T08:04:30.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77d9d9b640 1 -- 172.21.15.57:0/367873144 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40ab980 con 0x7f77dc06c650 2023-11-24T08:04:30.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77e090f640 1 -- 172.21.15.57:0/367873144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc06c650 msgr2=0x7f77dc09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77e090f640 1 --2- 172.21.15.57:0/367873144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc06c650 0x7f77dc09cc20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c401c480 comp rx=0 tx=0).stop 2023-11-24T08:04:30.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77e090f640 1 -- 172.21.15.57:0/367873144 shutdown_connections 2023-11-24T08:04:30.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77e090f640 1 --2- 172.21.15.57:0/367873144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc06c650 0x7f77dc09cc20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77e090f640 1 -- 172.21.15.57:0/367873144 >> 172.21.15.57:0/367873144 conn(0x7f77dc0b0bf0 msgr2=0x7f77dc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:30.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77e090f640 1 -- 172.21.15.57:0/367873144 shutdown_connections 2023-11-24T08:04:30.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.347+0000 7f77e090f640 1 -- 172.21.15.57:0/367873144 wait complete. 2023-11-24T08:04:30.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 Processor -- start 2023-11-24T08:04:30.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 -- start start 2023-11-24T08:04:30.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77dc06c650 0x7f77dc137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc0709c0 0x7f77dc0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc144030 0x7f77dc151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0b0190 con 0x7f77dc144030 2023-11-24T08:04:30.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc15ae40 con 0x7f77dc0709c0 2023-11-24T08:04:30.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc15b120 con 0x7f77dc06c650 2023-11-24T08:04:30.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc144030 0x7f77dc151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc144030 0x7f77dc151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58474/0 (socket says 172.21.15.57:58474) 2023-11-24T08:04:30.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 -- 172.21.15.57:0/2111347791 learned_addr learned my addr 172.21.15.57:0/2111347791 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:30.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77da59c640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77dc06c650 0x7f77dc137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77d3fff640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc0709c0 0x7f77dc0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 -- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77dc06c650 msgr2=0x7f77dc137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77dc06c650 0x7f77dc137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 -- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc0709c0 msgr2=0x7f77dc0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc0709c0 0x7f77dc0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 -- 172.21.15.57:0/2111347791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009420 con 0x7f77dc144030 2023-11-24T08:04:30.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77da59c640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77dc06c650 0x7f77dc137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:30.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77dad9d640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc144030 0x7f77dc151d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c770 tx=0x7f77d400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77d2ffd640 1 -- 172.21.15.57:0/2111347791 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4003b80 con 0x7f77dc144030 2023-11-24T08:04:30.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77d2ffd640 1 -- 172.21.15.57:0/2111347791 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4003ce0 con 0x7f77dc144030 2023-11-24T08:04:30.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc155b80 con 0x7f77dc144030 2023-11-24T08:04:30.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77d2ffd640 1 -- 172.21.15.57:0/2111347791 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d400aa90 con 0x7f77dc144030 2023-11-24T08:04:30.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc15b400 con 0x7f77dc144030 2023-11-24T08:04:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.351+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77dc067520 con 0x7f77dc144030 2023-11-24T08:04:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.355+0000 7f77d2ffd640 1 -- 172.21.15.57:0/2111347791 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77d400abf0 con 0x7f77dc144030 2023-11-24T08:04:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.355+0000 7f77d2ffd640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77bc066470 0x7f77bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.355+0000 7f77d2ffd640 1 -- 172.21.15.57:0/2111347791 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77d4083bf0 con 0x7f77dc144030 2023-11-24T08:04:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.355+0000 7f77da59c640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77bc066470 0x7f77bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.355+0000 7f77da59c640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77bc066470 0x7f77bc068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77cc000f70 tx=0x7f77cc007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.359+0000 7f77d2ffd640 1 -- 172.21.15.57:0/2111347791 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77d40510a0 con 0x7f77dc144030 2023-11-24T08:04:30.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.519+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77dc156030 con 0x7f77dc144030 2023-11-24T08:04:30.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77d2ffd640 1 -- 172.21.15.57:0/2111347791 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f77d40546c0 con 0x7f77dc144030 2023-11-24T08:04:30.525 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:30.525 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77bc066470 msgr2=0x7f77bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77bc066470 0x7f77bc068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77cc000f70 tx=0x7f77cc007df0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc144030 msgr2=0x7f77dc151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc144030 0x7f77dc151d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c770 tx=0x7f77d400cc30 comp rx=0 tx=0).stop 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 shutdown_connections 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77bc066470 0x7f77bc068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77dc144030 0x7f77dc151d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77dc0709c0 0x7f77dc0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 --2- 172.21.15.57:0/2111347791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77dc06c650 0x7f77dc137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 >> 172.21.15.57:0/2111347791 conn(0x7f77dc0b0bf0 msgr2=0x7f77dc0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 shutdown_connections 2023-11-24T08:04:30.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.523+0000 7f77e090f640 1 -- 172.21.15.57:0/2111347791 wait complete. 2023-11-24T08:04:30.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:30.549 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b3180640 1 Processor -- start 2023-11-24T08:04:30.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b3180640 1 -- start start 2023-11-24T08:04:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b3180640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8ac161d70 0x7ff8ac0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b3180640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac15dda0 con 0x7ff8ac0d19e0 2023-11-24T08:04:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b3180640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac0d42e0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b3180640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0d3b10 con 0x7ff8ac161d70 2023-11-24T08:04:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b0f1c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff8ac0d19e0 0x7ff8ac0d1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39222/0 (socket says 172.21.15.57:39222) 2023-11-24T08:04:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8b0f1c640 1 -- 172.21.15.57:0/2727345949 learned_addr learned my addr 172.21.15.57:0/2727345949 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:30.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8abfff640 1 --2- 172.21.15.57:0/2727345949 >> v2:172.21.15.132:3300/0 conn(0x7ff8ac161d70 0x7ff8ac0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216818100 0 0) 0x7ff8ac15dda0 con 0x7ff8ac0d19e0 2023-11-24T08:04:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff89c003530 con 0x7ff8ac0d19e0 2023-11-24T08:04:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780957396 0 0) 0x7ff8ac0d42e0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ac15dda0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3692703650 0 0) 0x7ff89c003530 con 0x7ff8ac0d19e0 2023-11-24T08:04:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8abfff640 1 -- 172.21.15.57:0/2727345949 >> v1:172.21.15.132:6789/0 conn(0x7ff8ac0cdf10 legacy=0x7ff8ac15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8abfff640 1 -- 172.21.15.57:0/2727345949 >> v1:172.21.15.57:6789/0 conn(0x7ff8ac0d19e0 legacy=0x7ff8ac0d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.695+0000 7ff8abfff640 1 -- 172.21.15.57:0/2727345949 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0d3d20 con 0x7ff8ac161d70 2023-11-24T08:04:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8abfff640 1 --2- 172.21.15.57:0/2727345949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac0d0fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8980097a0 tx=0x7ff89801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4958c1779ea964e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0001680 con 0x7ff8ac161d70 2023-11-24T08:04:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8980a7050 con 0x7ff8ac161d70 2023-11-24T08:04:30.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8ab7fe640 1 -- 172.21.15.57:0/2727345949 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8980ab600 con 0x7ff8ac161d70 2023-11-24T08:04:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8b3180640 1 -- 172.21.15.57:0/2727345949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 msgr2=0x7ff8ac0d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8b3180640 1 --2- 172.21.15.57:0/2727345949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac0d0fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8980097a0 tx=0x7ff89801c350 comp rx=0 tx=0).stop 2023-11-24T08:04:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8b3180640 1 -- 172.21.15.57:0/2727345949 shutdown_connections 2023-11-24T08:04:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8b3180640 1 --2- 172.21.15.57:0/2727345949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac0d0fd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8b3180640 1 -- 172.21.15.57:0/2727345949 >> 172.21.15.57:0/2727345949 conn(0x7ff8ac09c760 msgr2=0x7ff8ac0d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8b3180640 1 -- 172.21.15.57:0/2727345949 shutdown_connections 2023-11-24T08:04:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.699+0000 7ff8b3180640 1 -- 172.21.15.57:0/2727345949 wait complete. 2023-11-24T08:04:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 Processor -- start 2023-11-24T08:04:30.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 -- start start 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8ac0cdf10 0x7ff8ac154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8ac0d19e0 0x7ff8ac0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0b77e0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac155180 con 0x7ff8ac161d70 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0b7440 con 0x7ff8ac0d19e0 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8ac0cdf10 0x7ff8ac154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8ac0cdf10 0x7ff8ac154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58480/0 (socket says 172.21.15.57:58480) 2023-11-24T08:04:30.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 -- 172.21.15.57:0/4242161615 learned_addr learned my addr 172.21.15.57:0/4242161615 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:30.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 -- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8ac0d19e0 msgr2=0x7ff8ac0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8ac0d19e0 0x7ff8ac0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 -- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 msgr2=0x7ff8ac160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b171d640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 -- 172.21.15.57:0/4242161615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8980093b0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b171d640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:30.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b0f1c640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8ac0cdf10 0x7ff8ac154c40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000c750 tx=0x7ff8a000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8a97fa640 1 -- 172.21.15.57:0/4242161615 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0005af0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8a97fa640 1 -- 172.21.15.57:0/4242161615 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0005c50 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8a97fa640 1 -- 172.21.15.57:0/4242161615 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0007070 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac0cb730 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.703+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac0cb420 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.707+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac067a40 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.707+0000 7ff8a97fa640 1 -- 172.21.15.57:0/4242161615 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8a00071d0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.707+0000 7ff8a97fa640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff890066470 0x7ff890068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.707+0000 7ff8a97fa640 1 -- 172.21.15.57:0/4242161615 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8a0083cd0 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.707+0000 7ff8abfff640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff890066470 0x7ff890068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.711+0000 7ff8abfff640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff890066470 0x7ff890068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8980ad000 tx=0x7ff898004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.711+0000 7ff8a97fa640 1 -- 172.21.15.57:0/4242161615 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8a0051130 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.871+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8ac0b7580 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.871+0000 7ff8a97fa640 1 -- 172.21.15.57:0/4242161615 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8a0054750 con 0x7ff8ac0cdf10 2023-11-24T08:04:30.876 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff890066470 msgr2=0x7ff890068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff890066470 0x7ff890068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8980ad000 tx=0x7ff898004740 comp rx=0 tx=0).stop 2023-11-24T08:04:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8ac0cdf10 msgr2=0x7ff8ac154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8ac0cdf10 0x7ff8ac154c40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000c750 tx=0x7ff8a000cc10 comp rx=0 tx=0).stop 2023-11-24T08:04:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 shutdown_connections 2023-11-24T08:04:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff890066470 0x7ff890068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8ac161d70 0x7ff8ac160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8ac0d19e0 0x7ff8ac0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 --2- 172.21.15.57:0/4242161615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8ac0cdf10 0x7ff8ac154c40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 >> 172.21.15.57:0/4242161615 conn(0x7ff8ac09c760 msgr2=0x7ff8ac06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 shutdown_connections 2023-11-24T08:04:30.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:30.875+0000 7ff8b3180640 1 -- 172.21.15.57:0/4242161615 wait complete. 2023-11-24T08:04:30.898 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:31.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8fad94640 1 Processor -- start 2023-11-24T08:04:31.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8fad94640 1 -- start start 2023-11-24T08:04:31.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8fad94640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8f415d7f0 0x7fd8f40d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8fad94640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8f40d37e0 0x7fd8f40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8fad94640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40d3c60 con 0x7fd8f40b1630 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8fad94640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f406b980 con 0x7fd8f40d37e0 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8fad94640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40b0090 con 0x7fd8f415d7f0 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8f40d37e0 0x7fd8f40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8f40d37e0 0x7fd8f40b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58496/0 (socket says 172.21.15.57:58496) 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f3fff640 1 -- 172.21.15.57:0/2199520379 learned_addr learned my addr 172.21.15.57:0/2199520379 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f8b30640 1 --2- 172.21.15.57:0/2199520379 >> v2:172.21.15.132:3300/0 conn(0x7fd8f415d7f0 0x7fd8f40d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f3fff640 1 -- 172.21.15.57:0/2199520379 >> v2:172.21.15.132:3300/0 conn(0x7fd8f415d7f0 msgr2=0x7fd8f40d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f3fff640 1 --2- 172.21.15.57:0/2199520379 >> v2:172.21.15.132:3300/0 conn(0x7fd8f415d7f0 0x7fd8f40d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f3fff640 1 -- 172.21.15.57:0/2199520379 >> v1:172.21.15.132:6789/0 conn(0x7fd8f40b1630 legacy=0x7fd8f40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.043+0000 7fd8f3fff640 1 -- 172.21.15.57:0/2199520379 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40b0330 con 0x7fd8f40d37e0 2023-11-24T08:04:31.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8f3fff640 1 --2- 172.21.15.57:0/2199520379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40d37e0 0x7fd8f40b10f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd8f408ce00 tx=0x7fd8e001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae702eded46c6995 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8f37fe640 1 -- 172.21.15.57:0/2199520379 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00ab5f0 con 0x7fd8f40d37e0 2023-11-24T08:04:31.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8f37fe640 1 -- 172.21.15.57:0/2199520379 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e00ab750 con 0x7fd8f40d37e0 2023-11-24T08:04:31.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8f37fe640 1 -- 172.21.15.57:0/2199520379 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00abae0 con 0x7fd8f40d37e0 2023-11-24T08:04:31.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 -- 172.21.15.57:0/2199520379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40d37e0 msgr2=0x7fd8f40b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 --2- 172.21.15.57:0/2199520379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40d37e0 0x7fd8f40b10f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd8f408ce00 tx=0x7fd8e001c500 comp rx=0 tx=0).stop 2023-11-24T08:04:31.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 -- 172.21.15.57:0/2199520379 shutdown_connections 2023-11-24T08:04:31.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 --2- 172.21.15.57:0/2199520379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40d37e0 0x7fd8f40b10f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 --2- 172.21.15.57:0/2199520379 >> v2:172.21.15.132:3300/0 conn(0x7fd8f415d7f0 0x7fd8f40d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 -- 172.21.15.57:0/2199520379 >> 172.21.15.57:0/2199520379 conn(0x7fd8f409c790 msgr2=0x7fd8f408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 -- 172.21.15.57:0/2199520379 shutdown_connections 2023-11-24T08:04:31.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.047+0000 7fd8fad94640 1 -- 172.21.15.57:0/2199520379 wait complete. 2023-11-24T08:04:31.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 Processor -- start 2023-11-24T08:04:31.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 -- start start 2023-11-24T08:04:31.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40b1630 0x7fd8f414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8f40d37e0 0x7fd8f40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f415d7f0 0x7fd8f40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40b3770 con 0x7fd8f40b1630 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4150b00 con 0x7fd8f415d7f0 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40b3980 con 0x7fd8f40d37e0 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40b1630 0x7fd8f414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40b1630 0x7fd8f414efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58508/0 (socket says 172.21.15.57:58508) 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 -- 172.21.15.57:0/820383068 learned_addr learned my addr 172.21.15.57:0/820383068 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f3fff640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8f40d37e0 0x7fd8f40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f9331640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f415d7f0 0x7fd8f40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 -- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8f40d37e0 msgr2=0x7fd8f40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8f40d37e0 0x7fd8f40b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 -- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f415d7f0 msgr2=0x7fd8f40cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f415d7f0 0x7fd8f40cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 -- 172.21.15.57:0/820383068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00094d0 con 0x7fd8f40b1630 2023-11-24T08:04:31.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f3fff640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8f40d37e0 0x7fd8f40b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:31.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f8b30640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40b1630 0x7fd8f414efa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800e870 tx=0x7fd8e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f17fa640 1 -- 172.21.15.57:0/820383068 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8009510 con 0x7fd8f40b1630 2023-11-24T08:04:31.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f17fa640 1 -- 172.21.15.57:0/820383068 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e800eec0 con 0x7fd8f40b1630 2023-11-24T08:04:31.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8f17fa640 1 -- 172.21.15.57:0/820383068 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800cb40 con 0x7fd8f40b1630 2023-11-24T08:04:31.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f40b3c60 con 0x7fd8f40b1630 2023-11-24T08:04:31.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f40b6e20 con 0x7fd8f40b1630 2023-11-24T08:04:31.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.051+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f404e8c0 con 0x7fd8f40b1630 2023-11-24T08:04:31.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.055+0000 7fd8f17fa640 1 -- 172.21.15.57:0/820383068 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8e800cca0 con 0x7fd8f40b1630 2023-11-24T08:04:31.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.055+0000 7fd8f17fa640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd8d80664a0 0x7fd8d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.055+0000 7fd8f17fa640 1 -- 172.21.15.57:0/820383068 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8e8083fe0 con 0x7fd8f40b1630 2023-11-24T08:04:31.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.055+0000 7fd8f3fff640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd8d80664a0 0x7fd8d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.055+0000 7fd8f3fff640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd8d80664a0 0x7fd8d8068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00af000 tx=0x7fd8e00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.059+0000 7fd8f17fa640 1 -- 172.21.15.57:0/820383068 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8e80513d0 con 0x7fd8f40b1630 2023-11-24T08:04:31.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.215+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8f415c180 con 0x7fd8f40b1630 2023-11-24T08:04:31.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.215+0000 7fd8f17fa640 1 -- 172.21.15.57:0/820383068 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8e8017020 con 0x7fd8f40b1630 2023-11-24T08:04:31.220 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd8d80664a0 msgr2=0x7fd8d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd8d80664a0 0x7fd8d8068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00af000 tx=0x7fd8e00a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40b1630 msgr2=0x7fd8f414efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40b1630 0x7fd8f414efa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800e870 tx=0x7fd8e800ec70 comp rx=0 tx=0).stop 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 shutdown_connections 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd8d80664a0 0x7fd8d8068960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f415d7f0 0x7fd8f40cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd8f40d37e0 0x7fd8f40b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 --2- 172.21.15.57:0/820383068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f40b1630 0x7fd8f414efa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 >> 172.21.15.57:0/820383068 conn(0x7fd8f409c790 msgr2=0x7fd8f4154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:31.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 shutdown_connections 2023-11-24T08:04:31.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.219+0000 7fd8fad94640 1 -- 172.21.15.57:0/820383068 wait complete. 2023-11-24T08:04:31.241 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:31.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.383+0000 7f52fd98d640 1 Processor -- start 2023-11-24T08:04:31.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.383+0000 7f52fd98d640 1 -- start start 2023-11-24T08:04:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52fd98d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f52f80d39b0 0x7f52f806bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52fd98d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f80b2100 0x7f52f806c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52fd98d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f80b0090 con 0x7f52f815d7f0 2023-11-24T08:04:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52fd98d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f806b980 con 0x7f52f80d39b0 2023-11-24T08:04:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52fd98d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80b0330 con 0x7f52f80b2100 2023-11-24T08:04:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52f6ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f52f815d7f0 0x7f52f80d32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39230/0 (socket says 172.21.15.57:39230) 2023-11-24T08:04:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52f6ffd640 1 -- 172.21.15.57:0/1454297527 learned_addr learned my addr 172.21.15.57:0/1454297527 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:31.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52effff640 1 --2- 172.21.15.57:0/1454297527 >> v2:172.21.15.132:3300/0 conn(0x7f52f80d39b0 0x7f52f806bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52f77fe640 1 --2- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f80b2100 0x7f52f806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52f67fc640 1 -- 172.21.15.57:0/1454297527 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488003715 0 0) 0x7f52f80b0090 con 0x7f52f815d7f0 2023-11-24T08:04:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52f67fc640 1 -- 172.21.15.57:0/1454297527 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e4003530 con 0x7f52f815d7f0 2023-11-24T08:04:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52effff640 1 -- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f80b2100 msgr2=0x7f52f806c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52effff640 1 --2- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f80b2100 0x7f52f806c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52effff640 1 -- 172.21.15.57:0/1454297527 >> v1:172.21.15.57:6789/0 conn(0x7f52f815d7f0 legacy=0x7f52f80d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.387+0000 7f52effff640 1 -- 172.21.15.57:0/1454297527 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f80b0610 con 0x7f52f80d39b0 2023-11-24T08:04:31.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52effff640 1 --2- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80d39b0 0x7f52f806bcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097c0 tx=0x7f52e001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be9235bbe7e661 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52f67fc640 1 -- 172.21.15.57:0/1454297527 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e00ab600 con 0x7f52f80d39b0 2023-11-24T08:04:31.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52f67fc640 1 -- 172.21.15.57:0/1454297527 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e00a7050 con 0x7f52f80d39b0 2023-11-24T08:04:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52f67fc640 1 -- 172.21.15.57:0/1454297527 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e00ab980 con 0x7f52f80d39b0 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 -- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80d39b0 msgr2=0x7f52f806bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 --2- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80d39b0 0x7f52f806bcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097c0 tx=0x7f52e001c480 comp rx=0 tx=0).stop 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 -- 172.21.15.57:0/1454297527 shutdown_connections 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 --2- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f80b2100 0x7f52f806c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 --2- 172.21.15.57:0/1454297527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80d39b0 0x7f52f806bcd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 -- 172.21.15.57:0/1454297527 >> 172.21.15.57:0/1454297527 conn(0x7f52f809c790 msgr2=0x7f52f808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 -- 172.21.15.57:0/1454297527 shutdown_connections 2023-11-24T08:04:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 -- 172.21.15.57:0/1454297527 wait complete. 2023-11-24T08:04:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 Processor -- start 2023-11-24T08:04:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.391+0000 7f52fd98d640 1 -- start start 2023-11-24T08:04:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80b2100 0x7f52f81563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f80d39b0 0x7f52f80d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f815d7f0 0x7f52f80b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f815a9a0 con 0x7f52f80d39b0 2023-11-24T08:04:31.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80ceae0 con 0x7f52f80b2100 2023-11-24T08:04:31.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8156e40 con 0x7f52f815d7f0 2023-11-24T08:04:31.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f80d39b0 0x7f52f80d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f80d39b0 0x7f52f80d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58522/0 (socket says 172.21.15.57:58522) 2023-11-24T08:04:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 -- 172.21.15.57:0/2233886465 learned_addr learned my addr 172.21.15.57:0/2233886465 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52f6ffd640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80b2100 0x7f52f81563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52f77fe640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f815d7f0 0x7f52f80b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 -- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f815d7f0 msgr2=0x7f52f80b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f815d7f0 0x7f52f80b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 -- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80b2100 msgr2=0x7f52f81563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80b2100 0x7f52f81563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 -- 172.21.15.57:0/2233886465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0009420 con 0x7f52f80d39b0 2023-11-24T08:04:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52f6ffd640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80b2100 0x7f52f81563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52effff640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f80d39b0 0x7f52f80d0730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f52e00ae040 tx=0x7f52e0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52f4ff9640 1 -- 172.21.15.57:0/2233886465 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e00b4430 con 0x7f52f80d39b0 2023-11-24T08:04:31.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52f4ff9640 1 -- 172.21.15.57:0/2233886465 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e00b45b0 con 0x7f52f80d39b0 2023-11-24T08:04:31.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f80cf2f0 con 0x7f52f80d39b0 2023-11-24T08:04:31.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52f4ff9640 1 -- 172.21.15.57:0/2233886465 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e00b4960 con 0x7f52f80d39b0 2023-11-24T08:04:31.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f80ced30 con 0x7f52f80d39b0 2023-11-24T08:04:31.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.395+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f8156fb0 con 0x7f52f80d39b0 2023-11-24T08:04:31.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.399+0000 7f52f4ff9640 1 -- 172.21.15.57:0/2233886465 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52e00b2040 con 0x7f52f80d39b0 2023-11-24T08:04:31.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.399+0000 7f52f4ff9640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f52d8066470 0x7f52d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.399+0000 7f52f4ff9640 1 -- 172.21.15.57:0/2233886465 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52e011dd60 con 0x7f52f80d39b0 2023-11-24T08:04:31.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.399+0000 7f52f6ffd640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f52d8066470 0x7f52d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.399+0000 7f52f6ffd640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f52d8066470 0x7f52d8068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52e80011f0 tx=0x7f52e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.403+0000 7f52f4ff9640 1 -- 172.21.15.57:0/2233886465 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52e00eb1d0 con 0x7f52f80d39b0 2023-11-24T08:04:31.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52f804e8c0 con 0x7f52f80d39b0 2023-11-24T08:04:31.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52f4ff9640 1 -- 172.21.15.57:0/2233886465 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52e00ee7f0 con 0x7f52f80d39b0 2023-11-24T08:04:31.562 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f52d8066470 msgr2=0x7f52d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f52d8066470 0x7f52d8068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52e80011f0 tx=0x7f52e8009040 comp rx=0 tx=0).stop 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f80d39b0 msgr2=0x7f52f80d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f80d39b0 0x7f52f80d0730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f52e00ae040 tx=0x7f52e0019220 comp rx=0 tx=0).stop 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 shutdown_connections 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f52d8066470 0x7f52d8068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52f815d7f0 0x7f52f80b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f80d39b0 0x7f52f80d0730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 --2- 172.21.15.57:0/2233886465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52f80b2100 0x7f52f81563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 >> 172.21.15.57:0/2233886465 conn(0x7f52f809c790 msgr2=0x7f52f815ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:31.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 shutdown_connections 2023-11-24T08:04:31.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.559+0000 7f52fd98d640 1 -- 172.21.15.57:0/2233886465 wait complete. 2023-11-24T08:04:31.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:31.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d7701640 1 Processor -- start 2023-11-24T08:04:31.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d7701640 1 -- start start 2023-11-24T08:04:31.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d7701640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7d015d7a0 0x7fa7d00b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d7701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006acc0 0x7fa7d00ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d7701640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d015db80 con 0x7fa7d00b1690 2023-11-24T08:04:31.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d7701640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00cc9a0 con 0x7fa7d015d7a0 2023-11-24T08:04:31.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d7701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00cd970 con 0x7fa7d006acc0 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d5c9e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006acc0 0x7fa7d00ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d5c9e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006acc0 0x7fa7d00ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:38796/0 (socket says 172.21.15.57:38796) 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d5c9e640 1 -- 172.21.15.57:0/3541209895 learned_addr learned my addr 172.21.15.57:0/3541209895 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d549d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7d015d7a0 0x7fa7d00b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.727+0000 7fa7d4c9c640 1 --1- 172.21.15.57:0/3541209895 >> v1:172.21.15.132:6789/0 conn(0x7fa7d00b1690 0x7fa7d006a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:57744/0 (socket says 172.21.15.57:57744) 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7d5c9e640 1 -- 172.21.15.57:0/3541209895 >> v2:172.21.15.132:3300/0 conn(0x7fa7d015d7a0 msgr2=0x7fa7d00b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7d5c9e640 1 --2- 172.21.15.57:0/3541209895 >> v2:172.21.15.132:3300/0 conn(0x7fa7d015d7a0 0x7fa7d00b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7d5c9e640 1 -- 172.21.15.57:0/3541209895 >> v1:172.21.15.132:6789/0 conn(0x7fa7d00b1690 legacy=0x7fa7d006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7d5c9e640 1 -- 172.21.15.57:0/3541209895 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00ccbb0 con 0x7fa7d006acc0 2023-11-24T08:04:31.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7d5c9e640 1 --2- 172.21.15.57:0/3541209895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006acc0 0x7fa7d00ca770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009e50 tx=0x7fa7c801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ba69b3c9fb6e1d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7c7fff640 1 -- 172.21.15.57:0/3541209895 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a57c0 con 0x7fa7d006acc0 2023-11-24T08:04:31.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7c7fff640 1 -- 172.21.15.57:0/3541209895 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80a5920 con 0x7fa7d006acc0 2023-11-24T08:04:31.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.731+0000 7fa7c7fff640 1 -- 172.21.15.57:0/3541209895 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a5cb0 con 0x7fa7d006acc0 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- 172.21.15.57:0/3541209895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006acc0 msgr2=0x7fa7d00ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 --2- 172.21.15.57:0/3541209895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006acc0 0x7fa7d00ca770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009e50 tx=0x7fa7c801c9e0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- 172.21.15.57:0/3541209895 shutdown_connections 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 --2- 172.21.15.57:0/3541209895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006acc0 0x7fa7d00ca770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 --2- 172.21.15.57:0/3541209895 >> v2:172.21.15.132:3300/0 conn(0x7fa7d015d7a0 0x7fa7d00b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- 172.21.15.57:0/3541209895 >> 172.21.15.57:0/3541209895 conn(0x7fa7d0071ce0 msgr2=0x7fa7d00b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- 172.21.15.57:0/3541209895 shutdown_connections 2023-11-24T08:04:31.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- 172.21.15.57:0/3541209895 wait complete. 2023-11-24T08:04:31.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 Processor -- start 2023-11-24T08:04:31.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- start start 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7d006acc0 0x7fa7d0155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00b1690 0x7fa7d00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d015d7a0 0x7fa7d0148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d014e610 con 0x7fa7d006acc0 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00cef10 con 0x7fa7d015d7a0 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d7701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00cf1f0 con 0x7fa7d00b1690 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7d006acc0 0x7fa7d0155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7d006acc0 0x7fa7d0155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58536/0 (socket says 172.21.15.57:58536) 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 -- 172.21.15.57:0/2968847900 learned_addr learned my addr 172.21.15.57:0/2968847900 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d4c9c640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00b1690 0x7fa7d00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d5c9e640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d015d7a0 0x7fa7d0148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 -- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00b1690 msgr2=0x7fa7d00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00b1690 0x7fa7d00ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 -- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d015d7a0 msgr2=0x7fa7d0148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d015d7a0 0x7fa7d0148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.735+0000 7fa7d549d640 1 -- 172.21.15.57:0/2968847900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8009b30 con 0x7fa7d006acc0 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7d549d640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7d006acc0 0x7fa7d0155ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00e870 tx=0x7fa7cc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7c5ffb640 1 -- 172.21.15.57:0/2968847900 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc009510 con 0x7fa7d006acc0 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7c5ffb640 1 -- 172.21.15.57:0/2968847900 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc00eec0 con 0x7fa7d006acc0 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7c5ffb640 1 -- 172.21.15.57:0/2968847900 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00cb40 con 0x7fa7d006acc0 2023-11-24T08:04:31.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d00cf4d0 con 0x7fa7d006acc0 2023-11-24T08:04:31.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00cec00 con 0x7fa7d006acc0 2023-11-24T08:04:31.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d009e3d0 con 0x7fa7d006acc0 2023-11-24T08:04:31.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7c5ffb640 1 -- 172.21.15.57:0/2968847900 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7cc00cca0 con 0x7fa7d006acc0 2023-11-24T08:04:31.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7c5ffb640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa7b4066470 0x7fa7b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:31.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7c5ffb640 1 -- 172.21.15.57:0/2968847900 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7cc083f60 con 0x7fa7d006acc0 2023-11-24T08:04:31.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.739+0000 7fa7d4c9c640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa7b4066470 0x7fa7b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:31.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.743+0000 7fa7d4c9c640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa7b4066470 0x7fa7b4068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00ca090 tx=0x7fa7c0007e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:31.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.743+0000 7fa7c5ffb640 1 -- 172.21.15.57:0/2968847900 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7cc051480 con 0x7fa7d006acc0 2023-11-24T08:04:31.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.911+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7d004e930 con 0x7fa7d006acc0 2023-11-24T08:04:31.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7c5ffb640 1 -- 172.21.15.57:0/2968847900 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa7cc054aa0 con 0x7fa7d006acc0 2023-11-24T08:04:31.917 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:04:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa7b4066470 msgr2=0x7fa7b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa7b4066470 0x7fa7b4068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00ca090 tx=0x7fa7c0007e50 comp rx=0 tx=0).stop 2023-11-24T08:04:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7d006acc0 msgr2=0x7fa7d0155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7d006acc0 0x7fa7d0155ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00e870 tx=0x7fa7cc00ec70 comp rx=0 tx=0).stop 2023-11-24T08:04:31.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 shutdown_connections 2023-11-24T08:04:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa7b4066470 0x7fa7b4068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d015d7a0 0x7fa7d0148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00b1690 0x7fa7d00ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 --2- 172.21.15.57:0/2968847900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7d006acc0 0x7fa7d0155ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 >> 172.21.15.57:0/2968847900 conn(0x7fa7d0071ce0 msgr2=0x7fa7d00c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 shutdown_connections 2023-11-24T08:04:31.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:31.915+0000 7fa7d7701640 1 -- 172.21.15.57:0/2968847900 wait complete. 2023-11-24T08:04:31.938 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:04:31.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-24T08:04:31.973 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:04:31.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:31.974 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:04:32.031 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:32.031 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:32.041 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:32.041 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:32.094 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:32.094 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:32.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:32.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.283+0000 7f6a10135640 1 Processor -- start 2023-11-24T08:04:32.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a10135640 1 -- start start 2023-11-24T08:04:32.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a10135640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 0x7f6a080b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a10135640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080cee60 con 0x7f6a080d0640 2023-11-24T08:04:32.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a10135640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080cf140 con 0x7f6a08147020 2023-11-24T08:04:32.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a10135640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080cf420 con 0x7f6a080d01e0 2023-11-24T08:04:32.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0e6d2640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6a080d0640 0x7f6a0806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39234/0 (socket says 172.21.15.57:39234) 2023-11-24T08:04:32.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0e6d2640 1 -- 172.21.15.57:0/1219355826 learned_addr learned my addr 172.21.15.57:0/1219355826 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:32.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0d6d0640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 0x7f6a080b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022885182 0 0) 0x7f6a080cee60 con 0x7f6a080d0640 2023-11-24T08:04:32.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f4003530 con 0x7f6a080d0640 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 792543606 0 0) 0x7f69f4003530 con 0x7f6a080d0640 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 msgr2=0x7f6a080b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 0x7f6a080b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 >> v1:172.21.15.132:6789/0 conn(0x7f6a08147020 legacy=0x7f6a080d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080cf700 con 0x7f6a080d0640 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f6a00001a00 con 0x7f6a080d0640 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 >> v1:172.21.15.57:6789/0 conn(0x7f6a080d0640 legacy=0x7f6a0806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f40039b0 0x7f69f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 0x7f69f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f4004d10 0x7f69f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080cf420 con 0x7f69f40039b0 2023-11-24T08:04:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f400b990 con 0x7f69f4004d10 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f400bb50 con 0x7f6a080d01e0 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0ded1640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f40039b0 0x7f69f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0d6d0640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 0x7f69f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0e6d2640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f4004d10 0x7f69f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0ded1640 1 -- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 msgr2=0x7f69f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0ded1640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 0x7f69f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0ded1640 1 -- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f4004d10 msgr2=0x7f69f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0ded1640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f4004d10 0x7f69f4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0ded1640 1 -- 172.21.15.57:0/1219355826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4003530 con 0x7f69f40039b0 2023-11-24T08:04:32.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.287+0000 7f6a0d6d0640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a080d01e0 0x7f69f40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:32.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a0ded1640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f40039b0 0x7f69f4003d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6a04001860 tx=0x7f6a0401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe9b36890606ffe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040ad660 con 0x7f69f40039b0 2023-11-24T08:04:32.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a040ad7c0 con 0x7f69f40039b0 2023-11-24T08:04:32.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a0cecf640 1 -- 172.21.15.57:0/1219355826 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040adb70 con 0x7f69f40039b0 2023-11-24T08:04:32.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a10135640 1 -- 172.21.15.57:0/1219355826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f40039b0 msgr2=0x7f69f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a10135640 1 --2- 172.21.15.57:0/1219355826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69f40039b0 0x7f69f4003d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6a04001860 tx=0x7f6a0401c440 comp rx=0 tx=0).stop 2023-11-24T08:04:32.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a0e6d2640 1 -- 172.21.15.57:0/1219355826 reap_dead start 2023-11-24T08:04:32.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a10135640 1 -- 172.21.15.57:0/1219355826 shutdown_connections 2023-11-24T08:04:32.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a10135640 1 -- 172.21.15.57:0/1219355826 >> 172.21.15.57:0/1219355826 conn(0x7f6a08060fd0 msgr2=0x7f6a080613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:32.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a10135640 1 -- 172.21.15.57:0/1219355826 shutdown_connections 2023-11-24T08:04:32.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.291+0000 7f6a10135640 1 -- 172.21.15.57:0/1219355826 wait complete. 2023-11-24T08:04:32.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 Processor -- start 2023-11-24T08:04:32.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 -- start start 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f40039b0 0x7f6a081639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a0815bc70 0x7f6a08162230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a081671d0 0x7f6a0815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08163540 con 0x7f6a0815bc70 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0815c480 con 0x7f69f40039b0 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08162930 con 0x7f6a081671d0 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a0815bc70 0x7f6a08162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a0815bc70 0x7f6a08162230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58550/0 (socket says 172.21.15.57:58550) 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 -- 172.21.15.57:0/3142761423 learned_addr learned my addr 172.21.15.57:0/3142761423 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:32.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0ded1640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f40039b0 0x7f6a081639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0e6d2640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a081671d0 0x7f6a0815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 -- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a081671d0 msgr2=0x7f6a0815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a081671d0 0x7f6a0815b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 -- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f40039b0 msgr2=0x7f6a081639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f40039b0 0x7f6a081639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 -- 172.21.15.57:0/3142761423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08162c10 con 0x7f6a0815bc70 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a0d6d0640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a0815bc70 0x7f6a08162230 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009fd0 tx=0x7f69f8011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f69fe7fc640 1 -- 172.21.15.57:0/3142761423 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8004220 con 0x7f6a0815bc70 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f69fe7fc640 1 -- 172.21.15.57:0/3142761423 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f8004380 con 0x7f6a0815bc70 2023-11-24T08:04:32.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f69fe7fc640 1 -- 172.21.15.57:0/3142761423 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800f9e0 con 0x7f6a0815bc70 2023-11-24T08:04:32.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a08162ef0 con 0x7f6a0815bc70 2023-11-24T08:04:32.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.295+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a08167650 con 0x7f6a0815bc70 2023-11-24T08:04:32.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.299+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a081678d0 con 0x7f6a0815bc70 2023-11-24T08:04:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.299+0000 7f69fe7fc640 1 -- 172.21.15.57:0/3142761423 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69f800fb40 con 0x7f6a0815bc70 2023-11-24T08:04:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.299+0000 7f69fe7fc640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69ec066470 0x7f69ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.299+0000 7f69fe7fc640 1 -- 172.21.15.57:0/3142761423 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69f80842f0 con 0x7f6a0815bc70 2023-11-24T08:04:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.299+0000 7f6a0ded1640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69ec066470 0x7f69ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.299+0000 7f6a0ded1640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69ec066470 0x7f69ec068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6a040af000 tx=0x7f6a040a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.303+0000 7f69fe7fc640 1 -- 172.21.15.57:0/3142761423 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69f8051810 con 0x7f6a0815bc70 2023-11-24T08:04:32.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.459+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a080d1020 con 0x7f6a0815bc70 2023-11-24T08:04:32.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f69fe7fc640 1 -- 172.21.15.57:0/3142761423 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f69f8054e30 con 0x7f6a0815bc70 2023-11-24T08:04:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:32.466 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:32.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69ec066470 msgr2=0x7f69ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69ec066470 0x7f69ec068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6a040af000 tx=0x7f6a040a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a0815bc70 msgr2=0x7f6a08162230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a0815bc70 0x7f6a08162230 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009fd0 tx=0x7f69f8011b30 comp rx=0 tx=0).stop 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 shutdown_connections 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69ec066470 0x7f69ec068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6a081671d0 0x7f6a0815b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a0815bc70 0x7f6a08162230 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 --2- 172.21.15.57:0/3142761423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69f40039b0 0x7f6a081639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 >> 172.21.15.57:0/3142761423 conn(0x7f6a08060fd0 msgr2=0x7f6a0806c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:32.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 shutdown_connections 2023-11-24T08:04:32.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.463+0000 7f6a10135640 1 -- 172.21.15.57:0/3142761423 wait complete. 2023-11-24T08:04:32.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:32.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.631+0000 7f8beea88640 1 Processor -- start 2023-11-24T08:04:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.631+0000 7f8beea88640 1 -- start start 2023-11-24T08:04:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8beea88640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8be815a450 0x7f8be80b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8beea88640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be806e0a0 con 0x7f8be806d090 2023-11-24T08:04:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8beea88640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80ca430 con 0x7f8be80b0b50 2023-11-24T08:04:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8beea88640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80b1470 con 0x7f8be815a450 2023-11-24T08:04:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8bee287640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8be806d090 0x7f8be8070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39248/0 (socket says 172.21.15.57:39248) 2023-11-24T08:04:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8bee287640 1 -- 172.21.15.57:0/2998335964 learned_addr learned my addr 172.21.15.57:0/2998335964 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8bed285640 1 --2- 172.21.15.57:0/2998335964 >> v2:172.21.15.132:3300/0 conn(0x7f8be815a450 0x7f8be80b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8beca84640 1 -- 172.21.15.57:0/2998335964 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110248097 0 0) 0x7f8be806e0a0 con 0x7f8be806d090 2023-11-24T08:04:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8beca84640 1 -- 172.21.15.57:0/2998335964 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd4003530 con 0x7f8be806d090 2023-11-24T08:04:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8bed285640 1 -- 172.21.15.57:0/2998335964 >> v1:172.21.15.132:6789/0 conn(0x7f8be80b0b50 legacy=0x7f8be815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8bed285640 1 -- 172.21.15.57:0/2998335964 >> v1:172.21.15.57:6789/0 conn(0x7f8be806d090 legacy=0x7f8be8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.635+0000 7f8bed285640 1 -- 172.21.15.57:0/2998335964 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be806d520 con 0x7f8be815a450 2023-11-24T08:04:32.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8bed285640 1 --2- 172.21.15.57:0/2998335964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be815a450 0x7f8be80b0f30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80097c0 tx=0x7f8bd801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc90c704d7b4892e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beca84640 1 -- 172.21.15.57:0/2998335964 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80ab650 con 0x7f8be815a450 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beca84640 1 -- 172.21.15.57:0/2998335964 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd80ab7b0 con 0x7f8be815a450 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beca84640 1 -- 172.21.15.57:0/2998335964 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80abb40 con 0x7f8be815a450 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 -- 172.21.15.57:0/2998335964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be815a450 msgr2=0x7f8be80b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 --2- 172.21.15.57:0/2998335964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be815a450 0x7f8be80b0f30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80097c0 tx=0x7f8bd801c450 comp rx=0 tx=0).stop 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 -- 172.21.15.57:0/2998335964 shutdown_connections 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 --2- 172.21.15.57:0/2998335964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be815a450 0x7f8be80b0f30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 -- 172.21.15.57:0/2998335964 >> 172.21.15.57:0/2998335964 conn(0x7f8be80cbb50 msgr2=0x7f8be80cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 -- 172.21.15.57:0/2998335964 shutdown_connections 2023-11-24T08:04:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 -- 172.21.15.57:0/2998335964 wait complete. 2023-11-24T08:04:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 Processor -- start 2023-11-24T08:04:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 -- start start 2023-11-24T08:04:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80b0b50 0x7f8be80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.639+0000 7f8beea88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be8154600 0x7f8be80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beea88640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8be80ad000 0x7f8be80ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beea88640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8154a60 con 0x7f8be80b0b50 2023-11-24T08:04:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beea88640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80ad9c0 con 0x7f8be8154600 2023-11-24T08:04:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beea88640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80b3370 con 0x7f8be80ad000 2023-11-24T08:04:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80b0b50 0x7f8be80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80b0b50 0x7f8be80b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58556/0 (socket says 172.21.15.57:58556) 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 -- 172.21.15.57:0/3850643739 learned_addr learned my addr 172.21.15.57:0/3850643739 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8bed285640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be8154600 0x7f8be80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8bee287640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8be80ad000 0x7f8be80ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 -- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8be80ad000 msgr2=0x7f8be80ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8be80ad000 0x7f8be80ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 -- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be8154600 msgr2=0x7f8be80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be8154600 0x7f8be80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 -- 172.21.15.57:0/3850643739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8009420 con 0x7f8be80b0b50 2023-11-24T08:04:32.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8bed285640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be8154600 0x7f8be80b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beda86640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80b0b50 0x7f8be80b1cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c530 tx=0x7f8be400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8bde7fc640 1 -- 172.21.15.57:0/3850643739 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4005220 con 0x7f8be80b0b50 2023-11-24T08:04:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8bde7fc640 1 -- 172.21.15.57:0/3850643739 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4005380 con 0x7f8be80b0b50 2023-11-24T08:04:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8bde7fc640 1 -- 172.21.15.57:0/3850643739 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4007270 con 0x7f8be80b0b50 2023-11-24T08:04:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be80b22d0 con 0x7f8be80b0b50 2023-11-24T08:04:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be80b2890 con 0x7f8be80b0b50 2023-11-24T08:04:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be804e850 con 0x7f8be80b0b50 2023-11-24T08:04:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.643+0000 7f8bde7fc640 1 -- 172.21.15.57:0/3850643739 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8be40073d0 con 0x7f8be80b0b50 2023-11-24T08:04:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.647+0000 7f8bde7fc640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8bcc0664a0 0x7f8bcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.647+0000 7f8bde7fc640 1 -- 172.21.15.57:0/3850643739 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8be40837f0 con 0x7f8be80b0b50 2023-11-24T08:04:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.647+0000 7f8bed285640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8bcc0664a0 0x7f8bcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.647+0000 7f8bed285640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8bcc0664a0 0x7f8bcc068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80af000 tx=0x7f8bd80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.651+0000 7f8bde7fc640 1 -- 172.21.15.57:0/3850643739 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8be4050bd0 con 0x7f8be80b0b50 2023-11-24T08:04:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8be80c9fe0 con 0x7f8be80b0b50 2023-11-24T08:04:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8bde7fc640 1 -- 172.21.15.57:0/3850643739 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8be40541f0 con 0x7f8be80b0b50 2023-11-24T08:04:32.813 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8bcc0664a0 msgr2=0x7f8bcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8bcc0664a0 0x7f8bcc068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80af000 tx=0x7f8bd80a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80b0b50 msgr2=0x7f8be80b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80b0b50 0x7f8be80b1cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c530 tx=0x7f8be400c9f0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 shutdown_connections 2023-11-24T08:04:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8bcc0664a0 0x7f8bcc068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8be80ad000 0x7f8be80ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8be8154600 0x7f8be80b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 --2- 172.21.15.57:0/3850643739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8be80b0b50 0x7f8be80b1cf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 >> 172.21.15.57:0/3850643739 conn(0x7f8be80cbb50 msgr2=0x7f8be80cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 shutdown_connections 2023-11-24T08:04:32.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.811+0000 7f8beea88640 1 -- 172.21.15.57:0/3850643739 wait complete. 2023-11-24T08:04:32.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:32.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.975+0000 7f016f8c9640 1 Processor -- start 2023-11-24T08:04:32.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.975+0000 7f016f8c9640 1 -- start start 2023-11-24T08:04:32.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016f8c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f016815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016f8c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01680ce420 0x7f016806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016f8c9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680b3510 con 0x7f01680cd850 2023-11-24T08:04:32.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016f8c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680b37f0 con 0x7f01680ce420 2023-11-24T08:04:32.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016f8c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680b3ad0 con 0x7f01680ae4a0 2023-11-24T08:04:32.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016d665640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f016815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016ce64640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f01680cd850 0x7f01680cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:57758/0 (socket says 172.21.15.57:57758) 2023-11-24T08:04:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016ce64640 1 -- 172.21.15.57:0/2198074630 learned_addr learned my addr 172.21.15.57:0/2198074630 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016de66640 1 --2- 172.21.15.57:0/2198074630 >> v2:172.21.15.132:3300/0 conn(0x7f01680ce420 0x7f016806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016d665640 1 -- 172.21.15.57:0/2198074630 >> v2:172.21.15.132:3300/0 conn(0x7f01680ce420 msgr2=0x7f016806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016d665640 1 --2- 172.21.15.57:0/2198074630 >> v2:172.21.15.132:3300/0 conn(0x7f01680ce420 0x7f016806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f015ffff640 1 -- 172.21.15.57:0/2198074630 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174257600 0 0) 0x7f01680b3510 con 0x7f01680cd850 2023-11-24T08:04:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016d665640 1 -- 172.21.15.57:0/2198074630 >> v1:172.21.15.132:6789/0 conn(0x7f01680cd850 legacy=0x7f01680cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.979+0000 7f016d665640 1 -- 172.21.15.57:0/2198074630 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680b3db0 con 0x7f01680ae4a0 2023-11-24T08:04:32.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016d665640 1 --2- 172.21.15.57:0/2198074630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f016815ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01640097c0 tx=0x7f016401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ccfdd373249b7c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f015ffff640 1 -- 172.21.15.57:0/2198074630 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640ab670 con 0x7f01680ae4a0 2023-11-24T08:04:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f015ffff640 1 -- 172.21.15.57:0/2198074630 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01640ab7d0 con 0x7f01680ae4a0 2023-11-24T08:04:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f015ffff640 1 -- 172.21.15.57:0/2198074630 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640abb60 con 0x7f01680ae4a0 2023-11-24T08:04:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 -- 172.21.15.57:0/2198074630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 msgr2=0x7f016815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2198074630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f016815ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01640097c0 tx=0x7f016401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 -- 172.21.15.57:0/2198074630 shutdown_connections 2023-11-24T08:04:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2198074630 >> v2:172.21.15.132:3300/0 conn(0x7f01680ce420 0x7f016806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2198074630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f016815ba00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 -- 172.21.15.57:0/2198074630 >> 172.21.15.57:0/2198074630 conn(0x7f01680b0c80 msgr2=0x7f01680b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 -- 172.21.15.57:0/2198074630 shutdown_connections 2023-11-24T08:04:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 -- 172.21.15.57:0/2198074630 wait complete. 2023-11-24T08:04:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 Processor -- start 2023-11-24T08:04:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.983+0000 7f016f8c9640 1 -- start start 2023-11-24T08:04:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f0168146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680cd850 0x7f01680afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01680ce420 0x7f01680b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680acf70 con 0x7f01680cd850 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680abf60 con 0x7f01680ce420 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680ac1b0 con 0x7f01680ae4a0 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680cd850 0x7f01680afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680cd850 0x7f01680afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58560/0 (socket says 172.21.15.57:58560) 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 -- 172.21.15.57:0/2985939445 learned_addr learned my addr 172.21.15.57:0/2985939445 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016d665640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f0168146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016de66640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01680ce420 0x7f01680b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 -- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 msgr2=0x7f0168146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f0168146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 -- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01680ce420 msgr2=0x7f01680b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01680ce420 0x7f01680b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:32.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 -- 172.21.15.57:0/2985939445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164009420 con 0x7f01680cd850 2023-11-24T08:04:32.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016ce64640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680cd850 0x7f01680afc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f01580011f0 tx=0x7f015800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f015dffb640 1 -- 172.21.15.57:0/2985939445 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01580074e0 con 0x7f01680cd850 2023-11-24T08:04:32.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f015dffb640 1 -- 172.21.15.57:0/2985939445 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158007640 con 0x7f01680cd850 2023-11-24T08:04:32.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f015dffb640 1 -- 172.21.15.57:0/2985939445 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158004a10 con 0x7f01680cd850 2023-11-24T08:04:32.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01680ac490 con 0x7f01680cd850 2023-11-24T08:04:32.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01680aca50 con 0x7f01680cd850 2023-11-24T08:04:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016804e8c0 con 0x7f01680cd850 2023-11-24T08:04:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.987+0000 7f015dffb640 1 -- 172.21.15.57:0/2985939445 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0158004b70 con 0x7f01680cd850 2023-11-24T08:04:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.991+0000 7f015dffb640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f014c066470 0x7f014c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.991+0000 7f015dffb640 1 -- 172.21.15.57:0/2985939445 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0158083130 con 0x7f01680cd850 2023-11-24T08:04:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.991+0000 7f016d665640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f014c066470 0x7f014c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:32.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.991+0000 7f016d665640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f014c066470 0x7f014c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f01640af000 tx=0x7f01640a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:32.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:32.995+0000 7f015dffb640 1 -- 172.21.15.57:0/2985939445 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01580505c0 con 0x7f01680cd850 2023-11-24T08:04:33.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.151+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01680cd100 con 0x7f01680cd850 2023-11-24T08:04:33.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.151+0000 7f015dffb640 1 -- 172.21.15.57:0/2985939445 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0158018020 con 0x7f01680cd850 2023-11-24T08:04:33.157 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f014c066470 msgr2=0x7f014c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f014c066470 0x7f014c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f01640af000 tx=0x7f01640a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680cd850 msgr2=0x7f01680afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680cd850 0x7f01680afc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f01580011f0 tx=0x7f015800c9b0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 shutdown_connections 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f014c066470 0x7f014c068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01680ce420 0x7f01680b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680cd850 0x7f01680afc00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 --2- 172.21.15.57:0/2985939445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01680ae4a0 0x7f0168146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 >> 172.21.15.57:0/2985939445 conn(0x7f01680b0c80 msgr2=0x7f0168070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:33.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 shutdown_connections 2023-11-24T08:04:33.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.155+0000 7f016f8c9640 1 -- 172.21.15.57:0/2985939445 wait complete. 2023-11-24T08:04:33.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:33.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.319+0000 7fe82e232640 1 Processor -- start 2023-11-24T08:04:33.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.319+0000 7fe82e232640 1 -- start start 2023-11-24T08:04:33.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe82e232640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe82815d7f0 0x7fe8280d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe82e232640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280d3c60 con 0x7fe82806cce0 2023-11-24T08:04:33.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe82e232640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280b0090 con 0x7fe8280d37e0 2023-11-24T08:04:33.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe82e232640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82806b980 con 0x7fe82815d7f0 2023-11-24T08:04:33.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe827fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe82806cce0 0x7fe82806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39256/0 (socket says 172.21.15.57:39256) 2023-11-24T08:04:33.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe827fff640 1 -- 172.21.15.57:0/1481228071 learned_addr learned my addr 172.21.15.57:0/1481228071 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe8277fe640 1 --2- 172.21.15.57:0/1481228071 >> v2:172.21.15.132:3300/0 conn(0x7fe82815d7f0 0x7fe8280d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe8267fc640 1 -- 172.21.15.57:0/1481228071 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175483654 0 0) 0x7fe8280d3c60 con 0x7fe82806cce0 2023-11-24T08:04:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe8267fc640 1 -- 172.21.15.57:0/1481228071 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe810003530 con 0x7fe82806cce0 2023-11-24T08:04:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe8277fe640 1 -- 172.21.15.57:0/1481228071 >> v1:172.21.15.132:6789/0 conn(0x7fe8280d37e0 legacy=0x7fe8280b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe8277fe640 1 -- 172.21.15.57:0/1481228071 >> v1:172.21.15.57:6789/0 conn(0x7fe82806cce0 legacy=0x7fe82806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.323+0000 7fe8277fe640 1 -- 172.21.15.57:0/1481228071 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280b0330 con 0x7fe82815d7f0 2023-11-24T08:04:33.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe8277fe640 1 --2- 172.21.15.57:0/1481228071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe82815d7f0 0x7fe8280d32a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe81801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153e77109afc33b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe8267fc640 1 -- 172.21.15.57:0/1481228071 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180ab600 con 0x7fe82815d7f0 2023-11-24T08:04:33.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe8267fc640 1 -- 172.21.15.57:0/1481228071 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180a7050 con 0x7fe82815d7f0 2023-11-24T08:04:33.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe8267fc640 1 -- 172.21.15.57:0/1481228071 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180ab980 con 0x7fe82815d7f0 2023-11-24T08:04:33.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 -- 172.21.15.57:0/1481228071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe82815d7f0 msgr2=0x7fe8280d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 --2- 172.21.15.57:0/1481228071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe82815d7f0 0x7fe8280d32a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe81801c480 comp rx=0 tx=0).stop 2023-11-24T08:04:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 -- 172.21.15.57:0/1481228071 shutdown_connections 2023-11-24T08:04:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 --2- 172.21.15.57:0/1481228071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe82815d7f0 0x7fe8280d32a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 -- 172.21.15.57:0/1481228071 >> 172.21.15.57:0/1481228071 conn(0x7fe82809c790 msgr2=0x7fe82808af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 -- 172.21.15.57:0/1481228071 shutdown_connections 2023-11-24T08:04:33.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 -- 172.21.15.57:0/1481228071 wait complete. 2023-11-24T08:04:33.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 Processor -- start 2023-11-24T08:04:33.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 -- start start 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe82806cce0 0x7fe82809eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280d37e0 0x7fe82809f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.327+0000 7fe82e232640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe82815d7f0 0x7fe828154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe82e232640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82809e770 con 0x7fe82806cce0 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe82e232640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280a1080 con 0x7fe8280d37e0 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe82e232640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82809e1b0 con 0x7fe82815d7f0 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe82806cce0 0x7fe82809eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe82806cce0 0x7fe82809eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58570/0 (socket says 172.21.15.57:58570) 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 -- 172.21.15.57:0/3313664559 learned_addr learned my addr 172.21.15.57:0/3313664559 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe827fff640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe82815d7f0 0x7fe828154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe826ffd640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280d37e0 0x7fe82809f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 -- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe82815d7f0 msgr2=0x7fe828154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe82815d7f0 0x7fe828154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 -- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280d37e0 msgr2=0x7fe82809f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280d37e0 0x7fe82809f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 -- 172.21.15.57:0/3313664559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009420 con 0x7fe82806cce0 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe826ffd640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280d37e0 0x7fe82809f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe827fff640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe82815d7f0 0x7fe828154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe8277fe640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe82806cce0 0x7fe82809eb10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe818019090 tx=0x7fe81801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe80ffff640 1 -- 172.21.15.57:0/3313664559 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180b7450 con 0x7fe82806cce0 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe80ffff640 1 -- 172.21.15.57:0/3313664559 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180b75b0 con 0x7fe82806cce0 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe80ffff640 1 -- 172.21.15.57:0/3313664559 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180b7960 con 0x7fe82806cce0 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82809e490 con 0x7fe82806cce0 2023-11-24T08:04:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8280a0ba0 con 0x7fe82806cce0 2023-11-24T08:04:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8280b2c50 con 0x7fe82806cce0 2023-11-24T08:04:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.331+0000 7fe80ffff640 1 -- 172.21.15.57:0/3313664559 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8180b7ac0 con 0x7fe82806cce0 2023-11-24T08:04:33.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.335+0000 7fe80ffff640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe8140664a0 0x7fe814068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.335+0000 7fe80ffff640 1 -- 172.21.15.57:0/3313664559 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe81811e550 con 0x7fe82806cce0 2023-11-24T08:04:33.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.335+0000 7fe826ffd640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe8140664a0 0x7fe814068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.335+0000 7fe826ffd640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe8140664a0 0x7fe814068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe828154eb0 tx=0x7fe81c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.339+0000 7fe80ffff640 1 -- 172.21.15.57:0/3313664559 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8180eb9d0 con 0x7fe82806cce0 2023-11-24T08:04:33.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.495+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe82804e8c0 con 0x7fe82806cce0 2023-11-24T08:04:33.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.495+0000 7fe80ffff640 1 -- 172.21.15.57:0/3313664559 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8180eeff0 con 0x7fe82806cce0 2023-11-24T08:04:33.500 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe8140664a0 msgr2=0x7fe814068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe8140664a0 0x7fe814068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe828154eb0 tx=0x7fe81c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe82806cce0 msgr2=0x7fe82809eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe82806cce0 0x7fe82809eb10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe818019090 tx=0x7fe81801acc0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 shutdown_connections 2023-11-24T08:04:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe8140664a0 0x7fe814068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe82815d7f0 0x7fe828154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8280d37e0 0x7fe82809f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 --2- 172.21.15.57:0/3313664559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe82806cce0 0x7fe82809eb10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 >> 172.21.15.57:0/3313664559 conn(0x7fe82809c790 msgr2=0x7fe8280cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:33.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 shutdown_connections 2023-11-24T08:04:33.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.499+0000 7fe82e232640 1 -- 172.21.15.57:0/3313664559 wait complete. 2023-11-24T08:04:33.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:33.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f98d35640 1 Processor -- start 2023-11-24T08:04:33.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f98d35640 1 -- start start 2023-11-24T08:04:33.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f98d35640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f940d3020 0x7f9f940d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f98d35640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9f940ce8b0 0x7f9f940ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f98d35640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9406c0e0 con 0x7f9f9415d570 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f98d35640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f940d39f0 con 0x7f9f940d3020 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f98d35640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f940d1cc0 con 0x7f9f940ce8b0 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f8bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f940d3020 0x7f9f940d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f8bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f940d3020 0x7f9f940d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58578/0 (socket says 172.21.15.57:58578) 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.663+0000 7f9f8bfff640 1 -- 172.21.15.57:0/474229998 learned_addr learned my addr 172.21.15.57:0/474229998 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f92d9d640 1 --2- 172.21.15.57:0/474229998 >> v2:172.21.15.132:3300/0 conn(0x7f9f940ce8b0 0x7f9f940ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f8bfff640 1 -- 172.21.15.57:0/474229998 >> v2:172.21.15.132:3300/0 conn(0x7f9f940ce8b0 msgr2=0x7f9f940ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f8bfff640 1 --2- 172.21.15.57:0/474229998 >> v2:172.21.15.132:3300/0 conn(0x7f9f940ce8b0 0x7f9f940ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f8bfff640 1 -- 172.21.15.57:0/474229998 >> v1:172.21.15.132:6789/0 conn(0x7f9f9415d570 legacy=0x7f9f9406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f8bfff640 1 -- 172.21.15.57:0/474229998 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940d1fa0 con 0x7f9f940d3020 2023-11-24T08:04:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f91d9b640 1 -- 172.21.15.57:0/474229998 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661056144 0 0) 0x7f9f9406c0e0 con 0x7f9f9415d570 2023-11-24T08:04:33.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f8bfff640 1 --2- 172.21.15.57:0/474229998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940d3020 0x7f9f940d34b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f9406d730 tx=0x7f9f7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c586eef7a54d1525 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f91d9b640 1 -- 172.21.15.57:0/474229998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0aa430 con 0x7f9f940d3020 2023-11-24T08:04:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f91d9b640 1 -- 172.21.15.57:0/474229998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c0aa590 con 0x7f9f940d3020 2023-11-24T08:04:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.667+0000 7f9f91d9b640 1 -- 172.21.15.57:0/474229998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0aa920 con 0x7f9f940d3020 2023-11-24T08:04:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- 172.21.15.57:0/474229998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940d3020 msgr2=0x7f9f940d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 --2- 172.21.15.57:0/474229998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940d3020 0x7f9f940d34b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f9406d730 tx=0x7f9f7c01c4d0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- 172.21.15.57:0/474229998 shutdown_connections 2023-11-24T08:04:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 --2- 172.21.15.57:0/474229998 >> v2:172.21.15.132:3300/0 conn(0x7f9f940ce8b0 0x7f9f940ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 --2- 172.21.15.57:0/474229998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940d3020 0x7f9f940d34b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- 172.21.15.57:0/474229998 >> 172.21.15.57:0/474229998 conn(0x7f9f9408ceb0 msgr2=0x7f9f9409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- 172.21.15.57:0/474229998 shutdown_connections 2023-11-24T08:04:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- 172.21.15.57:0/474229998 wait complete. 2023-11-24T08:04:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 Processor -- start 2023-11-24T08:04:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- start start 2023-11-24T08:04:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940ce8b0 0x7f9f94155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f940d3020 0x7f9f9415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f9415d570 0x7f9f9415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940c9890 con 0x7f9f940ce8b0 2023-11-24T08:04:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b7070 con 0x7f9f9415d570 2023-11-24T08:04:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f98d35640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940cd570 con 0x7f9f940d3020 2023-11-24T08:04:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940ce8b0 0x7f9f94155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940ce8b0 0x7f9f94155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58590/0 (socket says 172.21.15.57:58590) 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 -- 172.21.15.57:0/4031442593 learned_addr learned my addr 172.21.15.57:0/4031442593 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f8bfff640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f940d3020 0x7f9f9415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f92d9d640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f9415d570 0x7f9f9415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 -- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f940d3020 msgr2=0x7f9f9415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f940d3020 0x7f9f9415dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 -- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f9415d570 msgr2=0x7f9f9415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f9415d570 0x7f9f9415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.671+0000 7f9f9259c640 1 -- 172.21.15.57:0/4031442593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0094d0 con 0x7f9f940ce8b0 2023-11-24T08:04:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f9259c640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940ce8b0 0x7f9f94155820 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f84001ec0 tx=0x7f9f8400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f8affd640 1 -- 172.21.15.57:0/4031442593 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840054e0 con 0x7f9f940ce8b0 2023-11-24T08:04:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f8affd640 1 -- 172.21.15.57:0/4031442593 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84003600 con 0x7f9f940ce8b0 2023-11-24T08:04:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f8affd640 1 -- 172.21.15.57:0/4031442593 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840039b0 con 0x7f9f940ce8b0 2023-11-24T08:04:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9415e6f0 con 0x7f9f940ce8b0 2023-11-24T08:04:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f940b7280 con 0x7f9f940ce8b0 2023-11-24T08:04:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f940a13b0 con 0x7f9f940ce8b0 2023-11-24T08:04:33.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f8affd640 1 -- 172.21.15.57:0/4031442593 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f84003b10 con 0x7f9f940ce8b0 2023-11-24T08:04:33.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f8affd640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9f74066470 0x7f9f74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:33.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f8affd640 1 -- 172.21.15.57:0/4031442593 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f84083470 con 0x7f9f940ce8b0 2023-11-24T08:04:33.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.675+0000 7f9f8bfff640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9f74066470 0x7f9f74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:33.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.679+0000 7f9f8bfff640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9f74066470 0x7f9f74068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0ae000 tx=0x7f9f7c0b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:33.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.679+0000 7f9f8affd640 1 -- 172.21.15.57:0/4031442593 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f84050900 con 0x7f9f940ce8b0 2023-11-24T08:04:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f9404e930 con 0x7f9f940ce8b0 2023-11-24T08:04:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f8affd640 1 -- 172.21.15.57:0/4031442593 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f84017080 con 0x7f9f940ce8b0 2023-11-24T08:04:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:04:33.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9f74066470 msgr2=0x7f9f74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9f74066470 0x7f9f74068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0ae000 tx=0x7f9f7c0b5040 comp rx=0 tx=0).stop 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940ce8b0 msgr2=0x7f9f94155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940ce8b0 0x7f9f94155820 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f84001ec0 tx=0x7f9f8400c8e0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 shutdown_connections 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9f74066470 0x7f9f74068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f9415d570 0x7f9f9415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f940d3020 0x7f9f9415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 --2- 172.21.15.57:0/4031442593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940ce8b0 0x7f9f94155820 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 >> 172.21.15.57:0/4031442593 conn(0x7f9f9408ceb0 msgr2=0x7f9f94156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 shutdown_connections 2023-11-24T08:04:33.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:33.851+0000 7f9f98d35640 1 -- 172.21.15.57:0/4031442593 wait complete. 2023-11-24T08:04:33.875 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:04:33.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.875 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-24T08:04:33.914 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:04:33.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:33.914 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:04:33.975 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:33.975 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:33.985 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:33.985 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:34.041 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:34.041 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:34.093 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.275+0000 7f2310172640 1 Processor -- start 2023-11-24T08:04:34.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.275+0000 7f2310172640 1 -- start start 2023-11-24T08:04:34.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.275+0000 7f2310172640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2308070ec0 0x7f230816c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.275+0000 7f2310172640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230806dc20 con 0x7f230806e340 2023-11-24T08:04:34.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.275+0000 7f2310172640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230806cd60 con 0x7f2308158a50 2023-11-24T08:04:34.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.275+0000 7f2310172640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230806e0b0 con 0x7f2308070ec0 2023-11-24T08:04:34.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230d70d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f230806e340 0x7f23080707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39266/0 (socket says 172.21.15.57:39266) 2023-11-24T08:04:34.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230d70d640 1 -- 172.21.15.57:0/3681278188 learned_addr learned my addr 172.21.15.57:0/3681278188 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:34.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230e70f640 1 --2- 172.21.15.57:0/3681278188 >> v2:172.21.15.132:3300/0 conn(0x7f2308070ec0 0x7f230816c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915170088 0 0) 0x7f230806dc20 con 0x7f230806e340 2023-11-24T08:04:34.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f4003530 con 0x7f230806e340 2023-11-24T08:04:34.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919967253 0 0) 0x7f230806cd60 con 0x7f2308158a50 2023-11-24T08:04:34.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f230806dc20 con 0x7f2308158a50 2023-11-24T08:04:34.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2495225515 0 0) 0x7f22f4003530 con 0x7f230806e340 2023-11-24T08:04:34.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 >> v2:172.21.15.132:3300/0 conn(0x7f2308070ec0 msgr2=0x7f230816c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:34.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 --2- 172.21.15.57:0/3681278188 >> v2:172.21.15.132:3300/0 conn(0x7f2308070ec0 0x7f230816c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 >> v1:172.21.15.132:6789/0 conn(0x7f2308158a50 legacy=0x7f230806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080b3620 con 0x7f230806e340 2023-11-24T08:04:34.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f22f8001680 con 0x7f230806e340 2023-11-24T08:04:34.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 >> v1:172.21.15.57:6789/0 conn(0x7f230806e340 legacy=0x7f23080707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f4003b10 0x7f22f4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f40047d0 0x7f22f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f4005190 0x7f22f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f400bfe0 con 0x7f22f4005190 2023-11-24T08:04:34.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f400c150 con 0x7f22f4003b10 2023-11-24T08:04:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f400c310 con 0x7f22f40047d0 2023-11-24T08:04:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230e70f640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f4005190 0x7f22f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230df0e640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f4003b10 0x7f22f4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230d70d640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f40047d0 0x7f22f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230e70f640 1 -- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f40047d0 msgr2=0x7f22f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230e70f640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f40047d0 0x7f22f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230e70f640 1 -- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f4003b10 msgr2=0x7f22f4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230e70f640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f4003b10 0x7f22f4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230e70f640 1 -- 172.21.15.57:0/3681278188 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4003530 con 0x7f22f4005190 2023-11-24T08:04:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230df0e640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22f4003b10 0x7f22f4003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.279+0000 7f230d70d640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f40047d0 0x7f22f4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:34.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f230e70f640 1 -- 172.21.15.57:0/3681278188 reap_dead start 2023-11-24T08:04:34.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f230e70f640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f4005190 0x7f22f400b990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2300009fc0 tx=0x7f230001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f783990be410e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300003ba0 con 0x7f22f4005190 2023-11-24T08:04:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230000f040 con 0x7f22f4005190 2023-11-24T08:04:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f230cf0c640 1 -- 172.21.15.57:0/3681278188 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000a59a0 con 0x7f22f4005190 2023-11-24T08:04:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 -- 172.21.15.57:0/3681278188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f4005190 msgr2=0x7f22f400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f4005190 0x7f22f400b990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2300009fc0 tx=0x7f230001cca0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 -- 172.21.15.57:0/3681278188 shutdown_connections 2023-11-24T08:04:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 --2- 172.21.15.57:0/3681278188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f4005190 0x7f22f400b990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 -- 172.21.15.57:0/3681278188 >> 172.21.15.57:0/3681278188 conn(0x7f23080b0bf0 msgr2=0x7f23080b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 -- 172.21.15.57:0/3681278188 shutdown_connections 2023-11-24T08:04:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 -- 172.21.15.57:0/3681278188 wait complete. 2023-11-24T08:04:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 Processor -- start 2023-11-24T08:04:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.283+0000 7f2310172640 1 -- start start 2023-11-24T08:04:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f4005190 0x7f23081540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23081565d0 0x7f2308156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23080afda0 0x7f23080b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23081557c0 con 0x7f23080afda0 2023-11-24T08:04:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23080b0760 con 0x7f23081565d0 2023-11-24T08:04:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23081545f0 con 0x7f22f4005190 2023-11-24T08:04:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23080afda0 0x7f23080b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230df0e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f4005190 0x7f23081540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23080afda0 0x7f23080b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58604/0 (socket says 172.21.15.57:58604) 2023-11-24T08:04:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 -- 172.21.15.57:0/2815065058 learned_addr learned my addr 172.21.15.57:0/2815065058 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230d70d640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23081565d0 0x7f2308156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 -- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f4005190 msgr2=0x7f23081540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f4005190 0x7f23081540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 -- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23081565d0 msgr2=0x7f2308156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23081565d0 0x7f2308156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 -- 172.21.15.57:0/2815065058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308154b40 con 0x7f23080afda0 2023-11-24T08:04:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230d70d640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23081565d0 0x7f2308156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f230e70f640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23080afda0 0x7f23080b0220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f230001c710 tx=0x7f2300009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f22fe7fc640 1 -- 172.21.15.57:0/2815065058 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000b8880 con 0x7f23080afda0 2023-11-24T08:04:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f22fe7fc640 1 -- 172.21.15.57:0/2815065058 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23000a6e90 con 0x7f23080afda0 2023-11-24T08:04:34.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f22fe7fc640 1 -- 172.21.15.57:0/2815065058 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000b8c40 con 0x7f23080afda0 2023-11-24T08:04:34.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2308154e20 con 0x7f23080afda0 2023-11-24T08:04:34.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23081553e0 con 0x7f23080afda0 2023-11-24T08:04:34.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2308067520 con 0x7f23080afda0 2023-11-24T08:04:34.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.287+0000 7f22fe7fc640 1 -- 172.21.15.57:0/2815065058 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f23000c3460 con 0x7f23080afda0 2023-11-24T08:04:34.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.291+0000 7f22fe7fc640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f22ec066470 0x7f22ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.291+0000 7f22fe7fc640 1 -- 172.21.15.57:0/2815065058 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f230011f4e0 con 0x7f23080afda0 2023-11-24T08:04:34.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.291+0000 7f230df0e640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f22ec066470 0x7f22ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.291+0000 7f230df0e640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f22ec066470 0x7f22ec068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23040016e0 tx=0x7f2304009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.295+0000 7f22fe7fc640 1 -- 172.21.15.57:0/2815065058 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23000ec9f0 con 0x7f23080afda0 2023-11-24T08:04:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.455+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2308165690 con 0x7f23080afda0 2023-11-24T08:04:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.455+0000 7f22fe7fc640 1 -- 172.21.15.57:0/2815065058 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f23000f0010 con 0x7f23080afda0 2023-11-24T08:04:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:34.459 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f22ec066470 msgr2=0x7f22ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f22ec066470 0x7f22ec068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23040016e0 tx=0x7f2304009040 comp rx=0 tx=0).stop 2023-11-24T08:04:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23080afda0 msgr2=0x7f23080b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23080afda0 0x7f23080b0220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f230001c710 tx=0x7f2300009750 comp rx=0 tx=0).stop 2023-11-24T08:04:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 shutdown_connections 2023-11-24T08:04:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f22ec066470 0x7f22ec068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23080afda0 0x7f23080b0220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23081565d0 0x7f2308156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 --2- 172.21.15.57:0/2815065058 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22f4005190 0x7f23081540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 >> 172.21.15.57:0/2815065058 conn(0x7f23080b0bf0 msgr2=0x7f2308157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 shutdown_connections 2023-11-24T08:04:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.459+0000 7f2310172640 1 -- 172.21.15.57:0/2815065058 wait complete. 2023-11-24T08:04:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:34.482 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc79f2a640 1 Processor -- start 2023-11-24T08:04:34.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc79f2a640 1 -- start start 2023-11-24T08:04:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc79f2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efc740d0530 0x7efc740ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc79f2a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7415daf0 con 0x7efc7415d710 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc79f2a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740ce770 con 0x7efc7415e690 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc79f2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740cf3f0 con 0x7efc740d0530 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efc7415d710 0x7efc740cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39276/0 (socket says 172.21.15.57:39276) 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 -- 172.21.15.57:0/3861065198 learned_addr learned my addr 172.21.15.57:0/3861065198 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc72ffd640 1 --2- 172.21.15.57:0/3861065198 >> v2:172.21.15.132:3300/0 conn(0x7efc740d0530 0x7efc740ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279613251 0 0) 0x7efc7415daf0 con 0x7efc7415d710 2023-11-24T08:04:34.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc5c003530 con 0x7efc7415d710 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678445733 0 0) 0x7efc5c003530 con 0x7efc7415d710 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 >> v2:172.21.15.132:3300/0 conn(0x7efc740d0530 msgr2=0x7efc740ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 --2- 172.21.15.57:0/3861065198 >> v2:172.21.15.132:3300/0 conn(0x7efc740d0530 0x7efc740ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 >> v1:172.21.15.132:6789/0 conn(0x7efc7415e690 legacy=0x7efc7406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740cea50 con 0x7efc7415d710 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7efc64001680 con 0x7efc7415d710 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 >> v1:172.21.15.57:6789/0 conn(0x7efc7415d710 legacy=0x7efc740cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc5c005190 0x7efc5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740cf3f0 con 0x7efc5c003980 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c00c030 con 0x7efc5c0047d0 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c00c1f0 con 0x7efc5c005190 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc72ffd640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc73fff640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc5c005190 0x7efc5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 -- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc5c005190 msgr2=0x7efc5c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:34.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc5c005190 0x7efc5c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 -- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc5c0047d0 msgr2=0x7efc5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc5c0047d0 0x7efc5c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc737fe640 1 -- 172.21.15.57:0/3861065198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c003530 con 0x7efc5c003980 2023-11-24T08:04:34.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.627+0000 7efc73fff640 1 -- 172.21.15.57:0/3861065198 reap_dead start 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc737fe640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc5c003da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c240 tx=0x7efc6401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb8eda84314bd08 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640a5af0 con 0x7efc5c003980 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640a5c50 con 0x7efc5c003980 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc727fc640 1 -- 172.21.15.57:0/3861065198 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64005b20 con 0x7efc5c003980 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc79f2a640 1 -- 172.21.15.57:0/3861065198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 msgr2=0x7efc5c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc5c003da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c240 tx=0x7efc6401cc10 comp rx=0 tx=0).stop 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc79f2a640 1 -- 172.21.15.57:0/3861065198 shutdown_connections 2023-11-24T08:04:34.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3861065198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc5c003da0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc79f2a640 1 -- 172.21.15.57:0/3861065198 >> 172.21.15.57:0/3861065198 conn(0x7efc7408af70 msgr2=0x7efc740d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc79f2a640 1 -- 172.21.15.57:0/3861065198 shutdown_connections 2023-11-24T08:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.631+0000 7efc79f2a640 1 -- 172.21.15.57:0/3861065198 wait complete. 2023-11-24T08:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 Processor -- start 2023-11-24T08:04:34.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 -- start start 2023-11-24T08:04:34.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc740b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc741ea1b0 0x7efc74158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc74158550 0x7efc740b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc741ea630 con 0x7efc5c003980 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc741ea8e0 con 0x7efc741ea1b0 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc741eabc0 con 0x7efc74158550 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc740b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc740b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58614/0 (socket says 172.21.15.57:58614) 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 -- 172.21.15.57:0/3568221272 learned_addr learned my addr 172.21.15.57:0/3568221272 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc72ffd640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc741ea1b0 0x7efc74158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc73fff640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc74158550 0x7efc740b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 -- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc74158550 msgr2=0x7efc740b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc74158550 0x7efc740b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 -- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc741ea1b0 msgr2=0x7efc74158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc741ea1b0 0x7efc74158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 -- 172.21.15.57:0/3568221272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc741eaea0 con 0x7efc5c003980 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc72ffd640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc741ea1b0 0x7efc74158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc73fff640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc74158550 0x7efc740b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc737fe640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc740b7c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c240 tx=0x7efc5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc5bfff640 1 -- 172.21.15.57:0/3568221272 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640b3070 con 0x7efc5c003980 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc5bfff640 1 -- 172.21.15.57:0/3568221272 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64004e90 con 0x7efc5c003980 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc5bfff640 1 -- 172.21.15.57:0/3568221272 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64000ee0 con 0x7efc5c003980 2023-11-24T08:04:34.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc741eb180 con 0x7efc5c003980 2023-11-24T08:04:34.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.635+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc740b4530 con 0x7efc5c003980 2023-11-24T08:04:34.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.639+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7404e8c0 con 0x7efc5c003980 2023-11-24T08:04:34.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.639+0000 7efc5bfff640 1 -- 172.21.15.57:0/3568221272 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc64001440 con 0x7efc5c003980 2023-11-24T08:04:34.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.639+0000 7efc5bfff640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc60066470 0x7efc60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.639+0000 7efc5bfff640 1 -- 172.21.15.57:0/3568221272 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc6411d7f0 con 0x7efc5c003980 2023-11-24T08:04:34.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.639+0000 7efc72ffd640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc60066470 0x7efc60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.639+0000 7efc72ffd640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc60066470 0x7efc60068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc740b8b30 tx=0x7efc68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.643+0000 7efc5bfff640 1 -- 172.21.15.57:0/3568221272 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc640eac70 con 0x7efc5c003980 2023-11-24T08:04:34.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc740d0cd0 con 0x7efc5c003980 2023-11-24T08:04:34.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc5bfff640 1 -- 172.21.15.57:0/3568221272 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc640be0a0 con 0x7efc5c003980 2023-11-24T08:04:34.810 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc60066470 msgr2=0x7efc60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc60066470 0x7efc60068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efc740b8b30 tx=0x7efc68008040 comp rx=0 tx=0).stop 2023-11-24T08:04:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 msgr2=0x7efc740b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc740b7c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c240 tx=0x7efc5c005800 comp rx=0 tx=0).stop 2023-11-24T08:04:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 shutdown_connections 2023-11-24T08:04:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efc60066470 0x7efc60068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc74158550 0x7efc740b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc741ea1b0 0x7efc74158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 --2- 172.21.15.57:0/3568221272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc5c003980 0x7efc740b7c80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 >> 172.21.15.57:0/3568221272 conn(0x7efc7408af70 msgr2=0x7efc740b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 shutdown_connections 2023-11-24T08:04:34.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.807+0000 7efc79f2a640 1 -- 172.21.15.57:0/3568221272 wait complete. 2023-11-24T08:04:34.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.971+0000 7f67c2b01640 1 Processor -- start 2023-11-24T08:04:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.971+0000 7f67c2b01640 1 -- start start 2023-11-24T08:04:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67c2b01640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67bc0ce420 0x7f67bc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67c2b01640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc0b3510 con 0x7f67bc0ae4a0 2023-11-24T08:04:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67c2b01640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc0b37f0 con 0x7f67bc0cd850 2023-11-24T08:04:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67c2b01640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67bc0b3ad0 con 0x7f67bc0ce420 2023-11-24T08:04:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67c089d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f67bc0ae4a0 0x7f67bc0cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39280/0 (socket says 172.21.15.57:39280) 2023-11-24T08:04:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67c089d640 1 -- 172.21.15.57:0/2526122565 learned_addr learned my addr 172.21.15.57:0/2526122565 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:34.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bbfff640 1 --2- 172.21.15.57:0/2526122565 >> v2:172.21.15.132:3300/0 conn(0x7f67bc0ce420 0x7f67bc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bb7fe640 1 -- 172.21.15.57:0/2526122565 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680029015 0 0) 0x7f67bc0b3510 con 0x7f67bc0ae4a0 2023-11-24T08:04:34.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bb7fe640 1 -- 172.21.15.57:0/2526122565 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67ac003530 con 0x7f67bc0ae4a0 2023-11-24T08:04:34.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bb7fe640 1 -- 172.21.15.57:0/2526122565 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647194404 0 0) 0x7f67bc0b37f0 con 0x7f67bc0cd850 2023-11-24T08:04:34.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bb7fe640 1 -- 172.21.15.57:0/2526122565 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67bc0b3510 con 0x7f67bc0cd850 2023-11-24T08:04:34.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bbfff640 1 -- 172.21.15.57:0/2526122565 >> v1:172.21.15.132:6789/0 conn(0x7f67bc0cd850 legacy=0x7f67bc06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bbfff640 1 -- 172.21.15.57:0/2526122565 >> v1:172.21.15.57:6789/0 conn(0x7f67bc0ae4a0 legacy=0x7f67bc0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.975+0000 7f67bbfff640 1 -- 172.21.15.57:0/2526122565 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0b3db0 con 0x7f67bc0ce420 2023-11-24T08:04:34.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67bbfff640 1 --2- 172.21.15.57:0/2526122565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0ce420 0x7f67bc15ba00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f67a80097c0 tx=0x7f67a801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f713ea5d1cb32575 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67bb7fe640 1 -- 172.21.15.57:0/2526122565 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a80ab670 con 0x7f67bc0ce420 2023-11-24T08:04:34.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67bb7fe640 1 -- 172.21.15.57:0/2526122565 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a80ab7d0 con 0x7f67bc0ce420 2023-11-24T08:04:34.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67bb7fe640 1 -- 172.21.15.57:0/2526122565 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a80abb60 con 0x7f67bc0ce420 2023-11-24T08:04:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 -- 172.21.15.57:0/2526122565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0ce420 msgr2=0x7f67bc15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 --2- 172.21.15.57:0/2526122565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0ce420 0x7f67bc15ba00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f67a80097c0 tx=0x7f67a801c450 comp rx=0 tx=0).stop 2023-11-24T08:04:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 -- 172.21.15.57:0/2526122565 shutdown_connections 2023-11-24T08:04:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 --2- 172.21.15.57:0/2526122565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0ce420 0x7f67bc15ba00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 -- 172.21.15.57:0/2526122565 >> 172.21.15.57:0/2526122565 conn(0x7f67bc0b0c80 msgr2=0x7f67bc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 -- 172.21.15.57:0/2526122565 shutdown_connections 2023-11-24T08:04:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 -- 172.21.15.57:0/2526122565 wait complete. 2023-11-24T08:04:34.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.979+0000 7f67c2b01640 1 Processor -- start 2023-11-24T08:04:34.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 -- start start 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67bc0ae4a0 0x7f67bc09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0cd850 0x7f67bc13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67bc0ce420 0x7f67bc0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc13dd30 con 0x7f67bc0ce420 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc13d770 con 0x7f67bc0cd850 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc13da50 con 0x7f67bc0ae4a0 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67bc0ce420 0x7f67bc0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67bc0ce420 0x7f67bc0af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58624/0 (socket says 172.21.15.57:58624) 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 -- 172.21.15.57:0/782012184 learned_addr learned my addr 172.21.15.57:0/782012184 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c089d640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67bc0ae4a0 0x7f67bc09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67bbfff640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0cd850 0x7f67bc13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 -- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67bc0ae4a0 msgr2=0x7f67bc09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67bc0ae4a0 0x7f67bc09ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 -- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0cd850 msgr2=0x7f67bc13ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0cd850 0x7f67bc13ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 -- 172.21.15.57:0/782012184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8009420 con 0x7f67bc0ce420 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67bbfff640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0cd850 0x7f67bc13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c109e640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67bc0ce420 0x7f67bc0af9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c7a0 tx=0x7f67b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67b97fa640 1 -- 172.21.15.57:0/782012184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4003b80 con 0x7f67bc0ce420 2023-11-24T08:04:34.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67b97fa640 1 -- 172.21.15.57:0/782012184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b4003ce0 con 0x7f67bc0ce420 2023-11-24T08:04:34.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc13ae30 con 0x7f67bc0ce420 2023-11-24T08:04:34.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67b97fa640 1 -- 172.21.15.57:0/782012184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b400aa90 con 0x7f67bc0ce420 2023-11-24T08:04:34.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc09cf60 con 0x7f67bc0ce420 2023-11-24T08:04:34.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.983+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc04e8c0 con 0x7f67bc0ce420 2023-11-24T08:04:34.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.987+0000 7f67b97fa640 1 -- 172.21.15.57:0/782012184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67b400abf0 con 0x7f67bc0ce420 2023-11-24T08:04:34.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.987+0000 7f67b97fa640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67a0066470 0x7f67a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:34.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.987+0000 7f67b97fa640 1 -- 172.21.15.57:0/782012184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67b4083e30 con 0x7f67bc0ce420 2023-11-24T08:04:34.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.987+0000 7f67c089d640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67a0066470 0x7f67a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:34.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.987+0000 7f67c089d640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67a0066470 0x7f67a0068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f67b00011f0 tx=0x7f67b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:34.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:34.991+0000 7f67b97fa640 1 -- 172.21.15.57:0/782012184 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67b4051190 con 0x7f67bc0ce420 2023-11-24T08:04:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67bc150760 con 0x7f67bc0ce420 2023-11-24T08:04:35.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67b97fa640 1 -- 172.21.15.57:0/782012184 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67b40547b0 con 0x7f67bc0ce420 2023-11-24T08:04:35.150 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:35.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67a0066470 msgr2=0x7f67a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67a0066470 0x7f67a0068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f67b00011f0 tx=0x7f67b0009040 comp rx=0 tx=0).stop 2023-11-24T08:04:35.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67bc0ce420 msgr2=0x7f67bc0af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67bc0ce420 0x7f67bc0af9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c7a0 tx=0x7f67b400cc60 comp rx=0 tx=0).stop 2023-11-24T08:04:35.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 shutdown_connections 2023-11-24T08:04:35.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67a0066470 0x7f67a0068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67bc0ce420 0x7f67bc0af9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67bc0cd850 0x7f67bc13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 --2- 172.21.15.57:0/782012184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67bc0ae4a0 0x7f67bc09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 >> 172.21.15.57:0/782012184 conn(0x7f67bc0b0c80 msgr2=0x7f67bc0cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:35.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 shutdown_connections 2023-11-24T08:04:35.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.147+0000 7f67c2b01640 1 -- 172.21.15.57:0/782012184 wait complete. 2023-11-24T08:04:35.172 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:35.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2face32640 1 Processor -- start 2023-11-24T08:04:35.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2face32640 1 -- start start 2023-11-24T08:04:35.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2face32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2fa815a290 0x7f2fa80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2face32640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fa815ec60 0x7f2fa80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2face32640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa8071170 con 0x7f2fa80cc6b0 2023-11-24T08:04:35.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2face32640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa80cb690 con 0x7f2fa815ec60 2023-11-24T08:04:35.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2face32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa80cb970 con 0x7f2fa815a290 2023-11-24T08:04:35.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa5d9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fa815ec60 0x7f2fa80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa5d9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fa815ec60 0x7f2fa80cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58630/0 (socket says 172.21.15.57:58630) 2023-11-24T08:04:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa5d9b640 1 -- 172.21.15.57:0/3461987849 learned_addr learned my addr 172.21.15.57:0/3461987849 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa659c640 1 --2- 172.21.15.57:0/3461987849 >> v2:172.21.15.132:3300/0 conn(0x7f2fa815a290 0x7f2fa80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa5d9b640 1 -- 172.21.15.57:0/3461987849 >> v2:172.21.15.132:3300/0 conn(0x7f2fa815a290 msgr2=0x7f2fa80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:35.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa5d9b640 1 --2- 172.21.15.57:0/3461987849 >> v2:172.21.15.132:3300/0 conn(0x7f2fa815a290 0x7f2fa80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa5d9b640 1 -- 172.21.15.57:0/3461987849 >> v1:172.21.15.132:6789/0 conn(0x7f2fa80cc6b0 legacy=0x7f2fa80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:35.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.315+0000 7f2fa5d9b640 1 -- 172.21.15.57:0/3461987849 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80cbc50 con 0x7f2fa815ec60 2023-11-24T08:04:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2fa5d9b640 1 --2- 172.21.15.57:0/3461987849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa80cc170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2fa806c0d0 tx=0x7f2f9c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e53de38af320ba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2fa559a640 1 -- 172.21.15.57:0/3461987849 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0ab650 con 0x7f2fa815ec60 2023-11-24T08:04:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2fa559a640 1 -- 172.21.15.57:0/3461987849 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0ab7b0 con 0x7f2fa815ec60 2023-11-24T08:04:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2fa559a640 1 -- 172.21.15.57:0/3461987849 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0abb40 con 0x7f2fa815ec60 2023-11-24T08:04:35.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 -- 172.21.15.57:0/3461987849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 msgr2=0x7f2fa80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 --2- 172.21.15.57:0/3461987849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa80cc170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2fa806c0d0 tx=0x7f2f9c01c430 comp rx=0 tx=0).stop 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 -- 172.21.15.57:0/3461987849 shutdown_connections 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 --2- 172.21.15.57:0/3461987849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa80cc170 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 --2- 172.21.15.57:0/3461987849 >> v2:172.21.15.132:3300/0 conn(0x7f2fa815a290 0x7f2fa80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 -- 172.21.15.57:0/3461987849 >> 172.21.15.57:0/3461987849 conn(0x7f2fa80b0c80 msgr2=0x7f2fa80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 -- 172.21.15.57:0/3461987849 shutdown_connections 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.319+0000 7f2face32640 1 -- 172.21.15.57:0/3461987849 wait complete. 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 Processor -- start 2023-11-24T08:04:35.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 -- start start 2023-11-24T08:04:35.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fa80cc6b0 0x7f2fa80ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fa815a290 0x7f2fa8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa81523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8150880 con 0x7f2fa815ec60 2023-11-24T08:04:35.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81529d0 con 0x7f2fa815a290 2023-11-24T08:04:35.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8152cb0 con 0x7f2fa80cc6b0 2023-11-24T08:04:35.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa81523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa659c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fa80cc6b0 0x7f2fa80ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa81523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58636/0 (socket says 172.21.15.57:58636) 2023-11-24T08:04:35.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 -- 172.21.15.57:0/3843346743 learned_addr learned my addr 172.21.15.57:0/3843346743 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:35.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa5d9b640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fa815a290 0x7f2fa8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 -- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fa80cc6b0 msgr2=0x7f2fa80ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fa80cc6b0 0x7f2fa80ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 -- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fa815a290 msgr2=0x7f2fa8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fa815a290 0x7f2fa8151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 -- 172.21.15.57:0/3843346743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c0094d0 con 0x7f2fa815ec60 2023-11-24T08:04:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2fa6d9d640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa81523a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c780 tx=0x7f2fa000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2f96ffd640 1 -- 172.21.15.57:0/3843346743 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0004b70 con 0x7f2fa815ec60 2023-11-24T08:04:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2f96ffd640 1 -- 172.21.15.57:0/3843346743 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa000ce90 con 0x7f2fa815ec60 2023-11-24T08:04:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2f96ffd640 1 -- 172.21.15.57:0/3843346743 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000a850 con 0x7f2fa815ec60 2023-11-24T08:04:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa8152f90 con 0x7f2fa815ec60 2023-11-24T08:04:35.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.323+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa8153550 con 0x7f2fa815ec60 2023-11-24T08:04:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.327+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa8153740 con 0x7f2fa815ec60 2023-11-24T08:04:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.327+0000 7f2f96ffd640 1 -- 172.21.15.57:0/3843346743 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fa000a9b0 con 0x7f2fa815ec60 2023-11-24T08:04:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.327+0000 7f2f96ffd640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f88066470 0x7f2f88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.327+0000 7f2f96ffd640 1 -- 172.21.15.57:0/3843346743 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fa0083fc0 con 0x7f2fa815ec60 2023-11-24T08:04:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.327+0000 7f2fa659c640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f88066470 0x7f2f88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.327+0000 7f2fa659c640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f88066470 0x7f2f88068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007a60 tx=0x7f2f98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.331+0000 7f2f96ffd640 1 -- 172.21.15.57:0/3843346743 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fa0051450 con 0x7f2fa815ec60 2023-11-24T08:04:35.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.491+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fa804e8c0 con 0x7f2fa815ec60 2023-11-24T08:04:35.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.491+0000 7f2f96ffd640 1 -- 172.21.15.57:0/3843346743 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fa0054a70 con 0x7f2fa815ec60 2023-11-24T08:04:35.496 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:35.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f88066470 msgr2=0x7f2f88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f88066470 0x7f2f88068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2f98007a60 tx=0x7f2f98008040 comp rx=0 tx=0).stop 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 msgr2=0x7f2fa81523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa81523a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000c780 tx=0x7f2fa000cc40 comp rx=0 tx=0).stop 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 shutdown_connections 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f88066470 0x7f2f88068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa815ec60 0x7f2fa81523a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fa815a290 0x7f2fa8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 --2- 172.21.15.57:0/3843346743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2fa80cc6b0 0x7f2fa80ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 >> 172.21.15.57:0/3843346743 conn(0x7f2fa80b0c80 msgr2=0x7f2fa80b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:35.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 shutdown_connections 2023-11-24T08:04:35.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.495+0000 7f2face32640 1 -- 172.21.15.57:0/3843346743 wait complete. 2023-11-24T08:04:35.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:35.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddd5a9a640 1 Processor -- start 2023-11-24T08:04:35.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddd5a9a640 1 -- start start 2023-11-24T08:04:35.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddd5a9a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddd015b220 0x7fddd00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddd5a9a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fddd015b600 0x7fddd006d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddd5a9a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd00abed0 con 0x7fddd00c9650 2023-11-24T08:04:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddd5a9a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd0072710 con 0x7fddd015b600 2023-11-24T08:04:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddd5a9a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd0072370 con 0x7fddd015b220 2023-11-24T08:04:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddceffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fddd015b600 0x7fddd006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddcffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fddd00c9650 0x7fddd00c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39288/0 (socket says 172.21.15.57:39288) 2023-11-24T08:04:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddcffff640 1 -- 172.21.15.57:0/41580409 learned_addr learned my addr 172.21.15.57:0/41580409 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:35.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddcf7fe640 1 --2- 172.21.15.57:0/41580409 >> v2:172.21.15.132:3300/0 conn(0x7fddd015b220 0x7fddd00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddceffd640 1 -- 172.21.15.57:0/41580409 >> v2:172.21.15.132:3300/0 conn(0x7fddd015b220 msgr2=0x7fddd00cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:35.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddceffd640 1 --2- 172.21.15.57:0/41580409 >> v2:172.21.15.132:3300/0 conn(0x7fddd015b220 0x7fddd00cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddceffd640 1 -- 172.21.15.57:0/41580409 >> v1:172.21.15.57:6789/0 conn(0x7fddd00c9650 legacy=0x7fddd00c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.659+0000 7fddceffd640 1 -- 172.21.15.57:0/41580409 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd006d580 con 0x7fddd015b600 2023-11-24T08:04:35.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddceffd640 1 --2- 172.21.15.57:0/41580409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd006d040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fddd00cee30 tx=0x7fddc401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108085d009a070b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddce7fc640 1 -- 172.21.15.57:0/41580409 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc40a7070 con 0x7fddd015b600 2023-11-24T08:04:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddce7fc640 1 -- 172.21.15.57:0/41580409 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc40ab430 con 0x7fddd015b600 2023-11-24T08:04:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddce7fc640 1 -- 172.21.15.57:0/41580409 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc40ab7c0 con 0x7fddd015b600 2023-11-24T08:04:35.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 -- 172.21.15.57:0/41580409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 msgr2=0x7fddd006d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/41580409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd006d040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fddd00cee30 tx=0x7fddc401c430 comp rx=0 tx=0).stop 2023-11-24T08:04:35.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 -- 172.21.15.57:0/41580409 shutdown_connections 2023-11-24T08:04:35.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/41580409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd006d040 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/41580409 >> v2:172.21.15.132:3300/0 conn(0x7fddd015b220 0x7fddd00cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 -- 172.21.15.57:0/41580409 >> 172.21.15.57:0/41580409 conn(0x7fddd00b0bf0 msgr2=0x7fddd00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:35.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 -- 172.21.15.57:0/41580409 shutdown_connections 2023-11-24T08:04:35.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.663+0000 7fddd5a9a640 1 -- 172.21.15.57:0/41580409 wait complete. 2023-11-24T08:04:35.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 Processor -- start 2023-11-24T08:04:35.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 -- start start 2023-11-24T08:04:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddd00c9650 0x7fddd00c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015b220 0x7fddd00aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd00af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c7740 con 0x7fddd015b600 2023-11-24T08:04:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0154dd0 con 0x7fddd015b220 2023-11-24T08:04:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0154a30 con 0x7fddd00c9650 2023-11-24T08:04:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd00af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd00af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58654/0 (socket says 172.21.15.57:58654) 2023-11-24T08:04:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 -- 172.21.15.57:0/1157490169 learned_addr learned my addr 172.21.15.57:0/1157490169 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:35.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcf7fe640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddd00c9650 0x7fddd00c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddceffd640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015b220 0x7fddd00aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 -- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddd00c9650 msgr2=0x7fddd00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddd00c9650 0x7fddd00c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 -- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015b220 msgr2=0x7fddd00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015b220 0x7fddd00aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 -- 172.21.15.57:0/1157490169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009420 con 0x7fddd015b600 2023-11-24T08:04:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddcffff640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd00af290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fddc800cbc0 tx=0x7fddc800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddb7fff640 1 -- 172.21.15.57:0/1157490169 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800ad40 con 0x7fddd015b600 2023-11-24T08:04:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddb7fff640 1 -- 172.21.15.57:0/1157490169 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8012400 con 0x7fddd015b600 2023-11-24T08:04:35.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddb7fff640 1 -- 172.21.15.57:0/1157490169 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800aea0 con 0x7fddd015b600 2023-11-24T08:04:35.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd01551f0 con 0x7fddd015b600 2023-11-24T08:04:35.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.667+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd0153d40 con 0x7fddd015b600 2023-11-24T08:04:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.671+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd0154f10 con 0x7fddd015b600 2023-11-24T08:04:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.671+0000 7fddb7fff640 1 -- 172.21.15.57:0/1157490169 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fddc8007070 con 0x7fddd015b600 2023-11-24T08:04:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.671+0000 7fddb7fff640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fddbc066470 0x7fddbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.671+0000 7fddb7fff640 1 -- 172.21.15.57:0/1157490169 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddc8083ce0 con 0x7fddd015b600 2023-11-24T08:04:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.671+0000 7fddcf7fe640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fddbc066470 0x7fddbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:35.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.675+0000 7fddcf7fe640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fddbc066470 0x7fddbc068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddd015bcb0 tx=0x7fddc0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:35.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.675+0000 7fddb7fff640 1 -- 172.21.15.57:0/1157490169 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fddd0154f10 con 0x7fddd015b600 2023-11-24T08:04:35.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.847+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fddd0154f10 con 0x7fddd015b600 2023-11-24T08:04:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.847+0000 7fddb7fff640 1 -- 172.21.15.57:0/1157490169 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fddd0154f10 con 0x7fddd015b600 2023-11-24T08:04:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fddbc066470 msgr2=0x7fddbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fddbc066470 0x7fddbc068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddd015bcb0 tx=0x7fddc0008040 comp rx=0 tx=0).stop 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 msgr2=0x7fddd00af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd00af290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fddc800cbc0 tx=0x7fddc800a430 comp rx=0 tx=0).stop 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 shutdown_connections 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fddbc066470 0x7fddbc068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd015b600 0x7fddd00af290 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015b220 0x7fddd00aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 --2- 172.21.15.57:0/1157490169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddd00c9650 0x7fddd00c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:35.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 >> 172.21.15.57:0/1157490169 conn(0x7fddd00b0bf0 msgr2=0x7fddd00c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:35.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 shutdown_connections 2023-11-24T08:04:35.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:35.851+0000 7fddd5a9a640 1 -- 172.21.15.57:0/1157490169 wait complete. 2023-11-24T08:04:35.872 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-24T08:04:35.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-24T08:04:35.897 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:04:35.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:35.898 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:04:35.950 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:35.950 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:35.960 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:35.960 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:36.013 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:04:36.013 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:36.069 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:36.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.207+0000 7f83b95a1640 1 Processor -- start 2023-11-24T08:04:36.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.207+0000 7f83b95a1640 1 -- start start 2023-11-24T08:04:36.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b95a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b4144030 0x7f83b406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b95a1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b406d8b0 con 0x7f83b409cc20 2023-11-24T08:04:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b95a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b409d0a0 con 0x7f83b40709c0 2023-11-24T08:04:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b95a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4145020 con 0x7f83b4144030 2023-11-24T08:04:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83abfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f83b409cc20 0x7f83b406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60506/0 (socket says 172.21.15.57:60506) 2023-11-24T08:04:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83abfff640 1 -- 172.21.15.57:0/3870960682 learned_addr learned my addr 172.21.15.57:0/3870960682 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b2ffd640 1 --2- 172.21.15.57:0/3870960682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b4144030 0x7f83b406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388355581 0 0) 0x7f83b406d8b0 con 0x7f83b409cc20 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a0003530 con 0x7f83b409cc20 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414120488 0 0) 0x7f83b409d0a0 con 0x7f83b40709c0 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b406d8b0 con 0x7f83b40709c0 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1135123602 0 0) 0x7f83a0003530 con 0x7f83b409cc20 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b2ffd640 1 -- 172.21.15.57:0/3870960682 >> v1:172.21.15.132:6789/0 conn(0x7f83b40709c0 legacy=0x7f83b4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b2ffd640 1 -- 172.21.15.57:0/3870960682 >> v1:172.21.15.57:6789/0 conn(0x7f83b409cc20 legacy=0x7f83b406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.211+0000 7f83b2ffd640 1 -- 172.21.15.57:0/3870960682 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b406cca0 con 0x7f83b4144030 2023-11-24T08:04:36.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b2ffd640 1 --2- 172.21.15.57:0/3870960682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b4144030 0x7f83b406c650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83a40097f0 tx=0x7f83a401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd531de7c258330c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c001680 con 0x7f83b4144030 2023-11-24T08:04:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a40a7050 con 0x7f83b4144030 2023-11-24T08:04:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b27fc640 1 -- 172.21.15.57:0/3870960682 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40ab600 con 0x7f83b4144030 2023-11-24T08:04:36.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 -- 172.21.15.57:0/3870960682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b4144030 msgr2=0x7f83b406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 --2- 172.21.15.57:0/3870960682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b4144030 0x7f83b406c650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83a40097f0 tx=0x7f83a401c3b0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 -- 172.21.15.57:0/3870960682 shutdown_connections 2023-11-24T08:04:36.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 --2- 172.21.15.57:0/3870960682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b4144030 0x7f83b406c650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 -- 172.21.15.57:0/3870960682 >> 172.21.15.57:0/3870960682 conn(0x7f83b40b0bf0 msgr2=0x7f83b40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 -- 172.21.15.57:0/3870960682 shutdown_connections 2023-11-24T08:04:36.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 -- 172.21.15.57:0/3870960682 wait complete. 2023-11-24T08:04:36.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 Processor -- start 2023-11-24T08:04:36.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.215+0000 7f83b95a1640 1 -- start start 2023-11-24T08:04:36.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83b40709c0 0x7f83b40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b409cc20 0x7f83b4153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b4144030 0x7f83b415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b409ae00 con 0x7f83b4144030 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4138d40 con 0x7f83b40709c0 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4159ca0 con 0x7f83b409cc20 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b4144030 0x7f83b415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b4144030 0x7f83b415a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43790/0 (socket says 172.21.15.57:43790) 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 -- 172.21.15.57:0/2769606536 learned_addr learned my addr 172.21.15.57:0/2769606536 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83abfff640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b409cc20 0x7f83b4153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b2ffd640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83b40709c0 0x7f83b40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 -- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b409cc20 msgr2=0x7f83b4153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b409cc20 0x7f83b4153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 -- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83b40709c0 msgr2=0x7f83b40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83b40709c0 0x7f83b40cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 -- 172.21.15.57:0/2769606536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4009420 con 0x7f83b4144030 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83abfff640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b409cc20 0x7f83b4153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b37fe640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b4144030 0x7f83b415a640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c790 tx=0x7f83ac00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83ab7fe640 1 -- 172.21.15.57:0/2769606536 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00cea0 con 0x7f83b4144030 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83ab7fe640 1 -- 172.21.15.57:0/2769606536 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac003b80 con 0x7f83b4144030 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b4159f80 con 0x7f83b4144030 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83ab7fe640 1 -- 172.21.15.57:0/2769606536 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00a850 con 0x7f83b4144030 2023-11-24T08:04:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b409b380 con 0x7f83b4144030 2023-11-24T08:04:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b40cb7c0 con 0x7f83b4144030 2023-11-24T08:04:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.219+0000 7f83ab7fe640 1 -- 172.21.15.57:0/2769606536 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83ac00a9b0 con 0x7f83b4144030 2023-11-24T08:04:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.223+0000 7f83ab7fe640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8394066470 0x7f8394068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.223+0000 7f83ab7fe640 1 -- 172.21.15.57:0/2769606536 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83ac083df0 con 0x7f83b4144030 2023-11-24T08:04:36.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.223+0000 7f83b2ffd640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8394066470 0x7f8394068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.223+0000 7f83b2ffd640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8394066470 0x7f8394068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ad000 tx=0x7f83a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.227+0000 7f83ab7fe640 1 -- 172.21.15.57:0/2769606536 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83ac0511d0 con 0x7f83b4144030 2023-11-24T08:04:36.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83b4067520 con 0x7f83b4144030 2023-11-24T08:04:36.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83ab7fe640 1 -- 172.21.15.57:0/2769606536 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f83ac0547f0 con 0x7f83b4144030 2023-11-24T08:04:36.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:36.390 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:36.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8394066470 msgr2=0x7f8394068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8394066470 0x7f8394068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ad000 tx=0x7f83a4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b4144030 msgr2=0x7f83b415a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b4144030 0x7f83b415a640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c790 tx=0x7f83ac00cc50 comp rx=0 tx=0).stop 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 shutdown_connections 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8394066470 0x7f8394068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b4144030 0x7f83b415a640 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83b409cc20 0x7f83b4153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 --2- 172.21.15.57:0/2769606536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83b40709c0 0x7f83b40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 >> 172.21.15.57:0/2769606536 conn(0x7f83b40b0bf0 msgr2=0x7f83b40ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 shutdown_connections 2023-11-24T08:04:36.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.387+0000 7f83b95a1640 1 -- 172.21.15.57:0/2769606536 wait complete. 2023-11-24T08:04:36.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:36.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.555+0000 7fbc4e31d640 1 Processor -- start 2023-11-24T08:04:36.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.555+0000 7fbc4e31d640 1 -- start start 2023-11-24T08:04:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4e31d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc480cd850 0x7fbc4815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4e31d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480b3510 con 0x7fbc480ae4a0 2023-11-24T08:04:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4e31d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480b37f0 con 0x7fbc480ce420 2023-11-24T08:04:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4e31d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc480b3ad0 con 0x7fbc480cd850 2023-11-24T08:04:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc47fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbc480ae4a0 0x7fbc480cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60522/0 (socket says 172.21.15.57:60522) 2023-11-24T08:04:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc47fff640 1 -- 172.21.15.57:0/2571063189 learned_addr learned my addr 172.21.15.57:0/2571063189 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4c8ba640 1 --2- 172.21.15.57:0/2571063189 >> v2:172.21.15.57:3300/0 conn(0x7fbc480cd850 0x7fbc4815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc46ffd640 1 -- 172.21.15.57:0/2571063189 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675392357 0 0) 0x7fbc480b3510 con 0x7fbc480ae4a0 2023-11-24T08:04:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc46ffd640 1 -- 172.21.15.57:0/2571063189 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc30003530 con 0x7fbc480ae4a0 2023-11-24T08:04:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4c8ba640 1 -- 172.21.15.57:0/2571063189 >> v1:172.21.15.132:6789/0 conn(0x7fbc480ce420 legacy=0x7fbc4806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4c8ba640 1 -- 172.21.15.57:0/2571063189 >> v1:172.21.15.57:6789/0 conn(0x7fbc480ae4a0 legacy=0x7fbc480cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4c8ba640 1 -- 172.21.15.57:0/2571063189 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480b3db0 con 0x7fbc480cd850 2023-11-24T08:04:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.559+0000 7fbc4c8ba640 1 --2- 172.21.15.57:0/2571063189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc4815ba00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009d90 tx=0x7fbc4001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba989be4080b7c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc46ffd640 1 -- 172.21.15.57:0/2571063189 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400a5a00 con 0x7fbc480cd850 2023-11-24T08:04:36.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc46ffd640 1 -- 172.21.15.57:0/2571063189 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400a5b60 con 0x7fbc480cd850 2023-11-24T08:04:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc46ffd640 1 -- 172.21.15.57:0/2571063189 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400ad440 con 0x7fbc480cd850 2023-11-24T08:04:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- 172.21.15.57:0/2571063189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 msgr2=0x7fbc4815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/2571063189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc4815ba00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009d90 tx=0x7fbc4001c920 comp rx=0 tx=0).stop 2023-11-24T08:04:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- 172.21.15.57:0/2571063189 shutdown_connections 2023-11-24T08:04:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/2571063189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc4815ba00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- 172.21.15.57:0/2571063189 >> 172.21.15.57:0/2571063189 conn(0x7fbc480b0c80 msgr2=0x7fbc480b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- 172.21.15.57:0/2571063189 shutdown_connections 2023-11-24T08:04:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- 172.21.15.57:0/2571063189 wait complete. 2023-11-24T08:04:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 Processor -- start 2023-11-24T08:04:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- start start 2023-11-24T08:04:36.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480ae4a0 0x7fbc480acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc48151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc480ce420 0x7fbc481fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480ad4f0 con 0x7fbc480cd850 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480ad770 con 0x7fbc480ae4a0 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc4e31d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48070680 con 0x7fbc480ce420 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc477fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc48151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc477fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc48151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43800/0 (socket says 172.21.15.57:43800) 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.563+0000 7fbc477fe640 1 -- 172.21.15.57:0/188934610 learned_addr learned my addr 172.21.15.57:0/188934610 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc4c8ba640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc480ce420 0x7fbc481fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc47fff640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480ae4a0 0x7fbc480acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc477fe640 1 -- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc480ce420 msgr2=0x7fbc481fa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc477fe640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc480ce420 0x7fbc481fa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc477fe640 1 -- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480ae4a0 msgr2=0x7fbc480acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc477fe640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480ae4a0 0x7fbc480acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc477fe640 1 -- 172.21.15.57:0/188934610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009a70 con 0x7fbc480cd850 2023-11-24T08:04:36.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc47fff640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480ae4a0 0x7fbc480acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc477fe640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc48151850 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00c390 tx=0x7fbc3c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc44ff9640 1 -- 172.21.15.57:0/188934610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0052d0 con 0x7fbc480cd850 2023-11-24T08:04:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc44ff9640 1 -- 172.21.15.57:0/188934610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c005430 con 0x7fbc480cd850 2023-11-24T08:04:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc48070960 con 0x7fbc480cd850 2023-11-24T08:04:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc44ff9640 1 -- 172.21.15.57:0/188934610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c003820 con 0x7fbc480cd850 2023-11-24T08:04:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc48070f20 con 0x7fbc480cd850 2023-11-24T08:04:36.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4804e8c0 con 0x7fbc480cd850 2023-11-24T08:04:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc44ff9640 1 -- 172.21.15.57:0/188934610 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbc3c003980 con 0x7fbc480cd850 2023-11-24T08:04:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc44ff9640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbc34066470 0x7fbc34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.567+0000 7fbc44ff9640 1 -- 172.21.15.57:0/188934610 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc3c083350 con 0x7fbc480cd850 2023-11-24T08:04:36.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.571+0000 7fbc47fff640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbc34066470 0x7fbc34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.571+0000 7fbc47fff640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbc34066470 0x7fbc34068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbc380011f0 tx=0x7fbc38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.571+0000 7fbc44ff9640 1 -- 172.21.15.57:0/188934610 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc3c050870 con 0x7fbc480cd850 2023-11-24T08:04:36.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc480710e0 con 0x7fbc480cd850 2023-11-24T08:04:36.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc44ff9640 1 -- 172.21.15.57:0/188934610 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc3c053e90 con 0x7fbc480cd850 2023-11-24T08:04:36.734 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:36.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbc34066470 msgr2=0x7fbc34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbc34066470 0x7fbc34068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbc380011f0 tx=0x7fbc38009040 comp rx=0 tx=0).stop 2023-11-24T08:04:36.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 msgr2=0x7fbc48151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc48151850 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00c390 tx=0x7fbc3c00c850 comp rx=0 tx=0).stop 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 shutdown_connections 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbc34066470 0x7fbc34068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbc480ce420 0x7fbc481fa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc480cd850 0x7fbc48151850 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 --2- 172.21.15.57:0/188934610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480ae4a0 0x7fbc480acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 >> 172.21.15.57:0/188934610 conn(0x7fbc480b0c80 msgr2=0x7fbc480cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 shutdown_connections 2023-11-24T08:04:36.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.731+0000 7fbc4e31d640 1 -- 172.21.15.57:0/188934610 wait complete. 2023-11-24T08:04:36.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba817df640 1 Processor -- start 2023-11-24T08:04:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba817df640 1 -- start start 2023-11-24T08:04:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba817df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c0cf4d0 0x7fba7c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba817df640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c06c620 con 0x7fba7c0ce200 2023-11-24T08:04:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba817df640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c06ba10 con 0x7fba7c15d630 2023-11-24T08:04:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba817df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c06bcf0 con 0x7fba7c0cf4d0 2023-11-24T08:04:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba73fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fba7c0ce200 0x7fba7c0cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60528/0 (socket says 172.21.15.57:60528) 2023-11-24T08:04:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba73fff640 1 -- 172.21.15.57:0/742585630 learned_addr learned my addr 172.21.15.57:0/742585630 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7b7fe640 1 --2- 172.21.15.57:0/742585630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c0cf4d0 0x7fba7c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7a7fc640 1 -- 172.21.15.57:0/742585630 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287819597 0 0) 0x7fba7c06c620 con 0x7fba7c0ce200 2023-11-24T08:04:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7a7fc640 1 -- 172.21.15.57:0/742585630 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba68003530 con 0x7fba7c0ce200 2023-11-24T08:04:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7a7fc640 1 -- 172.21.15.57:0/742585630 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015309916 0 0) 0x7fba7c06ba10 con 0x7fba7c15d630 2023-11-24T08:04:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7a7fc640 1 -- 172.21.15.57:0/742585630 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba7c06c620 con 0x7fba7c15d630 2023-11-24T08:04:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7b7fe640 1 -- 172.21.15.57:0/742585630 >> v1:172.21.15.132:6789/0 conn(0x7fba7c15d630 legacy=0x7fba7c0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7b7fe640 1 -- 172.21.15.57:0/742585630 >> v1:172.21.15.57:6789/0 conn(0x7fba7c0ce200 legacy=0x7fba7c0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.899+0000 7fba7b7fe640 1 -- 172.21.15.57:0/742585630 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c06bfd0 con 0x7fba7c0cf4d0 2023-11-24T08:04:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba7b7fe640 1 --2- 172.21.15.57:0/742585630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c0cf4d0 0x7fba7c06cab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba74009dc0 tx=0x7fba7401d3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8825933195313801 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba7a7fc640 1 -- 172.21.15.57:0/742585630 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740a5a20 con 0x7fba7c0cf4d0 2023-11-24T08:04:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba7a7fc640 1 -- 172.21.15.57:0/742585630 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba740a5b80 con 0x7fba7c0cf4d0 2023-11-24T08:04:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba7a7fc640 1 -- 172.21.15.57:0/742585630 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740ad440 con 0x7fba7c0cf4d0 2023-11-24T08:04:36.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 -- 172.21.15.57:0/742585630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c0cf4d0 msgr2=0x7fba7c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 --2- 172.21.15.57:0/742585630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c0cf4d0 0x7fba7c06cab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba74009dc0 tx=0x7fba7401d3a0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 -- 172.21.15.57:0/742585630 shutdown_connections 2023-11-24T08:04:36.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 --2- 172.21.15.57:0/742585630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c0cf4d0 0x7fba7c06cab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 -- 172.21.15.57:0/742585630 >> 172.21.15.57:0/742585630 conn(0x7fba7c06e860 msgr2=0x7fba7c06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 -- 172.21.15.57:0/742585630 shutdown_connections 2023-11-24T08:04:36.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 -- 172.21.15.57:0/742585630 wait complete. 2023-11-24T08:04:36.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.903+0000 7fba817df640 1 Processor -- start 2023-11-24T08:04:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 -- start start 2023-11-24T08:04:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba7c0ce200 0x7fba7c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7c0cf4d0 0x7fba7c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c15d630 0x7fba7c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c153110 con 0x7fba7c0ce200 2023-11-24T08:04:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1533f0 con 0x7fba7c0cf4d0 2023-11-24T08:04:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1536d0 con 0x7fba7c15d630 2023-11-24T08:04:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba7c0ce200 0x7fba7c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba7c0ce200 0x7fba7c1528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43802/0 (socket says 172.21.15.57:43802) 2023-11-24T08:04:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 -- 172.21.15.57:0/382969193 learned_addr learned my addr 172.21.15.57:0/382969193 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba73fff640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7c0cf4d0 0x7fba7c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7b7fe640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c15d630 0x7fba7c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 -- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c15d630 msgr2=0x7fba7c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c15d630 0x7fba7c0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 -- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7c0cf4d0 msgr2=0x7fba7c14e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7c0cf4d0 0x7fba7c14e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 -- 172.21.15.57:0/382969193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74009a70 con 0x7fba7c0ce200 2023-11-24T08:04:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba73fff640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7c0cf4d0 0x7fba7c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba7affd640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba7c0ce200 0x7fba7c1528c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00c430 tx=0x7fba6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba737fe640 1 -- 172.21.15.57:0/382969193 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0052d0 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba737fe640 1 -- 172.21.15.57:0/382969193 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c005450 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c1539b0 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba737fe640 1 -- 172.21.15.57:0/382969193 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c003840 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c152e00 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.907+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0d0510 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.911+0000 7fba737fe640 1 -- 172.21.15.57:0/382969193 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba6c0039a0 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.911+0000 7fba737fe640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fba5c0664a0 0x7fba5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.911+0000 7fba737fe640 1 -- 172.21.15.57:0/382969193 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba6c0833f0 con 0x7fba7c0ce200 2023-11-24T08:04:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.911+0000 7fba73fff640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fba5c0664a0 0x7fba5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.911+0000 7fba73fff640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fba5c0664a0 0x7fba5c068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0c7a50 tx=0x7fba64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:36.915+0000 7fba737fe640 1 -- 172.21.15.57:0/382969193 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba6c050910 con 0x7fba7c0ce200 2023-11-24T08:04:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba7c04e8c0 con 0x7fba7c0ce200 2023-11-24T08:04:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba737fe640 1 -- 172.21.15.57:0/382969193 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba6c053f30 con 0x7fba7c0ce200 2023-11-24T08:04:37.074 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fba5c0664a0 msgr2=0x7fba5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fba5c0664a0 0x7fba5c068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0c7a50 tx=0x7fba64009040 comp rx=0 tx=0).stop 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba7c0ce200 msgr2=0x7fba7c1528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba7c0ce200 0x7fba7c1528c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00c430 tx=0x7fba6c00c8f0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 shutdown_connections 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fba5c0664a0 0x7fba5c068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba7c15d630 0x7fba7c0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7c0cf4d0 0x7fba7c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 --2- 172.21.15.57:0/382969193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba7c0ce200 0x7fba7c1528c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 >> 172.21.15.57:0/382969193 conn(0x7fba7c06e860 msgr2=0x7fba7c0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 shutdown_connections 2023-11-24T08:04:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.071+0000 7fba817df640 1 -- 172.21.15.57:0/382969193 wait complete. 2023-11-24T08:04:37.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 Processor -- start 2023-11-24T08:04:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 -- start start 2023-11-24T08:04:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f4415d7f0 0x7f5f440d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f440d37e0 0x7f5f440b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5f440b1630 0x7f5f440b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4406b980 con 0x7f5f440d37e0 2023-11-24T08:04:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440d3c60 con 0x7f5f440b1630 2023-11-24T08:04:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f492c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b0090 con 0x7f5f4415d7f0 2023-11-24T08:04:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f440d37e0 0x7f5f440b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f440d37e0 0x7f5f440b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43810/0 (socket says 172.21.15.57:43810) 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 -- 172.21.15.57:0/318229477 learned_addr learned my addr 172.21.15.57:0/318229477 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f42ffd640 1 --2- 172.21.15.57:0/318229477 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f4415d7f0 0x7f5f440d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f437fe640 1 --2- 172.21.15.57:0/318229477 >> v2:172.21.15.132:3300/0 conn(0x7f5f440b1630 0x7f5f440b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 -- 172.21.15.57:0/318229477 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f4415d7f0 msgr2=0x7f5f440d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 --2- 172.21.15.57:0/318229477 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f4415d7f0 0x7f5f440d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 -- 172.21.15.57:0/318229477 >> v2:172.21.15.132:3300/0 conn(0x7f5f440b1630 msgr2=0x7f5f440b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 --2- 172.21.15.57:0/318229477 >> v2:172.21.15.132:3300/0 conn(0x7f5f440b1630 0x7f5f440b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f3bfff640 1 -- 172.21.15.57:0/318229477 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440b0330 con 0x7f5f440d37e0 2023-11-24T08:04:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.239+0000 7f5f437fe640 1 --2- 172.21.15.57:0/318229477 >> v2:172.21.15.132:3300/0 conn(0x7f5f440b1630 0x7f5f440b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f3bfff640 1 --2- 172.21.15.57:0/318229477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f440b10f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406bb90 tx=0x7f5f2c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46e6ecd2aa1b486 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f427fc640 1 -- 172.21.15.57:0/318229477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0ab600 con 0x7f5f440d37e0 2023-11-24T08:04:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f427fc640 1 -- 172.21.15.57:0/318229477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0a7050 con 0x7f5f440d37e0 2023-11-24T08:04:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f427fc640 1 -- 172.21.15.57:0/318229477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0ab980 con 0x7f5f440d37e0 2023-11-24T08:04:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 -- 172.21.15.57:0/318229477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 msgr2=0x7f5f440b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 --2- 172.21.15.57:0/318229477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f440b10f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f4406bb90 tx=0x7f5f2c01c500 comp rx=0 tx=0).stop 2023-11-24T08:04:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 -- 172.21.15.57:0/318229477 shutdown_connections 2023-11-24T08:04:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 --2- 172.21.15.57:0/318229477 >> v2:172.21.15.132:3300/0 conn(0x7f5f440b1630 0x7f5f440b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 --2- 172.21.15.57:0/318229477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f440b10f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 --2- 172.21.15.57:0/318229477 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f4415d7f0 0x7f5f440d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 -- 172.21.15.57:0/318229477 >> 172.21.15.57:0/318229477 conn(0x7f5f4409c790 msgr2=0x7f5f4408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 -- 172.21.15.57:0/318229477 shutdown_connections 2023-11-24T08:04:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.243+0000 7f5f492c9640 1 -- 172.21.15.57:0/318229477 wait complete. 2023-11-24T08:04:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 Processor -- start 2023-11-24T08:04:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 -- start start 2023-11-24T08:04:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f440b1630 0x7f5f440b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f441f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f4415d7f0 0x7f5f441fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440ce500 con 0x7f5f440d37e0 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b55c0 con 0x7f5f4415d7f0 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b58a0 con 0x7f5f440b1630 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f441f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f441f9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43820/0 (socket says 172.21.15.57:43820) 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 -- 172.21.15.57:0/1551589813 learned_addr learned my addr 172.21.15.57:0/1551589813 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f42ffd640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f440b1630 0x7f5f440b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f437fe640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f4415d7f0 0x7f5f441fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 -- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f440b1630 msgr2=0x7f5f440b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f440b1630 0x7f5f440b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 -- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f4415d7f0 msgr2=0x7f5f441fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f4415d7f0 0x7f5f441fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 -- 172.21.15.57:0/1551589813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c0094d0 con 0x7f5f440d37e0 2023-11-24T08:04:37.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3bfff640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f441f9b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0ae040 tx=0x7f5f2c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3b7fe640 1 -- 172.21.15.57:0/1551589813 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0b6420 con 0x7f5f440d37e0 2023-11-24T08:04:37.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3b7fe640 1 -- 172.21.15.57:0/1551589813 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0b6580 con 0x7f5f440d37e0 2023-11-24T08:04:37.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f440b5b80 con 0x7f5f440d37e0 2023-11-24T08:04:37.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f3b7fe640 1 -- 172.21.15.57:0/1551589813 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0b6910 con 0x7f5f440d37e0 2023-11-24T08:04:37.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.247+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f441fa5f0 con 0x7f5f440d37e0 2023-11-24T08:04:37.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.251+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440ce670 con 0x7f5f440d37e0 2023-11-24T08:04:37.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.251+0000 7f5f3b7fe640 1 -- 172.21.15.57:0/1551589813 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f2c0b2040 con 0x7f5f440d37e0 2023-11-24T08:04:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.251+0000 7f5f3b7fe640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f240664c0 0x7f5f24068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.251+0000 7f5f3b7fe640 1 -- 172.21.15.57:0/1551589813 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f2c11df40 con 0x7f5f440d37e0 2023-11-24T08:04:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.251+0000 7f5f42ffd640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f240664c0 0x7f5f24068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.251+0000 7f5f42ffd640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f240664c0 0x7f5f24068980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009a40 tx=0x7f5f34009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.255+0000 7f5f3b7fe640 1 -- 172.21.15.57:0/1551589813 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f2c0eb450 con 0x7f5f440d37e0 2023-11-24T08:04:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.411+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f440b59e0 con 0x7f5f440d37e0 2023-11-24T08:04:37.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.411+0000 7f5f3b7fe640 1 -- 172.21.15.57:0/1551589813 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f440b59e0 con 0x7f5f440d37e0 2023-11-24T08:04:37.416 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f240664c0 msgr2=0x7f5f24068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f240664c0 0x7f5f24068980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009a40 tx=0x7f5f34009190 comp rx=0 tx=0).stop 2023-11-24T08:04:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 msgr2=0x7f5f441f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f441f9b70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0ae040 tx=0x7f5f2c01ad40 comp rx=0 tx=0).stop 2023-11-24T08:04:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 shutdown_connections 2023-11-24T08:04:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f240664c0 0x7f5f24068980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f4415d7f0 0x7f5f441fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f440d37e0 0x7f5f441f9b70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 --2- 172.21.15.57:0/1551589813 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f440b1630 0x7f5f440b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 >> 172.21.15.57:0/1551589813 conn(0x7f5f4409c790 msgr2=0x7f5f44073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 shutdown_connections 2023-11-24T08:04:37.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.415+0000 7f5f492c9640 1 -- 172.21.15.57:0/1551589813 wait complete. 2023-11-24T08:04:37.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:04:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f30859c1640 1 Processor -- start 2023-11-24T08:04:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f30859c1640 1 -- start start 2023-11-24T08:04:37.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f30859c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f308015d440 0x7f30800d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f30859c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30800b4660 0x7f30800b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f30859c1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30800aff80 con 0x7f30800d1bd0 2023-11-24T08:04:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f30859c1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800cdc40 con 0x7f308015d440 2023-11-24T08:04:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f30859c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800b0b00 con 0x7f30800b4660 2023-11-24T08:04:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f307effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f308015d440 0x7f30800d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f307effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f308015d440 0x7f30800d1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43832/0 (socket says 172.21.15.57:43832) 2023-11-24T08:04:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f307effd640 1 -- 172.21.15.57:0/2913838355 learned_addr learned my addr 172.21.15.57:0/2913838355 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:37.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f307effd640 1 -- 172.21.15.57:0/2913838355 >> v2:172.21.15.132:3300/0 conn(0x7f30800b4660 msgr2=0x7f30800b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f307effd640 1 --2- 172.21.15.57:0/2913838355 >> v2:172.21.15.132:3300/0 conn(0x7f30800b4660 0x7f30800b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f307effd640 1 -- 172.21.15.57:0/2913838355 >> v1:172.21.15.132:6789/0 conn(0x7f30800d1bd0 legacy=0x7f30800b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.583+0000 7f307effd640 1 -- 172.21.15.57:0/2913838355 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800d2010 con 0x7f308015d440 2023-11-24T08:04:37.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f307effd640 1 --2- 172.21.15.57:0/2913838355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f308015d440 0x7f30800d1690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f308008c9f0 tx=0x7f307001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7805a17a93442044 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f307e7fc640 1 -- 172.21.15.57:0/2913838355 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700a89b0 con 0x7f308015d440 2023-11-24T08:04:37.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f307e7fc640 1 -- 172.21.15.57:0/2913838355 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30700a8b10 con 0x7f308015d440 2023-11-24T08:04:37.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f307e7fc640 1 -- 172.21.15.57:0/2913838355 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700a8ea0 con 0x7f308015d440 2023-11-24T08:04:37.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 -- 172.21.15.57:0/2913838355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f308015d440 msgr2=0x7f30800d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 --2- 172.21.15.57:0/2913838355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f308015d440 0x7f30800d1690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f308008c9f0 tx=0x7f307001ecb0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 -- 172.21.15.57:0/2913838355 shutdown_connections 2023-11-24T08:04:37.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 --2- 172.21.15.57:0/2913838355 >> v2:172.21.15.132:3300/0 conn(0x7f30800b4660 0x7f30800b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 --2- 172.21.15.57:0/2913838355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f308015d440 0x7f30800d1690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 -- 172.21.15.57:0/2913838355 >> 172.21.15.57:0/2913838355 conn(0x7f308008cd00 msgr2=0x7f308009c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 -- 172.21.15.57:0/2913838355 shutdown_connections 2023-11-24T08:04:37.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.587+0000 7f30859c1640 1 -- 172.21.15.57:0/2913838355 wait complete. 2023-11-24T08:04:37.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 Processor -- start 2023-11-24T08:04:37.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 -- start start 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30800b4660 0x7f30800c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30800d1bd0 0x7f30800ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f308015d440 0x7f30800d3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800b77f0 con 0x7f30800d1bd0 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800b8630 con 0x7f30800b4660 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c8bb0 con 0x7f308015d440 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30800d1bd0 0x7f30800ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30800d1bd0 0x7f30800ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43846/0 (socket says 172.21.15.57:43846) 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 -- 172.21.15.57:0/1714830146 learned_addr learned my addr 172.21.15.57:0/1714830146 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f307effd640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30800b4660 0x7f30800c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f307f7fe640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f308015d440 0x7f30800d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 -- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f308015d440 msgr2=0x7f30800d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f308015d440 0x7f30800d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 -- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30800b4660 msgr2=0x7f30800c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30800b4660 0x7f30800c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 -- 172.21.15.57:0/1714830146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700094d0 con 0x7f30800d1bd0 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f307f7fe640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f308015d440 0x7f30800d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30767fc640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30800d1bd0 0x7f30800ce7c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f306800c490 tx=0x7f3068001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f307cff9640 1 -- 172.21.15.57:0/1714830146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068003600 con 0x7f30800d1bd0 2023-11-24T08:04:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f307cff9640 1 -- 172.21.15.57:0/1714830146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3068003780 con 0x7f30800d1bd0 2023-11-24T08:04:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f307cff9640 1 -- 172.21.15.57:0/1714830146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068003b70 con 0x7f30800d1bd0 2023-11-24T08:04:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30800b7a20 con 0x7f30800d1bd0 2023-11-24T08:04:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.591+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30800b7fe0 con 0x7f30800d1bd0 2023-11-24T08:04:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.595+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30800b87e0 con 0x7f30800d1bd0 2023-11-24T08:04:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.595+0000 7f307cff9640 1 -- 172.21.15.57:0/1714830146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3068003cd0 con 0x7f30800d1bd0 2023-11-24T08:04:37.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.595+0000 7f307cff9640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30600664a0 0x7f3060068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.595+0000 7f307cff9640 1 -- 172.21.15.57:0/1714830146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3068082fd0 con 0x7f30800d1bd0 2023-11-24T08:04:37.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.595+0000 7f307effd640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30600664a0 0x7f3060068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.595+0000 7f307effd640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30600664a0 0x7f3060068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30700b2000 tx=0x7f3070009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.599+0000 7f307cff9640 1 -- 172.21.15.57:0/1714830146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30800b87e0 con 0x7f30800d1bd0 2023-11-24T08:04:37.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.771+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30800b87a0 con 0x7f30800d1bd0 2023-11-24T08:04:37.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.771+0000 7f307cff9640 1 -- 172.21.15.57:0/1714830146 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3068050430 con 0x7f30800d1bd0 2023-11-24T08:04:37.775 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.771+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30600664a0 msgr2=0x7f3060068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.771+0000 7f30859c1640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30600664a0 0x7f3060068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30700b2000 tx=0x7f3070009040 comp rx=0 tx=0).stop 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.771+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30800d1bd0 msgr2=0x7f30800ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.771+0000 7f30859c1640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30800d1bd0 0x7f30800ce7c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f306800c490 tx=0x7f3068001e80 comp rx=0 tx=0).stop 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 shutdown_connections 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30600664a0 0x7f3060068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f308015d440 0x7f30800d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30800d1bd0 0x7f30800ce7c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 --2- 172.21.15.57:0/1714830146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30800b4660 0x7f30800c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 >> 172.21.15.57:0/1714830146 conn(0x7f308008cd00 msgr2=0x7f30800b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 shutdown_connections 2023-11-24T08:04:37.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:37.775+0000 7f30859c1640 1 -- 172.21.15.57:0/1714830146 wait complete. 2023-11-24T08:04:37.796 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-24T08:04:37.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:37.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-24T08:04:37.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:04:37.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:37.825 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:04:37.882 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:04:37.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:38.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea17afe640 1 Processor -- start 2023-11-24T08:04:38.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea17afe640 1 -- start start 2023-11-24T08:04:38.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea17afe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea10070ec0 0x7fea1016c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea17afe640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1006dc20 con 0x7fea1006e340 2023-11-24T08:04:38.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea17afe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1006cd60 con 0x7fea10158a50 2023-11-24T08:04:38.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea17afe640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1006e0b0 con 0x7fea10070ec0 2023-11-24T08:04:38.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea15099640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fea1006e340 0x7fea100707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60538/0 (socket says 172.21.15.57:60538) 2023-11-24T08:04:38.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea15099640 1 -- 172.21.15.57:0/349943533 learned_addr learned my addr 172.21.15.57:0/349943533 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:38.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea1609b640 1 --2- 172.21.15.57:0/349943533 >> v2:172.21.15.57:3300/0 conn(0x7fea10070ec0 0x7fea1016c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea1609b640 1 -- 172.21.15.57:0/349943533 >> v1:172.21.15.132:6789/0 conn(0x7fea10158a50 legacy=0x7fea1006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea1609b640 1 -- 172.21.15.57:0/349943533 >> v1:172.21.15.57:6789/0 conn(0x7fea1006e340 legacy=0x7fea100707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea1609b640 1 -- 172.21.15.57:0/349943533 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100b3620 con 0x7fea10070ec0 2023-11-24T08:04:38.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.023+0000 7fea14898640 1 -- 172.21.15.57:0/349943533 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256374881 0 0) 0x7fea1006dc20 con 0x7fea1006e340 2023-11-24T08:04:38.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea1609b640 1 --2- 172.21.15.57:0/349943533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea10070ec0 0x7fea1016c6a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fea08009d90 tx=0x7fea0801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712ab86c92ba9130 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea14898640 1 -- 172.21.15.57:0/349943533 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080a59a0 con 0x7fea10070ec0 2023-11-24T08:04:38.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea14898640 1 -- 172.21.15.57:0/349943533 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea080a5b00 con 0x7fea10070ec0 2023-11-24T08:04:38.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea14898640 1 -- 172.21.15.57:0/349943533 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080a5e90 con 0x7fea10070ec0 2023-11-24T08:04:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea17afe640 1 -- 172.21.15.57:0/349943533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea10070ec0 msgr2=0x7fea1016c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea17afe640 1 --2- 172.21.15.57:0/349943533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea10070ec0 0x7fea1016c6a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fea08009d90 tx=0x7fea0801c8e0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea17afe640 1 -- 172.21.15.57:0/349943533 shutdown_connections 2023-11-24T08:04:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea17afe640 1 --2- 172.21.15.57:0/349943533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea10070ec0 0x7fea1016c6a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea17afe640 1 -- 172.21.15.57:0/349943533 >> 172.21.15.57:0/349943533 conn(0x7fea100b0bf0 msgr2=0x7fea100b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea17afe640 1 -- 172.21.15.57:0/349943533 shutdown_connections 2023-11-24T08:04:38.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.027+0000 7fea17afe640 1 -- 172.21.15.57:0/349943533 wait complete. 2023-11-24T08:04:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 Processor -- start 2023-11-24T08:04:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 -- start start 2023-11-24T08:04:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea1006e340 0x7fea1014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea10070ec0 0x7fea10160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea10158a50 0x7fea10161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101587b0 con 0x7fea1006e340 2023-11-24T08:04:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10161980 con 0x7fea10070ec0 2023-11-24T08:04:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea10154920 con 0x7fea10158a50 2023-11-24T08:04:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea1006e340 0x7fea1014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea1006e340 0x7fea1014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43862/0 (socket says 172.21.15.57:43862) 2023-11-24T08:04:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 -- 172.21.15.57:0/2677757326 learned_addr learned my addr 172.21.15.57:0/2677757326 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:38.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 -- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea10158a50 msgr2=0x7fea10161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea10158a50 0x7fea10161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 -- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea10070ec0 msgr2=0x7fea10160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea10070ec0 0x7fea10160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 -- 172.21.15.57:0/2677757326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08009a70 con 0x7fea1006e340 2023-11-24T08:04:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea1589a640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea1006e340 0x7fea1014f220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c450 tx=0x7fea0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea067fc640 1 -- 172.21.15.57:0/2677757326 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c012830 con 0x7fea1006e340 2023-11-24T08:04:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea067fc640 1 -- 172.21.15.57:0/2677757326 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c0129b0 con 0x7fea1006e340 2023-11-24T08:04:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea067fc640 1 -- 172.21.15.57:0/2677757326 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c012d60 con 0x7fea1006e340 2023-11-24T08:04:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea10154640 con 0x7fea1006e340 2023-11-24T08:04:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.031+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea10150870 con 0x7fea1006e340 2023-11-24T08:04:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.035+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10067520 con 0x7fea1006e340 2023-11-24T08:04:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.035+0000 7fea067fc640 1 -- 172.21.15.57:0/2677757326 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea0c01c460 con 0x7fea1006e340 2023-11-24T08:04:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.035+0000 7fea067fc640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe9f4066470 0x7fe9f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.035+0000 7fea067fc640 1 -- 172.21.15.57:0/2677757326 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea0c083c80 con 0x7fea1006e340 2023-11-24T08:04:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.035+0000 7fea15099640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe9f4066470 0x7fe9f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.035+0000 7fea15099640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe9f4066470 0x7fe9f4068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea100cb2b0 tx=0x7fea00007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.039+0000 7fea067fc640 1 -- 172.21.15.57:0/2677757326 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea0c089020 con 0x7fea1006e340 2023-11-24T08:04:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.227+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea1015c2b0 con 0x7fea1006e340 2023-11-24T08:04:38.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.227+0000 7fea067fc640 1 -- 172.21.15.57:0/2677757326 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fea0c054c00 con 0x7fea1006e340 2023-11-24T08:04:38.232 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:38.232 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe9f4066470 msgr2=0x7fe9f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe9f4066470 0x7fe9f4068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea100cb2b0 tx=0x7fea00007970 comp rx=0 tx=0).stop 2023-11-24T08:04:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea1006e340 msgr2=0x7fea1014f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea1006e340 0x7fea1014f220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c450 tx=0x7fea0c00c910 comp rx=0 tx=0).stop 2023-11-24T08:04:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 shutdown_connections 2023-11-24T08:04:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe9f4066470 0x7fe9f4068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea10158a50 0x7fea10161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea10070ec0 0x7fea10160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 --2- 172.21.15.57:0/2677757326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea1006e340 0x7fea1014f220 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 >> 172.21.15.57:0/2677757326 conn(0x7fea100b0bf0 msgr2=0x7fea100b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 shutdown_connections 2023-11-24T08:04:38.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.231+0000 7fea17afe640 1 -- 172.21.15.57:0/2677757326 wait complete. 2023-11-24T08:04:38.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:38.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.391+0000 7fa7843f5640 1 Processor -- start 2023-11-24T08:04:38.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.391+0000 7fa7843f5640 1 -- start start 2023-11-24T08:04:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa7843f5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa77c0710d0 0x7fa77c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa7843f5640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c06d8b0 con 0x7fa77c144030 2023-11-24T08:04:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa7843f5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c06cca0 con 0x7fa77c06c650 2023-11-24T08:04:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa7843f5640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c145020 con 0x7fa77c0710d0 2023-11-24T08:04:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa782992640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa77c0710d0 0x7fa77c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa782191640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa77c144030 0x7fa77c06dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60542/0 (socket says 172.21.15.57:60542) 2023-11-24T08:04:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa782191640 1 -- 172.21.15.57:0/946283103 learned_addr learned my addr 172.21.15.57:0/946283103 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa782992640 1 -- 172.21.15.57:0/946283103 >> v1:172.21.15.132:6789/0 conn(0x7fa77c06c650 legacy=0x7fa77c0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa782992640 1 -- 172.21.15.57:0/946283103 >> v1:172.21.15.57:6789/0 conn(0x7fa77c144030 legacy=0x7fa77c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa78118f640 1 -- 172.21.15.57:0/946283103 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044276655 0 0) 0x7fa77c06d8b0 con 0x7fa77c144030 2023-11-24T08:04:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.395+0000 7fa782992640 1 -- 172.21.15.57:0/946283103 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c06cf80 con 0x7fa77c0710d0 2023-11-24T08:04:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa782992640 1 --2- 172.21.15.57:0/946283103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c0710d0 0x7fa77c09cc20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa774009d90 tx=0x7fa77401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2feb97dfe8d23b34 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa78118f640 1 -- 172.21.15.57:0/946283103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740a58c0 con 0x7fa77c0710d0 2023-11-24T08:04:38.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa78118f640 1 -- 172.21.15.57:0/946283103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7740a5a20 con 0x7fa77c0710d0 2023-11-24T08:04:38.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa78118f640 1 -- 172.21.15.57:0/946283103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740a5db0 con 0x7fa77c0710d0 2023-11-24T08:04:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 -- 172.21.15.57:0/946283103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c0710d0 msgr2=0x7fa77c09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 --2- 172.21.15.57:0/946283103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c0710d0 0x7fa77c09cc20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa774009d90 tx=0x7fa77401c910 comp rx=0 tx=0).stop 2023-11-24T08:04:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 -- 172.21.15.57:0/946283103 shutdown_connections 2023-11-24T08:04:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 --2- 172.21.15.57:0/946283103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c0710d0 0x7fa77c09cc20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 -- 172.21.15.57:0/946283103 >> 172.21.15.57:0/946283103 conn(0x7fa77c0b0bf0 msgr2=0x7fa77c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 -- 172.21.15.57:0/946283103 shutdown_connections 2023-11-24T08:04:38.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 -- 172.21.15.57:0/946283103 wait complete. 2023-11-24T08:04:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 Processor -- start 2023-11-24T08:04:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.399+0000 7fa7843f5640 1 -- start start 2023-11-24T08:04:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa77c06c650 0x7fa77c13b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa77c0710d0 0x7fa77c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c144030 0x7fa77c0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c13b700 con 0x7fa77c144030 2023-11-24T08:04:38.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c153580 con 0x7fa77c0710d0 2023-11-24T08:04:38.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c153860 con 0x7fa77c06c650 2023-11-24T08:04:38.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c144030 0x7fa77c0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c144030 0x7fa77c0cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43878/0 (socket says 172.21.15.57:43878) 2023-11-24T08:04:38.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 -- 172.21.15.57:0/3046893118 learned_addr learned my addr 172.21.15.57:0/3046893118 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:38.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782191640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa77c06c650 0x7fa77c13b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa781990640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa77c0710d0 0x7fa77c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 -- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa77c06c650 msgr2=0x7fa77c13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa77c06c650 0x7fa77c13b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 -- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa77c0710d0 msgr2=0x7fa77c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa77c0710d0 0x7fa77c0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 -- 172.21.15.57:0/3046893118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa774009a70 con 0x7fa77c144030 2023-11-24T08:04:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782191640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa77c06c650 0x7fa77c13b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:38.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa781990640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa77c0710d0 0x7fa77c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:38.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa782992640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c144030 0x7fa77c0cc420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa7740b0040 tx=0x7fa7740196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa772ffd640 1 -- 172.21.15.57:0/3046893118 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740ad850 con 0x7fa77c144030 2023-11-24T08:04:38.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa772ffd640 1 -- 172.21.15.57:0/3046893118 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7740ad9b0 con 0x7fa77c144030 2023-11-24T08:04:38.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa772ffd640 1 -- 172.21.15.57:0/3046893118 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740adda0 con 0x7fa77c144030 2023-11-24T08:04:38.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c153b40 con 0x7fa77c144030 2023-11-24T08:04:38.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c154100 con 0x7fa77c144030 2023-11-24T08:04:38.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c067520 con 0x7fa77c144030 2023-11-24T08:04:38.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.403+0000 7fa772ffd640 1 -- 172.21.15.57:0/3046893118 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7740b4050 con 0x7fa77c144030 2023-11-24T08:04:38.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.407+0000 7fa772ffd640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa760066470 0x7fa760068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.407+0000 7fa772ffd640 1 -- 172.21.15.57:0/3046893118 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa77411eeb0 con 0x7fa77c144030 2023-11-24T08:04:38.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.407+0000 7fa782191640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa760066470 0x7fa760068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.407+0000 7fa782191640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa760066470 0x7fa760068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa778007fd0 tx=0x7fa778009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.411+0000 7fa772ffd640 1 -- 172.21.15.57:0/3046893118 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7740ec3a0 con 0x7fa77c144030 2023-11-24T08:04:38.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.567+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa77c0caed0 con 0x7fa77c144030 2023-11-24T08:04:38.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa772ffd640 1 -- 172.21.15.57:0/3046893118 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa7740c7090 con 0x7fa77c144030 2023-11-24T08:04:38.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:38.574 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:00.583687+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:38.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa760066470 msgr2=0x7fa760068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa760066470 0x7fa760068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa778007fd0 tx=0x7fa778009040 comp rx=0 tx=0).stop 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c144030 msgr2=0x7fa77c0cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c144030 0x7fa77c0cc420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa7740b0040 tx=0x7fa7740196b0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 shutdown_connections 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa760066470 0x7fa760068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa77c144030 0x7fa77c0cc420 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa77c0710d0 0x7fa77c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 --2- 172.21.15.57:0/3046893118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa77c06c650 0x7fa77c13b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 >> 172.21.15.57:0/3046893118 conn(0x7fa77c0b0bf0 msgr2=0x7fa77c0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 shutdown_connections 2023-11-24T08:04:38.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.571+0000 7fa7843f5640 1 -- 172.21.15.57:0/3046893118 wait complete. 2023-11-24T08:04:38.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:03:56.933450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:03:57.955074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:38.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68b51b8640 1 Processor -- start 2023-11-24T08:04:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68b51b8640 1 -- start start 2023-11-24T08:04:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68b51b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f68b00ce420 0x7f68b015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68b51b8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68b00cd850 0x7f68b006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68b51b8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b00b3510 con 0x7f68b00ae4a0 2023-11-24T08:04:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68b51b8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b00b37f0 con 0x7f68b00cd850 2023-11-24T08:04:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68b51b8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b00b3ad0 con 0x7f68b00ce420 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68af59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68b00cd850 0x7f68b006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68af59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68b00cd850 0x7f68b006c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43894/0 (socket says 172.21.15.57:43894) 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68af59e640 1 -- 172.21.15.57:0/3770284610 learned_addr learned my addr 172.21.15.57:0/3770284610 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68aed9d640 1 --1- 172.21.15.57:0/3770284610 >> v1:172.21.15.57:6789/0 conn(0x7f68b00ae4a0 0x7f68b00cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60558/0 (socket says 172.21.15.57:60558) 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68a7fff640 1 --2- 172.21.15.57:0/3770284610 >> v2:172.21.15.132:3300/0 conn(0x7f68b00ce420 0x7f68b015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68af59e640 1 -- 172.21.15.57:0/3770284610 >> v2:172.21.15.132:3300/0 conn(0x7f68b00ce420 msgr2=0x7f68b015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68af59e640 1 --2- 172.21.15.57:0/3770284610 >> v2:172.21.15.132:3300/0 conn(0x7f68b00ce420 0x7f68b015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68af59e640 1 -- 172.21.15.57:0/3770284610 >> v1:172.21.15.57:6789/0 conn(0x7f68b00ae4a0 legacy=0x7f68b00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68af59e640 1 -- 172.21.15.57:0/3770284610 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00b3db0 con 0x7f68b00cd850 2023-11-24T08:04:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.739+0000 7f68a7fff640 1 --2- 172.21.15.57:0/3770284610 >> v2:172.21.15.132:3300/0 conn(0x7f68b00ce420 0x7f68b015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68af59e640 1 --2- 172.21.15.57:0/3770284610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b006c640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f68b00b45b0 tx=0x7f68a801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95425442964cc75e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68ae59c640 1 -- 172.21.15.57:0/3770284610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80a5880 con 0x7f68b00cd850 2023-11-24T08:04:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68ae59c640 1 -- 172.21.15.57:0/3770284610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a80a59e0 con 0x7f68b00cd850 2023-11-24T08:04:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68ae59c640 1 -- 172.21.15.57:0/3770284610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80a5d70 con 0x7f68b00cd850 2023-11-24T08:04:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 -- 172.21.15.57:0/3770284610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 msgr2=0x7f68b006c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 --2- 172.21.15.57:0/3770284610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b006c640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f68b00b45b0 tx=0x7f68a801c9a0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 -- 172.21.15.57:0/3770284610 shutdown_connections 2023-11-24T08:04:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 --2- 172.21.15.57:0/3770284610 >> v2:172.21.15.132:3300/0 conn(0x7f68b00ce420 0x7f68b015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 --2- 172.21.15.57:0/3770284610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b006c640 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 -- 172.21.15.57:0/3770284610 >> 172.21.15.57:0/3770284610 conn(0x7f68b00b0c80 msgr2=0x7f68b00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 -- 172.21.15.57:0/3770284610 shutdown_connections 2023-11-24T08:04:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.743+0000 7f68b51b8640 1 -- 172.21.15.57:0/3770284610 wait complete. 2023-11-24T08:04:38.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 Processor -- start 2023-11-24T08:04:38.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 -- start start 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b00ae4a0 0x7f68b014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b014ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68b00ce420 0x7f68b0153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b014b9a0 con 0x7f68b00cd850 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0071480 con 0x7f68b00ae4a0 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0071760 con 0x7f68b00ce420 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b014ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b014ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43900/0 (socket says 172.21.15.57:43900) 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 -- 172.21.15.57:0/417399210 learned_addr learned my addr 172.21.15.57:0/417399210 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68aed9d640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b00ae4a0 0x7f68b014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68af59e640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68b00ce420 0x7f68b0153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 -- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68b00ce420 msgr2=0x7f68b0153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68b00ce420 0x7f68b0153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 -- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b00ae4a0 msgr2=0x7f68b014d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b00ae4a0 0x7f68b014d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 -- 172.21.15.57:0/417399210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009b30 con 0x7f68b00cd850 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a7fff640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b014ada0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f689800c7f0 tx=0x7f689800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a77fe640 1 -- 172.21.15.57:0/417399210 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898004220 con 0x7f68b00cd850 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a77fe640 1 -- 172.21.15.57:0/417399210 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898004380 con 0x7f68b00cd850 2023-11-24T08:04:38.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68a77fe640 1 -- 172.21.15.57:0/417399210 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898003840 con 0x7f68b00cd850 2023-11-24T08:04:38.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.747+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b0071a40 con 0x7f68b00cd850 2023-11-24T08:04:38.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.751+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b0072000 con 0x7f68b00cd850 2023-11-24T08:04:38.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.751+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b004e8c0 con 0x7f68b00cd850 2023-11-24T08:04:38.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.751+0000 7f68a77fe640 1 -- 172.21.15.57:0/417399210 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6898003bb0 con 0x7f68b00cd850 2023-11-24T08:04:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.751+0000 7f68a77fe640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6890066470 0x7f6890068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.751+0000 7f68a77fe640 1 -- 172.21.15.57:0/417399210 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6898083d70 con 0x7f68b00cd850 2023-11-24T08:04:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.751+0000 7f68aed9d640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6890066470 0x7f6890068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.751+0000 7f68aed9d640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6890066470 0x7f6890068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000f70 tx=0x7f68a0007e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.755+0000 7f68a77fe640 1 -- 172.21.15.57:0/417399210 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6898051290 con 0x7f68b00cd850 2023-11-24T08:04:38.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.915+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68b00cd370 con 0x7f68b00cd850 2023-11-24T08:04:38.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.915+0000 7f68a77fe640 1 -- 172.21.15.57:0/417399210 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f689801e020 con 0x7f68b00cd850 2023-11-24T08:04:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:38.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.915+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6890066470 msgr2=0x7f6890068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.915+0000 7f68b51b8640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6890066470 0x7f6890068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000f70 tx=0x7f68a0007e50 comp rx=0 tx=0).stop 2023-11-24T08:04:38.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.915+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 msgr2=0x7f68b014ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.915+0000 7f68b51b8640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b014ada0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f689800c7f0 tx=0x7f689800ccb0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 shutdown_connections 2023-11-24T08:04:38.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6890066470 0x7f6890068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68b00ce420 0x7f68b0153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68b00cd850 0x7f68b014ada0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 --2- 172.21.15.57:0/417399210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b00ae4a0 0x7f68b014d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 >> 172.21.15.57:0/417399210 conn(0x7f68b00b0c80 msgr2=0x7f68b015cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 shutdown_connections 2023-11-24T08:04:38.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:38.919+0000 7f68b51b8640 1 -- 172.21.15.57:0/417399210 wait complete. 2023-11-24T08:04:38.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40af7e7640 1 Processor -- start 2023-11-24T08:04:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40af7e7640 1 -- start start 2023-11-24T08:04:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40af7e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40a81624f0 0x7f40a81628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40af7e7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40a80ccef0 0x7f40a8071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40af7e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a80723c0 con 0x7f40a80cd380 2023-11-24T08:04:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40af7e7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a8072980 con 0x7f40a80ccef0 2023-11-24T08:04:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40af7e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80726a0 con 0x7f40a81624f0 2023-11-24T08:04:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40acd82640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40a80ccef0 0x7f40a8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40acd82640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40a80ccef0 0x7f40a8071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43910/0 (socket says 172.21.15.57:43910) 2023-11-24T08:04:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40acd82640 1 -- 172.21.15.57:0/3429169539 learned_addr learned my addr 172.21.15.57:0/3429169539 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40ad583640 1 --2- 172.21.15.57:0/3429169539 >> v2:172.21.15.132:3300/0 conn(0x7f40a81624f0 0x7f40a81628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40acd82640 1 -- 172.21.15.57:0/3429169539 >> v2:172.21.15.132:3300/0 conn(0x7f40a81624f0 msgr2=0x7f40a81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40acd82640 1 --2- 172.21.15.57:0/3429169539 >> v2:172.21.15.132:3300/0 conn(0x7f40a81624f0 0x7f40a81628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40acd82640 1 -- 172.21.15.57:0/3429169539 >> v1:172.21.15.132:6789/0 conn(0x7f40a80cd380 legacy=0x7f40a80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40acd82640 1 -- 172.21.15.57:0/3429169539 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a806c7e0 con 0x7f40a80ccef0 2023-11-24T08:04:39.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.083+0000 7f40ad583640 1 --2- 172.21.15.57:0/3429169539 >> v2:172.21.15.132:3300/0 conn(0x7f40a81624f0 0x7f40a81628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40acd82640 1 --2- 172.21.15.57:0/3429169539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80ccef0 0x7f40a8071900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40a809d2b0 tx=0x7f409801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acde996960dc1382 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f409ffff640 1 -- 172.21.15.57:0/3429169539 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980ac640 con 0x7f40a80ccef0 2023-11-24T08:04:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f409ffff640 1 -- 172.21.15.57:0/3429169539 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40980ac7a0 con 0x7f40a80ccef0 2023-11-24T08:04:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f409ffff640 1 -- 172.21.15.57:0/3429169539 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980acb30 con 0x7f40a80ccef0 2023-11-24T08:04:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 -- 172.21.15.57:0/3429169539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80ccef0 msgr2=0x7f40a8071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 --2- 172.21.15.57:0/3429169539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80ccef0 0x7f40a8071900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40a809d2b0 tx=0x7f409801c440 comp rx=0 tx=0).stop 2023-11-24T08:04:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 -- 172.21.15.57:0/3429169539 shutdown_connections 2023-11-24T08:04:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 --2- 172.21.15.57:0/3429169539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80ccef0 0x7f40a8071900 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 --2- 172.21.15.57:0/3429169539 >> v2:172.21.15.132:3300/0 conn(0x7f40a81624f0 0x7f40a81628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 -- 172.21.15.57:0/3429169539 >> 172.21.15.57:0/3429169539 conn(0x7f40a80b0c80 msgr2=0x7f40a80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 -- 172.21.15.57:0/3429169539 shutdown_connections 2023-11-24T08:04:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.087+0000 7f40af7e7640 1 -- 172.21.15.57:0/3429169539 wait complete. 2023-11-24T08:04:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 Processor -- start 2023-11-24T08:04:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 -- start start 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40a80ccef0 0x7f40a815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80cd380 0x7f40a80ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40a81624f0 0x7f40a8157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80ade80 con 0x7f40a80cd380 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80ad620 con 0x7f40a81624f0 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80ad8c0 con 0x7f40a80ccef0 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80cd380 0x7f40a80ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80cd380 0x7f40a80ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43912/0 (socket says 172.21.15.57:43912) 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 -- 172.21.15.57:0/2337001887 learned_addr learned my addr 172.21.15.57:0/2337001887 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:39.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40ad583640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40a80ccef0 0x7f40a815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40add84640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40a81624f0 0x7f40a8157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 -- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40a80ccef0 msgr2=0x7f40a815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40a80ccef0 0x7f40a815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 -- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40a81624f0 msgr2=0x7f40a8157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40a81624f0 0x7f40a8157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 -- 172.21.15.57:0/2337001887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980094d0 con 0x7f40a80cd380 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40ad583640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40a80ccef0 0x7f40a815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:39.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40acd82640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80cd380 0x7f40a80ad0e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4098019050 tx=0x7f40980191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f409dffb640 1 -- 172.21.15.57:0/2337001887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980b5640 con 0x7f40a80cd380 2023-11-24T08:04:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f409dffb640 1 -- 172.21.15.57:0/2337001887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40980b57a0 con 0x7f40a80cd380 2023-11-24T08:04:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a80adba0 con 0x7f40a80cd380 2023-11-24T08:04:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.091+0000 7f409dffb640 1 -- 172.21.15.57:0/2337001887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980b5b10 con 0x7f40a80cd380 2023-11-24T08:04:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.095+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a815f6d0 con 0x7f40a80cd380 2023-11-24T08:04:39.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.095+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a815f8c0 con 0x7f40a80cd380 2023-11-24T08:04:39.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.095+0000 7f409dffb640 1 -- 172.21.15.57:0/2337001887 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40980b3070 con 0x7f40a80cd380 2023-11-24T08:04:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.095+0000 7f409dffb640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f408c066470 0x7f408c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.095+0000 7f409dffb640 1 -- 172.21.15.57:0/2337001887 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f409811e260 con 0x7f40a80cd380 2023-11-24T08:04:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.095+0000 7f40ad583640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f408c066470 0x7f408c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.099+0000 7f40ad583640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f408c066470 0x7f408c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40a809cd30 tx=0x7f40a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.099+0000 7f409dffb640 1 -- 172.21.15.57:0/2337001887 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40980eb650 con 0x7f40a80cd380 2023-11-24T08:04:39.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.255+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40a804e8c0 con 0x7f40a80cd380 2023-11-24T08:04:39.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.255+0000 7f409dffb640 1 -- 172.21.15.57:0/2337001887 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40980eec70 con 0x7f40a80cd380 2023-11-24T08:04:39.261 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:04:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f408c066470 msgr2=0x7f408c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f408c066470 0x7f408c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40a809cd30 tx=0x7f40a4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80cd380 msgr2=0x7f40a80ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80cd380 0x7f40a80ad0e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4098019050 tx=0x7f40980191e0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 shutdown_connections 2023-11-24T08:04:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f408c066470 0x7f408c068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40a81624f0 0x7f40a8157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40a80cd380 0x7f40a80ad0e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 --2- 172.21.15.57:0/2337001887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f40a80ccef0 0x7f40a815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 >> 172.21.15.57:0/2337001887 conn(0x7f40a80b0c80 msgr2=0x7f40a8165dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 shutdown_connections 2023-11-24T08:04:39.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.259+0000 7f40af7e7640 1 -- 172.21.15.57:0/2337001887 wait complete. 2023-11-24T08:04:39.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:39.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.423+0000 7f76bddec640 1 Processor -- start 2023-11-24T08:04:39.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.423+0000 7f76bddec640 1 -- start start 2023-11-24T08:04:39.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76bddec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76b8146f60 0x7f76b80b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76bddec640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b815fb20 con 0x7f76b806acc0 2023-11-24T08:04:39.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76bddec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b80b1b40 con 0x7f76b80b4fd0 2023-11-24T08:04:39.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76bddec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b80b1580 con 0x7f76b8146f60 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b7fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f76b806acc0 0x7f76b815ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60560/0 (socket says 172.21.15.57:60560) 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b7fff640 1 -- 172.21.15.57:0/1399378445 learned_addr learned my addr 172.21.15.57:0/1399378445 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b77fe640 1 --2- 172.21.15.57:0/1399378445 >> v2:172.21.15.132:3300/0 conn(0x7f76b8146f60 0x7f76b80b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b67fc640 1 -- 172.21.15.57:0/1399378445 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076991185 0 0) 0x7f76b815fb20 con 0x7f76b806acc0 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b67fc640 1 -- 172.21.15.57:0/1399378445 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76a0003530 con 0x7f76b806acc0 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b67fc640 1 -- 172.21.15.57:0/1399378445 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762001757 0 0) 0x7f76b80b1b40 con 0x7f76b80b4fd0 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b77fe640 1 -- 172.21.15.57:0/1399378445 >> v1:172.21.15.132:6789/0 conn(0x7f76b80b4fd0 legacy=0x7f76b806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b77fe640 1 -- 172.21.15.57:0/1399378445 >> v1:172.21.15.57:6789/0 conn(0x7f76b806acc0 legacy=0x7f76b815ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.427+0000 7f76b77fe640 1 -- 172.21.15.57:0/1399378445 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80b1860 con 0x7f76b8146f60 2023-11-24T08:04:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76b77fe640 1 --2- 172.21.15.57:0/1399378445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b8146f60 0x7f76b80b4a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097c0 tx=0x7f76a801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc215a9ff30a35e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76b67fc640 1 -- 172.21.15.57:0/1399378445 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80ad680 con 0x7f76b8146f60 2023-11-24T08:04:39.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76b67fc640 1 -- 172.21.15.57:0/1399378445 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a80ad7e0 con 0x7f76b8146f60 2023-11-24T08:04:39.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76b67fc640 1 -- 172.21.15.57:0/1399378445 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80adb70 con 0x7f76b8146f60 2023-11-24T08:04:39.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 -- 172.21.15.57:0/1399378445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b8146f60 msgr2=0x7f76b80b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 --2- 172.21.15.57:0/1399378445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b8146f60 0x7f76b80b4a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097c0 tx=0x7f76a801c3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 -- 172.21.15.57:0/1399378445 shutdown_connections 2023-11-24T08:04:39.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 --2- 172.21.15.57:0/1399378445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b8146f60 0x7f76b80b4a90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 -- 172.21.15.57:0/1399378445 >> 172.21.15.57:0/1399378445 conn(0x7f76b80b5590 msgr2=0x7f76b80b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 -- 172.21.15.57:0/1399378445 shutdown_connections 2023-11-24T08:04:39.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 -- 172.21.15.57:0/1399378445 wait complete. 2023-11-24T08:04:39.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 Processor -- start 2023-11-24T08:04:39.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 -- start start 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.431+0000 7f76bddec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b806acc0 0x7f76b8140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76b80b4fd0 0x7f76b806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b8146f60 0x7f76b806e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8138730 con 0x7f76b8146f60 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8137e70 con 0x7f76b806acc0 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8140cb0 con 0x7f76b80b4fd0 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b8146f60 0x7f76b806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b8146f60 0x7f76b806e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43918/0 (socket says 172.21.15.57:43918) 2023-11-24T08:04:39.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 -- 172.21.15.57:0/4260909069 learned_addr learned my addr 172.21.15.57:0/4260909069 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:39.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b77fe640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b806acc0 0x7f76b8140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b6ffd640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76b80b4fd0 0x7f76b806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 -- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76b80b4fd0 msgr2=0x7f76b806e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76b80b4fd0 0x7f76b806e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 -- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b806acc0 msgr2=0x7f76b8140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b806acc0 0x7f76b8140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 -- 172.21.15.57:0/4260909069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009420 con 0x7f76b8146f60 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76b7fff640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b8146f60 0x7f76b806e600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f76b000caa0 tx=0x7f76b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f769ffff640 1 -- 172.21.15.57:0/4260909069 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000ac00 con 0x7f76b8146f60 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f769ffff640 1 -- 172.21.15.57:0/4260909069 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b000ad60 con 0x7f76b8146f60 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b81380e0 con 0x7f76b8146f60 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f769ffff640 1 -- 172.21.15.57:0/4260909069 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0012600 con 0x7f76b8146f60 2023-11-24T08:04:39.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8136420 con 0x7f76b8146f60 2023-11-24T08:04:39.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b81388e0 con 0x7f76b8146f60 2023-11-24T08:04:39.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.435+0000 7f769ffff640 1 -- 172.21.15.57:0/4260909069 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76b0007070 con 0x7f76b8146f60 2023-11-24T08:04:39.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.439+0000 7f769ffff640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f76a4066470 0x7f76a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.439+0000 7f769ffff640 1 -- 172.21.15.57:0/4260909069 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76b0083c80 con 0x7f76b8146f60 2023-11-24T08:04:39.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.439+0000 7f76b77fe640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f76a4066470 0x7f76a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.439+0000 7f76b77fe640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f76a4066470 0x7f76a4068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76a80af000 tx=0x7f76a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.443+0000 7f769ffff640 1 -- 172.21.15.57:0/4260909069 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76b81388e0 con 0x7f76b8146f60 2023-11-24T08:04:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76b81388e0 con 0x7f76b8146f60 2023-11-24T08:04:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f769ffff640 1 -- 172.21.15.57:0/4260909069 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76b81388e0 con 0x7f76b8146f60 2023-11-24T08:04:39.613 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:04:39.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f76a4066470 msgr2=0x7f76a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f76a4066470 0x7f76a4068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76a80af000 tx=0x7f76a8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b8146f60 msgr2=0x7f76b806e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b8146f60 0x7f76b806e600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f76b000caa0 tx=0x7f76b000cf60 comp rx=0 tx=0).stop 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 shutdown_connections 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f76a4066470 0x7f76a4068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76b8146f60 0x7f76b806e600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76b80b4fd0 0x7f76b806e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 --2- 172.21.15.57:0/4260909069 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b806acc0 0x7f76b8140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 >> 172.21.15.57:0/4260909069 conn(0x7f76b80b5590 msgr2=0x7f76b813c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 shutdown_connections 2023-11-24T08:04:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.611+0000 7f76bddec640 1 -- 172.21.15.57:0/4260909069 wait complete. 2023-11-24T08:04:39.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:39.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda23868640 1 Processor -- start 2023-11-24T08:04:39.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda23868640 1 -- start start 2023-11-24T08:04:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda23868640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c15d570 0x7fda1c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda23868640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda1c0d3020 0x7fda1c0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda23868640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c0d39c0 con 0x7fda1c0ce8b0 2023-11-24T08:04:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda23868640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0d1cc0 con 0x7fda1c0d3020 2023-11-24T08:04:39.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda23868640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0d1fa0 con 0x7fda1c15d570 2023-11-24T08:04:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda21e05640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda1c0ce8b0 0x7fda1c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60576/0 (socket says 172.21.15.57:60576) 2023-11-24T08:04:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda21e05640 1 -- 172.21.15.57:0/59087240 learned_addr learned my addr 172.21.15.57:0/59087240 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda20e03640 1 --2- 172.21.15.57:0/59087240 >> v2:172.21.15.57:3300/0 conn(0x7fda1c0d3020 0x7fda1c0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda21604640 1 --2- 172.21.15.57:0/59087240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c15d570 0x7fda1c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda13fff640 1 -- 172.21.15.57:0/59087240 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708778833 0 0) 0x7fda1c0d39c0 con 0x7fda1c0ce8b0 2023-11-24T08:04:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda13fff640 1 -- 172.21.15.57:0/59087240 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda08003530 con 0x7fda1c0ce8b0 2023-11-24T08:04:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda20e03640 1 -- 172.21.15.57:0/59087240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c15d570 msgr2=0x7fda1c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda20e03640 1 --2- 172.21.15.57:0/59087240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c15d570 0x7fda1c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda20e03640 1 -- 172.21.15.57:0/59087240 >> v1:172.21.15.57:6789/0 conn(0x7fda1c0ce8b0 legacy=0x7fda1c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.775+0000 7fda20e03640 1 -- 172.21.15.57:0/59087240 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0ce0b0 con 0x7fda1c0d3020 2023-11-24T08:04:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda20e03640 1 --2- 172.21.15.57:0/59087240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0d3020 0x7fda1c0d3480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097c0 tx=0x7fda0c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f6898655a764dd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda13fff640 1 -- 172.21.15.57:0/59087240 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0ac640 con 0x7fda1c0d3020 2023-11-24T08:04:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda13fff640 1 -- 172.21.15.57:0/59087240 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0ac7a0 con 0x7fda1c0d3020 2023-11-24T08:04:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda13fff640 1 -- 172.21.15.57:0/59087240 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0acb30 con 0x7fda1c0d3020 2023-11-24T08:04:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 -- 172.21.15.57:0/59087240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0d3020 msgr2=0x7fda1c0d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 --2- 172.21.15.57:0/59087240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0d3020 0x7fda1c0d3480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097c0 tx=0x7fda0c01c3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 -- 172.21.15.57:0/59087240 shutdown_connections 2023-11-24T08:04:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 --2- 172.21.15.57:0/59087240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c0d3020 0x7fda1c0d3480 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 --2- 172.21.15.57:0/59087240 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c15d570 0x7fda1c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 -- 172.21.15.57:0/59087240 >> 172.21.15.57:0/59087240 conn(0x7fda1c08ceb0 msgr2=0x7fda1c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 -- 172.21.15.57:0/59087240 shutdown_connections 2023-11-24T08:04:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.779+0000 7fda23868640 1 -- 172.21.15.57:0/59087240 wait complete. 2023-11-24T08:04:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 Processor -- start 2023-11-24T08:04:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 -- start start 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1c0ce8b0 0x7fda1c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c0d3020 0x7fda1c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c15d570 0x7fda1c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c15db60 con 0x7fda1c15d570 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c1559a0 con 0x7fda1c0ce8b0 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0c96d0 con 0x7fda1c0d3020 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c15d570 0x7fda1c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c15d570 0x7fda1c0ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43944/0 (socket says 172.21.15.57:43944) 2023-11-24T08:04:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 -- 172.21.15.57:0/2566127139 learned_addr learned my addr 172.21.15.57:0/2566127139 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21604640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1c0ce8b0 0x7fda1c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 -- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c0d3020 msgr2=0x7fda1c0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c0d3020 0x7fda1c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 -- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1c0ce8b0 msgr2=0x7fda1c155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1c0ce8b0 0x7fda1c155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 -- 172.21.15.57:0/2566127139 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009420 con 0x7fda1c15d570 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21604640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1c0ce8b0 0x7fda1c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda21e05640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c15d570 0x7fda1c0ca4d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c9f0 tx=0x7fda1400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda11ffb640 1 -- 172.21.15.57:0/2566127139 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400ab70 con 0x7fda1c15d570 2023-11-24T08:04:39.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda11ffb640 1 -- 172.21.15.57:0/2566127139 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1400acd0 con 0x7fda1c15d570 2023-11-24T08:04:39.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c15dd40 con 0x7fda1c15d570 2023-11-24T08:04:39.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda11ffb640 1 -- 172.21.15.57:0/2566127139 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14012600 con 0x7fda1c15d570 2023-11-24T08:04:39.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.783+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c15e300 con 0x7fda1c15d570 2023-11-24T08:04:39.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.787+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c15e4f0 con 0x7fda1c15d570 2023-11-24T08:04:39.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.787+0000 7fda11ffb640 1 -- 172.21.15.57:0/2566127139 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda14007070 con 0x7fda1c15d570 2023-11-24T08:04:39.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.787+0000 7fda11ffb640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fda00066470 0x7fda00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.787+0000 7fda11ffb640 1 -- 172.21.15.57:0/2566127139 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fda14083ca0 con 0x7fda1c15d570 2023-11-24T08:04:39.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.787+0000 7fda21604640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fda00066470 0x7fda00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.787+0000 7fda21604640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fda00066470 0x7fda00068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda1c157310 tx=0x7fda18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.791+0000 7fda11ffb640 1 -- 172.21.15.57:0/2566127139 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda14051140 con 0x7fda1c15d570 2023-11-24T08:04:39.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda1c067520 con 0x7fda1c15d570 2023-11-24T08:04:39.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda11ffb640 1 -- 172.21.15.57:0/2566127139 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fda14017090 con 0x7fda1c15d570 2023-11-24T08:04:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:39.987 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:39.987 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fda00066470 msgr2=0x7fda00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fda00066470 0x7fda00068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda1c157310 tx=0x7fda18008040 comp rx=0 tx=0).stop 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c15d570 msgr2=0x7fda1c0ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c15d570 0x7fda1c0ca4d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c9f0 tx=0x7fda1400ceb0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 shutdown_connections 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fda00066470 0x7fda00068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda1c15d570 0x7fda1c0ca4d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda1c0d3020 0x7fda1c0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 --2- 172.21.15.57:0/2566127139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1c0ce8b0 0x7fda1c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 >> 172.21.15.57:0/2566127139 conn(0x7fda1c08ceb0 msgr2=0x7fda1c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 shutdown_connections 2023-11-24T08:04:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:39.983+0000 7fda23868640 1 -- 172.21.15.57:0/2566127139 wait complete. 2023-11-24T08:04:40.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:40.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7aeb49c640 1 Processor -- start 2023-11-24T08:04:40.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7aeb49c640 1 -- start start 2023-11-24T08:04:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7aeb49c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7ae40b36c0 0x7f7ae40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7aeb49c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 0x7f7ae415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7aeb49c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae415a700 con 0x7f7ae415a320 2023-11-24T08:04:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7aeb49c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40b2430 con 0x7f7ae40b36c0 2023-11-24T08:04:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7aeb49c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40b2620 con 0x7f7ae4070da0 2023-11-24T08:04:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7ae9238640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7ae415a320 0x7f7ae4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60582/0 (socket says 172.21.15.57:60582) 2023-11-24T08:04:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7ae9238640 1 -- 172.21.15.57:0/86304042 learned_addr learned my addr 172.21.15.57:0/86304042 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/86304042 >> v2:172.21.15.132:3300/0 conn(0x7f7ae40b36c0 0x7f7ae40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187593027 0 0) 0x7f7ae415a700 con 0x7f7ae415a320 2023-11-24T08:04:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad0003530 con 0x7f7ae415a320 2023-11-24T08:04:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7ae9a39640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 0x7f7ae415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032546195 0 0) 0x7f7ad0003530 con 0x7f7ae415a320 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 msgr2=0x7f7ae415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 0x7f7ae415ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 >> v2:172.21.15.132:3300/0 conn(0x7f7ae40b36c0 msgr2=0x7f7ae40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 --2- 172.21.15.57:0/86304042 >> v2:172.21.15.132:3300/0 conn(0x7f7ae40b36c0 0x7f7ae40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae40b2900 con 0x7f7ae415a320 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f7ae0001680 con 0x7f7ae415a320 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 >> v1:172.21.15.57:6789/0 conn(0x7f7ae415a320 legacy=0x7f7ae4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ad0003980 0x7f7ad0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ad0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 0x7f7ad0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40b2620 con 0x7f7ad00047d0 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad000dba0 con 0x7f7ad0003980 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.147+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad000dd30 con 0x7f7ae4070da0 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ad0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae9238640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ad0003980 0x7f7ad0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae9a39640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 0x7f7ad0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae8a37640 1 -- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 msgr2=0x7f7ad0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 0x7f7ad0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae8a37640 1 -- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ad0003980 msgr2=0x7f7ad0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ad0003980 0x7f7ad0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae8a37640 1 -- 172.21.15.57:0/86304042 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0003530 con 0x7f7ad00047d0 2023-11-24T08:04:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae9a39640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae4070da0 0x7f7ad0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ad0004c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009ae0 tx=0x7f7ad401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e2326e3b3388d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40a64a0 con 0x7f7ad00047d0 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad40a6600 con 0x7f7ad00047d0 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.151+0000 7f7adbfff640 1 -- 172.21.15.57:0/86304042 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40a69b0 con 0x7f7ad00047d0 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- 172.21.15.57:0/86304042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 msgr2=0x7f7ad0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 --2- 172.21.15.57:0/86304042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ad0004c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009ae0 tx=0x7f7ad401ca90 comp rx=0 tx=0).stop 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7ae9a39640 1 -- 172.21.15.57:0/86304042 reap_dead start 2023-11-24T08:04:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- 172.21.15.57:0/86304042 shutdown_connections 2023-11-24T08:04:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- 172.21.15.57:0/86304042 >> 172.21.15.57:0/86304042 conn(0x7f7ae40b0bf0 msgr2=0x7f7ae40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- 172.21.15.57:0/86304042 shutdown_connections 2023-11-24T08:04:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- 172.21.15.57:0/86304042 wait complete. 2023-11-24T08:04:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 Processor -- start 2023-11-24T08:04:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- start start 2023-11-24T08:04:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ae414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae40c8270 0x7f7ae406d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae406da70 0x7f7ae40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae406def0 con 0x7f7ad00047d0 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae414c010 con 0x7f7ae406da70 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7aeb49c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae41f7020 con 0x7f7ae40c8270 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7ae9238640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ae414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7ae9238640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ae414bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43958/0 (socket says 172.21.15.57:43958) 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7ae9238640 1 -- 172.21.15.57:0/1945814444 learned_addr learned my addr 172.21.15.57:0/1945814444 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7ae9a39640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae406da70 0x7f7ae40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.155+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae40c8270 0x7f7ae406d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ae9238640 1 -- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae40c8270 msgr2=0x7f7ae406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ae9238640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae40c8270 0x7f7ae406d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ae9238640 1 -- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae406da70 msgr2=0x7f7ae40999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ae9238640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae406da70 0x7f7ae40999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ae9238640 1 -- 172.21.15.57:0/1945814444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae41f64a0 con 0x7f7ad00047d0 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ae9238640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ae414bad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0012510 tx=0x7f7ae00129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ad9ffb640 1 -- 172.21.15.57:0/1945814444 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0014810 con 0x7f7ad00047d0 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ad9ffb640 1 -- 172.21.15.57:0/1945814444 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0014970 con 0x7f7ad00047d0 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae41f6780 con 0x7f7ad00047d0 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ad9ffb640 1 -- 172.21.15.57:0/1945814444 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0014d20 con 0x7f7ad00047d0 2023-11-24T08:04:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae41f6d40 con 0x7f7ad00047d0 2023-11-24T08:04:40.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae4067520 con 0x7f7ad00047d0 2023-11-24T08:04:40.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ad9ffb640 1 -- 172.21.15.57:0/1945814444 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ae00153e0 con 0x7f7ad00047d0 2023-11-24T08:04:40.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ad9ffb640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7ac80664a0 0x7f7ac8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ad9ffb640 1 -- 172.21.15.57:0/1945814444 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7ae0086bd0 con 0x7f7ad00047d0 2023-11-24T08:04:40.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.159+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7ac80664a0 0x7f7ac8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.163+0000 7f7ae8a37640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7ac80664a0 0x7f7ac8068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40ad000 tx=0x7f7ad40b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.163+0000 7f7ad9ffb640 1 -- 172.21.15.57:0/1945814444 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ae0053fe0 con 0x7f7ad00047d0 2023-11-24T08:04:40.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.323+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae409aee0 con 0x7f7ad00047d0 2023-11-24T08:04:40.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.323+0000 7f7ad9ffb640 1 -- 172.21.15.57:0/1945814444 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f7ae001c020 con 0x7f7ad00047d0 2023-11-24T08:04:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:40.327 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:39.516339+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.323+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7ac80664a0 msgr2=0x7f7ac8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.323+0000 7f7aeb49c640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7ac80664a0 0x7f7ac8068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40ad000 tx=0x7f7ad40b3040 comp rx=0 tx=0).stop 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.323+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 msgr2=0x7f7ae414bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.323+0000 7f7aeb49c640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ae414bad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0012510 tx=0x7f7ae00129d0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 shutdown_connections 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7ac80664a0 0x7f7ac8068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae406da70 0x7f7ae40999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ae40c8270 0x7f7ae406d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 --2- 172.21.15.57:0/1945814444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad00047d0 0x7f7ae414bad0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 >> 172.21.15.57:0/1945814444 conn(0x7f7ae40b0bf0 msgr2=0x7f7ae40afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 shutdown_connections 2023-11-24T08:04:40.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.327+0000 7f7aeb49c640 1 -- 172.21.15.57:0/1945814444 wait complete. 2023-11-24T08:04:40.349 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:04:40.349 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:40.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.487+0000 7f36e8468640 1 Processor -- start 2023-11-24T08:04:40.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.487+0000 7f36e8468640 1 -- start start 2023-11-24T08:04:40.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e8468640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36e015a320 0x7f36e00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e8468640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e015a700 con 0x7f36e00b36c0 2023-11-24T08:04:40.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e8468640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e00b2620 con 0x7f36e0070da0 2023-11-24T08:04:40.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e8468640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e00b2430 con 0x7f36e015a320 2023-11-24T08:04:40.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e5a03640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f36e00b36c0 0x7f36e0070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60596/0 (socket says 172.21.15.57:60596) 2023-11-24T08:04:40.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e5a03640 1 -- 172.21.15.57:0/581403417 learned_addr learned my addr 172.21.15.57:0/581403417 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:40.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e6204640 1 --2- 172.21.15.57:0/581403417 >> v2:172.21.15.57:3300/0 conn(0x7f36e015a320 0x7f36e00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e5202640 1 -- 172.21.15.57:0/581403417 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132939603 0 0) 0x7f36e015a700 con 0x7f36e00b36c0 2023-11-24T08:04:40.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e6204640 1 -- 172.21.15.57:0/581403417 >> v1:172.21.15.132:6789/0 conn(0x7f36e0070da0 legacy=0x7f36e015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e6204640 1 -- 172.21.15.57:0/581403417 >> v1:172.21.15.57:6789/0 conn(0x7f36e00b36c0 legacy=0x7f36e0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.491+0000 7f36e6204640 1 -- 172.21.15.57:0/581403417 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00b2900 con 0x7f36e015a320 2023-11-24T08:04:40.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e6204640 1 --2- 172.21.15.57:0/581403417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e00b1ef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097c0 tx=0x7f36dc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd85eec371e87251 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e5202640 1 -- 172.21.15.57:0/581403417 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0ad660 con 0x7f36e015a320 2023-11-24T08:04:40.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e5202640 1 -- 172.21.15.57:0/581403417 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc0ad7c0 con 0x7f36e015a320 2023-11-24T08:04:40.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e5202640 1 -- 172.21.15.57:0/581403417 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0adb50 con 0x7f36e015a320 2023-11-24T08:04:40.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 -- 172.21.15.57:0/581403417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 msgr2=0x7f36e00b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 --2- 172.21.15.57:0/581403417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e00b1ef0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097c0 tx=0x7f36dc01c450 comp rx=0 tx=0).stop 2023-11-24T08:04:40.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 -- 172.21.15.57:0/581403417 shutdown_connections 2023-11-24T08:04:40.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 --2- 172.21.15.57:0/581403417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e00b1ef0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 -- 172.21.15.57:0/581403417 >> 172.21.15.57:0/581403417 conn(0x7f36e00b0bf0 msgr2=0x7f36e00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 -- 172.21.15.57:0/581403417 shutdown_connections 2023-11-24T08:04:40.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 -- 172.21.15.57:0/581403417 wait complete. 2023-11-24T08:04:40.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 Processor -- start 2023-11-24T08:04:40.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.495+0000 7f36e8468640 1 -- start start 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36e0070da0 0x7f36e01625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36e00b36c0 0x7f36e0164af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e00b0620 con 0x7f36e015a320 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01f6ad0 con 0x7f36e0070da0 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01f6db0 con 0x7f36e00b36c0 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e015c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43974/0 (socket says 172.21.15.57:43974) 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 -- 172.21.15.57:0/1013554173 learned_addr learned my addr 172.21.15.57:0/1013554173 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6204640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36e0070da0 0x7f36e01625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e5a03640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36e00b36c0 0x7f36e0164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 -- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36e00b36c0 msgr2=0x7f36e0164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36e00b36c0 0x7f36e0164af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 -- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36e0070da0 msgr2=0x7f36e01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36e0070da0 0x7f36e01625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 -- 172.21.15.57:0/1013554173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009420 con 0x7f36e015a320 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e6a05640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e015c8d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c770 tx=0x7f36d800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36d6ffd640 1 -- 172.21.15.57:0/1013554173 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8003b80 con 0x7f36e015a320 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36d6ffd640 1 -- 172.21.15.57:0/1013554173 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8003ce0 con 0x7f36e015a320 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36d6ffd640 1 -- 172.21.15.57:0/1013554173 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800aa90 con 0x7f36e015a320 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e0164010 con 0x7f36e015a320 2023-11-24T08:04:40.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e01645d0 con 0x7f36e015a320 2023-11-24T08:04:40.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e0163e70 con 0x7f36e015a320 2023-11-24T08:04:40.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.499+0000 7f36d6ffd640 1 -- 172.21.15.57:0/1013554173 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36d800abf0 con 0x7f36e015a320 2023-11-24T08:04:40.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.503+0000 7f36d6ffd640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f36c4066470 0x7f36c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.503+0000 7f36d6ffd640 1 -- 172.21.15.57:0/1013554173 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f36d8083e00 con 0x7f36e015a320 2023-11-24T08:04:40.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.503+0000 7f36e6204640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f36c4066470 0x7f36c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.503+0000 7f36e6204640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f36c4066470 0x7f36c4068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0af000 tx=0x7f36dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.507+0000 7f36d6ffd640 1 -- 172.21.15.57:0/1013554173 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36e0163e70 con 0x7f36e015a320 2023-11-24T08:04:40.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.699+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e0163e70 con 0x7f36e015a320 2023-11-24T08:04:40.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36d6ffd640 1 -- 172.21.15.57:0/1013554173 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f36e0163e70 con 0x7f36e015a320 2023-11-24T08:04:40.706 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:40.706 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f36c4066470 msgr2=0x7f36c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f36c4066470 0x7f36c4068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0af000 tx=0x7f36dc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 msgr2=0x7f36e015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e015c8d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c770 tx=0x7f36d800cc30 comp rx=0 tx=0).stop 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 shutdown_connections 2023-11-24T08:04:40.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f36c4066470 0x7f36c4068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36e015a320 0x7f36e015c8d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36e00b36c0 0x7f36e0164af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 --2- 172.21.15.57:0/1013554173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36e0070da0 0x7f36e01625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 >> 172.21.15.57:0/1013554173 conn(0x7f36e00b0bf0 msgr2=0x7f36e006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 shutdown_connections 2023-11-24T08:04:40.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.703+0000 7f36e8468640 1 -- 172.21.15.57:0/1013554173 wait complete. 2023-11-24T08:04:40.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30fe4ea640 1 Processor -- start 2023-11-24T08:04:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30fe4ea640 1 -- start start 2023-11-24T08:04:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30fe4ea640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30f815a320 0x7f30f80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30fe4ea640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f8070da0 0x7f30f815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30fe4ea640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f815a700 con 0x7f30f80b36c0 2023-11-24T08:04:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30fe4ea640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f80b2430 con 0x7f30f815a320 2023-11-24T08:04:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30fe4ea640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80b2620 con 0x7f30f8070da0 2023-11-24T08:04:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30f815a320 0x7f30f80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f77fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f30f80b36c0 0x7f30f8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60600/0 (socket says 172.21.15.57:60600) 2023-11-24T08:04:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f77fe640 1 -- 172.21.15.57:0/3062124217 learned_addr learned my addr 172.21.15.57:0/3062124217 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f7fff640 1 -- 172.21.15.57:0/3062124217 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f8070da0 msgr2=0x7f30f815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f7fff640 1 --2- 172.21.15.57:0/3062124217 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f8070da0 0x7f30f815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f7fff640 1 -- 172.21.15.57:0/3062124217 >> v1:172.21.15.57:6789/0 conn(0x7f30f80b36c0 legacy=0x7f30f8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f7fff640 1 -- 172.21.15.57:0/3062124217 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80b2900 con 0x7f30f815a320 2023-11-24T08:04:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.867+0000 7f30f6ffd640 1 -- 172.21.15.57:0/3062124217 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131991644 0 0) 0x7f30f815a700 con 0x7f30f80b36c0 2023-11-24T08:04:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30f7fff640 1 --2- 172.21.15.57:0/3062124217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f815a320 0x7f30f80b1ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097c0 tx=0x7f30e801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51eb1f9cff5cb5d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30f6ffd640 1 -- 172.21.15.57:0/3062124217 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e80ab670 con 0x7f30f815a320 2023-11-24T08:04:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30f6ffd640 1 -- 172.21.15.57:0/3062124217 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e80ab7d0 con 0x7f30f815a320 2023-11-24T08:04:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30f6ffd640 1 -- 172.21.15.57:0/3062124217 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e80abb60 con 0x7f30f815a320 2023-11-24T08:04:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 -- 172.21.15.57:0/3062124217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f815a320 msgr2=0x7f30f80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/3062124217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f815a320 0x7f30f80b1ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097c0 tx=0x7f30e801c450 comp rx=0 tx=0).stop 2023-11-24T08:04:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 -- 172.21.15.57:0/3062124217 shutdown_connections 2023-11-24T08:04:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/3062124217 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f8070da0 0x7f30f815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/3062124217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f815a320 0x7f30f80b1ef0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 -- 172.21.15.57:0/3062124217 >> 172.21.15.57:0/3062124217 conn(0x7f30f80b0bf0 msgr2=0x7f30f80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 -- 172.21.15.57:0/3062124217 shutdown_connections 2023-11-24T08:04:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.871+0000 7f30fe4ea640 1 -- 172.21.15.57:0/3062124217 wait complete. 2023-11-24T08:04:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 Processor -- start 2023-11-24T08:04:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 -- start start 2023-11-24T08:04:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f8070da0 0x7f30f81f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f80b36c0 0x7f30f815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f815a320 0x7f30f815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f8160010 con 0x7f30f80b36c0 2023-11-24T08:04:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80ce210 con 0x7f30f8070da0 2023-11-24T08:04:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f80cebb0 con 0x7f30f815a320 2023-11-24T08:04:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f80b36c0 0x7f30f815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f80b36c0 0x7f30f815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43988/0 (socket says 172.21.15.57:43988) 2023-11-24T08:04:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 -- 172.21.15.57:0/67528961 learned_addr learned my addr 172.21.15.57:0/67528961 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f7fff640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f8070da0 0x7f30f81f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fca87640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f815a320 0x7f30f815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 -- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f815a320 msgr2=0x7f30f815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f815a320 0x7f30f815ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 -- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f8070da0 msgr2=0x7f30f81f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f8070da0 0x7f30f81f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 -- 172.21.15.57:0/67528961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8009420 con 0x7f30f80b36c0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f77fe640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f80b36c0 0x7f30f815c8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0011f0 tx=0x7f30ec00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f4ff9640 1 -- 172.21.15.57:0/67528961 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0074e0 con 0x7f30f80b36c0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f4ff9640 1 -- 172.21.15.57:0/67528961 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec007640 con 0x7f30f80b36c0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30f4ff9640 1 -- 172.21.15.57:0/67528961 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec004a10 con 0x7f30f80b36c0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f80cee90 con 0x7f30f80b36c0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.875+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f80cf450 con 0x7f30f80b36c0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.879+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f8067520 con 0x7f30f80b36c0 2023-11-24T08:04:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.879+0000 7f30f4ff9640 1 -- 172.21.15.57:0/67528961 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30ec004b70 con 0x7f30f80b36c0 2023-11-24T08:04:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.879+0000 7f30f4ff9640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30e4066470 0x7f30e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.879+0000 7f30f4ff9640 1 -- 172.21.15.57:0/67528961 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f30ec0830d0 con 0x7f30f80b36c0 2023-11-24T08:04:40.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.879+0000 7f30f7fff640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30e4066470 0x7f30e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.879+0000 7f30f7fff640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30e4066470 0x7f30e4068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30e80af000 tx=0x7f30e80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:40.883+0000 7f30f4ff9640 1 -- 172.21.15.57:0/67528961 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30ec050570 con 0x7f30f80b36c0 2023-11-24T08:04:41.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.071+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30f80b1220 con 0x7f30f80b36c0 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30f4ff9640 1 -- 172.21.15.57:0/67528961 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f30ec018020 con 0x7f30f80b36c0 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3793708445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3793708445},{"type":"v1","addr":"172.21.15.57:6835","nonce":3793708445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/4199202082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":4199202082},{"type":"v1","addr":"172.21.15.132:6836","nonce":4199202082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2474046080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2474046080},{"type":"v1","addr":"172.21.15.132:6837","nonce":2474046080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:03:58.959263+0000","modified":"2023-11-24T08:04:01.997394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6833/2419149614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2419149614},{"type":"v1","addr":"172.21.15.57:6833","nonce":2419149614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:04:41.079 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-11-24T08:04:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30e4066470 msgr2=0x7f30e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30e4066470 0x7f30e4068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30e80af000 tx=0x7f30e80a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f80b36c0 msgr2=0x7f30f815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f80b36c0 0x7f30f815c8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0011f0 tx=0x7f30ec00c9b0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 shutdown_connections 2023-11-24T08:04:41.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f30e4066470 0x7f30e4068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f815a320 0x7f30f815ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f80b36c0 0x7f30f815c8d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 --2- 172.21.15.57:0/67528961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f8070da0 0x7f30f81f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 >> 172.21.15.57:0/67528961 conn(0x7f30f80b0bf0 msgr2=0x7f30f806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 shutdown_connections 2023-11-24T08:04:41.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.075+0000 7f30fe4ea640 1 -- 172.21.15.57:0/67528961 wait complete. 2023-11-24T08:04:41.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:41.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.239+0000 7fa1ac32a640 1 Processor -- start 2023-11-24T08:04:41.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.239+0000 7fa1ac32a640 1 -- start start 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1ac32a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1a406c650 0x7fa1a409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1ac32a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a406d8b0 con 0x7fa1a40709c0 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1ac32a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a406cca0 con 0x7fa1a4144030 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1ac32a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a4145020 con 0x7fa1a406c650 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a98c5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1a406c650 0x7fa1a409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a98c5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1a406c650 0x7fa1a409cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43990/0 (socket says 172.21.15.57:43990) 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1aa8c7640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa1a40709c0 0x7fa1a4070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60608/0 (socket says 172.21.15.57:60608) 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a98c5640 1 -- 172.21.15.57:0/1507309792 learned_addr learned my addr 172.21.15.57:0/1507309792 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a98c5640 1 -- 172.21.15.57:0/1507309792 >> v1:172.21.15.132:6789/0 conn(0x7fa1a4144030 legacy=0x7fa1a406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a98c5640 1 -- 172.21.15.57:0/1507309792 >> v1:172.21.15.57:6789/0 conn(0x7fa1a40709c0 legacy=0x7fa1a4070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a98c5640 1 -- 172.21.15.57:0/1507309792 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a406cf80 con 0x7fa1a406c650 2023-11-24T08:04:41.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a90c4640 1 -- 172.21.15.57:0/1507309792 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154669602 0 0) 0x7fa1a406d8b0 con 0x7fa1a40709c0 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.243+0000 7fa1a98c5640 1 --2- 172.21.15.57:0/1507309792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a406c650 0x7fa1a409cc20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa194009870 tx=0x7fa19401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9331a6e1f4c245db server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1a90c4640 1 -- 172.21.15.57:0/1507309792 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940ab5f0 con 0x7fa1a406c650 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1a90c4640 1 -- 172.21.15.57:0/1507309792 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1940ab750 con 0x7fa1a406c650 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1a90c4640 1 -- 172.21.15.57:0/1507309792 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940abae0 con 0x7fa1a406c650 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- 172.21.15.57:0/1507309792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a406c650 msgr2=0x7fa1a409cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/1507309792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a406c650 0x7fa1a409cc20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa194009870 tx=0x7fa19401c500 comp rx=0 tx=0).stop 2023-11-24T08:04:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- 172.21.15.57:0/1507309792 shutdown_connections 2023-11-24T08:04:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/1507309792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a406c650 0x7fa1a409cc20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- 172.21.15.57:0/1507309792 >> 172.21.15.57:0/1507309792 conn(0x7fa1a40b0bf0 msgr2=0x7fa1a40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- 172.21.15.57:0/1507309792 shutdown_connections 2023-11-24T08:04:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- 172.21.15.57:0/1507309792 wait complete. 2023-11-24T08:04:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 Processor -- start 2023-11-24T08:04:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- start start 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a406c650 0x7fa1a415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a40709c0 0x7fa1a415ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a4144030 0x7fa1a4152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4159490 con 0x7fa1a40709c0 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4159730 con 0x7fa1a406c650 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1ac32a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4159a10 con 0x7fa1a4144030 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1a98c5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a40709c0 0x7fa1a415ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1a98c5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a40709c0 0x7fa1a415ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43998/0 (socket says 172.21.15.57:43998) 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1a98c5640 1 -- 172.21.15.57:0/2596349247 learned_addr learned my addr 172.21.15.57:0/2596349247 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1aa0c6640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a406c650 0x7fa1a415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.247+0000 7fa1aa8c7640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a4144030 0x7fa1a4152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1a98c5640 1 -- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a4144030 msgr2=0x7fa1a4152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1a98c5640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a4144030 0x7fa1a4152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1a98c5640 1 -- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a406c650 msgr2=0x7fa1a415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1a98c5640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a406c650 0x7fa1a415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1a98c5640 1 -- 172.21.15.57:0/2596349247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940094d0 con 0x7fa1a40709c0 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1a98c5640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a40709c0 0x7fa1a415ad00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa1940ad040 tx=0x7fa19401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa19affd640 1 -- 172.21.15.57:0/2596349247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940b4800 con 0x7fa1a40709c0 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa19affd640 1 -- 172.21.15.57:0/2596349247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1940b4980 con 0x7fa1a40709c0 2023-11-24T08:04:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a4159cf0 con 0x7fa1a40709c0 2023-11-24T08:04:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa19affd640 1 -- 172.21.15.57:0/2596349247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940b4d30 con 0x7fa1a40709c0 2023-11-24T08:04:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a415b240 con 0x7fa1a40709c0 2023-11-24T08:04:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a4067520 con 0x7fa1a40709c0 2023-11-24T08:04:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa19affd640 1 -- 172.21.15.57:0/2596349247 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa1940b3380 con 0x7fa1a40709c0 2023-11-24T08:04:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa19affd640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa188066470 0x7fa188068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.251+0000 7fa19affd640 1 -- 172.21.15.57:0/2596349247 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa1940a8050 con 0x7fa1a40709c0 2023-11-24T08:04:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.255+0000 7fa1aa0c6640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa188066470 0x7fa188068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.255+0000 7fa1aa0c6640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa188066470 0x7fa188068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0007fd0 tx=0x7fa1a0007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.255+0000 7fa19affd640 1 -- 172.21.15.57:0/2596349247 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa1940eb950 con 0x7fa1a40709c0 2023-11-24T08:04:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.415+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a415a1a0 con 0x7fa1a40709c0 2023-11-24T08:04:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.415+0000 7fa19affd640 1 -- 172.21.15.57:0/2596349247 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fa1940eef70 con 0x7fa1a40709c0 2023-11-24T08:04:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:41.422 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:40.527203+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:03:56.933450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:03:57.955074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa188066470 msgr2=0x7fa188068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa188066470 0x7fa188068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0007fd0 tx=0x7fa1a0007e40 comp rx=0 tx=0).stop 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a40709c0 msgr2=0x7fa1a415ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a40709c0 0x7fa1a415ad00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa1940ad040 tx=0x7fa19401ad40 comp rx=0 tx=0).stop 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 shutdown_connections 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa188066470 0x7fa188068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1a4144030 0x7fa1a4152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1a40709c0 0x7fa1a415ad00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 --2- 172.21.15.57:0/2596349247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1a406c650 0x7fa1a415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 >> 172.21.15.57:0/2596349247 conn(0x7fa1a40b0bf0 msgr2=0x7fa1a40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 shutdown_connections 2023-11-24T08:04:41.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.419+0000 7fa1ac32a640 1 -- 172.21.15.57:0/2596349247 wait complete. 2023-11-24T08:04:41.440 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:04:41.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26d089f640 1 Processor -- start 2023-11-24T08:04:41.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26d089f640 1 -- start start 2023-11-24T08:04:41.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26d089f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc160aa0 0x7f26cc0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26d089f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26cc0d0240 0x7f26cc0d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26d089f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0cf1a0 con 0x7f26cc0ca2f0 2023-11-24T08:04:41.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26d089f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0cf480 con 0x7f26cc0d0240 2023-11-24T08:04:41.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26d089f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0cf760 con 0x7f26cc160aa0 2023-11-24T08:04:41.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26caffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26cc0d0240 0x7f26cc0d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26cbfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f26cc0ca2f0 0x7f26cc0d31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60610/0 (socket says 172.21.15.57:60610) 2023-11-24T08:04:41.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26cbfff640 1 -- 172.21.15.57:0/3885123459 learned_addr learned my addr 172.21.15.57:0/3885123459 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:41.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26cb7fe640 1 --2- 172.21.15.57:0/3885123459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc160aa0 0x7f26cc0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26caffd640 1 -- 172.21.15.57:0/3885123459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc160aa0 msgr2=0x7f26cc0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26caffd640 1 --2- 172.21.15.57:0/3885123459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc160aa0 0x7f26cc0d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26caffd640 1 -- 172.21.15.57:0/3885123459 >> v1:172.21.15.57:6789/0 conn(0x7f26cc0ca2f0 legacy=0x7f26cc0d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26caffd640 1 -- 172.21.15.57:0/3885123459 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0cfa40 con 0x7f26cc0d0240 2023-11-24T08:04:41.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.583+0000 7f26ca7fc640 1 -- 172.21.15.57:0/3885123459 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335473832 0 0) 0x7f26cc0cf1a0 con 0x7f26cc0ca2f0 2023-11-24T08:04:41.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26caffd640 1 --2- 172.21.15.57:0/3885123459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc0d0240 0x7f26cc0d06a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097c0 tx=0x7f26c001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a3a5dc5d3135f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26ca7fc640 1 -- 172.21.15.57:0/3885123459 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00ab600 con 0x7f26cc0d0240 2023-11-24T08:04:41.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26ca7fc640 1 -- 172.21.15.57:0/3885123459 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00a7050 con 0x7f26cc0d0240 2023-11-24T08:04:41.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26ca7fc640 1 -- 172.21.15.57:0/3885123459 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00ab980 con 0x7f26cc0d0240 2023-11-24T08:04:41.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 -- 172.21.15.57:0/3885123459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc0d0240 msgr2=0x7f26cc0d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 --2- 172.21.15.57:0/3885123459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc0d0240 0x7f26cc0d06a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097c0 tx=0x7f26c001c3f0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 -- 172.21.15.57:0/3885123459 shutdown_connections 2023-11-24T08:04:41.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 --2- 172.21.15.57:0/3885123459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc0d0240 0x7f26cc0d06a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 --2- 172.21.15.57:0/3885123459 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc160aa0 0x7f26cc0d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 -- 172.21.15.57:0/3885123459 >> 172.21.15.57:0/3885123459 conn(0x7f26cc08cca0 msgr2=0x7f26cc09c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 -- 172.21.15.57:0/3885123459 shutdown_connections 2023-11-24T08:04:41.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.587+0000 7f26d089f640 1 -- 172.21.15.57:0/3885123459 wait complete. 2023-11-24T08:04:41.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 Processor -- start 2023-11-24T08:04:41.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 -- start start 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc0ca2f0 0x7f26cc156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26cc0d0240 0x7f26cc1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc160aa0 0x7f26cc153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc159610 con 0x7f26cc160aa0 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc1537a0 con 0x7f26cc0d0240 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc157c30 con 0x7f26cc0ca2f0 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc160aa0 0x7f26cc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc160aa0 0x7f26cc153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44008/0 (socket says 172.21.15.57:44008) 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 -- 172.21.15.57:0/4001694565 learned_addr learned my addr 172.21.15.57:0/4001694565 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26caffd640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26cc0d0240 0x7f26cc1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cb7fe640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc0ca2f0 0x7f26cc156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 -- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc0ca2f0 msgr2=0x7f26cc156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc0ca2f0 0x7f26cc156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 -- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26cc0d0240 msgr2=0x7f26cc1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26cc0d0240 0x7f26cc1590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 -- 172.21.15.57:0/4001694565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009420 con 0x7f26cc160aa0 2023-11-24T08:04:41.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26caffd640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26cc0d0240 0x7f26cc1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:41.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26cbfff640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc160aa0 0x7f26cc153260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f26c400c7b0 tx=0x7f26c400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26b3fff640 1 -- 172.21.15.57:0/4001694565 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400a640 con 0x7f26cc160aa0 2023-11-24T08:04:41.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26b3fff640 1 -- 172.21.15.57:0/4001694565 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c400a7c0 con 0x7f26cc160aa0 2023-11-24T08:04:41.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc157020 con 0x7f26cc160aa0 2023-11-24T08:04:41.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26b3fff640 1 -- 172.21.15.57:0/4001694565 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400ab70 con 0x7f26cc160aa0 2023-11-24T08:04:41.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.591+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc1575e0 con 0x7f26cc160aa0 2023-11-24T08:04:41.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.595+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc04e850 con 0x7f26cc160aa0 2023-11-24T08:04:41.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.595+0000 7f26b3fff640 1 -- 172.21.15.57:0/4001694565 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26c400acd0 con 0x7f26cc160aa0 2023-11-24T08:04:41.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.595+0000 7f26b3fff640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26b80664a0 0x7f26b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.595+0000 7f26b3fff640 1 -- 172.21.15.57:0/4001694565 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f26c4083610 con 0x7f26cc160aa0 2023-11-24T08:04:41.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.595+0000 7f26cb7fe640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26b80664a0 0x7f26b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.595+0000 7f26cb7fe640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26b80664a0 0x7f26b8068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009af0 tx=0x7f26bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.599+0000 7f26b3fff640 1 -- 172.21.15.57:0/4001694565 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26c4050aa0 con 0x7f26cc160aa0 2023-11-24T08:04:41.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.791+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f26cc15f430 con 0x7f26cc160aa0 2023-11-24T08:04:41.794 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-11-24T08:04:41.791+0000 7f305c7a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:04:41.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26b3fff640 1 -- 172.21.15.57:0/4001694565 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f26c40540c0 con 0x7f26cc160aa0 2023-11-24T08:04:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:04:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26b80664a0 msgr2=0x7f26b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26b80664a0 0x7f26b8068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009af0 tx=0x7f26bc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc160aa0 msgr2=0x7f26cc153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc160aa0 0x7f26cc153260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f26c400c7b0 tx=0x7f26c400cc70 comp rx=0 tx=0).stop 2023-11-24T08:04:41.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 shutdown_connections 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26b80664a0 0x7f26b8068960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26cc160aa0 0x7f26cc153260 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26cc0d0240 0x7f26cc1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 --2- 172.21.15.57:0/4001694565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26cc0ca2f0 0x7f26cc156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 >> 172.21.15.57:0/4001694565 conn(0x7f26cc08cca0 msgr2=0x7f26cc0d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 shutdown_connections 2023-11-24T08:04:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.795+0000 7f26d089f640 1 -- 172.21.15.57:0/4001694565 wait complete. 2023-11-24T08:04:41.813 INFO:tasks.ceph.mds.c.smithi057.stderr: -6776> 2023-11-24T08:04:03.196+0000 7f8f617d6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:04:41.820 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:04:41.863 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-11-24T08:04:41.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1f150e640 1 Processor -- start 2023-11-24T08:04:41.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1f150e640 1 -- start start 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1f150e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1ec13d0b0 0x7ff1ec0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1f150e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1ec15dd10 0x7ff1ec15e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1f150e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec071d30 con 0x7ff1ec070400 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1f150e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec072700 con 0x7ff1ec15dd10 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1f150e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec071700 con 0x7ff1ec13d0b0 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1eb7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff1ec070400 0x7ff1ec13d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60616/0 (socket says 172.21.15.57:60616) 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1eb7fe640 1 -- 172.21.15.57:0/997859358 learned_addr learned my addr 172.21.15.57:0/997859358 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:41.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.963+0000 7ff1e3fff640 1 --2- 172.21.15.57:0/997859358 >> v2:172.21.15.57:3300/0 conn(0x7ff1ec15dd10 0x7ff1ec15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1eaffd640 1 --2- 172.21.15.57:0/997859358 >> v2:172.21.15.132:3300/0 conn(0x7ff1ec13d0b0 0x7ff1ec0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1ea7fc640 1 -- 172.21.15.57:0/997859358 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143695784 0 0) 0x7ff1ec071d30 con 0x7ff1ec070400 2023-11-24T08:04:41.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1ea7fc640 1 -- 172.21.15.57:0/997859358 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d8003530 con 0x7ff1ec070400 2023-11-24T08:04:41.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1e3fff640 1 -- 172.21.15.57:0/997859358 >> v2:172.21.15.132:3300/0 conn(0x7ff1ec13d0b0 msgr2=0x7ff1ec0721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1e3fff640 1 --2- 172.21.15.57:0/997859358 >> v2:172.21.15.132:3300/0 conn(0x7ff1ec13d0b0 0x7ff1ec0721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1e3fff640 1 -- 172.21.15.57:0/997859358 >> v1:172.21.15.57:6789/0 conn(0x7ff1ec070400 legacy=0x7ff1ec13d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1e3fff640 1 -- 172.21.15.57:0/997859358 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec13d490 con 0x7ff1ec15dd10 2023-11-24T08:04:41.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1e3fff640 1 --2- 172.21.15.57:0/997859358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec15e170 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec06e700 tx=0x7ff1d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428eccc7d0129309 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1ea7fc640 1 -- 172.21.15.57:0/997859358 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4004230 con 0x7ff1ec15dd10 2023-11-24T08:04:41.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1ea7fc640 1 -- 172.21.15.57:0/997859358 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d40a7050 con 0x7ff1ec15dd10 2023-11-24T08:04:41.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.967+0000 7ff1ea7fc640 1 -- 172.21.15.57:0/997859358 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4003620 con 0x7ff1ec15dd10 2023-11-24T08:04:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- 172.21.15.57:0/997859358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 msgr2=0x7ff1ec15e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 --2- 172.21.15.57:0/997859358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec15e170 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec06e700 tx=0x7ff1d401c460 comp rx=0 tx=0).stop 2023-11-24T08:04:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- 172.21.15.57:0/997859358 shutdown_connections 2023-11-24T08:04:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 --2- 172.21.15.57:0/997859358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec15e170 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 --2- 172.21.15.57:0/997859358 >> v2:172.21.15.132:3300/0 conn(0x7ff1ec13d0b0 0x7ff1ec0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- 172.21.15.57:0/997859358 >> 172.21.15.57:0/997859358 conn(0x7ff1ec06daf0 msgr2=0x7ff1ec06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- 172.21.15.57:0/997859358 shutdown_connections 2023-11-24T08:04:41.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- 172.21.15.57:0/997859358 wait complete. 2023-11-24T08:04:41.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 Processor -- start 2023-11-24T08:04:41.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- start start 2023-11-24T08:04:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ec070400 0x7ff1ec0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ec13d0b0 0x7ff1ec15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec15d430 con 0x7ff1ec15dd10 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec1584c0 con 0x7ff1ec070400 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1f150e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0ccd60 con 0x7ff1ec13d0b0 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44042/0 (socket says 172.21.15.57:44042) 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 -- 172.21.15.57:0/896964745 learned_addr learned my addr 172.21.15.57:0/896964745 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eaffd640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ec070400 0x7ff1ec0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1e3fff640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ec13d0b0 0x7ff1ec15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 -- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ec13d0b0 msgr2=0x7ff1ec15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ec13d0b0 0x7ff1ec15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 -- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ec070400 msgr2=0x7ff1ec0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ec070400 0x7ff1ec0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.971+0000 7ff1eb7fe640 1 -- 172.21.15.57:0/896964745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4009420 con 0x7ff1ec15dd10 2023-11-24T08:04:41.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1eb7fe640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec146d40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400caa0 tx=0x7ff1e400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1e37fe640 1 -- 172.21.15.57:0/896964745 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400ac00 con 0x7ff1ec15dd10 2023-11-24T08:04:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1e37fe640 1 -- 172.21.15.57:0/896964745 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e400ad60 con 0x7ff1ec15dd10 2023-11-24T08:04:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1e37fe640 1 -- 172.21.15.57:0/896964745 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4012620 con 0x7ff1ec15dd10 2023-11-24T08:04:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec158760 con 0x7ff1ec15dd10 2023-11-24T08:04:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec158d20 con 0x7ff1ec15dd10 2023-11-24T08:04:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec04e850 con 0x7ff1ec15dd10 2023-11-24T08:04:41.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1e37fe640 1 -- 172.21.15.57:0/896964745 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1e4007070 con 0x7ff1ec15dd10 2023-11-24T08:04:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1e37fe640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff1cc066470 0x7ff1cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1e37fe640 1 -- 172.21.15.57:0/896964745 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ff1e4083fc0 con 0x7ff1ec15dd10 2023-11-24T08:04:41.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.975+0000 7ff1eaffd640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff1cc066470 0x7ff1cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.979+0000 7ff1eaffd640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff1cc066470 0x7ff1cc068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007a60 tx=0x7ff1dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:41.979+0000 7ff1e37fe640 1 -- 172.21.15.57:0/896964745 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1e40512f0 con 0x7ff1ec15dd10 2023-11-24T08:04:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.171+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1ec15a640 con 0x7ff1ec15dd10 2023-11-24T08:04:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.795+0000 7ff1e37fe640 1 -- 172.21.15.57:0/896964745 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff1e4017020 con 0x7ff1ec15dd10 2023-11-24T08:04:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff1cc066470 msgr2=0x7ff1cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff1cc066470 0x7ff1cc068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007a60 tx=0x7ff1dc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 msgr2=0x7ff1ec146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec146d40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400caa0 tx=0x7ff1e400cf60 comp rx=0 tx=0).stop 2023-11-24T08:04:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 shutdown_connections 2023-11-24T08:04:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff1cc066470 0x7ff1cc068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1ec15dd10 0x7ff1ec146d40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1ec13d0b0 0x7ff1ec15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 --2- 172.21.15.57:0/896964745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1ec070400 0x7ff1ec0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 >> 172.21.15.57:0/896964745 conn(0x7ff1ec06daf0 msgr2=0x7ff1ec06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 shutdown_connections 2023-11-24T08:04:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:42.799+0000 7ff1f150e640 1 -- 172.21.15.57:0/896964745 wait complete. 2023-11-24T08:04:42.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:04:43.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.015+0000 7f06b4432640 1 Processor -- start 2023-11-24T08:04:43.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.015+0000 7f06b4432640 1 -- start start 2023-11-24T08:04:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b4432640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b4432640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06ac070da0 0x7f06ac15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b4432640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac15a700 con 0x7f06ac0b36c0 2023-11-24T08:04:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b4432640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0b2430 con 0x7f06ac070da0 2023-11-24T08:04:43.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b4432640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0b2620 con 0x7f06ac15a320 2023-11-24T08:04:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b29cf640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06ac070da0 0x7f06ac15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b29cf640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06ac070da0 0x7f06ac15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44054/0 (socket says 172.21.15.57:44054) 2023-11-24T08:04:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b29cf640 1 -- 172.21.15.57:0/223104668 learned_addr learned my addr 172.21.15.57:0/223104668 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b21ce640 1 --2- 172.21.15.57:0/223104668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b29cf640 1 -- 172.21.15.57:0/223104668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 msgr2=0x7f06ac0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b29cf640 1 --2- 172.21.15.57:0/223104668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b29cf640 1 -- 172.21.15.57:0/223104668 >> v1:172.21.15.132:6789/0 conn(0x7f06ac0b36c0 legacy=0x7f06ac070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b29cf640 1 -- 172.21.15.57:0/223104668 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0b2900 con 0x7f06ac070da0 2023-11-24T08:04:43.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.019+0000 7f06b11cc640 1 -- 172.21.15.57:0/223104668 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488427349 0 0) 0x7f06ac15a700 con 0x7f06ac0b36c0 2023-11-24T08:04:43.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b29cf640 1 --2- 172.21.15.57:0/223104668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac15ddd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009e50 tx=0x7f06a401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29460db8c771651 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b11cc640 1 -- 172.21.15.57:0/223104668 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a58d0 con 0x7f06ac070da0 2023-11-24T08:04:43.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b11cc640 1 -- 172.21.15.57:0/223104668 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a40a5a30 con 0x7f06ac070da0 2023-11-24T08:04:43.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b11cc640 1 -- 172.21.15.57:0/223104668 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a5dc0 con 0x7f06ac070da0 2023-11-24T08:04:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- 172.21.15.57:0/223104668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 msgr2=0x7f06ac15ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 --2- 172.21.15.57:0/223104668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac15ddd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009e50 tx=0x7f06a401c9e0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- 172.21.15.57:0/223104668 shutdown_connections 2023-11-24T08:04:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 --2- 172.21.15.57:0/223104668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac15ddd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 --2- 172.21.15.57:0/223104668 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- 172.21.15.57:0/223104668 >> 172.21.15.57:0/223104668 conn(0x7f06ac0b0bf0 msgr2=0x7f06ac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- 172.21.15.57:0/223104668 shutdown_connections 2023-11-24T08:04:43.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- 172.21.15.57:0/223104668 wait complete. 2023-11-24T08:04:43.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 Processor -- start 2023-11-24T08:04:43.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- start start 2023-11-24T08:04:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06ac0b36c0 0x7f06ac156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1590b0 con 0x7f06ac070da0 2023-11-24T08:04:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac09cdf0 con 0x7f06ac0b36c0 2023-11-24T08:04:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.023+0000 7f06b4432640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac09cb10 con 0x7f06ac15a320 2023-11-24T08:04:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44068/0 (socket says 172.21.15.57:44068) 2023-11-24T08:04:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 -- 172.21.15.57:0/2080656995 learned_addr learned my addr 172.21.15.57:0/2080656995 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b29cf640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b19cd640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06ac0b36c0 0x7f06ac156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 -- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 msgr2=0x7f06ac147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 -- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06ac0b36c0 msgr2=0x7f06ac156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06ac0b36c0 0x7f06ac156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 -- 172.21.15.57:0/2080656995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4009b30 con 0x7f06ac070da0 2023-11-24T08:04:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b19cd640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06ac0b36c0 0x7f06ac156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:43.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b21ce640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac159540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f06a800e870 tx=0x7f06a800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06a2ffd640 1 -- 172.21.15.57:0/2080656995 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8009510 con 0x7f06ac070da0 2023-11-24T08:04:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06a2ffd640 1 -- 172.21.15.57:0/2080656995 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800eec0 con 0x7f06ac070da0 2023-11-24T08:04:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac158a60 con 0x7f06ac070da0 2023-11-24T08:04:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06a2ffd640 1 -- 172.21.15.57:0/2080656995 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800cb40 con 0x7f06ac070da0 2023-11-24T08:04:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac157040 con 0x7f06ac070da0 2023-11-24T08:04:43.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac06e7c0 con 0x7f06ac070da0 2023-11-24T08:04:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06a2ffd640 1 -- 172.21.15.57:0/2080656995 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06a800cca0 con 0x7f06ac070da0 2023-11-24T08:04:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.027+0000 7f06a2ffd640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f06900664a0 0x7f0690068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.031+0000 7f06a2ffd640 1 -- 172.21.15.57:0/2080656995 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f06a80840c0 con 0x7f06ac070da0 2023-11-24T08:04:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.031+0000 7f06b19cd640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f06900664a0 0x7f0690068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.031+0000 7f06b19cd640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f06900664a0 0x7f0690068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06ac164090 tx=0x7f069c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.031+0000 7f06a2ffd640 1 -- 172.21.15.57:0/2080656995 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06a80513d0 con 0x7f06ac070da0 2023-11-24T08:04:43.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.190+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f06ac067520 con 0x7f06ac070da0 2023-11-24T08:04:43.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06a2ffd640 1 -- 172.21.15.57:0/2080656995 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f06a80549f0 con 0x7f06ac070da0 2023-11-24T08:04:43.802 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f06900664a0 msgr2=0x7f0690068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f06900664a0 0x7f0690068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06ac164090 tx=0x7f069c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 msgr2=0x7f06ac159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac159540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f06a800e870 tx=0x7f06a800ec70 comp rx=0 tx=0).stop 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 shutdown_connections 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f06900664a0 0x7f0690068960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06ac15a320 0x7f06ac147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06ac0b36c0 0x7f06ac156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 --2- 172.21.15.57:0/2080656995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06ac070da0 0x7f06ac159540 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 >> 172.21.15.57:0/2080656995 conn(0x7f06ac0b0bf0 msgr2=0x7f06ac15c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 shutdown_connections 2023-11-24T08:04:43.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.798+0000 7f06b4432640 1 -- 172.21.15.57:0/2080656995 wait complete. 2023-11-24T08:04:43.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.974+0000 7ff2eecd6640 1 Processor -- start 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.974+0000 7ff2eecd6640 1 -- start start 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2eecd6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e815a320 0x7ff2e80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2eecd6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2e8070da0 0x7ff2e815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2eecd6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e815a700 con 0x7ff2e80b36c0 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2eecd6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80b2430 con 0x7ff2e8070da0 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2eecd6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80b2620 con 0x7ff2e815a320 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2ed273640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2e8070da0 0x7ff2e815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2e7fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff2e80b36c0 0x7ff2e8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60630/0 (socket says 172.21.15.57:60630) 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2e7fff640 1 -- 172.21.15.57:0/549537822 learned_addr learned my addr 172.21.15.57:0/549537822 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2eca72640 1 --2- 172.21.15.57:0/549537822 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e815a320 0x7ff2e80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2ed273640 1 -- 172.21.15.57:0/549537822 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e815a320 msgr2=0x7ff2e80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2ed273640 1 --2- 172.21.15.57:0/549537822 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e815a320 0x7ff2e80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2ed273640 1 -- 172.21.15.57:0/549537822 >> v1:172.21.15.57:6789/0 conn(0x7ff2e80b36c0 legacy=0x7ff2e8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2ed273640 1 -- 172.21.15.57:0/549537822 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80b2900 con 0x7ff2e8070da0 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2e77fe640 1 -- 172.21.15.57:0/549537822 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693746742 0 0) 0x7ff2e815a700 con 0x7ff2e80b36c0 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.978+0000 7ff2ed273640 1 --2- 172.21.15.57:0/549537822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e815ddd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009d90 tx=0x7ff2e001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716b73ccc5531cd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2e77fe640 1 -- 172.21.15.57:0/549537822 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00a5a00 con 0x7ff2e8070da0 2023-11-24T08:04:43.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2e77fe640 1 -- 172.21.15.57:0/549537822 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00a5b60 con 0x7ff2e8070da0 2023-11-24T08:04:43.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2e77fe640 1 -- 172.21.15.57:0/549537822 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00ad440 con 0x7ff2e8070da0 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- 172.21.15.57:0/549537822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 msgr2=0x7ff2e815ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/549537822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e815ddd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009d90 tx=0x7ff2e001c920 comp rx=0 tx=0).stop 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- 172.21.15.57:0/549537822 shutdown_connections 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/549537822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e815ddd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/549537822 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e815a320 0x7ff2e80b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- 172.21.15.57:0/549537822 >> 172.21.15.57:0/549537822 conn(0x7ff2e80b0bf0 msgr2=0x7ff2e80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- 172.21.15.57:0/549537822 shutdown_connections 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- 172.21.15.57:0/549537822 wait complete. 2023-11-24T08:04:43.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 Processor -- start 2023-11-24T08:04:43.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- start start 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e809a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e80b36c0 0x7ff2e80999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e815a320 0x7ff2e8153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8156fb0 con 0x7ff2e8070da0 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8157290 con 0x7ff2e815a320 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.982+0000 7ff2eecd6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8157570 con 0x7ff2e80b36c0 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e809a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e809a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44080/0 (socket says 172.21.15.57:44080) 2023-11-24T08:04:43.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 -- 172.21.15.57:0/3734491839 learned_addr learned my addr 172.21.15.57:0/3734491839 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2e7fff640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e80b36c0 0x7ff2e80999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2ed273640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e815a320 0x7ff2e8153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 -- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e80b36c0 msgr2=0x7ff2e80999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e80b36c0 0x7ff2e80999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 -- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e815a320 msgr2=0x7ff2e8153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e815a320 0x7ff2e8153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 -- 172.21.15.57:0/3734491839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0009a70 con 0x7ff2e8070da0 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2ed273640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e815a320 0x7ff2e8153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2e7fff640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e80b36c0 0x7ff2e80999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eca72640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e809a700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00d5f0 tx=0x7ff2dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2e57fa640 1 -- 172.21.15.57:0/3734491839 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0125f0 con 0x7ff2e8070da0 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2e57fa640 1 -- 172.21.15.57:0/3734491839 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc012750 con 0x7ff2e8070da0 2023-11-24T08:04:43.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e8158bf0 con 0x7ff2e8070da0 2023-11-24T08:04:43.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2e57fa640 1 -- 172.21.15.57:0/3734491839 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc012ae0 con 0x7ff2e8070da0 2023-11-24T08:04:43.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e8153cb0 con 0x7ff2e8070da0 2023-11-24T08:04:43.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e8067520 con 0x7ff2e8070da0 2023-11-24T08:04:43.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.986+0000 7ff2e57fa640 1 -- 172.21.15.57:0/3734491839 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2dc012c40 con 0x7ff2e8070da0 2023-11-24T08:04:43.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.990+0000 7ff2e57fa640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff2cc066470 0x7ff2cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.990+0000 7ff2e57fa640 1 -- 172.21.15.57:0/3734491839 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5473+0+0 (secure 0 0 0) 0x7ff2dc084240 con 0x7ff2e8070da0 2023-11-24T08:04:43.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.990+0000 7ff2e7fff640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff2cc066470 0x7ff2cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.990+0000 7ff2e7fff640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff2cc066470 0x7ff2cc068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:43.994+0000 7ff2e57fa640 1 -- 172.21.15.57:0/3734491839 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2dc0517a0 con 0x7ff2e8070da0 2023-11-24T08:04:44.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.170+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff2e815d820 con 0x7ff2e8070da0 2023-11-24T08:04:44.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.798+0000 7ff2e57fa640 1 -- 172.21.15.57:0/3734491839 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff2dc007380 con 0x7ff2e8070da0 2023-11-24T08:04:44.805 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-11-24T08:04:44.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff2cc066470 msgr2=0x7ff2cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff2cc066470 0x7ff2cc068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4007fd0 tx=0x7ff2d4007c20 comp rx=0 tx=0).stop 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 msgr2=0x7ff2e809a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e809a700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00d5f0 tx=0x7ff2dc00dab0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 shutdown_connections 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff2cc066470 0x7ff2cc068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e815a320 0x7ff2e8153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e80b36c0 0x7ff2e80999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 --2- 172.21.15.57:0/3734491839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2e8070da0 0x7ff2e809a700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 >> 172.21.15.57:0/3734491839 conn(0x7ff2e80b0bf0 msgr2=0x7ff2e80b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 shutdown_connections 2023-11-24T08:04:44.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:44.802+0000 7ff2eecd6640 1 -- 172.21.15.57:0/3734491839 wait complete. 2023-11-24T08:04:44.838 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:04:44.838 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:04:44.838 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:04:44.838 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:44.839 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:04:44.839 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:04:44.839 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:04:44.839 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:44.839 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:04:44.839 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:04:44.839 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:04:44.840 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:44.840 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:04:44.840 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:04:44.840 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:04:44.840 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:44.858 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:04:44.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:04:44.859 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:04:44.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:04:44.860 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:04:44.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:04:44.861 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:04:44.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:04:44.909 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:04:44.910 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:44.911 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:04:44.911 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:04:44.911 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:04:44.912 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:44.912 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:44.912 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:44.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:04:44.996 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-11-24T08:04:44.996 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-11-24T08:04:44.999 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-11-24T08:04:45.001 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-11-24T08:04:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3b1df640 1 Processor -- start 2023-11-24T08:04:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3b1df640 1 -- start start 2023-11-24T08:04:45.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3b1df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3b1df640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6d340d0150 0x7f6d3406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3b1df640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d340cee60 con 0x7f6d340d05d0 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3b1df640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d340cf0b0 con 0x7f6d340d0150 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3b1df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340cf390 con 0x7f6d34147020 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3977c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6d340d05d0 0x7f6d340b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60654/0 (socket says 172.21.15.57:60654) 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d3977c640 1 -- 172.21.15.57:0/2666592392 learned_addr learned my addr 172.21.15.57:0/2666592392 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.058+0000 7f6d33fff640 1 --2- 172.21.15.57:0/2666592392 >> v2:172.21.15.57:3300/0 conn(0x7f6d340d0150 0x7f6d3406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d38f7b640 1 --2- 172.21.15.57:0/2666592392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d38f7b640 1 -- 172.21.15.57:0/2666592392 >> v2:172.21.15.57:3300/0 conn(0x7f6d340d0150 msgr2=0x7f6d3406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:45.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d38f7b640 1 --2- 172.21.15.57:0/2666592392 >> v2:172.21.15.57:3300/0 conn(0x7f6d340d0150 0x7f6d3406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d38f7b640 1 -- 172.21.15.57:0/2666592392 >> v1:172.21.15.57:6789/0 conn(0x7f6d340d05d0 legacy=0x7f6d340b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d38f7b640 1 -- 172.21.15.57:0/2666592392 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d340cf670 con 0x7f6d34147020 2023-11-24T08:04:45.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d337fe640 1 -- 172.21.15.57:0/2666592392 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86702250 0 0) 0x7f6d340cee60 con 0x7f6d340d05d0 2023-11-24T08:04:45.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d38f7b640 1 --2- 172.21.15.57:0/2666592392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340d1a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d280097c0 tx=0x7f6d2801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=293cf7361e20c535 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d337fe640 1 -- 172.21.15.57:0/2666592392 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280ab650 con 0x7f6d34147020 2023-11-24T08:04:45.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d337fe640 1 -- 172.21.15.57:0/2666592392 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280ab7b0 con 0x7f6d34147020 2023-11-24T08:04:45.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.062+0000 7f6d337fe640 1 -- 172.21.15.57:0/2666592392 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280abb40 con 0x7f6d34147020 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2666592392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 msgr2=0x7f6d340d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2666592392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340d1a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d280097c0 tx=0x7f6d2801c450 comp rx=0 tx=0).stop 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2666592392 shutdown_connections 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2666592392 >> v2:172.21.15.57:3300/0 conn(0x7f6d340d0150 0x7f6d3406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2666592392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340d1a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2666592392 >> 172.21.15.57:0/2666592392 conn(0x7f6d34060fd0 msgr2=0x7f6d340613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2666592392 shutdown_connections 2023-11-24T08:04:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2666592392 wait complete. 2023-11-24T08:04:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 Processor -- start 2023-11-24T08:04:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- start start 2023-11-24T08:04:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d340d0150 0x7f6d3415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d340d05d0 0x7f6d3413bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340b4630 con 0x7f6d340d0150 2023-11-24T08:04:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340b4050 con 0x7f6d340d05d0 2023-11-24T08:04:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3b1df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3413c290 con 0x7f6d34147020 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d38f7b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d340d0150 0x7f6d3415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d38f7b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d340d0150 0x7f6d3415ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44114/0 (socket says 172.21.15.57:44114) 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d38f7b640 1 -- 172.21.15.57:0/2691158599 learned_addr learned my addr 172.21.15.57:0/2691158599 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d3977c640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.066+0000 7f6d33fff640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d340d05d0 0x7f6d3413bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d38f7b640 1 -- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 msgr2=0x7f6d340ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d38f7b640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d38f7b640 1 -- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d340d05d0 msgr2=0x7f6d3413bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d38f7b640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d340d05d0 0x7f6d3413bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d38f7b640 1 -- 172.21.15.57:0/2691158599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28009420 con 0x7f6d340d0150 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d33fff640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d340d05d0 0x7f6d3413bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d38f7b640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d340d0150 0x7f6d3415ce60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6d2801a080 tx=0x7f6d2801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d317fa640 1 -- 172.21.15.57:0/2691158599 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280b5810 con 0x7f6d340d0150 2023-11-24T08:04:45.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d317fa640 1 -- 172.21.15.57:0/2691158599 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280b5990 con 0x7f6d340d0150 2023-11-24T08:04:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d317fa640 1 -- 172.21.15.57:0/2691158599 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280b5d40 con 0x7f6d340d0150 2023-11-24T08:04:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d340ca770 con 0x7f6d340d0150 2023-11-24T08:04:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d340b42c0 con 0x7f6d340d0150 2023-11-24T08:04:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3406fea0 con 0x7f6d340d0150 2023-11-24T08:04:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.070+0000 7f6d317fa640 1 -- 172.21.15.57:0/2691158599 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d280b4390 con 0x7f6d340d0150 2023-11-24T08:04:45.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.074+0000 7f6d317fa640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6d18066470 0x7f6d18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.074+0000 7f6d317fa640 1 -- 172.21.15.57:0/2691158599 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d2811e2d0 con 0x7f6d340d0150 2023-11-24T08:04:45.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.074+0000 7f6d33fff640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6d18066470 0x7f6d18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.074+0000 7f6d33fff640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6d18066470 0x7f6d18068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d341464d0 tx=0x7f6d20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.078+0000 7f6d317fa640 1 -- 172.21.15.57:0/2691158599 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d280ebb80 con 0x7f6d340d0150 2023-11-24T08:04:45.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:45.254+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6d3404e930 con 0x7f6d340d0150 2023-11-24T08:04:46.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d317fa640 1 -- 172.21.15.57:0/2691158599 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6d280ab610 con 0x7f6d340d0150 2023-11-24T08:04:46.594 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blocklist entries 2023-11-24T08:04:46.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6d18066470 msgr2=0x7f6d18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6d18066470 0x7f6d18068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d341464d0 tx=0x7f6d20008040 comp rx=0 tx=0).stop 2023-11-24T08:04:46.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d340d0150 msgr2=0x7f6d3415ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d340d0150 0x7f6d3415ce60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6d2801a080 tx=0x7f6d2801ac90 comp rx=0 tx=0).stop 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 shutdown_connections 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6d18066470 0x7f6d18068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d34147020 0x7f6d340ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d340d05d0 0x7f6d3413bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 --2- 172.21.15.57:0/2691158599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d340d0150 0x7f6d3415ce60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 >> 172.21.15.57:0/2691158599 conn(0x7f6d34060fd0 msgr2=0x7f6d340c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 shutdown_connections 2023-11-24T08:04:46.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.590+0000 7f6d3b1df640 1 -- 172.21.15.57:0/2691158599 wait complete. 2023-11-24T08:04:46.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:04:46.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbdcabb640 1 Processor -- start 2023-11-24T08:04:46.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbdcabb640 1 -- start start 2023-11-24T08:04:46.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbdcabb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcbd8144030 0x7fcbd806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbdcabb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd809cc20 0x7fcbd806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbdcabb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd806d8b0 con 0x7fcbd806e280 2023-11-24T08:04:46.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbdcabb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd8145020 con 0x7fcbd8144030 2023-11-24T08:04:46.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbdcabb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd809d0a0 con 0x7fcbd809cc20 2023-11-24T08:04:46.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbcffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd809cc20 0x7fcbd806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcbd8144030 0x7fcbd806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcbd806e280 0x7fcbd80709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:57568/0 (socket says 172.21.15.57:57568) 2023-11-24T08:04:46.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd6d9d640 1 -- 172.21.15.57:0/3169687583 learned_addr learned my addr 172.21.15.57:0/3169687583 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:46.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd5d9b640 1 -- 172.21.15.57:0/3169687583 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705884449 0 0) 0x7fcbd806d8b0 con 0x7fcbd806e280 2023-11-24T08:04:46.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd5d9b640 1 -- 172.21.15.57:0/3169687583 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc4003530 con 0x7fcbd806e280 2023-11-24T08:04:46.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd659c640 1 -- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd809cc20 msgr2=0x7fcbd806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd659c640 1 --2- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd809cc20 0x7fcbd806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd659c640 1 -- 172.21.15.57:0/3169687583 >> v1:172.21.15.132:6789/0 conn(0x7fcbd806e280 legacy=0x7fcbd80709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbd659c640 1 -- 172.21.15.57:0/3169687583 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd806cca0 con 0x7fcbd8144030 2023-11-24T08:04:46.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.766+0000 7fcbcffff640 1 --2- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd809cc20 0x7fcbd806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:46.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbd659c640 1 --2- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 0x7fcbd806c650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80097c0 tx=0x7fcbc801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e175856a4f4b06 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbd5d9b640 1 -- 172.21.15.57:0/3169687583 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80ab650 con 0x7fcbd8144030 2023-11-24T08:04:46.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbd5d9b640 1 -- 172.21.15.57:0/3169687583 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc80ab7b0 con 0x7fcbd8144030 2023-11-24T08:04:46.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbd5d9b640 1 -- 172.21.15.57:0/3169687583 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80abb40 con 0x7fcbd8144030 2023-11-24T08:04:46.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 -- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 msgr2=0x7fcbd806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 0x7fcbd806c650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80097c0 tx=0x7fcbc801c450 comp rx=0 tx=0).stop 2023-11-24T08:04:46.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 -- 172.21.15.57:0/3169687583 shutdown_connections 2023-11-24T08:04:46.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd809cc20 0x7fcbd806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/3169687583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 0x7fcbd806c650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 -- 172.21.15.57:0/3169687583 >> 172.21.15.57:0/3169687583 conn(0x7fcbd80b0bf0 msgr2=0x7fcbd80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 -- 172.21.15.57:0/3169687583 shutdown_connections 2023-11-24T08:04:46.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.770+0000 7fcbdcabb640 1 -- 172.21.15.57:0/3169687583 wait complete. 2023-11-24T08:04:46.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 Processor -- start 2023-11-24T08:04:46.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 -- start start 2023-11-24T08:04:46.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd806e280 0x7fcbd81f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbd809cc20 0x7fcbd80aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 0x7fcbd80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd81f9330 con 0x7fcbd809cc20 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd81f9610 con 0x7fcbd8144030 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd81f98f0 con 0x7fcbd806e280 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbd809cc20 0x7fcbd80aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbd809cc20 0x7fcbd80aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43860/0 (socket says 172.21.15.57:43860) 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 -- 172.21.15.57:0/4030137889 learned_addr learned my addr 172.21.15.57:0/4030137889 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbd659c640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd806e280 0x7fcbd81f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbd6d9d640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 0x7fcbd80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 -- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd806e280 msgr2=0x7fcbd81f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd806e280 0x7fcbd81f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 -- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 msgr2=0x7fcbd80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 0x7fcbd80b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 -- 172.21.15.57:0/4030137889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0009420 con 0x7fcbd809cc20 2023-11-24T08:04:46.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbcffff640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbd809cc20 0x7fcbd80aff80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000e980 tx=0x7fcbc000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbceffd640 1 -- 172.21.15.57:0/4030137889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000ca00 con 0x7fcbd809cc20 2023-11-24T08:04:46.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbceffd640 1 -- 172.21.15.57:0/4030137889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc000cb60 con 0x7fcbd809cc20 2023-11-24T08:04:46.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc8009420 con 0x7fcbd809cc20 2023-11-24T08:04:46.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbceffd640 1 -- 172.21.15.57:0/4030137889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0013470 con 0x7fcbd809cc20 2023-11-24T08:04:46.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.774+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd81f9eb0 con 0x7fcbd809cc20 2023-11-24T08:04:46.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.778+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd8067520 con 0x7fcbd809cc20 2023-11-24T08:04:46.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.778+0000 7fcbceffd640 1 -- 172.21.15.57:0/4030137889 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbc00135d0 con 0x7fcbd809cc20 2023-11-24T08:04:46.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.778+0000 7fcbceffd640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcbb80664a0 0x7fcbb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.778+0000 7fcbceffd640 1 -- 172.21.15.57:0/4030137889 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcbc0083d10 con 0x7fcbd809cc20 2023-11-24T08:04:46.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.778+0000 7fcbd659c640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcbb80664a0 0x7fcbb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.782+0000 7fcbd659c640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcbb80664a0 0x7fcbb8068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80af000 tx=0x7fcbc80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.782+0000 7fcbceffd640 1 -- 172.21.15.57:0/4030137889 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbc0089020 con 0x7fcbd809cc20 2023-11-24T08:04:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.994+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcbd813c2a0 con 0x7fcbd809cc20 2023-11-24T08:04:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.994+0000 7fcbceffd640 1 -- 172.21.15.57:0/4030137889 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v7) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fcbc0051500 con 0x7fcbd809cc20 2023-11-24T08:04:46.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:46.999 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:04:46.999 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2023-11-24T08:04:46.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBli5Y5IBAAnvP0ucgaWCMVrPGzxD66SA==", 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlIvACLRAA3GBFpw4471E7VMC1v83uKw==", 2023-11-24T08:04:47.000 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBltsHpJxAA4cXeOlSioW+qpB6iET0JYA==", 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.001 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.d", 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlMAZmNBAAJ764yAUaJrB0C/NMgccnIQ==", 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:04:47.002 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCxWGBlL0EOIRAAGl5XgP5YNoKHFXcAZ7x8Dw==", 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2023-11-24T08:04:47.003 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC0WGBllgHlKBAAs4PpDKC95e8EbMikLNYamg==", 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC3WGBl0BHZMBAAO9QEi1GOOfCUoxneHsmMtQ==", 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.004 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC6WGBl7854ORAAjYNCXFSYc+rSJHmK5WNuBQ==", 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.005 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDBWGBlOWLlCBAAn/3woUG2ZUM65EvKQ/plBg==", 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.006 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDEWGBlbNduDxAABASB690ioHFg1QYgfbclaA==", 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDHWGBlpKlsFRAAIIo9fYbozro/Zf40wo7pqg==", 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.007 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDKWGBlVZj5GxAAkCx/Ev5UjrAu+8MKzlZrWw==", 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg==", 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2023-11-24T08:04:47.009 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBl+4YCBxAAKfb7t9BjuhCDnWDrdkswdA==", 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.2", 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBlzP4XAxAAgbiVgyWCJo76uqBghI1FOw==", 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.010 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.3", 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBlm45BDRAAv46vHB8X5TFKK0XqdxA1tQ==", 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:04:47.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlCwEjAxAAPy/bfz67KrMkV+ORpi2LWA==", 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.012 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mds", 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDVWGBllEFUIhAAw4xGca44cZOd9r0JKhobLQ==", 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDVWGBlNU1UIhAAiCWsokbow887+PEZy40r9Q==", 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-osd", 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDVWGBl/1VUIhAAXEvSTz85D70MuIGesofT4Q==", 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDVWGBl815UIhAA0DEFaW/33xuY5wEUIH7qBw==", 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDVWGBlo2hUIhAAm8pp72JX2xmOStb0AZOLPg==", 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDVWGBl1HRUIhAAN+YyU4brkyhvlQcEy5sz3A==", 2023-11-24T08:04:47.015 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.016 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T08:04:47.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.016 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2023-11-24T08:04:47.016 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlE12EGxAAnyGvPcM8AfeaVmxsl+MaBg==", 2023-11-24T08:04:47.016 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlAy9zFxAA6XZfIsLKTOoOTouFh2tD9w==", 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:04:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-11-24T08:04:47.018 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:04:47.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:47.018 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-11-24T08:04:47.018 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcbb80664a0 msgr2=0x7fcbb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcbb80664a0 0x7fcbb8068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80af000 tx=0x7fcbc80a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbd809cc20 msgr2=0x7fcbd80aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbd809cc20 0x7fcbd80aff80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000e980 tx=0x7fcbc000ee40 comp rx=0 tx=0).stop 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 shutdown_connections 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcbb80664a0 0x7fcbb8068960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd8144030 0x7fcbd80b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbd809cc20 0x7fcbd80aff80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 --2- 172.21.15.57:0/4030137889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbd806e280 0x7fcbd81f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 >> 172.21.15.57:0/4030137889 conn(0x7fcbd80b0bf0 msgr2=0x7fcbd80b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 shutdown_connections 2023-11-24T08:04:47.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:46.998+0000 7fcbdcabb640 1 -- 172.21.15.57:0/4030137889 wait complete. 2023-11-24T08:04:47.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T08:04:47.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e2a91d640 1 Processor -- start 2023-11-24T08:04:47.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e2a91d640 1 -- start start 2023-11-24T08:04:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e2a91d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e240725f0 0x7f7e2406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e2a91d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240ca000 0x7f7e240717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e2a91d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2406cb70 con 0x7f7e240cba80 2023-11-24T08:04:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e2a91d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e240ca770 con 0x7f7e240725f0 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e2a91d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240729d0 con 0x7f7e240ca000 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e23fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e240725f0 0x7f7e2406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e237fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7e240cba80 0x7f7e240c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60798/0 (socket says 172.21.15.57:60798) 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e23fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e240725f0 0x7f7e2406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43874/0 (socket says 172.21.15.57:43874) 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e237fe640 1 -- 172.21.15.57:0/1705200633 learned_addr learned my addr 172.21.15.57:0/1705200633 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e28eba640 1 --2- 172.21.15.57:0/1705200633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240ca000 0x7f7e240717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e23fff640 1 -- 172.21.15.57:0/1705200633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240ca000 msgr2=0x7f7e240717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e23fff640 1 --2- 172.21.15.57:0/1705200633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240ca000 0x7f7e240717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e23fff640 1 -- 172.21.15.57:0/1705200633 >> v1:172.21.15.57:6789/0 conn(0x7f7e240cba80 legacy=0x7f7e240c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e22ffd640 1 -- 172.21.15.57:0/1705200633 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60638452 0 0) 0x7f7e2406cb70 con 0x7f7e240cba80 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e23fff640 1 -- 172.21.15.57:0/1705200633 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2406ce10 con 0x7f7e240725f0 2023-11-24T08:04:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.162+0000 7f7e28eba640 1 --2- 172.21.15.57:0/1705200633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240ca000 0x7f7e240717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:47.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e23fff640 1 --2- 172.21.15.57:0/1705200633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240725f0 0x7f7e2406c630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400ba90 tx=0x7f7e14021340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0ca338272e7ee7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e22ffd640 1 -- 172.21.15.57:0/1705200633 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140b1600 con 0x7f7e240725f0 2023-11-24T08:04:47.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e22ffd640 1 -- 172.21.15.57:0/1705200633 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e140ad050 con 0x7f7e240725f0 2023-11-24T08:04:47.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e22ffd640 1 -- 172.21.15.57:0/1705200633 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140b1980 con 0x7f7e240725f0 2023-11-24T08:04:47.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 -- 172.21.15.57:0/1705200633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240725f0 msgr2=0x7f7e2406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/1705200633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240725f0 0x7f7e2406c630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400ba90 tx=0x7f7e14021340 comp rx=0 tx=0).stop 2023-11-24T08:04:47.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 -- 172.21.15.57:0/1705200633 shutdown_connections 2023-11-24T08:04:47.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/1705200633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240ca000 0x7f7e240717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/1705200633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240725f0 0x7f7e2406c630 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 -- 172.21.15.57:0/1705200633 >> 172.21.15.57:0/1705200633 conn(0x7f7e240b0bf0 msgr2=0x7f7e240b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 -- 172.21.15.57:0/1705200633 shutdown_connections 2023-11-24T08:04:47.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.166+0000 7f7e2a91d640 1 -- 172.21.15.57:0/1705200633 wait complete. 2023-11-24T08:04:47.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 Processor -- start 2023-11-24T08:04:47.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 -- start start 2023-11-24T08:04:47.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240725f0 0x7f7e241f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240ca000 0x7f7e240c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e240cba80 0x7f7e241f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e241f38e0 con 0x7f7e240ca000 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240c4f10 con 0x7f7e240cba80 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e241f4380 con 0x7f7e240725f0 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240ca000 0x7f7e240c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240ca000 0x7f7e240c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43880/0 (socket says 172.21.15.57:43880) 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 -- 172.21.15.57:0/2467644227 learned_addr learned my addr 172.21.15.57:0/2467644227 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e28eba640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e240cba80 0x7f7e241f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e23fff640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240725f0 0x7f7e241f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 -- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240725f0 msgr2=0x7f7e241f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240725f0 0x7f7e241f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 -- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e240cba80 msgr2=0x7f7e241f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e240cba80 0x7f7e241f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 -- 172.21.15.57:0/2467644227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1400b6c0 con 0x7f7e240ca000 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e28eba640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e240cba80 0x7f7e241f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e237fe640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240ca000 0x7f7e240c49d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c4b0 tx=0x7f7e1800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e20ff9640 1 -- 172.21.15.57:0/2467644227 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180074e0 con 0x7f7e240ca000 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e20ff9640 1 -- 172.21.15.57:0/2467644227 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18007660 con 0x7f7e240ca000 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e241f6750 con 0x7f7e240ca000 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e20ff9640 1 -- 172.21.15.57:0/2467644227 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18004a30 con 0x7f7e240ca000 2023-11-24T08:04:47.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e241f3dc0 con 0x7f7e240ca000 2023-11-24T08:04:47.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.170+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2409d250 con 0x7f7e240ca000 2023-11-24T08:04:47.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.174+0000 7f7e20ff9640 1 -- 172.21.15.57:0/2467644227 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e18004b90 con 0x7f7e240ca000 2023-11-24T08:04:47.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.174+0000 7f7e20ff9640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7e10066470 0x7f7e10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.174+0000 7f7e20ff9640 1 -- 172.21.15.57:0/2467644227 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e18082ff0 con 0x7f7e240ca000 2023-11-24T08:04:47.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.174+0000 7f7e23fff640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7e10066470 0x7f7e10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.174+0000 7f7e23fff640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7e10066470 0x7f7e10068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b3000 tx=0x7f7e14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.178+0000 7f7e20ff9640 1 -- 172.21.15.57:0/2467644227 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e18054240 con 0x7f7e240ca000 2023-11-24T08:04:47.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.386+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7e2404e930 con 0x7f7e240ca000 2023-11-24T08:04:47.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.390+0000 7f7e20ff9640 1 -- 172.21.15.57:0/2467644227 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7e18018020 con 0x7f7e240ca000 2023-11-24T08:04:47.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7e10066470 msgr2=0x7f7e10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7e10066470 0x7f7e10068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b3000 tx=0x7f7e14008040 comp rx=0 tx=0).stop 2023-11-24T08:04:47.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240ca000 msgr2=0x7f7e240c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240ca000 0x7f7e240c49d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c4b0 tx=0x7f7e1800c970 comp rx=0 tx=0).stop 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 shutdown_connections 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7e10066470 0x7f7e10068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e240cba80 0x7f7e241f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e240ca000 0x7f7e240c49d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 --2- 172.21.15.57:0/2467644227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7e240725f0 0x7f7e241f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 >> 172.21.15.57:0/2467644227 conn(0x7f7e240b0bf0 msgr2=0x7f7e241592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 shutdown_connections 2023-11-24T08:04:47.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.394+0000 7f7e2a91d640 1 -- 172.21.15.57:0/2467644227 wait complete. 2023-11-24T08:04:47.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T08:04:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c40c32640 1 Processor -- start 2023-11-24T08:04:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c40c32640 1 -- start start 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c40c32640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c3c15d600 0x7f3c3c161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c40c32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3c3c0cc0a0 0x7f3c3c0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c40c32640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c0c99f0 con 0x7f3c3c15e510 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c40c32640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c161120 con 0x7f3c3c15d600 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c40c32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c161400 con 0x7f3c3c0cc0a0 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c3c15d600 0x7f3c3c161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c3c15d600 0x7f3c3c161c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43896/0 (socket says 172.21.15.57:43896) 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3a59c640 1 -- 172.21.15.57:0/1609598872 learned_addr learned my addr 172.21.15.57:0/1609598872 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3ad9d640 1 --2- 172.21.15.57:0/1609598872 >> v2:172.21.15.132:3300/0 conn(0x7f3c3c0cc0a0 0x7f3c3c0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3a59c640 1 -- 172.21.15.57:0/1609598872 >> v2:172.21.15.132:3300/0 conn(0x7f3c3c0cc0a0 msgr2=0x7f3c3c0abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3a59c640 1 --2- 172.21.15.57:0/1609598872 >> v2:172.21.15.132:3300/0 conn(0x7f3c3c0cc0a0 0x7f3c3c0abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3a59c640 1 -- 172.21.15.57:0/1609598872 >> v1:172.21.15.132:6789/0 conn(0x7f3c3c15e510 legacy=0x7f3c3c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.558+0000 7f3c3a59c640 1 -- 172.21.15.57:0/1609598872 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c1616e0 con 0x7f3c3c15d600 2023-11-24T08:04:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c3a59c640 1 --2- 172.21.15.57:0/1609598872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15d600 0x7f3c3c161c00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c09ced0 tx=0x7f3c2c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed337148e3dadf8c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c3959a640 1 -- 172.21.15.57:0/1609598872 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0ac600 con 0x7f3c3c15d600 2023-11-24T08:04:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c3959a640 1 -- 172.21.15.57:0/1609598872 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0a8050 con 0x7f3c3c15d600 2023-11-24T08:04:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c3959a640 1 -- 172.21.15.57:0/1609598872 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0ac980 con 0x7f3c3c15d600 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 -- 172.21.15.57:0/1609598872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15d600 msgr2=0x7f3c3c161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 --2- 172.21.15.57:0/1609598872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15d600 0x7f3c3c161c00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c09ced0 tx=0x7f3c2c01c470 comp rx=0 tx=0).stop 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 -- 172.21.15.57:0/1609598872 shutdown_connections 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 --2- 172.21.15.57:0/1609598872 >> v2:172.21.15.132:3300/0 conn(0x7f3c3c0cc0a0 0x7f3c3c0abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 --2- 172.21.15.57:0/1609598872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15d600 0x7f3c3c161c00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 -- 172.21.15.57:0/1609598872 >> 172.21.15.57:0/1609598872 conn(0x7f3c3c0b0bf0 msgr2=0x7f3c3c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 -- 172.21.15.57:0/1609598872 shutdown_connections 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.562+0000 7f3c40c32640 1 -- 172.21.15.57:0/1609598872 wait complete. 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 Processor -- start 2023-11-24T08:04:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 -- start start 2023-11-24T08:04:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c3c0cc0a0 0x7f3c3c0999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c3c15d600 0x7f3c3c15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15e510 0x7f3c3c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c09c1e0 con 0x7f3c3c15e510 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c099f20 con 0x7f3c3c15d600 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c09b8b0 con 0x7f3c3c0cc0a0 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15e510 0x7f3c3c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15e510 0x7f3c3c15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43898/0 (socket says 172.21.15.57:43898) 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 -- 172.21.15.57:0/4001186102 learned_addr learned my addr 172.21.15.57:0/4001186102 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3a59c640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c3c0cc0a0 0x7f3c3c0999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c39d9b640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c3c15d600 0x7f3c3c15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 -- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c3c0cc0a0 msgr2=0x7f3c3c0999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c3c0cc0a0 0x7f3c3c0999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 -- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c3c15d600 msgr2=0x7f3c3c15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c3c15d600 0x7f3c3c15bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 -- 172.21.15.57:0/4001186102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c0094d0 con 0x7f3c3c15e510 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c3ad9d640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15e510 0x7f3c3c15c450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c34007e60 tx=0x7f3c3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c2affd640 1 -- 172.21.15.57:0/4001186102 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34014420 con 0x7f3c3c15e510 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c2affd640 1 -- 172.21.15.57:0/4001186102 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c340145a0 con 0x7f3c3c15e510 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c2affd640 1 -- 172.21.15.57:0/4001186102 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34014950 con 0x7f3c3c15e510 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c09bb90 con 0x7f3c3c15e510 2023-11-24T08:04:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.566+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c09b4d0 con 0x7f3c3c15e510 2023-11-24T08:04:47.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.570+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c09c390 con 0x7f3c3c15e510 2023-11-24T08:04:47.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.570+0000 7f3c2affd640 1 -- 172.21.15.57:0/4001186102 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c34014ab0 con 0x7f3c3c15e510 2023-11-24T08:04:47.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.570+0000 7f3c2affd640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3c1c066470 0x7f3c1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.570+0000 7f3c2affd640 1 -- 172.21.15.57:0/4001186102 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c34084430 con 0x7f3c3c15e510 2023-11-24T08:04:47.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.570+0000 7f3c3a59c640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3c1c066470 0x7f3c1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.570+0000 7f3c3a59c640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3c1c066470 0x7f3c1c068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0ae000 tx=0x7f3c2c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.574+0000 7f3c2affd640 1 -- 172.21.15.57:0/4001186102 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c3c09c390 con 0x7f3c3c15e510 2023-11-24T08:04:47.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.786+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f3c3c09d250 con 0x7f3c3c15e510 2023-11-24T08:04:47.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.790+0000 7f3c2affd640 1 -- 172.21.15.57:0/4001186102 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3c34055610 con 0x7f3c3c15e510 2023-11-24T08:04:47.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3c1c066470 msgr2=0x7f3c1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3c1c066470 0x7f3c1c068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0ae000 tx=0x7f3c2c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15e510 msgr2=0x7f3c3c15c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15e510 0x7f3c3c15c450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c34007e60 tx=0x7f3c3400e4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 shutdown_connections 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3c1c066470 0x7f3c1c068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c3c15e510 0x7f3c3c15c450 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c3c15d600 0x7f3c3c15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 --2- 172.21.15.57:0/4001186102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3c3c0cc0a0 0x7f3c3c0999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 >> 172.21.15.57:0/4001186102 conn(0x7f3c3c0b0bf0 msgr2=0x7f3c3c15ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 shutdown_connections 2023-11-24T08:04:47.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.794+0000 7f3c40c32640 1 -- 172.21.15.57:0/4001186102 wait complete. 2023-11-24T08:04:47.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T08:04:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd9765640 1 Processor -- start 2023-11-24T08:04:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd9765640 1 -- start start 2023-11-24T08:04:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd9765640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bd40cad20 0x7f3bd40c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd9765640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd406d740 0x7f3bd406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd9765640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd406e0d0 con 0x7f3bd415a4d0 2023-11-24T08:04:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd9765640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd415a8b0 con 0x7f3bd40cad20 2023-11-24T08:04:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd9765640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c9c30 con 0x7f3bd406d740 2023-11-24T08:04:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bd40cad20 0x7f3bd40c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd37fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd406d740 0x7f3bd406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd37fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd406d740 0x7f3bd406db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57288/0 (socket says 172.21.15.57:57288) 2023-11-24T08:04:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd37fe640 1 -- 172.21.15.57:0/3668556460 learned_addr learned my addr 172.21.15.57:0/3668556460 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd27fc640 1 --2- 172.21.15.57:0/3668556460 >> v2:172.21.15.132:3300/0 conn(0x7f3bd40cad20 0x7f3bd40c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:48330/0 (socket says 172.21.15.57:48330) 2023-11-24T08:04:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd2ffd640 1 --1- 172.21.15.57:0/3668556460 >> v1:172.21.15.132:6789/0 conn(0x7f3bd415a4d0 0x7f3bd415e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:57586/0 (socket says 172.21.15.57:57586) 2023-11-24T08:04:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd1ffb640 1 -- 172.21.15.57:0/3668556460 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543221779 0 0) 0x7f3bc4001120 con 0x7f3bd415a4d0 2023-11-24T08:04:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd1ffb640 1 -- 172.21.15.57:0/3668556460 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc003530 con 0x7f3bd415a4d0 2023-11-24T08:04:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd27fc640 1 -- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd406d740 msgr2=0x7f3bd406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd27fc640 1 --2- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd406d740 0x7f3bd406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd27fc640 1 -- 172.21.15.57:0/3668556460 >> v1:172.21.15.132:6789/0 conn(0x7f3bd415a4d0 legacy=0x7f3bd415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd27fc640 1 -- 172.21.15.57:0/3668556460 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40c9f60 con 0x7f3bd40cad20 2023-11-24T08:04:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.958+0000 7f3bd37fe640 1 --2- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd406d740 0x7f3bd406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd27fc640 1 --2- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd40c9650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80097c0 tx=0x7f3bc801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d685b4806e1f348 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd1ffb640 1 -- 172.21.15.57:0/3668556460 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80ac620 con 0x7f3bd40cad20 2023-11-24T08:04:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd1ffb640 1 -- 172.21.15.57:0/3668556460 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80ac780 con 0x7f3bd40cad20 2023-11-24T08:04:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd1ffb640 1 -- 172.21.15.57:0/3668556460 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80acb10 con 0x7f3bd40cad20 2023-11-24T08:04:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 -- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 msgr2=0x7f3bd40c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 --2- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd40c9650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80097c0 tx=0x7f3bc801c3c0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 -- 172.21.15.57:0/3668556460 shutdown_connections 2023-11-24T08:04:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 --2- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd406d740 0x7f3bd406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 --2- 172.21.15.57:0/3668556460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd40c9650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 -- 172.21.15.57:0/3668556460 >> 172.21.15.57:0/3668556460 conn(0x7f3bd40b0bf0 msgr2=0x7f3bd40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 -- 172.21.15.57:0/3668556460 shutdown_connections 2023-11-24T08:04:47.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.962+0000 7f3bd9765640 1 -- 172.21.15.57:0/3668556460 wait complete. 2023-11-24T08:04:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 Processor -- start 2023-11-24T08:04:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 -- start start 2023-11-24T08:04:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd406d740 0x7f3bd40c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd4151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd415a4d0 0x7f3bd4163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c6fc0 con 0x7f3bd406d740 2023-11-24T08:04:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c60d0 con 0x7f3bd40cad20 2023-11-24T08:04:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c63b0 con 0x7f3bd415a4d0 2023-11-24T08:04:47.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd406d740 0x7f3bd40c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd406d740 0x7f3bd40c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43914/0 (socket says 172.21.15.57:43914) 2023-11-24T08:04:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 -- 172.21.15.57:0/1893450646 learned_addr learned my addr 172.21.15.57:0/1893450646 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd27fc640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd4151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 -- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd415a4d0 msgr2=0x7f3bd4163c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd37fe640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd415a4d0 0x7f3bd4163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd415a4d0 0x7f3bd4163c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 -- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 msgr2=0x7f3bd4151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd4151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 -- 172.21.15.57:0/1893450646 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009b30 con 0x7f3bd406d740 2023-11-24T08:04:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd27fc640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd4151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd37fe640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd415a4d0 0x7f3bd4163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd2ffd640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd406d740 0x7f3bd40c7450 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400c420 tx=0x7f3bc400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bbb7fe640 1 -- 172.21.15.57:0/1893450646 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40074e0 con 0x7f3bd406d740 2023-11-24T08:04:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bbb7fe640 1 -- 172.21.15.57:0/1893450646 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4007640 con 0x7f3bd406d740 2023-11-24T08:04:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bbb7fe640 1 -- 172.21.15.57:0/1893450646 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4004a30 con 0x7f3bd406d740 2023-11-24T08:04:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc8009420 con 0x7f3bd406d740 2023-11-24T08:04:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd40c6970 con 0x7f3bd406d740 2023-11-24T08:04:47.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.966+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd409d250 con 0x7f3bd406d740 2023-11-24T08:04:47.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.970+0000 7f3bbb7fe640 1 -- 172.21.15.57:0/1893450646 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bc4004c50 con 0x7f3bd406d740 2023-11-24T08:04:47.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.970+0000 7f3bbb7fe640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3bc0066470 0x7f3bc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.970+0000 7f3bbb7fe640 1 -- 172.21.15.57:0/1893450646 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3bc4083530 con 0x7f3bd406d740 2023-11-24T08:04:47.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.970+0000 7f3bd27fc640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3bc0066470 0x7f3bc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.970+0000 7f3bd27fc640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3bc0066470 0x7f3bc0068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80ae000 tx=0x7f3bc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:47.974+0000 7f3bbb7fe640 1 -- 172.21.15.57:0/1893450646 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3bc4050c60 con 0x7f3bd406d740 2023-11-24T08:04:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.182+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3bd406e0d0 con 0x7f3bd406d740 2023-11-24T08:04:48.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bbb7fe640 1 -- 172.21.15.57:0/1893450646 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3bd406e0d0 con 0x7f3bd406d740 2023-11-24T08:04:48.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3bc0066470 msgr2=0x7f3bc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3bc0066470 0x7f3bc0068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80ae000 tx=0x7f3bc8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:48.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd406d740 msgr2=0x7f3bd40c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd406d740 0x7f3bd40c7450 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400c420 tx=0x7f3bc400c8e0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 shutdown_connections 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3bc0066470 0x7f3bc0068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3bd415a4d0 0x7f3bd4163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bd40cad20 0x7f3bd4151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 --2- 172.21.15.57:0/1893450646 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd406d740 0x7f3bd40c7450 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 >> 172.21.15.57:0/1893450646 conn(0x7f3bd40b0bf0 msgr2=0x7f3bd40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 shutdown_connections 2023-11-24T08:04:48.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.190+0000 7f3bd9765640 1 -- 172.21.15.57:0/1893450646 wait complete. 2023-11-24T08:04:48.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T08:04:48.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e60ec8640 1 Processor -- start 2023-11-24T08:04:48.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e60ec8640 1 -- start start 2023-11-24T08:04:48.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e60ec8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3e5c0cdf80 0x7f3e5c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e60ec8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0b6a30 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e60ec8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0d1a00 con 0x7f3e5c1608f0 2023-11-24T08:04:48.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e60ec8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c160cd0 con 0x7f3e5c0cdf80 2023-11-24T08:04:48.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3e5c0cdf80 0x7f3e5c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5affd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3e5c0b8ed0 0x7f3e5c0d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60814/0 (socket says 172.21.15.57:60814) 2023-11-24T08:04:48.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5affd640 1 -- 172.21.15.57:0/667021610 learned_addr learned my addr 172.21.15.57:0/667021610 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:48.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5a7fc640 1 -- 172.21.15.57:0/667021610 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092232407 0 0) 0x7f3e50001120 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5a7fc640 1 -- 172.21.15.57:0/667021610 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e44003530 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5bfff640 1 -- 172.21.15.57:0/667021610 >> v1:172.21.15.132:6789/0 conn(0x7f3e5c1608f0 legacy=0x7f3e5c0b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5bfff640 1 -- 172.21.15.57:0/667021610 >> v1:172.21.15.57:6789/0 conn(0x7f3e5c0b8ed0 legacy=0x7f3e5c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.358+0000 7f3e5bfff640 1 -- 172.21.15.57:0/667021610 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0b6c70 con 0x7f3e5c0cdf80 2023-11-24T08:04:48.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e5bfff640 1 --2- 172.21.15.57:0/667021610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0cdf80 0x7f3e5c0ce3d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009d90 tx=0x7f3e5401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c67a4771f33c50 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e5a7fc640 1 -- 172.21.15.57:0/667021610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540a59e0 con 0x7f3e5c0cdf80 2023-11-24T08:04:48.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e5a7fc640 1 -- 172.21.15.57:0/667021610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540a5b40 con 0x7f3e5c0cdf80 2023-11-24T08:04:48.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e5a7fc640 1 -- 172.21.15.57:0/667021610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540ad440 con 0x7f3e5c0cdf80 2023-11-24T08:04:48.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e60ec8640 1 -- 172.21.15.57:0/667021610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0cdf80 msgr2=0x7f3e5c0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/667021610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0cdf80 0x7f3e5c0ce3d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009d90 tx=0x7f3e5401c920 comp rx=0 tx=0).stop 2023-11-24T08:04:48.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e60ec8640 1 -- 172.21.15.57:0/667021610 shutdown_connections 2023-11-24T08:04:48.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/667021610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0cdf80 0x7f3e5c0ce3d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e60ec8640 1 -- 172.21.15.57:0/667021610 >> 172.21.15.57:0/667021610 conn(0x7f3e5c0613d0 msgr2=0x7f3e5c0617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e60ec8640 1 -- 172.21.15.57:0/667021610 shutdown_connections 2023-11-24T08:04:48.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.362+0000 7f3e60ec8640 1 -- 172.21.15.57:0/667021610 wait complete. 2023-11-24T08:04:48.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 Processor -- start 2023-11-24T08:04:48.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 -- start start 2023-11-24T08:04:48.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0b8ed0 0x7f3e5c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e5c0cdf80 0x7f3e5c1f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e5c1608f0 0x7f3e5c1fa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0b9310 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0b78f0 con 0x7f3e5c1608f0 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c15ab40 con 0x7f3e5c0cdf80 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0b8ed0 0x7f3e5c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0b8ed0 0x7f3e5c14e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43922/0 (socket says 172.21.15.57:43922) 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 -- 172.21.15.57:0/2723618801 learned_addr learned my addr 172.21.15.57:0/2723618801 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5bfff640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e5c1608f0 0x7f3e5c1fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5affd640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e5c0cdf80 0x7f3e5c1f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 -- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e5c0cdf80 msgr2=0x7f3e5c1f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e5c0cdf80 0x7f3e5c1f9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 -- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e5c1608f0 msgr2=0x7f3e5c1fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e5c1608f0 0x7f3e5c1fa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 -- 172.21.15.57:0/2723618801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54009a70 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5affd640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e5c0cdf80 0x7f3e5c1f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e5b7fe640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0b8ed0 0x7f3e5c14e490 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c3f0 tx=0x7f3e4c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e43fff640 1 -- 172.21.15.57:0/2723618801 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0052d0 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e43fff640 1 -- 172.21.15.57:0/2723618801 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c005430 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e43fff640 1 -- 172.21.15.57:0/2723618801 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c003840 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c0c67e0 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.366+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c15b070 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.370+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c15b2b0 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.370+0000 7f3e43fff640 1 -- 172.21.15.57:0/2723618801 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e4c0039a0 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.370+0000 7f3e43fff640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3e48066470 0x7f3e48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.370+0000 7f3e43fff640 1 -- 172.21.15.57:0/2723618801 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e4c083080 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.370+0000 7f3e5affd640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3e48066470 0x7f3e48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.370+0000 7f3e5affd640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3e48066470 0x7f3e48068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e50007fd0 tx=0x7f3e50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.374+0000 7f3e43fff640 1 -- 172.21.15.57:0/2723618801 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e4c0b4280 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:48.492 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.586+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3e5c04e850 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.590+0000 7f3e43fff640 1 -- 172.21.15.57:0/2723618801 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3e4c050840 con 0x7f3e5c0b8ed0 2023-11-24T08:04:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3e48066470 msgr2=0x7f3e48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3e48066470 0x7f3e48068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e50007fd0 tx=0x7f3e50009040 comp rx=0 tx=0).stop 2023-11-24T08:04:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0b8ed0 msgr2=0x7f3e5c14e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0b8ed0 0x7f3e5c14e490 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c3f0 tx=0x7f3e4c00c8b0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 shutdown_connections 2023-11-24T08:04:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3e48066470 0x7f3e48068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e5c1608f0 0x7f3e5c1fa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e5c0cdf80 0x7f3e5c1f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 --2- 172.21.15.57:0/2723618801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e5c0b8ed0 0x7f3e5c14e490 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 >> 172.21.15.57:0/2723618801 conn(0x7f3e5c0613d0 msgr2=0x7f3e5c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 shutdown_connections 2023-11-24T08:04:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.594+0000 7f3e60ec8640 1 -- 172.21.15.57:0/2723618801 wait complete. 2023-11-24T08:04:48.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T08:04:48.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f56a19f8640 1 Processor -- start 2023-11-24T08:04:48.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f56a19f8640 1 -- start start 2023-11-24T08:04:48.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f56a19f8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c0b2e50 0x7f569c13e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f56a19f8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f569c140c40 0x7f569c1410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f56a19f8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c0cf9b0 con 0x7f569c0b3230 2023-11-24T08:04:48.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f56a19f8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c15ee50 con 0x7f569c140c40 2023-11-24T08:04:48.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f56a19f8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c15f060 con 0x7f569c0b2e50 2023-11-24T08:04:48.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569b7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f569c140c40 0x7f569c1410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569a7fc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f569c0b3230 0x7f569c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60818/0 (socket says 172.21.15.57:60818) 2023-11-24T08:04:48.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569a7fc640 1 -- 172.21.15.57:0/1233930230 learned_addr learned my addr 172.21.15.57:0/1233930230 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:48.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569affd640 1 --2- 172.21.15.57:0/1233930230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c0b2e50 0x7f569c13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569b7fe640 1 -- 172.21.15.57:0/1233930230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c0b2e50 msgr2=0x7f569c13e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:48.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569b7fe640 1 --2- 172.21.15.57:0/1233930230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c0b2e50 0x7f569c13e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569b7fe640 1 -- 172.21.15.57:0/1233930230 >> v1:172.21.15.57:6789/0 conn(0x7f569c0b3230 legacy=0x7f569c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.758+0000 7f569b7fe640 1 -- 172.21.15.57:0/1233930230 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c15f340 con 0x7f569c140c40 2023-11-24T08:04:48.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f569b7fe640 1 --2- 172.21.15.57:0/1233930230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c140c40 0x7f569c1410d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5694009d90 tx=0x7f569401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f5dbd62892b4df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f5699ffb640 1 -- 172.21.15.57:0/1233930230 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940a5900 con 0x7f569c140c40 2023-11-24T08:04:48.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f5699ffb640 1 -- 172.21.15.57:0/1233930230 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56940a5a60 con 0x7f569c140c40 2023-11-24T08:04:48.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f5699ffb640 1 -- 172.21.15.57:0/1233930230 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940a5df0 con 0x7f569c140c40 2023-11-24T08:04:48.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 -- 172.21.15.57:0/1233930230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c140c40 msgr2=0x7f569c1410d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1233930230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c140c40 0x7f569c1410d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5694009d90 tx=0x7f569401c950 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 -- 172.21.15.57:0/1233930230 shutdown_connections 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1233930230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c140c40 0x7f569c1410d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1233930230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c0b2e50 0x7f569c13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 -- 172.21.15.57:0/1233930230 >> 172.21.15.57:0/1233930230 conn(0x7f569c060fd0 msgr2=0x7f569c0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 -- 172.21.15.57:0/1233930230 shutdown_connections 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.762+0000 7f56a19f8640 1 -- 172.21.15.57:0/1233930230 wait complete. 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 Processor -- start 2023-11-24T08:04:48.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 -- start start 2023-11-24T08:04:48.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c0b2e50 0x7f569c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c0b3230 0x7f569c13d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c140c40 0x7f569c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1578e0 con 0x7f569c0b2e50 2023-11-24T08:04:48.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c156da0 con 0x7f569c0b3230 2023-11-24T08:04:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c157040 con 0x7f569c140c40 2023-11-24T08:04:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c0b2e50 0x7f569c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c0b2e50 0x7f569c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43946/0 (socket says 172.21.15.57:43946) 2023-11-24T08:04:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 -- 172.21.15.57:0/1012988486 learned_addr learned my addr 172.21.15.57:0/1012988486 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 -- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c140c40 msgr2=0x7f569c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c140c40 0x7f569c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 -- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c0b3230 msgr2=0x7f569c13d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c0b3230 0x7f569c13d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 -- 172.21.15.57:0/1012988486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009a70 con 0x7f569c0b2e50 2023-11-24T08:04:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f569affd640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c0b2e50 0x7f569c1587d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f568c00e870 tx=0x7f568c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f5683fff640 1 -- 172.21.15.57:0/1012988486 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00eec0 con 0x7f569c0b2e50 2023-11-24T08:04:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f5683fff640 1 -- 172.21.15.57:0/1012988486 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c00c940 con 0x7f569c0b2e50 2023-11-24T08:04:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c157320 con 0x7f569c0b2e50 2023-11-24T08:04:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f5683fff640 1 -- 172.21.15.57:0/1012988486 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00ccb0 con 0x7f569c0b2e50 2023-11-24T08:04:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c13de80 con 0x7f569c0b2e50 2023-11-24T08:04:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.766+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c06fea0 con 0x7f569c0b2e50 2023-11-24T08:04:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.770+0000 7f5683fff640 1 -- 172.21.15.57:0/1012988486 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f568c013470 con 0x7f569c0b2e50 2023-11-24T08:04:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.770+0000 7f5683fff640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5688066470 0x7f5688068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.770+0000 7f5683fff640 1 -- 172.21.15.57:0/1012988486 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f568c083ce0 con 0x7f569c0b2e50 2023-11-24T08:04:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.770+0000 7f569a7fc640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5688066470 0x7f5688068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:48.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.770+0000 7f569a7fc640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5688066470 0x7f5688068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f569c1599e0 tx=0x7f5690007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:48.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.774+0000 7f5683fff640 1 -- 172.21.15.57:0/1012988486 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f568c0514a0 con 0x7f569c0b2e50 2023-11-24T08:04:48.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.990+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f569c0cb500 con 0x7f569c0b2e50 2023-11-24T08:04:48.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.990+0000 7f5683fff640 1 -- 172.21.15.57:0/1012988486 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f568c0170a0 con 0x7f569c0b2e50 2023-11-24T08:04:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5688066470 msgr2=0x7f5688068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5688066470 0x7f5688068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f569c1599e0 tx=0x7f5690007a50 comp rx=0 tx=0).stop 2023-11-24T08:04:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c0b2e50 msgr2=0x7f569c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c0b2e50 0x7f569c1587d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f568c00e870 tx=0x7f568c00ec70 comp rx=0 tx=0).stop 2023-11-24T08:04:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 shutdown_connections 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5688066470 0x7f5688068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f569c140c40 0x7f569c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c0b3230 0x7f569c13d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 --2- 172.21.15.57:0/1012988486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f569c0b2e50 0x7f569c1587d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 >> 172.21.15.57:0/1012988486 conn(0x7f569c060fd0 msgr2=0x7f569c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 shutdown_connections 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:48.994+0000 7f56a19f8640 1 -- 172.21.15.57:0/1012988486 wait complete. 2023-11-24T08:04:49.020 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T08:04:49.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 Processor -- start 2023-11-24T08:04:49.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 -- start start 2023-11-24T08:04:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f18e015a4d0 0x7f18e00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18e00cad20 0x7f18e015e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e006d740 0x7f18e006db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e006e0d0 con 0x7f18e00cad20 2023-11-24T08:04:49.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e015a8b0 con 0x7f18e015a4d0 2023-11-24T08:04:49.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e8335640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c9c30 con 0x7f18e006d740 2023-11-24T08:04:49.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.158+0000 7f18e58d0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18e00cad20 0x7f18e015e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18e00cad20 0x7f18e015e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43954/0 (socket says 172.21.15.57:43954) 2023-11-24T08:04:49.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 -- 172.21.15.57:0/1521326705 learned_addr learned my addr 172.21.15.57:0/1521326705 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:49.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e60d1640 1 --2- 172.21.15.57:0/1521326705 >> v2:172.21.15.132:3300/0 conn(0x7f18e015a4d0 0x7f18e00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e68d2640 1 --2- 172.21.15.57:0/1521326705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e006d740 0x7f18e006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 -- 172.21.15.57:0/1521326705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e006d740 msgr2=0x7f18e006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 --2- 172.21.15.57:0/1521326705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e006d740 0x7f18e006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 -- 172.21.15.57:0/1521326705 >> v2:172.21.15.132:3300/0 conn(0x7f18e015a4d0 msgr2=0x7f18e00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 --2- 172.21.15.57:0/1521326705 >> v2:172.21.15.132:3300/0 conn(0x7f18e015a4d0 0x7f18e00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 -- 172.21.15.57:0/1521326705 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e015ee80 con 0x7f18e00cad20 2023-11-24T08:04:49.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e68d2640 1 --2- 172.21.15.57:0/1521326705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e006d740 0x7f18e006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:49.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e60d1640 1 --2- 172.21.15.57:0/1521326705 >> v2:172.21.15.132:3300/0 conn(0x7f18e015a4d0 0x7f18e00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:49.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e58d0640 1 --2- 172.21.15.57:0/1521326705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e015e940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f18e006e7d0 tx=0x7f18d001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8acd8c6f4e7dcdb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e50cf640 1 -- 172.21.15.57:0/1521326705 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00ab600 con 0x7f18e00cad20 2023-11-24T08:04:49.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e50cf640 1 -- 172.21.15.57:0/1521326705 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d00ab760 con 0x7f18e00cad20 2023-11-24T08:04:49.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.162+0000 7f18e50cf640 1 -- 172.21.15.57:0/1521326705 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00abaf0 con 0x7f18e00cad20 2023-11-24T08:04:49.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- 172.21.15.57:0/1521326705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 msgr2=0x7f18e015e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 --2- 172.21.15.57:0/1521326705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e015e940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f18e006e7d0 tx=0x7f18d001c440 comp rx=0 tx=0).stop 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- 172.21.15.57:0/1521326705 shutdown_connections 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 --2- 172.21.15.57:0/1521326705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e006d740 0x7f18e006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 --2- 172.21.15.57:0/1521326705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e015e940 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 --2- 172.21.15.57:0/1521326705 >> v2:172.21.15.132:3300/0 conn(0x7f18e015a4d0 0x7f18e00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- 172.21.15.57:0/1521326705 >> 172.21.15.57:0/1521326705 conn(0x7f18e00b0bf0 msgr2=0x7f18e00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- 172.21.15.57:0/1521326705 shutdown_connections 2023-11-24T08:04:49.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- 172.21.15.57:0/1521326705 wait complete. 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 Processor -- start 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- start start 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18e006d740 0x7f18e015cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e0158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e015a4d0 0x7f18e0071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c3c90 con 0x7f18e00cad20 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c3080 con 0x7f18e006d740 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e8335640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c3360 con 0x7f18e015a4d0 2023-11-24T08:04:49.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e0158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e0158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43962/0 (socket says 172.21.15.57:43962) 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 -- 172.21.15.57:0/1206459179 learned_addr learned my addr 172.21.15.57:0/1206459179 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e68d2640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e015a4d0 0x7f18e0071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e60d1640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18e006d740 0x7f18e015cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 -- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e015a4d0 msgr2=0x7f18e0071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e015a4d0 0x7f18e0071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 -- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18e006d740 msgr2=0x7f18e015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18e006d740 0x7f18e015cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.166+0000 7f18e58d0640 1 -- 172.21.15.57:0/1206459179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00094d0 con 0x7f18e00cad20 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18e58d0640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e0158c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f18d001aaf0 tx=0x7f18d001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18d6ffd640 1 -- 172.21.15.57:0/1206459179 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00ab600 con 0x7f18e00cad20 2023-11-24T08:04:49.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18d6ffd640 1 -- 172.21.15.57:0/1206459179 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d00b4800 con 0x7f18e00cad20 2023-11-24T08:04:49.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18d6ffd640 1 -- 172.21.15.57:0/1206459179 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00b4bb0 con 0x7f18e00cad20 2023-11-24T08:04:49.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00c3640 con 0x7f18e00cad20 2023-11-24T08:04:49.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e01597a0 con 0x7f18e00cad20 2023-11-24T08:04:49.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00c3e40 con 0x7f18e00cad20 2023-11-24T08:04:49.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18d6ffd640 1 -- 172.21.15.57:0/1206459179 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18d00b4d10 con 0x7f18e00cad20 2023-11-24T08:04:49.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18d6ffd640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f18c4066470 0x7f18c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18d6ffd640 1 -- 172.21.15.57:0/1206459179 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f18d011e530 con 0x7f18e00cad20 2023-11-24T08:04:49.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.170+0000 7f18e60d1640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f18c4066470 0x7f18c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.174+0000 7f18e60d1640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f18c4066470 0x7f18c4068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f18e01f9620 tx=0x7f18dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.174+0000 7f18d6ffd640 1 -- 172.21.15.57:0/1206459179 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18d00ebd90 con 0x7f18e00cad20 2023-11-24T08:04:49.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.386+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f18e009d250 con 0x7f18e00cad20 2023-11-24T08:04:49.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18d6ffd640 1 -- 172.21.15.57:0/1206459179 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v13) v1 ==== 90+0+0 (secure 0 0 0) 0x7f18d00ef3b0 con 0x7f18e00cad20 2023-11-24T08:04:49.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f18c4066470 msgr2=0x7f18c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f18c4066470 0x7f18c4068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f18e01f9620 tx=0x7f18dc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:49.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 msgr2=0x7f18e0158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e0158c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f18d001aaf0 tx=0x7f18d001ac80 comp rx=0 tx=0).stop 2023-11-24T08:04:49.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 shutdown_connections 2023-11-24T08:04:49.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f18c4066470 0x7f18c4068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18e015a4d0 0x7f18e0071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18e00cad20 0x7f18e0158c90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 --2- 172.21.15.57:0/1206459179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18e006d740 0x7f18e015cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.390+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 >> 172.21.15.57:0/1206459179 conn(0x7f18e00b0bf0 msgr2=0x7f18e00b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.394+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 shutdown_connections 2023-11-24T08:04:49.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.394+0000 7f18e8335640 1 -- 172.21.15.57:0/1206459179 wait complete. 2023-11-24T08:04:49.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:49.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3243594640 1 Processor -- start 2023-11-24T08:04:49.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3243594640 1 -- start start 2023-11-24T08:04:49.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3243594640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 0x7f323c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3243594640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c06c0e0 con 0x7f323c15d570 2023-11-24T08:04:49.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3243594640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c0d1cc0 con 0x7f323c0d3020 2023-11-24T08:04:49.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3243594640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0d1fa0 con 0x7f323c0ce8b0 2023-11-24T08:04:49.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3241330640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f323c15d570 0x7f323c06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60832/0 (socket says 172.21.15.57:60832) 2023-11-24T08:04:49.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3241330640 1 -- 172.21.15.57:0/2138814887 learned_addr learned my addr 172.21.15.57:0/2138814887 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3241b31640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 0x7f323c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744503800 0 0) 0x7f323c06c0e0 con 0x7f323c15d570 2023-11-24T08:04:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3228003530 con 0x7f323c15d570 2023-11-24T08:04:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195029220 0 0) 0x7f3228003530 con 0x7f323c15d570 2023-11-24T08:04:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 msgr2=0x7f323c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 0x7f323c0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 >> v1:172.21.15.132:6789/0 conn(0x7f323c0d3020 legacy=0x7f323c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c0ce0b0 con 0x7f323c15d570 2023-11-24T08:04:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f3238001680 con 0x7f323c15d570 2023-11-24T08:04:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 >> v1:172.21.15.57:6789/0 conn(0x7f323c15d570 legacy=0x7f323c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.554+0000 7f3233fff640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f3228003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 0x7f32280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3228004d10 0x7f3228005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0d1fa0 con 0x7f32280039b0 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322800b9c0 con 0x7f3228004d10 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322800bb80 con 0x7f323c0ce8b0 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241330640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f3228003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241b31640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3228004d10 0x7f3228005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3240b2f640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 0x7f32280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241330640 1 -- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 msgr2=0x7f32280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241330640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 0x7f32280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241330640 1 -- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3228004d10 msgr2=0x7f3228005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241330640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3228004d10 0x7f3228005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241330640 1 -- 172.21.15.57:0/2138814887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228003530 con 0x7f32280039b0 2023-11-24T08:04:49.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3240b2f640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ce8b0 0x7f32280047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:49.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3241330640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f3228003d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f323800c210 tx=0x7f323801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33520e55d30edecd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238005ae0 con 0x7f32280039b0 2023-11-24T08:04:49.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3238005c60 con 0x7f32280039b0 2023-11-24T08:04:49.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.558+0000 7f3233fff640 1 -- 172.21.15.57:0/2138814887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238007070 con 0x7f32280039b0 2023-11-24T08:04:49.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- 172.21.15.57:0/2138814887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 msgr2=0x7f3228003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 --2- 172.21.15.57:0/2138814887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f3228003d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f323800c210 tx=0x7f323801cb70 comp rx=0 tx=0).stop 2023-11-24T08:04:49.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241b31640 1 -- 172.21.15.57:0/2138814887 reap_dead start 2023-11-24T08:04:49.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- 172.21.15.57:0/2138814887 shutdown_connections 2023-11-24T08:04:49.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- 172.21.15.57:0/2138814887 >> 172.21.15.57:0/2138814887 conn(0x7f323c08ceb0 msgr2=0x7f323c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- 172.21.15.57:0/2138814887 shutdown_connections 2023-11-24T08:04:49.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- 172.21.15.57:0/2138814887 wait complete. 2023-11-24T08:04:49.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 Processor -- start 2023-11-24T08:04:49.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- start start 2023-11-24T08:04:49.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f323c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ca770 0x7f323c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f323c06c2d0 0x7f323c06c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06ccc0 con 0x7f32280039b0 2023-11-24T08:04:49.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0cabf0 con 0x7f323c06c2d0 2023-11-24T08:04:49.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3243594640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1537a0 con 0x7f323c0ca770 2023-11-24T08:04:49.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f323c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f323c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43980/0 (socket says 172.21.15.57:43980) 2023-11-24T08:04:49.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 -- 172.21.15.57:0/3259732712 learned_addr learned my addr 172.21.15.57:0/3259732712 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:49.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3240b2f640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ca770 0x7f323c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241b31640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f323c06c2d0 0x7f323c06c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 -- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ca770 msgr2=0x7f323c152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ca770 0x7f323c152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 -- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f323c06c2d0 msgr2=0x7f323c06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f323c06c2d0 0x7f323c06c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241330640 1 -- 172.21.15.57:0/3259732712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c0cade0 con 0x7f32280039b0 2023-11-24T08:04:49.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3240b2f640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ca770 0x7f323c152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:49.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.562+0000 7f3241b31640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f323c06c2d0 0x7f323c06c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:49.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3241330640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f323c1568c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f323801c5e0 tx=0x7f3228005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3231ffb640 1 -- 172.21.15.57:0/3259732712 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380b4070 con 0x7f32280039b0 2023-11-24T08:04:49.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3231ffb640 1 -- 172.21.15.57:0/3259732712 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3238005e90 con 0x7f32280039b0 2023-11-24T08:04:49.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3231ffb640 1 -- 172.21.15.57:0/3259732712 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238001640 con 0x7f32280039b0 2023-11-24T08:04:49.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c0cb0c0 con 0x7f32280039b0 2023-11-24T08:04:49.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c154a90 con 0x7f32280039b0 2023-11-24T08:04:49.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c067520 con 0x7f32280039b0 2023-11-24T08:04:49.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3231ffb640 1 -- 172.21.15.57:0/3259732712 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3238007040 con 0x7f32280039b0 2023-11-24T08:04:49.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.566+0000 7f3231ffb640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f32200664a0 0x7f3220068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.570+0000 7f3231ffb640 1 -- 172.21.15.57:0/3259732712 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f323811cd50 con 0x7f32280039b0 2023-11-24T08:04:49.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.570+0000 7f3240b2f640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f32200664a0 0x7f3220068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.570+0000 7f3240b2f640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f32200664a0 0x7f3220068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b2640 tx=0x7f322c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.574+0000 7f3231ffb640 1 -- 172.21.15.57:0/3259732712 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32380edf20 con 0x7f32280039b0 2023-11-24T08:04:49.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.734+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f323c06b7b0 con 0x7f32280039b0 2023-11-24T08:04:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3231ffb640 1 -- 172.21.15.57:0/3259732712 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f32380edab0 con 0x7f32280039b0 2023-11-24T08:04:49.741 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:49.742 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":33,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:46.590911+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:49.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f32200664a0 msgr2=0x7f3220068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f32200664a0 0x7f3220068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b2640 tx=0x7f322c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 msgr2=0x7f323c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f323c1568c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f323801c5e0 tx=0x7f3228005800 comp rx=0 tx=0).stop 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 shutdown_connections 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f32200664a0 0x7f3220068960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f323c06c2d0 0x7f323c06c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f323c0ca770 0x7f323c152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 --2- 172.21.15.57:0/3259732712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32280039b0 0x7f323c1568c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 >> 172.21.15.57:0/3259732712 conn(0x7f323c08ceb0 msgr2=0x7f323c154050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 shutdown_connections 2023-11-24T08:04:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.738+0000 7f3243594640 1 -- 172.21.15.57:0/3259732712 wait complete. 2023-11-24T08:04:49.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:49.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:49.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.902+0000 7f6814ad6640 1 Processor -- start 2023-11-24T08:04:49.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f6814ad6640 1 -- start start 2023-11-24T08:04:49.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f6814ad6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f68100cd850 0x7f681015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f6814ad6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68100b3510 con 0x7f68100ce420 2023-11-24T08:04:49.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f6814ad6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68100b37f0 con 0x7f68100ae4a0 2023-11-24T08:04:49.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f6814ad6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68100b3ad0 con 0x7f68100cd850 2023-11-24T08:04:49.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f6807fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f68100ce420 0x7f681006c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60834/0 (socket says 172.21.15.57:60834) 2023-11-24T08:04:49.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f6807fff640 1 -- 172.21.15.57:0/2528132637 learned_addr learned my addr 172.21.15.57:0/2528132637 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:49.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f680ed9d640 1 --2- 172.21.15.57:0/2528132637 >> v2:172.21.15.132:3300/0 conn(0x7f68100cd850 0x7f681015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f680dd9b640 1 -- 172.21.15.57:0/2528132637 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936033398 0 0) 0x7f68100b3510 con 0x7f68100ce420 2023-11-24T08:04:49.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f680dd9b640 1 -- 172.21.15.57:0/2528132637 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67fc003530 con 0x7f68100ce420 2023-11-24T08:04:49.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f680ed9d640 1 -- 172.21.15.57:0/2528132637 >> v1:172.21.15.132:6789/0 conn(0x7f68100ae4a0 legacy=0x7f68100cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f680ed9d640 1 -- 172.21.15.57:0/2528132637 >> v1:172.21.15.57:6789/0 conn(0x7f68100ce420 legacy=0x7f681006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.906+0000 7f680ed9d640 1 -- 172.21.15.57:0/2528132637 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100b3db0 con 0x7f68100cd850 2023-11-24T08:04:49.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f680ed9d640 1 --2- 172.21.15.57:0/2528132637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 0x7f681015ba00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6808009d90 tx=0x7f680801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5a870c4f49e2a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f680dd9b640 1 -- 172.21.15.57:0/2528132637 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080a5a00 con 0x7f68100cd850 2023-11-24T08:04:49.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f680dd9b640 1 -- 172.21.15.57:0/2528132637 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68080a5b60 con 0x7f68100cd850 2023-11-24T08:04:49.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f680dd9b640 1 -- 172.21.15.57:0/2528132637 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080ad440 con 0x7f68100cd850 2023-11-24T08:04:49.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f6814ad6640 1 -- 172.21.15.57:0/2528132637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 msgr2=0x7f681015ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f6814ad6640 1 --2- 172.21.15.57:0/2528132637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 0x7f681015ba00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6808009d90 tx=0x7f680801c920 comp rx=0 tx=0).stop 2023-11-24T08:04:49.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f6814ad6640 1 -- 172.21.15.57:0/2528132637 shutdown_connections 2023-11-24T08:04:49.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f6814ad6640 1 --2- 172.21.15.57:0/2528132637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 0x7f681015ba00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f6814ad6640 1 -- 172.21.15.57:0/2528132637 >> 172.21.15.57:0/2528132637 conn(0x7f68100b0c80 msgr2=0x7f68100b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f6814ad6640 1 -- 172.21.15.57:0/2528132637 shutdown_connections 2023-11-24T08:04:49.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.910+0000 7f6814ad6640 1 -- 172.21.15.57:0/2528132637 wait complete. 2023-11-24T08:04:49.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 Processor -- start 2023-11-24T08:04:49.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 -- start start 2023-11-24T08:04:49.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68100ae4a0 0x7f68101fa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 0x7f68100abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68100ce420 0x7f681014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681009a1c0 con 0x7f68100ae4a0 2023-11-24T08:04:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68101fa560 con 0x7f68100cd850 2023-11-24T08:04:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681009bc40 con 0x7f68100ce420 2023-11-24T08:04:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68100ae4a0 0x7f68101fa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68100ae4a0 0x7f68101fa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43992/0 (socket says 172.21.15.57:43992) 2023-11-24T08:04:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 -- 172.21.15.57:0/426344333 learned_addr learned my addr 172.21.15.57:0/426344333 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6807fff640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 0x7f68100abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680ed9d640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68100ce420 0x7f681014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 -- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68100ce420 msgr2=0x7f681014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68100ce420 0x7f681014f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 -- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 msgr2=0x7f68100abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 0x7f68100abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 -- 172.21.15.57:0/426344333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808009a70 con 0x7f68100ae4a0 2023-11-24T08:04:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680ed9d640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68100ce420 0x7f681014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f680e59c640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68100ae4a0 0x7f68101fa020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f680000c500 tx=0x7f680000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6806ffd640 1 -- 172.21.15.57:0/426344333 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800005220 con 0x7f68100ae4a0 2023-11-24T08:04:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6806ffd640 1 -- 172.21.15.57:0/426344333 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800005380 con 0x7f68100ae4a0 2023-11-24T08:04:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68100ac4a0 con 0x7f68100ae4a0 2023-11-24T08:04:49.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6806ffd640 1 -- 172.21.15.57:0/426344333 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800007270 con 0x7f68100ae4a0 2023-11-24T08:04:49.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68101507b0 con 0x7f68100ae4a0 2023-11-24T08:04:49.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.914+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6810099c60 con 0x7f68100ae4a0 2023-11-24T08:04:49.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.918+0000 7f6806ffd640 1 -- 172.21.15.57:0/426344333 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68000073d0 con 0x7f68100ae4a0 2023-11-24T08:04:49.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.918+0000 7f6806ffd640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67f00664a0 0x7f67f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.918+0000 7f6806ffd640 1 -- 172.21.15.57:0/426344333 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68000833c0 con 0x7f68100ae4a0 2023-11-24T08:04:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.918+0000 7f6807fff640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67f00664a0 0x7f67f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.918+0000 7f6807fff640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67f00664a0 0x7f67f0068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f681015ebc0 tx=0x7f67f8007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:49.922+0000 7f6806ffd640 1 -- 172.21.15.57:0/426344333 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6800050b00 con 0x7f68100ae4a0 2023-11-24T08:04:50.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.078+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f681004e8c0 con 0x7f68100ae4a0 2023-11-24T08:04:50.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.078+0000 7f6806ffd640 1 -- 172.21.15.57:0/426344333 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6800054120 con 0x7f68100ae4a0 2023-11-24T08:04:50.083 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:04:50.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67f00664a0 msgr2=0x7f67f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67f00664a0 0x7f67f0068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f681015ebc0 tx=0x7f67f8007d40 comp rx=0 tx=0).stop 2023-11-24T08:04:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68100ae4a0 msgr2=0x7f68101fa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68100ae4a0 0x7f68101fa020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f680000c500 tx=0x7f680000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 shutdown_connections 2023-11-24T08:04:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67f00664a0 0x7f67f0068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68100ce420 0x7f681014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100cd850 0x7f68100abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 --2- 172.21.15.57:0/426344333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68100ae4a0 0x7f68101fa020 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 >> 172.21.15.57:0/426344333 conn(0x7f68100b0c80 msgr2=0x7f68100b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 shutdown_connections 2023-11-24T08:04:50.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.082+0000 7f6814ad6640 1 -- 172.21.15.57:0/426344333 wait complete. 2023-11-24T08:04:50.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:04:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.242+0000 7f69b8ac9640 1 Processor -- start 2023-11-24T08:04:50.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.242+0000 7f69b8ac9640 1 -- start start 2023-11-24T08:04:50.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b8ac9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69b415a320 0x7f69b40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b8ac9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b415a700 con 0x7f69b40b36c0 2023-11-24T08:04:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b8ac9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b40b2620 con 0x7f69b4070da0 2023-11-24T08:04:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b8ac9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b40b2430 con 0x7f69b415a320 2023-11-24T08:04:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69b415a320 0x7f69b40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b1d9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f69b40b36c0 0x7f69b4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60840/0 (socket says 172.21.15.57:60840) 2023-11-24T08:04:50.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b1d9b640 1 -- 172.21.15.57:0/4290721217 learned_addr learned my addr 172.21.15.57:0/4290721217 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:50.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b159a640 1 -- 172.21.15.57:0/4290721217 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446854685 0 0) 0x7f69b415a700 con 0x7f69b40b36c0 2023-11-24T08:04:50.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b259c640 1 -- 172.21.15.57:0/4290721217 >> v1:172.21.15.132:6789/0 conn(0x7f69b4070da0 legacy=0x7f69b415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b259c640 1 -- 172.21.15.57:0/4290721217 >> v1:172.21.15.57:6789/0 conn(0x7f69b40b36c0 legacy=0x7f69b4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.246+0000 7f69b259c640 1 -- 172.21.15.57:0/4290721217 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40b2900 con 0x7f69b415a320 2023-11-24T08:04:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b259c640 1 --2- 172.21.15.57:0/4290721217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b40b1ef0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f69a40097c0 tx=0x7f69a401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72adb4d889c2cdf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b159a640 1 -- 172.21.15.57:0/4290721217 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40ad660 con 0x7f69b415a320 2023-11-24T08:04:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b159a640 1 -- 172.21.15.57:0/4290721217 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a40ad7c0 con 0x7f69b415a320 2023-11-24T08:04:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b159a640 1 -- 172.21.15.57:0/4290721217 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40adb50 con 0x7f69b415a320 2023-11-24T08:04:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 -- 172.21.15.57:0/4290721217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 msgr2=0x7f69b40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/4290721217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b40b1ef0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f69a40097c0 tx=0x7f69a401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 -- 172.21.15.57:0/4290721217 shutdown_connections 2023-11-24T08:04:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/4290721217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b40b1ef0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 -- 172.21.15.57:0/4290721217 >> 172.21.15.57:0/4290721217 conn(0x7f69b40b0bf0 msgr2=0x7f69b40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 -- 172.21.15.57:0/4290721217 shutdown_connections 2023-11-24T08:04:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 -- 172.21.15.57:0/4290721217 wait complete. 2023-11-24T08:04:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 Processor -- start 2023-11-24T08:04:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 -- start start 2023-11-24T08:04:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.250+0000 7f69b8ac9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b4070da0 0x7f69b406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b40b36c0 0x7f69b40af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b4163310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40af4b0 con 0x7f69b415a320 2023-11-24T08:04:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40aeba0 con 0x7f69b40b36c0 2023-11-24T08:04:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b409baa0 con 0x7f69b4070da0 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b4163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b4163310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44004/0 (socket says 172.21.15.57:44004) 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 -- 172.21.15.57:0/662910039 learned_addr learned my addr 172.21.15.57:0/662910039 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b1d9b640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b40b36c0 0x7f69b40af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b259c640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b4070da0 0x7f69b406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 -- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b4070da0 msgr2=0x7f69b406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b4070da0 0x7f69b406d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 -- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b40b36c0 msgr2=0x7f69b40af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b40b36c0 0x7f69b40af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 -- 172.21.15.57:0/662910039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a4009420 con 0x7f69b415a320 2023-11-24T08:04:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b2d9d640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b4163310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c770 tx=0x7f69ac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69a2ffd640 1 -- 172.21.15.57:0/662910039 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac003b80 con 0x7f69b415a320 2023-11-24T08:04:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69a2ffd640 1 -- 172.21.15.57:0/662910039 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac003ce0 con 0x7f69b415a320 2023-11-24T08:04:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69a2ffd640 1 -- 172.21.15.57:0/662910039 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00aa90 con 0x7f69b415a320 2023-11-24T08:04:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b40aedf0 con 0x7f69b415a320 2023-11-24T08:04:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b406d6f0 con 0x7f69b415a320 2023-11-24T08:04:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b40af5f0 con 0x7f69b415a320 2023-11-24T08:04:50.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.254+0000 7f69a2ffd640 1 -- 172.21.15.57:0/662910039 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69ac00abf0 con 0x7f69b415a320 2023-11-24T08:04:50.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.258+0000 7f69a2ffd640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6994066470 0x7f6994068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.258+0000 7f69a2ffd640 1 -- 172.21.15.57:0/662910039 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69ac083790 con 0x7f69b415a320 2023-11-24T08:04:50.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.258+0000 7f69b259c640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6994066470 0x7f6994068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.258+0000 7f69b259c640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6994066470 0x7f6994068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69a40af000 tx=0x7f69a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.262+0000 7f69a2ffd640 1 -- 172.21.15.57:0/662910039 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69b40af5f0 con 0x7f69b415a320 2023-11-24T08:04:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.422+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f69b40af5f0 con 0x7f69b415a320 2023-11-24T08:04:50.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.422+0000 7f69a2ffd640 1 -- 172.21.15.57:0/662910039 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+65 (secure 0 0 0) 0x7f69b40af5f0 con 0x7f69b415a320 2023-11-24T08:04:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:50.428 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-11-24T08:04:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:04:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-11-24T08:04:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-11-24T08:04:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:04:50.429 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-11-24T08:04:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6994066470 msgr2=0x7f6994068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6994066470 0x7f6994068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69a40af000 tx=0x7f69a4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 msgr2=0x7f69b4163310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b4163310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c770 tx=0x7f69ac00cc30 comp rx=0 tx=0).stop 2023-11-24T08:04:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 shutdown_connections 2023-11-24T08:04:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6994066470 0x7f6994068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69b415a320 0x7f69b4163310 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b40b36c0 0x7f69b40af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 --2- 172.21.15.57:0/662910039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b4070da0 0x7f69b406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 >> 172.21.15.57:0/662910039 conn(0x7f69b40b0bf0 msgr2=0x7f69b40b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 shutdown_connections 2023-11-24T08:04:50.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.426+0000 7f69b8ac9640 1 -- 172.21.15.57:0/662910039 wait complete. 2023-11-24T08:04:50.449 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:04:50.449 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:04:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd706467640 1 Processor -- start 2023-11-24T08:04:50.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd706467640 1 -- start start 2023-11-24T08:04:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd706467640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 0x7fd700168460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd706467640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000cdd80 con 0x7fd70015d780 2023-11-24T08:04:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd706467640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000ceb80 con 0x7fd7000b21c0 2023-11-24T08:04:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd706467640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000b0e20 con 0x7fd7000d1ed0 2023-11-24T08:04:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd705465640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd70015d780 0x7fd7000d3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60852/0 (socket says 172.21.15.57:60852) 2023-11-24T08:04:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.590+0000 7fd705465640 1 -- 172.21.15.57:0/279476013 learned_addr learned my addr 172.21.15.57:0/279476013 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705c66640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 0x7fd700168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747845811 0 0) 0x7fd7000cdd80 con 0x7fd70015d780 2023-11-24T08:04:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec003530 con 0x7fd70015d780 2023-11-24T08:04:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569290053 0 0) 0x7fd7000ceb80 con 0x7fd7000b21c0 2023-11-24T08:04:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7000cdd80 con 0x7fd7000b21c0 2023-11-24T08:04:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 246434912 0 0) 0x7fd6ec003530 con 0x7fd70015d780 2023-11-24T08:04:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 msgr2=0x7fd700168460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 0x7fd700168460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 >> v1:172.21.15.132:6789/0 conn(0x7fd7000b21c0 legacy=0x7fd7000d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000cdfb0 con 0x7fd70015d780 2023-11-24T08:04:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fd6fc001680 con 0x7fd70015d780 2023-11-24T08:04:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 >> v1:172.21.15.57:6789/0 conn(0x7fd70015d780 legacy=0x7fd7000d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ec003b40 0x7fd6ec003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 0x7fd6ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd6ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000b0e20 con 0x7fd6ec004d10 2023-11-24T08:04:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec00ba70 con 0x7fd6ec003b40 2023-11-24T08:04:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec00bc30 con 0x7fd7000d1ed0 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705c66640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd6ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705465640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ec003b40 0x7fd6ec003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd704c64640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 0x7fd6ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705c66640 1 -- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 msgr2=0x7fd6ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705c66640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7000d1ed0 0x7fd6ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705c66640 1 -- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ec003b40 msgr2=0x7fd6ec003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705c66640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ec003b40 0x7fd6ec003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.594+0000 7fd705c66640 1 -- 172.21.15.57:0/279476013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec003530 con 0x7fd6ec004d10 2023-11-24T08:04:50.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd705c66640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd6ec005190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009f90 tx=0x7fd6f801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0145060ab034ec9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80a5b20 con 0x7fd6ec004d10 2023-11-24T08:04:50.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f800f040 con 0x7fd6ec004d10 2023-11-24T08:04:50.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd6f7fff640 1 -- 172.21.15.57:0/279476013 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80ad440 con 0x7fd6ec004d10 2023-11-24T08:04:50.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 -- 172.21.15.57:0/279476013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 msgr2=0x7fd6ec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 --2- 172.21.15.57:0/279476013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd6ec005190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009f90 tx=0x7fd6f801cc20 comp rx=0 tx=0).stop 2023-11-24T08:04:50.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd705c66640 1 -- 172.21.15.57:0/279476013 reap_dead start 2023-11-24T08:04:50.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 -- 172.21.15.57:0/279476013 shutdown_connections 2023-11-24T08:04:50.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 -- 172.21.15.57:0/279476013 >> 172.21.15.57:0/279476013 conn(0x7fd70009c520 msgr2=0x7fd7000d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 -- 172.21.15.57:0/279476013 shutdown_connections 2023-11-24T08:04:50.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 -- 172.21.15.57:0/279476013 wait complete. 2023-11-24T08:04:50.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 Processor -- start 2023-11-24T08:04:50.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.598+0000 7fd706467640 1 -- start start 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd7000b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7001511c0 0x7fd700158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7000cb880 0x7fd70015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000b5dc0 con 0x7fd6ec004d10 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7001588f0 con 0x7fd7000cb880 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd700158bd0 con 0x7fd7001511c0 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd7000b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd7000b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44028/0 (socket says 172.21.15.57:44028) 2023-11-24T08:04:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 -- 172.21.15.57:0/151658924 learned_addr learned my addr 172.21.15.57:0/151658924 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705c66640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7000cb880 0x7fd70015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd704c64640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7001511c0 0x7fd700158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 -- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7001511c0 msgr2=0x7fd700158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7001511c0 0x7fd700158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 -- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7000cb880 msgr2=0x7fd70015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7000cb880 0x7fd70015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 -- 172.21.15.57:0/151658924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000b5fd0 con 0x7fd6ec004d10 2023-11-24T08:04:50.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd705465640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd7000b67d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0124a0 tx=0x7fd6fc012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd6f5ffb640 1 -- 172.21.15.57:0/151658924 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc014810 con 0x7fd6ec004d10 2023-11-24T08:04:50.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd6f5ffb640 1 -- 172.21.15.57:0/151658924 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc014970 con 0x7fd6ec004d10 2023-11-24T08:04:50.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd6f5ffb640 1 -- 172.21.15.57:0/151658924 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc014ce0 con 0x7fd6ec004d10 2023-11-24T08:04:50.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7000b62b0 con 0x7fd6ec004d10 2023-11-24T08:04:50.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7000cbd00 con 0x7fd6ec004d10 2023-11-24T08:04:50.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd700158d90 con 0x7fd6ec004d10 2023-11-24T08:04:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.602+0000 7fd6f5ffb640 1 -- 172.21.15.57:0/151658924 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6fc016480 con 0x7fd6ec004d10 2023-11-24T08:04:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.606+0000 7fd6f5ffb640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd6e40664a0 0x7fd6e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.606+0000 7fd6f5ffb640 1 -- 172.21.15.57:0/151658924 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6fc086f00 con 0x7fd6ec004d10 2023-11-24T08:04:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.606+0000 7fd704c64640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd6e40664a0 0x7fd6e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.606+0000 7fd704c64640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd6e40664a0 0x7fd6e4068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd7000b1600 tx=0x7fd6f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.610+0000 7fd6f5ffb640 1 -- 172.21.15.57:0/151658924 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6fc054770 con 0x7fd6ec004d10 2023-11-24T08:04:50.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.766+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd7000b64a0 con 0x7fd6ec004d10 2023-11-24T08:04:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.826+0000 7fd6f5ffb640 1 -- 172.21.15.57:0/151658924 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd6fc057d90 con 0x7fd6ec004d10 2023-11-24T08:04:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-11-24T08:04:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd6e40664a0 msgr2=0x7fd6e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd6e40664a0 0x7fd6e4068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd7000b1600 tx=0x7fd6f0009040 comp rx=0 tx=0).stop 2023-11-24T08:04:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 msgr2=0x7fd7000b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd7000b67d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0124a0 tx=0x7fd6fc012960 comp rx=0 tx=0).stop 2023-11-24T08:04:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 shutdown_connections 2023-11-24T08:04:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd6e40664a0 0x7fd6e4068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7000cb880 0x7fd70015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7001511c0 0x7fd700158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 --2- 172.21.15.57:0/151658924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6ec004d10 0x7fd7000b67d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 >> 172.21.15.57:0/151658924 conn(0x7fd70009c520 msgr2=0x7fd70006c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 shutdown_connections 2023-11-24T08:04:50.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:50.830+0000 7fd706467640 1 -- 172.21.15.57:0/151658924 wait complete. 2023-11-24T08:04:50.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:04:51.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.002+0000 7f3a265b5640 1 Processor -- start 2023-11-24T08:04:51.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.002+0000 7f3a265b5640 1 -- start start 2023-11-24T08:04:51.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a265b5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a201617a0 0x7f3a200ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a265b5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a200ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a265b5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a20166230 con 0x7f3a200ce4a0 2023-11-24T08:04:51.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a265b5640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a20165620 con 0x7f3a201617a0 2023-11-24T08:04:51.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a265b5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20165900 con 0x7f3a200c27b0 2023-11-24T08:04:51.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a255b3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a201617a0 0x7f3a200ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a255b3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a201617a0 0x7f3a200ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44030/0 (socket says 172.21.15.57:44030) 2023-11-24T08:04:51.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a255b3640 1 -- 172.21.15.57:0/3572274580 learned_addr learned my addr 172.21.15.57:0/3572274580 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:51.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a25db4640 1 --2- 172.21.15.57:0/3572274580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a200ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a255b3640 1 -- 172.21.15.57:0/3572274580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 msgr2=0x7f3a200ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:51.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a255b3640 1 --2- 172.21.15.57:0/3572274580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a200ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a255b3640 1 -- 172.21.15.57:0/3572274580 >> v1:172.21.15.132:6789/0 conn(0x7f3a200ce4a0 legacy=0x7f3a200c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.006+0000 7f3a255b3640 1 -- 172.21.15.57:0/3572274580 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20165be0 con 0x7f3a201617a0 2023-11-24T08:04:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a255b3640 1 --2- 172.21.15.57:0/3572274580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200ca760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009870 tx=0x7f3a1c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adff87838e38362e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a17fff640 1 -- 172.21.15.57:0/3572274580 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0a95f0 con 0x7f3a201617a0 2023-11-24T08:04:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a17fff640 1 -- 172.21.15.57:0/3572274580 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c0a9750 con 0x7f3a201617a0 2023-11-24T08:04:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a17fff640 1 -- 172.21.15.57:0/3572274580 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0a9ae0 con 0x7f3a201617a0 2023-11-24T08:04:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- 172.21.15.57:0/3572274580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 msgr2=0x7f3a200ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 --2- 172.21.15.57:0/3572274580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200ca760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009870 tx=0x7f3a1c01c510 comp rx=0 tx=0).stop 2023-11-24T08:04:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- 172.21.15.57:0/3572274580 shutdown_connections 2023-11-24T08:04:51.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 --2- 172.21.15.57:0/3572274580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a200ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 --2- 172.21.15.57:0/3572274580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200ca760 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- 172.21.15.57:0/3572274580 >> 172.21.15.57:0/3572274580 conn(0x7f3a200cbb50 msgr2=0x7f3a200cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- 172.21.15.57:0/3572274580 shutdown_connections 2023-11-24T08:04:51.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- 172.21.15.57:0/3572274580 wait complete. 2023-11-24T08:04:51.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 Processor -- start 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- start start 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a20159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a200ce4a0 0x7f3a2015f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200b0700 con 0x7f3a201617a0 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20160370 con 0x7f3a200ce4a0 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.010+0000 7f3a265b5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200b03d0 con 0x7f3a200c27b0 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a255b3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a20159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a25db4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a255b3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a20159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57400/0 (socket says 172.21.15.57:57400) 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a255b3640 1 -- 172.21.15.57:0/2029768096 learned_addr learned my addr 172.21.15.57:0/2029768096 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a24db2640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a200ce4a0 0x7f3a2015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a25db4640 1 -- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 msgr2=0x7f3a20159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a25db4640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a20159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a25db4640 1 -- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a200ce4a0 msgr2=0x7f3a2015f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a25db4640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a200ce4a0 0x7f3a2015f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a25db4640 1 -- 172.21.15.57:0/2029768096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0094d0 con 0x7f3a201617a0 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a255b3640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a20159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a25db4640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200cf4e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3a200c96d0 tx=0x7f3a1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a15ffb640 1 -- 172.21.15.57:0/2029768096 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18018070 con 0x7f3a201617a0 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a15ffb640 1 -- 172.21.15.57:0/2029768096 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800edd0 con 0x7f3a201617a0 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a15ffb640 1 -- 172.21.15.57:0/2029768096 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18003bc0 con 0x7f3a201617a0 2023-11-24T08:04:51.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2015fdb0 con 0x7f3a201617a0 2023-11-24T08:04:51.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a200cfa20 con 0x7f3a201617a0 2023-11-24T08:04:51.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2015f660 con 0x7f3a201617a0 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.014+0000 7f3a15ffb640 1 -- 172.21.15.57:0/2029768096 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a18014420 con 0x7f3a201617a0 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.018+0000 7f3a15ffb640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3a040664a0 0x7f3a04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.018+0000 7f3a15ffb640 1 -- 172.21.15.57:0/2029768096 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3a18083d10 con 0x7f3a201617a0 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.018+0000 7f3a255b3640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3a040664a0 0x7f3a04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.018+0000 7f3a255b3640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3a040664a0 0x7f3a04068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000c10 tx=0x7f3a1c0b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.022+0000 7f3a15ffb640 1 -- 172.21.15.57:0/2029768096 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a2015f660 con 0x7f3a201617a0 2023-11-24T08:04:51.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.178+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3a2015f660 con 0x7f3a201617a0 2023-11-24T08:04:51.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.830+0000 7f3a15ffb640 1 -- 172.21.15.57:0/2029768096 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3a2015f660 con 0x7f3a201617a0 2023-11-24T08:04:51.835 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-11-24T08:04:51.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3a040664a0 msgr2=0x7f3a04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3a040664a0 0x7f3a04068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000c10 tx=0x7f3a1c0b3040 comp rx=0 tx=0).stop 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 msgr2=0x7f3a200cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200cf4e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3a200c96d0 tx=0x7f3a1800e4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 shutdown_connections 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3a040664a0 0x7f3a04068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a201617a0 0x7f3a200cf4e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a200ce4a0 0x7f3a2015f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 --2- 172.21.15.57:0/2029768096 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a200c27b0 0x7f3a20159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 >> 172.21.15.57:0/2029768096 conn(0x7f3a200cbb50 msgr2=0x7f3a200c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 shutdown_connections 2023-11-24T08:04:51.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:51.834+0000 7f3a265b5640 1 -- 172.21.15.57:0/2029768096 wait complete. 2023-11-24T08:04:51.880 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.022+0000 7f5a2ea9f640 1 Processor -- start 2023-11-24T08:04:52.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.022+0000 7f5a2ea9f640 1 -- start start 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2ea9f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a2815a450 0x7f5a280b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2ea9f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2806d090 0x7f5a28070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2ea9f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2806e0a0 con 0x7f5a280b0b50 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2ea9f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a280ca430 con 0x7f5a2815a450 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2ea9f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a280b1470 con 0x7f5a2806d090 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2d29c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a2815a450 0x7f5a280b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2e29e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2806d090 0x7f5a28070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2da9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5a280b0b50 0x7f5a2815e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:57636/0 (socket says 172.21.15.57:57636) 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2da9d640 1 -- 172.21.15.57:0/2106759543 learned_addr learned my addr 172.21.15.57:0/2106759543 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2ca9b640 1 -- 172.21.15.57:0/2106759543 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143174146 0 0) 0x7f5a2806e0a0 con 0x7f5a280b0b50 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2ca9b640 1 -- 172.21.15.57:0/2106759543 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a14003530 con 0x7f5a280b0b50 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2e29e640 1 -- 172.21.15.57:0/2106759543 >> v2:172.21.15.132:3300/0 conn(0x7f5a2815a450 msgr2=0x7f5a280b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2e29e640 1 --2- 172.21.15.57:0/2106759543 >> v2:172.21.15.132:3300/0 conn(0x7f5a2815a450 0x7f5a280b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2e29e640 1 -- 172.21.15.57:0/2106759543 >> v1:172.21.15.132:6789/0 conn(0x7f5a280b0b50 legacy=0x7f5a2815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2e29e640 1 -- 172.21.15.57:0/2106759543 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28071490 con 0x7f5a2806d090 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.026+0000 7f5a2d29c640 1 --2- 172.21.15.57:0/2106759543 >> v2:172.21.15.132:3300/0 conn(0x7f5a2815a450 0x7f5a280b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2e29e640 1 --2- 172.21.15.57:0/2106759543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2806d090 0x7f5a28070f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009d90 tx=0x7f5a2001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=723129a8aa890195 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ca9b640 1 -- 172.21.15.57:0/2106759543 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200a59e0 con 0x7f5a2806d090 2023-11-24T08:04:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ca9b640 1 -- 172.21.15.57:0/2106759543 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200a5b40 con 0x7f5a2806d090 2023-11-24T08:04:52.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ca9b640 1 -- 172.21.15.57:0/2106759543 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200ad440 con 0x7f5a2806d090 2023-11-24T08:04:52.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/2106759543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2806d090 msgr2=0x7f5a28070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/2106759543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2806d090 0x7f5a28070f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009d90 tx=0x7f5a2001c920 comp rx=0 tx=0).stop 2023-11-24T08:04:52.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/2106759543 shutdown_connections 2023-11-24T08:04:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/2106759543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2806d090 0x7f5a28070f50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/2106759543 >> v2:172.21.15.132:3300/0 conn(0x7f5a2815a450 0x7f5a280b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/2106759543 >> 172.21.15.57:0/2106759543 conn(0x7f5a280cbb50 msgr2=0x7f5a280cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/2106759543 shutdown_connections 2023-11-24T08:04:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/2106759543 wait complete. 2023-11-24T08:04:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 Processor -- start 2023-11-24T08:04:52.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.030+0000 7f5a2ea9f640 1 -- start start 2023-11-24T08:04:52.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a280b0b50 0x7f5a28153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2815b9c0 0x7f5a2815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2815c380 0x7f5a281f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a281536b0 con 0x7f5a2815c380 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2815c810 con 0x7f5a280b0b50 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28099dc0 con 0x7f5a2815b9c0 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2815c380 0x7f5a281f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2da9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a280b0b50 0x7f5a28153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2d29c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2815b9c0 0x7f5a2815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2815c380 0x7f5a281f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44058/0 (socket says 172.21.15.57:44058) 2023-11-24T08:04:52.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 -- 172.21.15.57:0/4266488892 learned_addr learned my addr 172.21.15.57:0/4266488892 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:52.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2da9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a280b0b50 0x7f5a28153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:48442/0 (socket says 172.21.15.57:48442) 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 -- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2815b9c0 msgr2=0x7f5a2815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2815b9c0 0x7f5a2815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 -- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a280b0b50 msgr2=0x7f5a28153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a280b0b50 0x7f5a28153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 -- 172.21.15.57:0/4266488892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18009420 con 0x7f5a2815c380 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2e29e640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2815c380 0x7f5a281f7030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5a2001a550 tx=0x7f5a200196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a1e7fc640 1 -- 172.21.15.57:0/4266488892 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200aed30 con 0x7f5a2815c380 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a1e7fc640 1 -- 172.21.15.57:0/4266488892 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200aee90 con 0x7f5a2815c380 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a1e7fc640 1 -- 172.21.15.57:0/4266488892 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200b7610 con 0x7f5a2815c380 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20009a70 con 0x7f5a2815c380 2023-11-24T08:04:52.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a280c2b40 con 0x7f5a2815c380 2023-11-24T08:04:52.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.034+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a28099f80 con 0x7f5a2815c380 2023-11-24T08:04:52.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.038+0000 7f5a1e7fc640 1 -- 172.21.15.57:0/4266488892 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a200b4050 con 0x7f5a2815c380 2023-11-24T08:04:52.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.038+0000 7f5a1e7fc640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5a0c066470 0x7f5a0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.038+0000 7f5a1e7fc640 1 -- 172.21.15.57:0/4266488892 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5a2011f8d0 con 0x7f5a2815c380 2023-11-24T08:04:52.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.038+0000 7f5a2da9d640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5a0c066470 0x7f5a0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.038+0000 7f5a2da9d640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5a0c066470 0x7f5a0c068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007fd0 tx=0x7f5a24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.042+0000 7f5a1e7fc640 1 -- 172.21.15.57:0/4266488892 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a200ecf60 con 0x7f5a2815c380 2023-11-24T08:04:52.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.230+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5a2804e850 con 0x7f5a2815c380 2023-11-24T08:04:52.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.854+0000 7f5a1e7fc640 1 -- 172.21.15.57:0/4266488892 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5a200b20c0 con 0x7f5a2815c380 2023-11-24T08:04:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T08:04:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5a0c066470 msgr2=0x7f5a0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5a0c066470 0x7f5a0c068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007fd0 tx=0x7f5a24009040 comp rx=0 tx=0).stop 2023-11-24T08:04:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2815c380 msgr2=0x7f5a281f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2815c380 0x7f5a281f7030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5a2001a550 tx=0x7f5a200196c0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 shutdown_connections 2023-11-24T08:04:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5a0c066470 0x7f5a0c068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2815c380 0x7f5a281f7030 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5a2815b9c0 0x7f5a2815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 --2- 172.21.15.57:0/4266488892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a280b0b50 0x7f5a28153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.862+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 >> 172.21.15.57:0/4266488892 conn(0x7f5a280cbb50 msgr2=0x7f5a28159620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.866+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 shutdown_connections 2023-11-24T08:04:52.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:52.866+0000 7f5a2ea9f640 1 -- 172.21.15.57:0/4266488892 wait complete. 2023-11-24T08:04:52.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:53.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa2f2a640 1 Processor -- start 2023-11-24T08:04:53.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa2f2a640 1 -- start start 2023-11-24T08:04:53.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa2f2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa2f2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f9c0b25c0 0x7f2f9c0d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa2f2a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9c06d050 con 0x7f2f9c0d3880 2023-11-24T08:04:53.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa2f2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9c0d2240 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa2f2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0d3d30 con 0x7f2f9c15d720 2023-11-24T08:04:53.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa14c7640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2f9c0d3880 0x7f2f9c0cfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60864/0 (socket says 172.21.15.57:60864) 2023-11-24T08:04:53.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa14c7640 1 -- 172.21.15.57:0/2142747411 learned_addr learned my addr 172.21.15.57:0/2142747411 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:53.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa0cc6640 1 --2- 172.21.15.57:0/2142747411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2f9bfff640 1 --2- 172.21.15.57:0/2142747411 >> v2:172.21.15.132:3300/0 conn(0x7f2f9c0b25c0 0x7f2f9c0d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2f9b7fe640 1 -- 172.21.15.57:0/2142747411 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590129322 0 0) 0x7f2f9c06d050 con 0x7f2f9c0d3880 2023-11-24T08:04:53.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2f9b7fe640 1 -- 172.21.15.57:0/2142747411 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f8c003530 con 0x7f2f9c0d3880 2023-11-24T08:04:53.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa0cc6640 1 -- 172.21.15.57:0/2142747411 >> v2:172.21.15.132:3300/0 conn(0x7f2f9c0b25c0 msgr2=0x7f2f9c0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa0cc6640 1 --2- 172.21.15.57:0/2142747411 >> v2:172.21.15.132:3300/0 conn(0x7f2f9c0b25c0 0x7f2f9c0d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa0cc6640 1 -- 172.21.15.57:0/2142747411 >> v1:172.21.15.57:6789/0 conn(0x7f2f9c0d3880 legacy=0x7f2f9c0cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2fa0cc6640 1 -- 172.21.15.57:0/2142747411 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c06c720 con 0x7f2f9c15d720 2023-11-24T08:04:53.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.046+0000 7f2f9bfff640 1 --2- 172.21.15.57:0/2142747411 >> v2:172.21.15.132:3300/0 conn(0x7f2f9c0b25c0 0x7f2f9c0d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:53.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa0cc6640 1 --2- 172.21.15.57:0/2142747411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0d1a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097c0 tx=0x7f2f9001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55c321f5a5006f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2f9b7fe640 1 -- 172.21.15.57:0/2142747411 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900ab600 con 0x7f2f9c15d720 2023-11-24T08:04:53.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2f9b7fe640 1 -- 172.21.15.57:0/2142747411 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900a7050 con 0x7f2f9c15d720 2023-11-24T08:04:53.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2f9b7fe640 1 -- 172.21.15.57:0/2142747411 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900ab980 con 0x7f2f9c15d720 2023-11-24T08:04:53.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/2142747411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 msgr2=0x7f2f9c0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/2142747411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0d1a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097c0 tx=0x7f2f9001c480 comp rx=0 tx=0).stop 2023-11-24T08:04:53.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/2142747411 shutdown_connections 2023-11-24T08:04:53.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/2142747411 >> v2:172.21.15.132:3300/0 conn(0x7f2f9c0b25c0 0x7f2f9c0d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/2142747411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0d1a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/2142747411 >> 172.21.15.57:0/2142747411 conn(0x7f2f9c08af70 msgr2=0x7f2f9c09c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/2142747411 shutdown_connections 2023-11-24T08:04:53.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.050+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/2142747411 wait complete. 2023-11-24T08:04:53.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 Processor -- start 2023-11-24T08:04:53.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 -- start start 2023-11-24T08:04:53.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9c0b25c0 0x7f2f9c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9c0d3880 0x7f2f9c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0ccbf0 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0ccd80 con 0x7f2f9c0d3880 2023-11-24T08:04:53.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c0b0cb0 con 0x7f2f9c15d720 2023-11-24T08:04:53.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9c0b25c0 0x7f2f9c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9c0b25c0 0x7f2f9c0cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44070/0 (socket says 172.21.15.57:44070) 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 -- 172.21.15.57:0/3349150530 learned_addr learned my addr 172.21.15.57:0/3349150530 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2f9bfff640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9c0d3880 0x7f2f9c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa14c7640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 -- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 msgr2=0x7f2f9c0b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 -- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9c0d3880 msgr2=0x7f2f9c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9c0d3880 0x7f2f9c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 -- 172.21.15.57:0/3349150530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88009420 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa0cc6640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9c0b25c0 0x7f2f9c0cb3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001a0b0 tx=0x7f2f90019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2f997fa640 1 -- 172.21.15.57:0/3349150530 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900b5470 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2f997fa640 1 -- 172.21.15.57:0/3349150530 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900b55f0 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f90009420 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2f997fa640 1 -- 172.21.15.57:0/3349150530 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900b59a0 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.054+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c15c6f0 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.058+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c067520 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.058+0000 7f2f997fa640 1 -- 172.21.15.57:0/3349150530 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f900b2040 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.058+0000 7f2f997fa640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f80066470 0x7f2f80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.058+0000 7f2f997fa640 1 -- 172.21.15.57:0/3349150530 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f9011e140 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.058+0000 7f2f9bfff640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f80066470 0x7f2f80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.058+0000 7f2f9bfff640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f80066470 0x7f2f80068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0ca170 tx=0x7f2f88009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.062+0000 7f2f997fa640 1 -- 172.21.15.57:0/3349150530 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f900eb5d0 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.222+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f9c0b1980 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.222+0000 7f2f997fa640 1 -- 172.21.15.57:0/3349150530 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f2f900b0090 con 0x7f2f9c0b25c0 2023-11-24T08:04:53.228 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:53.228 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:52.236519+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:53.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f80066470 msgr2=0x7f2f80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f80066470 0x7f2f80068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0ca170 tx=0x7f2f88009190 comp rx=0 tx=0).stop 2023-11-24T08:04:53.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9c0b25c0 msgr2=0x7f2f9c0cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9c0b25c0 0x7f2f9c0cb3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001a0b0 tx=0x7f2f90019220 comp rx=0 tx=0).stop 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 shutdown_connections 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2f80066470 0x7f2f80068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f9c15d720 0x7f2f9c0b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f9c0d3880 0x7f2f9c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 --2- 172.21.15.57:0/3349150530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9c0b25c0 0x7f2f9c0cb3b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 >> 172.21.15.57:0/3349150530 conn(0x7f2f9c08af70 msgr2=0x7f2f9c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 shutdown_connections 2023-11-24T08:04:53.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.226+0000 7f2fa2f2a640 1 -- 172.21.15.57:0/3349150530 wait complete. 2023-11-24T08:04:53.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:53.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8878701640 1 Processor -- start 2023-11-24T08:04:53.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8878701640 1 -- start start 2023-11-24T08:04:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8878701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 0x7f88700d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8878701640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887006d050 con 0x7f88700d3a50 2023-11-24T08:04:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8878701640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887006c720 con 0x7f88700b25c0 2023-11-24T08:04:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8878701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700d2240 con 0x7f887015d720 2023-11-24T08:04:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8876c9e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f88700d3a50 0x7f88700cde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60874/0 (socket says 172.21.15.57:60874) 2023-11-24T08:04:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.390+0000 7f8876c9e640 1 -- 172.21.15.57:0/1776757912 learned_addr learned my addr 172.21.15.57:0/1776757912 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887649d640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 0x7f88700d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617615915 0 0) 0x7f887006d050 con 0x7f88700d3a50 2023-11-24T08:04:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885c003530 con 0x7f88700d3a50 2023-11-24T08:04:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571987549 0 0) 0x7f885c003530 con 0x7f88700d3a50 2023-11-24T08:04:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 msgr2=0x7f88700d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 0x7f88700d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 >> v1:172.21.15.132:6789/0 conn(0x7f88700b25c0 legacy=0x7f88700d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887006ca00 con 0x7f88700d3a50 2023-11-24T08:04:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f8868001a00 con 0x7f88700d3a50 2023-11-24T08:04:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 >> v1:172.21.15.57:6789/0 conn(0x7f88700d3a50 legacy=0x7f88700cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f885c0039b0 0x7f885c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0047d0 0x7f885c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 0x7f885c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700d2240 con 0x7f885c0039b0 2023-11-24T08:04:53.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c00ba40 con 0x7f885c0047d0 2023-11-24T08:04:53.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c00bbb0 con 0x7f887015d720 2023-11-24T08:04:53.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887649d640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f885c0039b0 0x7f885c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f8875c9c640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0047d0 0x7f885c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f8876c9e640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 0x7f885c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887649d640 1 -- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 msgr2=0x7f885c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887649d640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f887015d720 0x7f885c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887649d640 1 -- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0047d0 msgr2=0x7f885c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887649d640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0047d0 0x7f885c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.394+0000 7f887649d640 1 -- 172.21.15.57:0/1776757912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c003530 con 0x7f885c0039b0 2023-11-24T08:04:53.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f887649d640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f885c0039b0 0x7f885c003d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f886c009ab0 tx=0x7f886c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e693b9f43edf5b2e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0a5600 con 0x7f885c0039b0 2023-11-24T08:04:53.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c0a5760 con 0x7f885c0039b0 2023-11-24T08:04:53.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f887549b640 1 -- 172.21.15.57:0/1776757912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0a5b10 con 0x7f885c0039b0 2023-11-24T08:04:53.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- 172.21.15.57:0/1776757912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f885c0039b0 msgr2=0x7f885c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 --2- 172.21.15.57:0/1776757912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f885c0039b0 0x7f885c003d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f886c009ab0 tx=0x7f886c01c9b0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8876c9e640 1 -- 172.21.15.57:0/1776757912 reap_dead start 2023-11-24T08:04:53.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- 172.21.15.57:0/1776757912 shutdown_connections 2023-11-24T08:04:53.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- 172.21.15.57:0/1776757912 >> 172.21.15.57:0/1776757912 conn(0x7f887008af70 msgr2=0x7f887009c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- 172.21.15.57:0/1776757912 shutdown_connections 2023-11-24T08:04:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- 172.21.15.57:0/1776757912 wait complete. 2023-11-24T08:04:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 Processor -- start 2023-11-24T08:04:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- start start 2023-11-24T08:04:53.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0039b0 0x7f88700cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88700b8890 0x7f88700cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88700ca500 0x7f887015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700caac0 con 0x7f88700ca500 2023-11-24T08:04:53.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700cada0 con 0x7f885c0039b0 2023-11-24T08:04:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.398+0000 7f8878701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700cb080 con 0x7f88700b8890 2023-11-24T08:04:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88700ca500 0x7f887015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88700ca500 0x7f887015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44094/0 (socket says 172.21.15.57:44094) 2023-11-24T08:04:53.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 -- 172.21.15.57:0/103345193 learned_addr learned my addr 172.21.15.57:0/103345193 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f887649d640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0039b0 0x7f88700cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8875c9c640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88700b8890 0x7f88700cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 -- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88700b8890 msgr2=0x7f88700cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88700b8890 0x7f88700cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 -- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0039b0 msgr2=0x7f88700cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0039b0 0x7f88700cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 -- 172.21.15.57:0/103345193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700cb360 con 0x7f88700ca500 2023-11-24T08:04:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8876c9e640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88700ca500 0x7f887015c370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f88700b9440 tx=0x7f8868007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8866ffd640 1 -- 172.21.15.57:0/103345193 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800eb00 con 0x7f88700ca500 2023-11-24T08:04:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8866ffd640 1 -- 172.21.15.57:0/103345193 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800ec60 con 0x7f88700ca500 2023-11-24T08:04:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8866ffd640 1 -- 172.21.15.57:0/103345193 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868013420 con 0x7f88700ca500 2023-11-24T08:04:53.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88700cb640 con 0x7f88700ca500 2023-11-24T08:04:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88700ccab0 con 0x7f88700ca500 2023-11-24T08:04:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88700ccca0 con 0x7f88700ca500 2023-11-24T08:04:53.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.402+0000 7f8866ffd640 1 -- 172.21.15.57:0/103345193 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8868013580 con 0x7f88700ca500 2023-11-24T08:04:53.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.406+0000 7f8866ffd640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8854066470 0x7f8854068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.406+0000 7f8866ffd640 1 -- 172.21.15.57:0/103345193 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8868084130 con 0x7f88700ca500 2023-11-24T08:04:53.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.406+0000 7f887649d640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8854066470 0x7f8854068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.406+0000 7f887649d640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8854066470 0x7f8854068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f886c0af000 tx=0x7f886c0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.410+0000 7f8866ffd640 1 -- 172.21.15.57:0/103345193 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88700ccca0 con 0x7f88700ca500 2023-11-24T08:04:53.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.566+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88700ccca0 con 0x7f88700ca500 2023-11-24T08:04:53.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8866ffd640 1 -- 172.21.15.57:0/103345193 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f88700ccca0 con 0x7f88700ca500 2023-11-24T08:04:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:53.574 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:52.236519+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8854066470 msgr2=0x7f8854068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8854066470 0x7f8854068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f886c0af000 tx=0x7f886c0046d0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88700ca500 msgr2=0x7f887015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88700ca500 0x7f887015c370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f88700b9440 tx=0x7f8868007bc0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 shutdown_connections 2023-11-24T08:04:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8854066470 0x7f8854068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88700ca500 0x7f887015c370 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88700b8890 0x7f88700cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 --2- 172.21.15.57:0/103345193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f885c0039b0 0x7f88700cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 >> 172.21.15.57:0/103345193 conn(0x7f887008af70 msgr2=0x7f8870073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 shutdown_connections 2023-11-24T08:04:53.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.570+0000 7f8878701640 1 -- 172.21.15.57:0/103345193 wait complete. 2023-11-24T08:04:53.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:04:53.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedf5d2a640 1 Processor -- start 2023-11-24T08:04:53.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedf5d2a640 1 -- start start 2023-11-24T08:04:53.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedf5d2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedf5d2a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fedf00cd850 0x7fedf00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedf5d2a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf00b3510 con 0x7fedf00ce250 2023-11-24T08:04:53.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedf5d2a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf00ce6e0 con 0x7fedf00cd850 2023-11-24T08:04:53.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedf5d2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00b37f0 con 0x7fedf00ae4a0 2023-11-24T08:04:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedeeffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fedf00cd850 0x7fedf00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedeffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fedf00ce250 0x7fedf015eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60890/0 (socket says 172.21.15.57:60890) 2023-11-24T08:04:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedeffff640 1 -- 172.21.15.57:0/2697248641 learned_addr learned my addr 172.21.15.57:0/2697248641 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedef7fe640 1 --2- 172.21.15.57:0/2697248641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedeeffd640 1 -- 172.21.15.57:0/2697248641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 msgr2=0x7fedf015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedeeffd640 1 --2- 172.21.15.57:0/2697248641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedeeffd640 1 -- 172.21.15.57:0/2697248641 >> v1:172.21.15.57:6789/0 conn(0x7fedf00ce250 legacy=0x7fedf015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.738+0000 7fedeeffd640 1 -- 172.21.15.57:0/2697248641 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00b3ad0 con 0x7fedf00cd850 2023-11-24T08:04:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedeeffd640 1 --2- 172.21.15.57:0/2697248641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00cd850 0x7fedf00cdd10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fede40097c0 tx=0x7fede401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd89257137d15b0a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedee7fc640 1 -- 172.21.15.57:0/2697248641 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede40ab650 con 0x7fedf00cd850 2023-11-24T08:04:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedee7fc640 1 -- 172.21.15.57:0/2697248641 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede40ab7b0 con 0x7fedf00cd850 2023-11-24T08:04:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedee7fc640 1 -- 172.21.15.57:0/2697248641 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede40abb40 con 0x7fedf00cd850 2023-11-24T08:04:53.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2697248641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00cd850 msgr2=0x7fedf00cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2697248641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00cd850 0x7fedf00cdd10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fede40097c0 tx=0x7fede401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:53.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2697248641 shutdown_connections 2023-11-24T08:04:53.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2697248641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00cd850 0x7fedf00cdd10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2697248641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2697248641 >> 172.21.15.57:0/2697248641 conn(0x7fedf00b0c80 msgr2=0x7fedf00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2697248641 shutdown_connections 2023-11-24T08:04:53.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.742+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2697248641 wait complete. 2023-11-24T08:04:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 Processor -- start 2023-11-24T08:04:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 -- start start 2023-11-24T08:04:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf0147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf00cd850 0x7fedf015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00ce250 0x7fedf015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0070af0 con 0x7fedf00ce250 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00ad2f0 con 0x7fedf00cd850 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00acd30 con 0x7fedf00ae4a0 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00ce250 0x7fedf015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00ce250 0x7fedf015e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44112/0 (socket says 172.21.15.57:44112) 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 -- 172.21.15.57:0/2243294515 learned_addr learned my addr 172.21.15.57:0/2243294515 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedef7fe640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf0147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeeffd640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf00cd850 0x7fedf015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 -- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 msgr2=0x7fedf0147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf0147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 -- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf00cd850 msgr2=0x7fedf015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf00cd850 0x7fedf015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 -- 172.21.15.57:0/2243294515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4009420 con 0x7fedf00ce250 2023-11-24T08:04:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedeffff640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00ce250 0x7fedf015e0f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fede800ca80 tx=0x7fede800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedd7fff640 1 -- 172.21.15.57:0/2243294515 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800ac30 con 0x7fedf00ce250 2023-11-24T08:04:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedd7fff640 1 -- 172.21.15.57:0/2243294515 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede800ad90 con 0x7fedf00ce250 2023-11-24T08:04:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf00ad010 con 0x7fedf00ce250 2023-11-24T08:04:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedd7fff640 1 -- 172.21.15.57:0/2243294515 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8012600 con 0x7fedf00ce250 2023-11-24T08:04:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf00ac970 con 0x7fedf00ce250 2023-11-24T08:04:53.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.746+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf00cff90 con 0x7fedf00ce250 2023-11-24T08:04:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.750+0000 7fedd7fff640 1 -- 172.21.15.57:0/2243294515 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fede8007070 con 0x7fedf00ce250 2023-11-24T08:04:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.750+0000 7fedd7fff640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feddc0664a0 0x7feddc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.750+0000 7fedd7fff640 1 -- 172.21.15.57:0/2243294515 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fede8083c40 con 0x7fedf00ce250 2023-11-24T08:04:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.750+0000 7fedef7fe640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feddc0664a0 0x7feddc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.750+0000 7fedef7fe640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feddc0664a0 0x7feddc068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fedf00b1d10 tx=0x7fede0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.754+0000 7fedd7fff640 1 -- 172.21.15.57:0/2243294515 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fede8051160 con 0x7fedf00ce250 2023-11-24T08:04:53.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:53.950+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fedf00705e0 con 0x7fedf00ce250 2023-11-24T08:04:54.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.882+0000 7fedd7fff640 1 -- 172.21.15.57:0/2243294515 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fedf00705e0 con 0x7fedf00ce250 2023-11-24T08:04:54.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feddc0664a0 msgr2=0x7feddc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feddc0664a0 0x7feddc068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fedf00b1d10 tx=0x7fede0009190 comp rx=0 tx=0).stop 2023-11-24T08:04:54.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00ce250 msgr2=0x7fedf015e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00ce250 0x7fedf015e0f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fede800ca80 tx=0x7fede800cf40 comp rx=0 tx=0).stop 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 shutdown_connections 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feddc0664a0 0x7feddc068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf00ce250 0x7fedf015e0f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedf00cd850 0x7fedf015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 --2- 172.21.15.57:0/2243294515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fedf00ae4a0 0x7fedf0147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 >> 172.21.15.57:0/2243294515 conn(0x7fedf00b0c80 msgr2=0x7fedf00b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 shutdown_connections 2023-11-24T08:04:54.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:54.886+0000 7fedf5d2a640 1 -- 172.21.15.57:0/2243294515 wait complete. 2023-11-24T08:04:54.915 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:04:54.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:04:55.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f913050f640 1 Processor -- start 2023-11-24T08:04:55.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f913050f640 1 -- start start 2023-11-24T08:04:55.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f913050f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ce420 0x7f912815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f913050f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91280cd850 0x7f912806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f913050f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91280b3510 con 0x7f91280ae4a0 2023-11-24T08:04:55.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f913050f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91280b37f0 con 0x7f91280cd850 2023-11-24T08:04:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f913050f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280b3ad0 con 0x7f91280ce420 2023-11-24T08:04:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912eaac640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91280cd850 0x7f912806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912eaac640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91280cd850 0x7f912806c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44122/0 (socket says 172.21.15.57:44122) 2023-11-24T08:04:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912eaac640 1 -- 172.21.15.57:0/3030844043 learned_addr learned my addr 172.21.15.57:0/3030844043 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912daaa640 1 --2- 172.21.15.57:0/3030844043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ce420 0x7f912815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912eaac640 1 -- 172.21.15.57:0/3030844043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ce420 msgr2=0x7f912815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912eaac640 1 --2- 172.21.15.57:0/3030844043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ce420 0x7f912815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912eaac640 1 -- 172.21.15.57:0/3030844043 >> v1:172.21.15.132:6789/0 conn(0x7f91280ae4a0 legacy=0x7f91280cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912eaac640 1 -- 172.21.15.57:0/3030844043 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280b3db0 con 0x7f91280cd850 2023-11-24T08:04:55.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.062+0000 7f912daaa640 1 --2- 172.21.15.57:0/3030844043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ce420 0x7f912815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f912eaac640 1 --2- 172.21.15.57:0/3030844043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f912806c640 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9120009e50 tx=0x7f912001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c05478d8d25dedc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f912d2a9640 1 -- 172.21.15.57:0/3030844043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91200a5840 con 0x7f91280cd850 2023-11-24T08:04:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f912d2a9640 1 -- 172.21.15.57:0/3030844043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91200a59a0 con 0x7f91280cd850 2023-11-24T08:04:55.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f912d2a9640 1 -- 172.21.15.57:0/3030844043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91200a5d30 con 0x7f91280cd850 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 -- 172.21.15.57:0/3030844043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 msgr2=0x7f912806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 --2- 172.21.15.57:0/3030844043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f912806c640 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9120009e50 tx=0x7f912001c9a0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 -- 172.21.15.57:0/3030844043 shutdown_connections 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 --2- 172.21.15.57:0/3030844043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f912806c640 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 --2- 172.21.15.57:0/3030844043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ce420 0x7f912815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 -- 172.21.15.57:0/3030844043 >> 172.21.15.57:0/3030844043 conn(0x7f91280b0c80 msgr2=0x7f91280b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 -- 172.21.15.57:0/3030844043 shutdown_connections 2023-11-24T08:04:55.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.066+0000 7f913050f640 1 -- 172.21.15.57:0/3030844043 wait complete. 2023-11-24T08:04:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 Processor -- start 2023-11-24T08:04:55.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 -- start start 2023-11-24T08:04:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ae4a0 0x7f9128149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f9128149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91280ce420 0x7f9128150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128149ac0 con 0x7f91280cd850 2023-11-24T08:04:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128149580 con 0x7f91280ce420 2023-11-24T08:04:55.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912814a450 con 0x7f91280ae4a0 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f9128149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f9128149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44138/0 (socket says 172.21.15.57:44138) 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 -- 172.21.15.57:0/2266535062 learned_addr learned my addr 172.21.15.57:0/2266535062 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912eaac640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91280ce420 0x7f9128150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912e2ab640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ae4a0 0x7f9128149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 -- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ae4a0 msgr2=0x7f9128149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ae4a0 0x7f9128149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 -- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91280ce420 msgr2=0x7f9128150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91280ce420 0x7f9128150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 -- 172.21.15.57:0/2266535062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120009b30 con 0x7f91280cd850 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912e2ab640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ae4a0 0x7f9128149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:55.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f912daaa640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f9128149f10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f911800d7d0 tx=0x7f911800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f911effd640 1 -- 172.21.15.57:0/2266535062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91180096a0 con 0x7f91280cd850 2023-11-24T08:04:55.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f911effd640 1 -- 172.21.15.57:0/2266535062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118009800 con 0x7f91280cd850 2023-11-24T08:04:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9128153650 con 0x7f91280cd850 2023-11-24T08:04:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f911effd640 1 -- 172.21.15.57:0/2266535062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118009bb0 con 0x7f91280cd850 2023-11-24T08:04:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.070+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9128153c10 con 0x7f91280cd850 2023-11-24T08:04:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.074+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912804e8c0 con 0x7f91280cd850 2023-11-24T08:04:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.074+0000 7f911effd640 1 -- 172.21.15.57:0/2266535062 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9118009d10 con 0x7f91280cd850 2023-11-24T08:04:55.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.074+0000 7f911effd640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f910c066470 0x7f910c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.074+0000 7f911effd640 1 -- 172.21.15.57:0/2266535062 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9118084500 con 0x7f91280cd850 2023-11-24T08:04:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.074+0000 7f912e2ab640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f910c066470 0x7f910c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.074+0000 7f912e2ab640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f910c066470 0x7f910c068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9124003ec0 tx=0x7f9124009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.078+0000 7f911effd640 1 -- 172.21.15.57:0/2266535062 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9118051980 con 0x7f91280cd850 2023-11-24T08:04:55.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.266+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f912815e530 con 0x7f91280cd850 2023-11-24T08:04:55.814 INFO:tasks.ceph.mds.d.smithi132.stderr:2023-11-24T08:04:55.810+0000 7fa5c3ec5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:04:55.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.886+0000 7f911effd640 1 -- 172.21.15.57:0/2266535062 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f911800b440 con 0x7f91280cd850 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f910c066470 msgr2=0x7f910c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f910c066470 0x7f910c068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9124003ec0 tx=0x7f9124009040 comp rx=0 tx=0).stop 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 msgr2=0x7f9128149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f9128149f10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f911800d7d0 tx=0x7f911800dc90 comp rx=0 tx=0).stop 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 shutdown_connections 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f910c066470 0x7f910c068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91280ce420 0x7f9128150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91280cd850 0x7f9128149f10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 --2- 172.21.15.57:0/2266535062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f91280ae4a0 0x7f9128149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 >> 172.21.15.57:0/2266535062 conn(0x7f91280b0c80 msgr2=0x7f91280cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 shutdown_connections 2023-11-24T08:04:55.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:55.890+0000 7f913050f640 1 -- 172.21.15.57:0/2266535062 wait complete. 2023-11-24T08:04:55.918 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:04:55.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:56.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f69b4640 1 Processor -- start 2023-11-24T08:04:56.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f69b4640 1 -- start start 2023-11-24T08:04:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f69b4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56f015d500 0x7f56f00ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f69b4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56f00cfc10 0x7f56f00d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f69b4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f00d0580 con 0x7f56f00d3e80 2023-11-24T08:04:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f69b4640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f00d21c0 con 0x7f56f015d500 2023-11-24T08:04:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f69b4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f00cdcd0 con 0x7f56f00cfc10 2023-11-24T08:04:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f59b2640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56f015d500 0x7f56f00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f59b2640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56f015d500 0x7f56f00ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47554/0 (socket says 172.21.15.57:47554) 2023-11-24T08:04:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f59b2640 1 -- 172.21.15.57:0/2402800786 learned_addr learned my addr 172.21.15.57:0/2402800786 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f59b2640 1 -- 172.21.15.57:0/2402800786 >> v2:172.21.15.132:3300/0 conn(0x7f56f00cfc10 msgr2=0x7f56f00d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f61b3640 1 --2- 172.21.15.57:0/2402800786 >> v2:172.21.15.132:3300/0 conn(0x7f56f00cfc10 0x7f56f00d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f59b2640 1 --2- 172.21.15.57:0/2402800786 >> v2:172.21.15.132:3300/0 conn(0x7f56f00cfc10 0x7f56f00d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f59b2640 1 -- 172.21.15.57:0/2402800786 >> v1:172.21.15.132:6789/0 conn(0x7f56f00d3e80 legacy=0x7f56f00d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f59b2640 1 -- 172.21.15.57:0/2402800786 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f00d1ef0 con 0x7f56f015d500 2023-11-24T08:04:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.062+0000 7f56f61b3640 1 --2- 172.21.15.57:0/2402800786 >> v2:172.21.15.132:3300/0 conn(0x7f56f00cfc10 0x7f56f00d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f59b2640 1 --2- 172.21.15.57:0/2402800786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f015d500 0x7f56f00ced30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f56f00728f0 tx=0x7f56ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec77895785d93e7c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f49b0640 1 -- 172.21.15.57:0/2402800786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0aa5f0 con 0x7f56f015d500 2023-11-24T08:04:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f49b0640 1 -- 172.21.15.57:0/2402800786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0aa750 con 0x7f56f015d500 2023-11-24T08:04:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f49b0640 1 -- 172.21.15.57:0/2402800786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0aaae0 con 0x7f56f015d500 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 -- 172.21.15.57:0/2402800786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f015d500 msgr2=0x7f56f00ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 --2- 172.21.15.57:0/2402800786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f015d500 0x7f56f00ced30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f56f00728f0 tx=0x7f56ec01c490 comp rx=0 tx=0).stop 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 -- 172.21.15.57:0/2402800786 shutdown_connections 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 --2- 172.21.15.57:0/2402800786 >> v2:172.21.15.132:3300/0 conn(0x7f56f00cfc10 0x7f56f00d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 --2- 172.21.15.57:0/2402800786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f015d500 0x7f56f00ced30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 -- 172.21.15.57:0/2402800786 >> 172.21.15.57:0/2402800786 conn(0x7f56f009c540 msgr2=0x7f56f00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 -- 172.21.15.57:0/2402800786 shutdown_connections 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 -- 172.21.15.57:0/2402800786 wait complete. 2023-11-24T08:04:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.066+0000 7f56f69b4640 1 Processor -- start 2023-11-24T08:04:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 -- start start 2023-11-24T08:04:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00cfc10 0x7f56f00b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f00d3e80 0x7f56f00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56f015d500 0x7f56f00b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00b5b50 con 0x7f56f00d3e80 2023-11-24T08:04:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f01601a0 con 0x7f56f00cfc10 2023-11-24T08:04:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00b60b0 con 0x7f56f015d500 2023-11-24T08:04:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f00d3e80 0x7f56f00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f00d3e80 0x7f56f00b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47560/0 (socket says 172.21.15.57:47560) 2023-11-24T08:04:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 -- 172.21.15.57:0/3885212649 learned_addr learned my addr 172.21.15.57:0/3885212649 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f59b2640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00cfc10 0x7f56f00b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f61b3640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56f015d500 0x7f56f00b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 -- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56f015d500 msgr2=0x7f56f00b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56f015d500 0x7f56f00b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 -- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00cfc10 msgr2=0x7f56f00b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00cfc10 0x7f56f00b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 -- 172.21.15.57:0/3885212649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0094d0 con 0x7f56f00d3e80 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f59b2640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00cfc10 0x7f56f00b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f51b1640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f00d3e80 0x7f56f00b5610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56e000c4c0 tx=0x7f56e0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56e67fc640 1 -- 172.21.15.57:0/3885212649 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0005480 con 0x7f56f00d3e80 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56e67fc640 1 -- 172.21.15.57:0/3885212649 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e0003600 con 0x7f56f00d3e80 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f01609b0 con 0x7f56f00d3e80 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56e67fc640 1 -- 172.21.15.57:0/3885212649 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0003990 con 0x7f56f00d3e80 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f01606d0 con 0x7f56f00d3e80 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.070+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f004e850 con 0x7f56f00d3e80 2023-11-24T08:04:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.074+0000 7f56e67fc640 1 -- 172.21.15.57:0/3885212649 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56e0003af0 con 0x7f56f00d3e80 2023-11-24T08:04:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.074+0000 7f56e67fc640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f56d40664c0 0x7f56d4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.074+0000 7f56e67fc640 1 -- 172.21.15.57:0/3885212649 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56e00833e0 con 0x7f56f00d3e80 2023-11-24T08:04:56.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.074+0000 7f56f59b2640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f56d40664c0 0x7f56d4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.074+0000 7f56f59b2640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f56d40664c0 0x7f56d4068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0ae000 tx=0x7f56ec0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.078+0000 7f56e67fc640 1 -- 172.21.15.57:0/3885212649 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56e00508d0 con 0x7f56f00d3e80 2023-11-24T08:04:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.266+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56f00cf9f0 con 0x7f56f00d3e80 2023-11-24T08:04:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.266+0000 7f56e67fc640 1 -- 172.21.15.57:0/3885212649 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f56e0017090 con 0x7f56f00d3e80 2023-11-24T08:04:56.273 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:56.273 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2109788946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2109788946},{"type":"v1","addr":"172.21.15.132:6835","nonce":2109788946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3040903718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3040903718},{"type":"v1","addr":"172.21.15.57:6834","nonce":3040903718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/412231567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":412231567},{"type":"v1","addr":"172.21.15.57:6835","nonce":412231567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:52.236854+0000","modified":"2023-11-24T08:04:55.272383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54689},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54689":{"gid":54689,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/404616365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":404616365},{"type":"v1","addr":"172.21.15.132:6837","nonce":404616365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:04:56.273 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f56d40664c0 msgr2=0x7f56d4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f56d40664c0 0x7f56d4068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0ae000 tx=0x7f56ec0a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f00d3e80 msgr2=0x7f56f00b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f00d3e80 0x7f56f00b5610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56e000c4c0 tx=0x7f56e0001e80 comp rx=0 tx=0).stop 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 shutdown_connections 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f56d40664c0 0x7f56d4068980 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56f015d500 0x7f56f00b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56f00d3e80 0x7f56f00b5610 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 --2- 172.21.15.57:0/3885212649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f00cfc10 0x7f56f00b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 >> 172.21.15.57:0/3885212649 conn(0x7f56f009c540 msgr2=0x7f56f006b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 shutdown_connections 2023-11-24T08:04:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.270+0000 7f56f69b4640 1 -- 172.21.15.57:0/3885212649 wait complete. 2023-11-24T08:04:56.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:56.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.430+0000 7f17f125a640 1 Processor -- start 2023-11-24T08:04:56.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17f125a640 1 -- start start 2023-11-24T08:04:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17f125a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17f125a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17ec09cc20 0x7f17ec06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17f125a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec06d8b0 con 0x7f17ec06e280 2023-11-24T08:04:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17f125a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec145020 con 0x7f17ec09cc20 2023-11-24T08:04:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17f125a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec09d0a0 con 0x7f17ec144030 2023-11-24T08:04:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17e3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17ec09cc20 0x7f17ec06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17eb59e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f17ec06e280 0x7f17ec0709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52380/0 (socket says 172.21.15.57:52380) 2023-11-24T08:04:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17eb59e640 1 -- 172.21.15.57:0/84513730 learned_addr learned my addr 172.21.15.57:0/84513730 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17ead9d640 1 --2- 172.21.15.57:0/84513730 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17e3fff640 1 -- 172.21.15.57:0/84513730 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 msgr2=0x7f17ec06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17e3fff640 1 --2- 172.21.15.57:0/84513730 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17e3fff640 1 -- 172.21.15.57:0/84513730 >> v1:172.21.15.57:6789/0 conn(0x7f17ec06e280 legacy=0x7f17ec0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17e3fff640 1 -- 172.21.15.57:0/84513730 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec06cca0 con 0x7f17ec09cc20 2023-11-24T08:04:56.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.434+0000 7f17ea59c640 1 -- 172.21.15.57:0/84513730 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639775939 0 0) 0x7f17ec06d8b0 con 0x7f17ec06e280 2023-11-24T08:04:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17e3fff640 1 --2- 172.21.15.57:0/84513730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec09cc20 0x7f17ec06dd40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17d40097c0 tx=0x7f17d401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f728209afa61d65 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17ea59c640 1 -- 172.21.15.57:0/84513730 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40ab650 con 0x7f17ec09cc20 2023-11-24T08:04:56.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17ea59c640 1 -- 172.21.15.57:0/84513730 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d40ab7b0 con 0x7f17ec09cc20 2023-11-24T08:04:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17ea59c640 1 -- 172.21.15.57:0/84513730 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40abb40 con 0x7f17ec09cc20 2023-11-24T08:04:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 -- 172.21.15.57:0/84513730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec09cc20 msgr2=0x7f17ec06dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 --2- 172.21.15.57:0/84513730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec09cc20 0x7f17ec06dd40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17d40097c0 tx=0x7f17d401c450 comp rx=0 tx=0).stop 2023-11-24T08:04:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 -- 172.21.15.57:0/84513730 shutdown_connections 2023-11-24T08:04:56.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 --2- 172.21.15.57:0/84513730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec09cc20 0x7f17ec06dd40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 --2- 172.21.15.57:0/84513730 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 -- 172.21.15.57:0/84513730 >> 172.21.15.57:0/84513730 conn(0x7f17ec0b0bf0 msgr2=0x7f17ec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 -- 172.21.15.57:0/84513730 shutdown_connections 2023-11-24T08:04:56.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 -- 172.21.15.57:0/84513730 wait complete. 2023-11-24T08:04:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.438+0000 7f17f125a640 1 Processor -- start 2023-11-24T08:04:56.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 -- start start 2023-11-24T08:04:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec06e280 0x7f17ec13c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ec09cc20 0x7f17ec1353d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec13d180 con 0x7f17ec06e280 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec13d460 con 0x7f17ec09cc20 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec13d740 con 0x7f17ec144030 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec06e280 0x7f17ec13c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec06e280 0x7f17ec13c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47580/0 (socket says 172.21.15.57:47580) 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 -- 172.21.15.57:0/1402139574 learned_addr learned my addr 172.21.15.57:0/1402139574 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17eb59e640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17e3fff640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ec09cc20 0x7f17ec1353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 -- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 msgr2=0x7f17ec15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 -- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ec09cc20 msgr2=0x7f17ec1353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ec09cc20 0x7f17ec1353d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 -- 172.21.15.57:0/1402139574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4009420 con 0x7f17ec06e280 2023-11-24T08:04:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17ead9d640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec06e280 0x7f17ec13c8e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d800 tx=0x7f17dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17e37fe640 1 -- 172.21.15.57:0/1402139574 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00b6c0 con 0x7f17ec06e280 2023-11-24T08:04:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17e37fe640 1 -- 172.21.15.57:0/1402139574 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00b820 con 0x7f17ec06e280 2023-11-24T08:04:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec13da20 con 0x7f17ec06e280 2023-11-24T08:04:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17e37fe640 1 -- 172.21.15.57:0/1402139574 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00bb90 con 0x7f17ec06e280 2023-11-24T08:04:56.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec13ce20 con 0x7f17ec06e280 2023-11-24T08:04:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.442+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec067520 con 0x7f17ec06e280 2023-11-24T08:04:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.446+0000 7f17e37fe640 1 -- 172.21.15.57:0/1402139574 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17dc00bcf0 con 0x7f17ec06e280 2023-11-24T08:04:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.446+0000 7f17e37fe640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17cc066470 0x7f17cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.446+0000 7f17e37fe640 1 -- 172.21.15.57:0/1402139574 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17dc084370 con 0x7f17ec06e280 2023-11-24T08:04:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.446+0000 7f17e3fff640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17cc066470 0x7f17cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.446+0000 7f17e3fff640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17cc066470 0x7f17cc068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17d40af000 tx=0x7f17d40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.450+0000 7f17e37fe640 1 -- 172.21.15.57:0/1402139574 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17dc051880 con 0x7f17ec06e280 2023-11-24T08:04:56.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.606+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17ec13c540 con 0x7f17ec06e280 2023-11-24T08:04:56.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.606+0000 7f17e37fe640 1 -- 172.21.15.57:0/1402139574 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f17dc054ea0 con 0x7f17ec06e280 2023-11-24T08:04:56.613 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:56.613 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:53.859168+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:56.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17cc066470 msgr2=0x7f17cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17cc066470 0x7f17cc068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17d40af000 tx=0x7f17d40a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:56.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec06e280 msgr2=0x7f17ec13c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec06e280 0x7f17ec13c8e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d800 tx=0x7f17dc00dcc0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 shutdown_connections 2023-11-24T08:04:56.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17cc066470 0x7f17cc068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ec144030 0x7f17ec15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ec09cc20 0x7f17ec1353d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 --2- 172.21.15.57:0/1402139574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ec06e280 0x7f17ec13c8e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 >> 172.21.15.57:0/1402139574 conn(0x7f17ec0b0bf0 msgr2=0x7f17ec13b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 shutdown_connections 2023-11-24T08:04:56.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.610+0000 7f17f125a640 1 -- 172.21.15.57:0/1402139574 wait complete. 2023-11-24T08:04:56.635 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:04:56.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc8728fe640 1 Processor -- start 2023-11-24T08:04:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc8728fe640 1 -- start start 2023-11-24T08:04:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc8728fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc86c15d570 0x7fc86c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc8728fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc86c0ce8b0 0x7fc86c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc8728fe640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c0d1cc0 con 0x7fc86c0d3020 2023-11-24T08:04:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc8728fe640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c0d1fa0 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc8728fe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c0ce0b0 con 0x7fc86c15d570 2023-11-24T08:04:56.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc870e9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc86c0ce8b0 0x7fc86c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc86b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc86c0d3020 0x7fc86c0d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52388/0 (socket says 172.21.15.57:52388) 2023-11-24T08:04:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc870e9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc86c0ce8b0 0x7fc86c0ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47590/0 (socket says 172.21.15.57:47590) 2023-11-24T08:04:56.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc86b7fe640 1 -- 172.21.15.57:0/2223891616 learned_addr learned my addr 172.21.15.57:0/2223891616 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc86bfff640 1 --2- 172.21.15.57:0/2223891616 >> v2:172.21.15.132:3300/0 conn(0x7fc86c15d570 0x7fc86c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc870e9b640 1 -- 172.21.15.57:0/2223891616 >> v2:172.21.15.132:3300/0 conn(0x7fc86c15d570 msgr2=0x7fc86c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc870e9b640 1 --2- 172.21.15.57:0/2223891616 >> v2:172.21.15.132:3300/0 conn(0x7fc86c15d570 0x7fc86c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc870e9b640 1 -- 172.21.15.57:0/2223891616 >> v1:172.21.15.57:6789/0 conn(0x7fc86c0d3020 legacy=0x7fc86c0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc870e9b640 1 -- 172.21.15.57:0/2223891616 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0ce390 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc86bfff640 1 --2- 172.21.15.57:0/2223891616 >> v2:172.21.15.132:3300/0 conn(0x7fc86c15d570 0x7fc86c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.774+0000 7fc86affd640 1 -- 172.21.15.57:0/2223891616 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730536675 0 0) 0x7fc86c0d1cc0 con 0x7fc86c0d3020 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc870e9b640 1 --2- 172.21.15.57:0/2223891616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0ced60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0d0eb0 tx=0x7fc86401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2e5700e7eb57db server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc86affd640 1 -- 172.21.15.57:0/2223891616 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640a59c0 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc86affd640 1 -- 172.21.15.57:0/2223891616 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8640a5b20 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc86affd640 1 -- 172.21.15.57:0/2223891616 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640ad440 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 -- 172.21.15.57:0/2223891616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 msgr2=0x7fc86c0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 --2- 172.21.15.57:0/2223891616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0ced60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0d0eb0 tx=0x7fc86401c8e0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 -- 172.21.15.57:0/2223891616 shutdown_connections 2023-11-24T08:04:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 --2- 172.21.15.57:0/2223891616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0ced60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 --2- 172.21.15.57:0/2223891616 >> v2:172.21.15.132:3300/0 conn(0x7fc86c15d570 0x7fc86c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 -- 172.21.15.57:0/2223891616 >> 172.21.15.57:0/2223891616 conn(0x7fc86c08ceb0 msgr2=0x7fc86c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 -- 172.21.15.57:0/2223891616 shutdown_connections 2023-11-24T08:04:56.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.778+0000 7fc8728fe640 1 -- 172.21.15.57:0/2223891616 wait complete. 2023-11-24T08:04:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 Processor -- start 2023-11-24T08:04:56.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 -- start start 2023-11-24T08:04:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc86c0d3020 0x7fc86c156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86c15d570 0x7fc86c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0c91c0 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c1569b0 con 0x7fc86c15d570 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0c8c00 con 0x7fc86c0d3020 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47604/0 (socket says 172.21.15.57:47604) 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 -- 172.21.15.57:0/499788793 learned_addr learned my addr 172.21.15.57:0/499788793 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc870e9b640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86c15d570 0x7fc86c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86b7fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc86c0d3020 0x7fc86c156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 -- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc86c0d3020 msgr2=0x7fc86c156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc86c0d3020 0x7fc86c156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 -- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86c15d570 msgr2=0x7fc86c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86c15d570 0x7fc86c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 -- 172.21.15.57:0/499788793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc864009a70 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86b7fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc86c0d3020 0x7fc86c156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc870e9b640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86c15d570 0x7fc86c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc86bfff640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0c8520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00c820 tx=0x7fc85c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc868ff9640 1 -- 172.21.15.57:0/499788793 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c007a30 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc868ff9640 1 -- 172.21.15.57:0/499788793 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c007b90 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c0c8ee0 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc868ff9640 1 -- 172.21.15.57:0/499788793 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c00ce10 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.782+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c0ca950 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.786+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c0cab70 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.786+0000 7fc868ff9640 1 -- 172.21.15.57:0/499788793 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc85c0113f0 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.786+0000 7fc868ff9640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc858066470 0x7fc858068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.786+0000 7fc868ff9640 1 -- 172.21.15.57:0/499788793 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc85c083ea0 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.786+0000 7fc86b7fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc858066470 0x7fc858068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.786+0000 7fc86b7fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc858066470 0x7fc858068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc860007fd0 tx=0x7fc860007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.790+0000 7fc868ff9640 1 -- 172.21.15.57:0/499788793 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc85c0513b0 con 0x7fc86c0ce8b0 2023-11-24T08:04:56.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.946+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc86c0d17e0 con 0x7fc858066470 2023-11-24T08:04:56.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.954+0000 7fc868ff9640 1 -- 172.21.15.57:0/499788793 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288984 (secure 0 0 0) 0x7fc860005c90 con 0x7fc858066470 2023-11-24T08:04:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:56.964 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:04:56.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc858066470 msgr2=0x7fc858068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc858066470 0x7fc858068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc860007fd0 tx=0x7fc860007c20 comp rx=0 tx=0).stop 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 msgr2=0x7fc86c0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0c8520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00c820 tx=0x7fc85c00cce0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 shutdown_connections 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc858066470 0x7fc858068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86c15d570 0x7fc86c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc86c0d3020 0x7fc86c156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 --2- 172.21.15.57:0/499788793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86c0ce8b0 0x7fc86c0c8520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 >> 172.21.15.57:0/499788793 conn(0x7fc86c08ceb0 msgr2=0x7fc86c0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 shutdown_connections 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:56.958+0000 7fc8728fe640 1 -- 172.21.15.57:0/499788793 wait complete. 2023-11-24T08:04:56.983 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-24T08:04:56.693726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233104,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741616,"statfs":{"total":773094113280,"available":772855414784,"internally_reserved":0,"allocated":4562944,"data_stored":2480916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.861599"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182699+0000","last_change":"2023-11-24T08:04:52.866351+0000","last_active":"2023-11-24T08:04:54.182699+0000","last_peered":"2023-11-24T08:04:54.182699+0000","last_clean":"2023-11-24T08:04:54.182699+0000","last_became_active":"2023-11-24T08:04:52.866058+0000","last_became_peered":"2023-11-24T08:04:52.866058+0000","last_unstale":"2023-11-24T08:04:54.182699+0000","last_undegraded":"2023-11-24T08:04:54.182699+0000","last_fullsized":"2023-11-24T08:04:54.182699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:36.158868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181607+0000","last_change":"2023-11-24T08:04:52.876201+0000","last_active":"2023-11-24T08:04:54.181607+0000","last_peered":"2023-11-24T08:04:54.181607+0000","last_clean":"2023-11-24T08:04:54.181607+0000","last_became_active":"2023-11-24T08:04:52.875395+0000","last_became_peered":"2023-11-24T08:04:52.875395+0000","last_unstale":"2023-11-24T08:04:54.181607+0000","last_undegraded":"2023-11-24T08:04:54.181607+0000","last_fullsized":"2023-11-24T08:04:54.181607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:07.550669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181828+0000","last_change":"2023-11-24T08:04:52.873971+0000","last_active":"2023-11-24T08:04:54.181828+0000","last_peered":"2023-11-24T08:04:54.181828+0000","last_clean":"2023-11-24T08:04:54.181828+0000","last_became_active":"2023-11-24T08:04:52.872927+0000","last_became_peered":"2023-11-24T08:04:52.872927+0000","last_unstale":"2023-11-24T08:04:54.181828+0000","last_undegraded":"2023-11-24T08:04:54.181828+0000","last_fullsized":"2023-11-24T08:04:54.181828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:24.349560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180829+0000","last_change":"2023-11-24T08:04:52.890135+0000","last_active":"2023-11-24T08:04:54.180829+0000","last_peered":"2023-11-24T08:04:54.180829+0000","last_clean":"2023-11-24T08:04:54.180829+0000","last_became_active":"2023-11-24T08:04:52.889829+0000","last_became_peered":"2023-11-24T08:04:52.889829+0000","last_unstale":"2023-11-24T08:04:54.180829+0000","last_undegraded":"2023-11-24T08:04:54.180829+0000","last_fullsized":"2023-11-24T08:04:54.180829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:36.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880635+0000","last_change":"2023-11-24T08:04:52.866987+0000","last_active":"2023-11-24T08:04:53.880635+0000","last_peered":"2023-11-24T08:04:53.880635+0000","last_clean":"2023-11-24T08:04:53.880635+0000","last_became_active":"2023-11-24T08:04:52.866661+0000","last_became_peered":"2023-11-24T08:04:52.866661+0000","last_unstale":"2023-11-24T08:04:53.880635+0000","last_undegraded":"2023-11-24T08:04:53.880635+0000","last_fullsized":"2023-11-24T08:04:53.880635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:42:52.537643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181012+0000","last_change":"2023-11-24T08:04:52.872120+0000","last_active":"2023-11-24T08:04:54.181012+0000","last_peered":"2023-11-24T08:04:54.181012+0000","last_clean":"2023-11-24T08:04:54.181012+0000","last_became_active":"2023-11-24T08:04:52.871837+0000","last_became_peered":"2023-11-24T08:04:52.871837+0000","last_unstale":"2023-11-24T08:04:54.181012+0000","last_undegraded":"2023-11-24T08:04:54.181012+0000","last_fullsized":"2023-11-24T08:04:54.181012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878293+0000","last_change":"2023-11-24T08:04:52.878839+0000","last_active":"2023-11-24T08:04:53.878293+0000","last_peered":"2023-11-24T08:04:53.878293+0000","last_clean":"2023-11-24T08:04:53.878293+0000","last_became_active":"2023-11-24T08:04:52.877628+0000","last_became_peered":"2023-11-24T08:04:52.877628+0000","last_unstale":"2023-11-24T08:04:53.878293+0000","last_undegraded":"2023-11-24T08:04:53.878293+0000","last_fullsized":"2023-11-24T08:04:53.878293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:49.042270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878000+0000","last_change":"2023-11-24T08:04:52.884532+0000","last_active":"2023-11-24T08:04:53.878000+0000","last_peered":"2023-11-24T08:04:53.878000+0000","last_clean":"2023-11-24T08:04:53.878000+0000","last_became_active":"2023-11-24T08:04:52.884134+0000","last_became_peered":"2023-11-24T08:04:52.884134+0000","last_unstale":"2023-11-24T08:04:53.878000+0000","last_undegraded":"2023-11-24T08:04:53.878000+0000","last_fullsized":"2023-11-24T08:04:53.878000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:34.835875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182433+0000","last_change":"2023-11-24T08:04:52.881147+0000","last_active":"2023-11-24T08:04:54.182433+0000","last_peered":"2023-11-24T08:04:54.182433+0000","last_clean":"2023-11-24T08:04:54.182433+0000","last_became_active":"2023-11-24T08:04:52.879556+0000","last_became_peered":"2023-11-24T08:04:52.879556+0000","last_unstale":"2023-11-24T08:04:54.182433+0000","last_undegraded":"2023-11-24T08:04:54.182433+0000","last_fullsized":"2023-11-24T08:04:54.182433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:34.835875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181897+0000","last_change":"2023-11-24T08:04:52.872364+0000","last_active":"2023-11-24T08:04:54.181897+0000","last_peered":"2023-11-24T08:04:54.181897+0000","last_clean":"2023-11-24T08:04:54.181897+0000","last_became_active":"2023-11-24T08:04:52.872043+0000","last_became_peered":"2023-11-24T08:04:52.872043+0000","last_unstale":"2023-11-24T08:04:54.181897+0000","last_undegraded":"2023-11-24T08:04:54.181897+0000","last_fullsized":"2023-11-24T08:04:54.181897+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878173+0000","last_change":"2023-11-24T08:04:52.892219+0000","last_active":"2023-11-24T08:04:53.878173+0000","last_peered":"2023-11-24T08:04:53.878173+0000","last_clean":"2023-11-24T08:04:53.878173+0000","last_became_active":"2023-11-24T08:04:52.891938+0000","last_became_peered":"2023-11-24T08:04:52.891938+0000","last_unstale":"2023-11-24T08:04:53.878173+0000","last_undegraded":"2023-11-24T08:04:53.878173+0000","last_fullsized":"2023-11-24T08:04:53.878173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:31.794109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181470+0000","last_change":"2023-11-24T08:04:52.871589+0000","last_active":"2023-11-24T08:04:54.181470+0000","last_peered":"2023-11-24T08:04:54.181470+0000","last_clean":"2023-11-24T08:04:54.181470+0000","last_became_active":"2023-11-24T08:04:52.871340+0000","last_became_peered":"2023-11-24T08:04:52.871340+0000","last_unstale":"2023-11-24T08:04:54.181470+0000","last_undegraded":"2023-11-24T08:04:54.181470+0000","last_fullsized":"2023-11-24T08:04:54.181470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880770+0000","last_change":"2023-11-24T08:04:52.865341+0000","last_active":"2023-11-24T08:04:53.880770+0000","last_peered":"2023-11-24T08:04:53.880770+0000","last_clean":"2023-11-24T08:04:53.880770+0000","last_became_active":"2023-11-24T08:04:52.864979+0000","last_became_peered":"2023-11-24T08:04:52.864979+0000","last_unstale":"2023-11-24T08:04:53.880770+0000","last_undegraded":"2023-11-24T08:04:53.880770+0000","last_fullsized":"2023-11-24T08:04:53.880770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:12.300848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181075+0000","last_change":"2023-11-24T08:04:52.868201+0000","last_active":"2023-11-24T08:04:54.181075+0000","last_peered":"2023-11-24T08:04:54.181075+0000","last_clean":"2023-11-24T08:04:54.181075+0000","last_became_active":"2023-11-24T08:04:52.867698+0000","last_became_peered":"2023-11-24T08:04:52.867698+0000","last_unstale":"2023-11-24T08:04:54.181075+0000","last_undegraded":"2023-11-24T08:04:54.181075+0000","last_fullsized":"2023-11-24T08:04:54.181075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:49.042270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181077+0000","last_change":"2023-11-24T08:04:52.862741+0000","last_active":"2023-11-24T08:04:54.181077+0000","last_peered":"2023-11-24T08:04:54.181077+0000","last_clean":"2023-11-24T08:04:54.181077+0000","last_became_active":"2023-11-24T08:04:52.862131+0000","last_became_peered":"2023-11-24T08:04:52.862131+0000","last_unstale":"2023-11-24T08:04:54.181077+0000","last_undegraded":"2023-11-24T08:04:54.181077+0000","last_fullsized":"2023-11-24T08:04:54.181077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:03.959259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878377+0000","last_change":"2023-11-24T08:04:52.891217+0000","last_active":"2023-11-24T08:04:53.878377+0000","last_peered":"2023-11-24T08:04:53.878377+0000","last_clean":"2023-11-24T08:04:53.878377+0000","last_became_active":"2023-11-24T08:04:52.885264+0000","last_became_peered":"2023-11-24T08:04:52.885264+0000","last_unstale":"2023-11-24T08:04:53.878377+0000","last_undegraded":"2023-11-24T08:04:53.878377+0000","last_fullsized":"2023-11-24T08:04:53.878377+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:24.349560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878405+0000","last_change":"2023-11-24T08:04:52.891535+0000","last_active":"2023-11-24T08:04:53.878405+0000","last_peered":"2023-11-24T08:04:53.878405+0000","last_clean":"2023-11-24T08:04:53.878405+0000","last_became_active":"2023-11-24T08:04:52.891166+0000","last_became_peered":"2023-11-24T08:04:52.891166+0000","last_unstale":"2023-11-24T08:04:53.878405+0000","last_undegraded":"2023-11-24T08:04:53.878405+0000","last_fullsized":"2023-11-24T08:04:53.878405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:49.748948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181686+0000","last_change":"2023-11-24T08:04:52.878810+0000","last_active":"2023-11-24T08:04:54.181686+0000","last_peered":"2023-11-24T08:04:54.181686+0000","last_clean":"2023-11-24T08:04:54.181686+0000","last_became_active":"2023-11-24T08:04:52.878412+0000","last_became_peered":"2023-11-24T08:04:52.878412+0000","last_unstale":"2023-11-24T08:04:54.181686+0000","last_undegraded":"2023-11-24T08:04:54.181686+0000","last_fullsized":"2023-11-24T08:04:54.181686+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:15.482400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181515+0000","last_change":"2023-11-24T08:04:52.878574+0000","last_active":"2023-11-24T08:04:54.181515+0000","last_peered":"2023-11-24T08:04:54.181515+0000","last_clean":"2023-11-24T08:04:54.181515+0000","last_became_active":"2023-11-24T08:04:52.878204+0000","last_became_peered":"2023-11-24T08:04:52.878204+0000","last_unstale":"2023-11-24T08:04:54.181515+0000","last_undegraded":"2023-11-24T08:04:54.181515+0000","last_fullsized":"2023-11-24T08:04:54.181515+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:49.748948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880874+0000","last_change":"2023-11-24T08:04:52.867316+0000","last_active":"2023-11-24T08:04:53.880874+0000","last_peered":"2023-11-24T08:04:53.880874+0000","last_clean":"2023-11-24T08:04:53.880874+0000","last_became_active":"2023-11-24T08:04:52.867012+0000","last_became_peered":"2023-11-24T08:04:52.867012+0000","last_unstale":"2023-11-24T08:04:53.880874+0000","last_undegraded":"2023-11-24T08:04:53.880874+0000","last_fullsized":"2023-11-24T08:04:53.880874+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:00.965775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181291+0000","last_change":"2023-11-24T08:04:52.884350+0000","last_active":"2023-11-24T08:04:54.181291+0000","last_peered":"2023-11-24T08:04:54.181291+0000","last_clean":"2023-11-24T08:04:54.181291+0000","last_became_active":"2023-11-24T08:04:52.884081+0000","last_became_peered":"2023-11-24T08:04:52.884081+0000","last_unstale":"2023-11-24T08:04:54.181291+0000","last_undegraded":"2023-11-24T08:04:54.181291+0000","last_fullsized":"2023-11-24T08:04:54.181291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:35:19.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181348+0000","last_change":"2023-11-24T08:04:52.872254+0000","last_active":"2023-11-24T08:04:54.181348+0000","last_peered":"2023-11-24T08:04:54.181348+0000","last_clean":"2023-11-24T08:04:54.181348+0000","last_became_active":"2023-11-24T08:04:52.871991+0000","last_became_peered":"2023-11-24T08:04:52.871991+0000","last_unstale":"2023-11-24T08:04:54.181348+0000","last_undegraded":"2023-11-24T08:04:54.181348+0000","last_fullsized":"2023-11-24T08:04:54.181348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:08.608502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879611+0000","last_change":"2023-11-24T08:04:52.866567+0000","last_active":"2023-11-24T08:04:53.879611+0000","last_peered":"2023-11-24T08:04:53.879611+0000","last_clean":"2023-11-24T08:04:53.879611+0000","last_became_active":"2023-11-24T08:04:52.866326+0000","last_became_peered":"2023-11-24T08:04:52.866326+0000","last_unstale":"2023-11-24T08:04:53.879611+0000","last_undegraded":"2023-11-24T08:04:53.879611+0000","last_fullsized":"2023-11-24T08:04:53.879611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:11:40.574217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180834+0000","last_change":"2023-11-24T08:04:52.867717+0000","last_active":"2023-11-24T08:04:54.180834+0000","last_peered":"2023-11-24T08:04:54.180834+0000","last_clean":"2023-11-24T08:04:54.180834+0000","last_became_active":"2023-11-24T08:04:52.867396+0000","last_became_peered":"2023-11-24T08:04:52.867396+0000","last_unstale":"2023-11-24T08:04:54.180834+0000","last_undegraded":"2023-11-24T08:04:54.180834+0000","last_fullsized":"2023-11-24T08:04:54.180834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:41.704030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182033+0000","last_change":"2023-11-24T08:04:52.869295+0000","last_active":"2023-11-24T08:04:54.182033+0000","last_peered":"2023-11-24T08:04:54.182033+0000","last_clean":"2023-11-24T08:04:54.182033+0000","last_became_active":"2023-11-24T08:04:52.869017+0000","last_became_peered":"2023-11-24T08:04:52.869017+0000","last_unstale":"2023-11-24T08:04:54.182033+0000","last_undegraded":"2023-11-24T08:04:54.182033+0000","last_fullsized":"2023-11-24T08:04:54.182033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181719+0000","last_change":"2023-11-24T08:04:52.896877+0000","last_active":"2023-11-24T08:04:54.181719+0000","last_peered":"2023-11-24T08:04:54.181719+0000","last_clean":"2023-11-24T08:04:54.181719+0000","last_became_active":"2023-11-24T08:04:52.896540+0000","last_became_peered":"2023-11-24T08:04:52.896540+0000","last_unstale":"2023-11-24T08:04:54.181719+0000","last_undegraded":"2023-11-24T08:04:54.181719+0000","last_fullsized":"2023-11-24T08:04:54.181719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:13:16.685459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181145+0000","last_change":"2023-11-24T08:04:52.882761+0000","last_active":"2023-11-24T08:04:54.181145+0000","last_peered":"2023-11-24T08:04:54.181145+0000","last_clean":"2023-11-24T08:04:54.181145+0000","last_became_active":"2023-11-24T08:04:52.881832+0000","last_became_peered":"2023-11-24T08:04:52.881832+0000","last_unstale":"2023-11-24T08:04:54.181145+0000","last_undegraded":"2023-11-24T08:04:54.181145+0000","last_fullsized":"2023-11-24T08:04:54.181145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:03.959259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181552+0000","last_change":"2023-11-24T08:04:52.862328+0000","last_active":"2023-11-24T08:04:54.181552+0000","last_peered":"2023-11-24T08:04:54.181552+0000","last_clean":"2023-11-24T08:04:54.181552+0000","last_became_active":"2023-11-24T08:04:52.862063+0000","last_became_peered":"2023-11-24T08:04:52.862063+0000","last_unstale":"2023-11-24T08:04:54.181552+0000","last_undegraded":"2023-11-24T08:04:54.181552+0000","last_fullsized":"2023-11-24T08:04:54.181552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181779+0000","last_change":"2023-11-24T08:04:52.879750+0000","last_active":"2023-11-24T08:04:54.181779+0000","last_peered":"2023-11-24T08:04:54.181779+0000","last_clean":"2023-11-24T08:04:54.181779+0000","last_became_active":"2023-11-24T08:04:52.878782+0000","last_became_peered":"2023-11-24T08:04:52.878782+0000","last_unstale":"2023-11-24T08:04:54.181779+0000","last_undegraded":"2023-11-24T08:04:54.181779+0000","last_fullsized":"2023-11-24T08:04:54.181779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:12.061843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878018+0000","last_change":"2023-11-24T08:04:52.881605+0000","last_active":"2023-11-24T08:04:53.878018+0000","last_peered":"2023-11-24T08:04:53.878018+0000","last_clean":"2023-11-24T08:04:53.878018+0000","last_became_active":"2023-11-24T08:04:52.881316+0000","last_became_peered":"2023-11-24T08:04:52.881316+0000","last_unstale":"2023-11-24T08:04:53.878018+0000","last_undegraded":"2023-11-24T08:04:53.878018+0000","last_fullsized":"2023-11-24T08:04:53.878018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:36.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182251+0000","last_change":"2023-11-24T08:04:52.869112+0000","last_active":"2023-11-24T08:04:54.182251+0000","last_peered":"2023-11-24T08:04:54.182251+0000","last_clean":"2023-11-24T08:04:54.182251+0000","last_became_active":"2023-11-24T08:04:52.868831+0000","last_became_peered":"2023-11-24T08:04:52.868831+0000","last_unstale":"2023-11-24T08:04:54.182251+0000","last_undegraded":"2023-11-24T08:04:54.182251+0000","last_fullsized":"2023-11-24T08:04:54.182251+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:35.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878054+0000","last_change":"2023-11-24T08:04:52.894331+0000","last_active":"2023-11-24T08:04:53.878054+0000","last_peered":"2023-11-24T08:04:53.878054+0000","last_clean":"2023-11-24T08:04:53.878054+0000","last_became_active":"2023-11-24T08:04:52.893972+0000","last_became_peered":"2023-11-24T08:04:52.893972+0000","last_unstale":"2023-11-24T08:04:53.878054+0000","last_undegraded":"2023-11-24T08:04:53.878054+0000","last_fullsized":"2023-11-24T08:04:53.878054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:41.704030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879909+0000","last_change":"2023-11-24T08:04:52.881360+0000","last_active":"2023-11-24T08:04:53.879909+0000","last_peered":"2023-11-24T08:04:53.879909+0000","last_clean":"2023-11-24T08:04:53.879909+0000","last_became_active":"2023-11-24T08:04:52.881088+0000","last_became_peered":"2023-11-24T08:04:52.881088+0000","last_unstale":"2023-11-24T08:04:53.879909+0000","last_undegraded":"2023-11-24T08:04:53.879909+0000","last_fullsized":"2023-11-24T08:04:53.879909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:24.299126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"36'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182749+0000","last_change":"2023-11-24T08:04:51.857287+0000","last_active":"2023-11-24T08:04:54.182749+0000","last_peered":"2023-11-24T08:04:54.182749+0000","last_clean":"2023-11-24T08:04:54.182749+0000","last_became_active":"2023-11-24T08:04:51.856848+0000","last_became_peered":"2023-11-24T08:04:51.856848+0000","last_unstale":"2023-11-24T08:04:54.182749+0000","last_undegraded":"2023-11-24T08:04:54.182749+0000","last_fullsized":"2023-11-24T08:04:54.182749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:57.159965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182690+0000","last_change":"2023-11-24T08:04:52.886428+0000","last_active":"2023-11-24T08:04:54.182690+0000","last_peered":"2023-11-24T08:04:54.182690+0000","last_clean":"2023-11-24T08:04:54.182690+0000","last_became_active":"2023-11-24T08:04:52.886140+0000","last_became_peered":"2023-11-24T08:04:52.886140+0000","last_unstale":"2023-11-24T08:04:54.182690+0000","last_undegraded":"2023-11-24T08:04:54.182690+0000","last_fullsized":"2023-11-24T08:04:54.182690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:37:26.465846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880345+0000","last_change":"2023-11-24T08:04:51.851952+0000","last_active":"2023-11-24T08:04:53.880345+0000","last_peered":"2023-11-24T08:04:53.880345+0000","last_clean":"2023-11-24T08:04:53.880345+0000","last_became_active":"2023-11-24T08:04:51.851653+0000","last_became_peered":"2023-11-24T08:04:51.851653+0000","last_unstale":"2023-11-24T08:04:53.880345+0000","last_undegraded":"2023-11-24T08:04:53.880345+0000","last_fullsized":"2023-11-24T08:04:53.880345+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:47.493894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182204+0000","last_change":"2023-11-24T08:04:52.889005+0000","last_active":"2023-11-24T08:04:54.182204+0000","last_peered":"2023-11-24T08:04:54.182204+0000","last_clean":"2023-11-24T08:04:54.182204+0000","last_became_active":"2023-11-24T08:04:52.887707+0000","last_became_peered":"2023-11-24T08:04:52.887707+0000","last_unstale":"2023-11-24T08:04:54.182204+0000","last_undegraded":"2023-11-24T08:04:54.182204+0000","last_fullsized":"2023-11-24T08:04:54.182204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:14.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181496+0000","last_change":"2023-11-24T08:04:51.871189+0000","last_active":"2023-11-24T08:04:54.181496+0000","last_peered":"2023-11-24T08:04:54.181496+0000","last_clean":"2023-11-24T08:04:54.181496+0000","last_became_active":"2023-11-24T08:04:51.870918+0000","last_became_peered":"2023-11-24T08:04:51.870918+0000","last_unstale":"2023-11-24T08:04:54.181496+0000","last_undegraded":"2023-11-24T08:04:54.181496+0000","last_fullsized":"2023-11-24T08:04:54.181496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:30.787131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181356+0000","last_change":"2023-11-24T08:04:52.876649+0000","last_active":"2023-11-24T08:04:54.181356+0000","last_peered":"2023-11-24T08:04:54.181356+0000","last_clean":"2023-11-24T08:04:54.181356+0000","last_became_active":"2023-11-24T08:04:52.876298+0000","last_became_peered":"2023-11-24T08:04:52.876298+0000","last_unstale":"2023-11-24T08:04:54.181356+0000","last_undegraded":"2023-11-24T08:04:54.181356+0000","last_fullsized":"2023-11-24T08:04:54.181356+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:31.794109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880983+0000","last_change":"2023-11-24T08:04:51.864476+0000","last_active":"2023-11-24T08:04:53.880983+0000","last_peered":"2023-11-24T08:04:53.880983+0000","last_clean":"2023-11-24T08:04:53.880983+0000","last_became_active":"2023-11-24T08:04:51.861634+0000","last_became_peered":"2023-11-24T08:04:51.861634+0000","last_unstale":"2023-11-24T08:04:53.880983+0000","last_undegraded":"2023-11-24T08:04:53.880983+0000","last_fullsized":"2023-11-24T08:04:53.880983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:36:12.868097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878055+0000","last_change":"2023-11-24T08:04:52.897754+0000","last_active":"2023-11-24T08:04:53.878055+0000","last_peered":"2023-11-24T08:04:53.878055+0000","last_clean":"2023-11-24T08:04:53.878055+0000","last_became_active":"2023-11-24T08:04:52.897470+0000","last_became_peered":"2023-11-24T08:04:52.897470+0000","last_unstale":"2023-11-24T08:04:53.878055+0000","last_undegraded":"2023-11-24T08:04:53.878055+0000","last_fullsized":"2023-11-24T08:04:53.878055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:03.959259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182466+0000","last_change":"2023-11-24T08:04:51.866805+0000","last_active":"2023-11-24T08:04:54.182466+0000","last_peered":"2023-11-24T08:04:54.182466+0000","last_clean":"2023-11-24T08:04:54.182466+0000","last_became_active":"2023-11-24T08:04:51.866521+0000","last_became_peered":"2023-11-24T08:04:51.866521+0000","last_unstale":"2023-11-24T08:04:54.182466+0000","last_undegraded":"2023-11-24T08:04:54.182466+0000","last_fullsized":"2023-11-24T08:04:54.182466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:01.671125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181467+0000","last_change":"2023-11-24T08:04:52.864592+0000","last_active":"2023-11-24T08:04:54.181467+0000","last_peered":"2023-11-24T08:04:54.181467+0000","last_clean":"2023-11-24T08:04:54.181467+0000","last_became_active":"2023-11-24T08:04:52.864330+0000","last_became_peered":"2023-11-24T08:04:52.864330+0000","last_unstale":"2023-11-24T08:04:54.181467+0000","last_undegraded":"2023-11-24T08:04:54.181467+0000","last_fullsized":"2023-11-24T08:04:54.181467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:31.794109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181216+0000","last_change":"2023-11-24T08:04:51.858242+0000","last_active":"2023-11-24T08:04:54.181216+0000","last_peered":"2023-11-24T08:04:54.181216+0000","last_clean":"2023-11-24T08:04:54.181216+0000","last_became_active":"2023-11-24T08:04:51.857935+0000","last_became_peered":"2023-11-24T08:04:51.857935+0000","last_unstale":"2023-11-24T08:04:54.181216+0000","last_undegraded":"2023-11-24T08:04:54.181216+0000","last_fullsized":"2023-11-24T08:04:54.181216+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:11.293871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181287+0000","last_change":"2023-11-24T08:04:52.888201+0000","last_active":"2023-11-24T08:04:54.181287+0000","last_peered":"2023-11-24T08:04:54.181287+0000","last_clean":"2023-11-24T08:04:54.181287+0000","last_became_active":"2023-11-24T08:04:52.883216+0000","last_became_peered":"2023-11-24T08:04:52.883216+0000","last_unstale":"2023-11-24T08:04:54.181287+0000","last_undegraded":"2023-11-24T08:04:54.181287+0000","last_fullsized":"2023-11-24T08:04:54.181287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:36.158868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180883+0000","last_change":"2023-11-24T08:04:51.860862+0000","last_active":"2023-11-24T08:04:54.180883+0000","last_peered":"2023-11-24T08:04:54.180883+0000","last_clean":"2023-11-24T08:04:54.180883+0000","last_became_active":"2023-11-24T08:04:51.860562+0000","last_became_peered":"2023-11-24T08:04:51.860562+0000","last_unstale":"2023-11-24T08:04:54.180883+0000","last_undegraded":"2023-11-24T08:04:54.180883+0000","last_fullsized":"2023-11-24T08:04:54.180883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:42.889618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180647+0000","last_change":"2023-11-24T08:04:52.867028+0000","last_active":"2023-11-24T08:04:54.180647+0000","last_peered":"2023-11-24T08:04:54.180647+0000","last_clean":"2023-11-24T08:04:54.180647+0000","last_became_active":"2023-11-24T08:04:52.866757+0000","last_became_peered":"2023-11-24T08:04:52.866757+0000","last_unstale":"2023-11-24T08:04:54.180647+0000","last_undegraded":"2023-11-24T08:04:54.180647+0000","last_fullsized":"2023-11-24T08:04:54.180647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:14.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182498+0000","last_change":"2023-11-24T08:04:51.857960+0000","last_active":"2023-11-24T08:04:54.182498+0000","last_peered":"2023-11-24T08:04:54.182498+0000","last_clean":"2023-11-24T08:04:54.182498+0000","last_became_active":"2023-11-24T08:04:51.857634+0000","last_became_peered":"2023-11-24T08:04:51.857634+0000","last_unstale":"2023-11-24T08:04:54.182498+0000","last_undegraded":"2023-11-24T08:04:54.182498+0000","last_fullsized":"2023-11-24T08:04:54.182498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:34.025117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181897+0000","last_change":"2023-11-24T08:04:52.875599+0000","last_active":"2023-11-24T08:04:54.181897+0000","last_peered":"2023-11-24T08:04:54.181897+0000","last_clean":"2023-11-24T08:04:54.181897+0000","last_became_active":"2023-11-24T08:04:52.875140+0000","last_became_peered":"2023-11-24T08:04:52.875140+0000","last_unstale":"2023-11-24T08:04:54.181897+0000","last_undegraded":"2023-11-24T08:04:54.181897+0000","last_fullsized":"2023-11-24T08:04:54.181897+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:03.434551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181664+0000","last_change":"2023-11-24T08:04:51.867070+0000","last_active":"2023-11-24T08:04:54.181664+0000","last_peered":"2023-11-24T08:04:54.181664+0000","last_clean":"2023-11-24T08:04:54.181664+0000","last_became_active":"2023-11-24T08:04:51.866755+0000","last_became_peered":"2023-11-24T08:04:51.866755+0000","last_unstale":"2023-11-24T08:04:54.181664+0000","last_undegraded":"2023-11-24T08:04:54.181664+0000","last_fullsized":"2023-11-24T08:04:54.181664+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:35.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181641+0000","last_change":"2023-11-24T08:04:52.873204+0000","last_active":"2023-11-24T08:04:54.181641+0000","last_peered":"2023-11-24T08:04:54.181641+0000","last_clean":"2023-11-24T08:04:54.181641+0000","last_became_active":"2023-11-24T08:04:52.872092+0000","last_became_peered":"2023-11-24T08:04:52.872092+0000","last_unstale":"2023-11-24T08:04:54.181641+0000","last_undegraded":"2023-11-24T08:04:54.181641+0000","last_fullsized":"2023-11-24T08:04:54.181641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:23.904435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.881162+0000","last_change":"2023-11-24T08:04:51.867470+0000","last_active":"2023-11-24T08:04:53.881162+0000","last_peered":"2023-11-24T08:04:53.881162+0000","last_clean":"2023-11-24T08:04:53.881162+0000","last_became_active":"2023-11-24T08:04:51.867131+0000","last_became_peered":"2023-11-24T08:04:51.867131+0000","last_unstale":"2023-11-24T08:04:53.881162+0000","last_undegraded":"2023-11-24T08:04:53.881162+0000","last_fullsized":"2023-11-24T08:04:53.881162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.972994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181341+0000","last_change":"2023-11-24T08:04:52.887400+0000","last_active":"2023-11-24T08:04:54.181341+0000","last_peered":"2023-11-24T08:04:54.181341+0000","last_clean":"2023-11-24T08:04:54.181341+0000","last_became_active":"2023-11-24T08:04:52.887182+0000","last_became_peered":"2023-11-24T08:04:52.887182+0000","last_unstale":"2023-11-24T08:04:54.181341+0000","last_undegraded":"2023-11-24T08:04:54.181341+0000","last_fullsized":"2023-11-24T08:04:54.181341+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:03.434551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"36'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181914+0000","last_change":"2023-11-24T08:04:51.862029+0000","last_active":"2023-11-24T08:04:54.181914+0000","last_peered":"2023-11-24T08:04:54.181914+0000","last_clean":"2023-11-24T08:04:54.181914+0000","last_became_active":"2023-11-24T08:04:51.861576+0000","last_became_peered":"2023-11-24T08:04:51.861576+0000","last_unstale":"2023-11-24T08:04:54.181914+0000","last_undegraded":"2023-11-24T08:04:54.181914+0000","last_fullsized":"2023-11-24T08:04:54.181914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:35.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181713+0000","last_change":"2023-11-24T08:04:52.874968+0000","last_active":"2023-11-24T08:04:54.181713+0000","last_peered":"2023-11-24T08:04:54.181713+0000","last_clean":"2023-11-24T08:04:54.181713+0000","last_became_active":"2023-11-24T08:04:52.874042+0000","last_became_peered":"2023-11-24T08:04:52.874042+0000","last_unstale":"2023-11-24T08:04:54.181713+0000","last_undegraded":"2023-11-24T08:04:54.181713+0000","last_fullsized":"2023-11-24T08:04:54.181713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:49.042270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181347+0000","last_change":"2023-11-24T08:04:51.868079+0000","last_active":"2023-11-24T08:04:54.181347+0000","last_peered":"2023-11-24T08:04:54.181347+0000","last_clean":"2023-11-24T08:04:54.181347+0000","last_became_active":"2023-11-24T08:04:51.867781+0000","last_became_peered":"2023-11-24T08:04:51.867781+0000","last_unstale":"2023-11-24T08:04:54.181347+0000","last_undegraded":"2023-11-24T08:04:54.181347+0000","last_fullsized":"2023-11-24T08:04:54.181347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:11.054866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180656+0000","last_change":"2023-11-24T08:04:52.868330+0000","last_active":"2023-11-24T08:04:54.180656+0000","last_peered":"2023-11-24T08:04:54.180656+0000","last_clean":"2023-11-24T08:04:54.180656+0000","last_became_active":"2023-11-24T08:04:52.868062+0000","last_became_peered":"2023-11-24T08:04:52.868062+0000","last_unstale":"2023-11-24T08:04:54.180656+0000","last_undegraded":"2023-11-24T08:04:54.180656+0000","last_fullsized":"2023-11-24T08:04:54.180656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:34.835875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181886+0000","last_change":"2023-11-24T08:04:51.858160+0000","last_active":"2023-11-24T08:04:54.181886+0000","last_peered":"2023-11-24T08:04:54.181886+0000","last_clean":"2023-11-24T08:04:54.181886+0000","last_became_active":"2023-11-24T08:04:51.857593+0000","last_became_peered":"2023-11-24T08:04:51.857593+0000","last_unstale":"2023-11-24T08:04:54.181886+0000","last_undegraded":"2023-11-24T08:04:54.181886+0000","last_fullsized":"2023-11-24T08:04:54.181886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:08:44.738162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181304+0000","last_change":"2023-11-24T08:04:52.870209+0000","last_active":"2023-11-24T08:04:54.181304+0000","last_peered":"2023-11-24T08:04:54.181304+0000","last_clean":"2023-11-24T08:04:54.181304+0000","last_became_active":"2023-11-24T08:04:52.869590+0000","last_became_peered":"2023-11-24T08:04:52.869590+0000","last_unstale":"2023-11-24T08:04:54.181304+0000","last_undegraded":"2023-11-24T08:04:54.181304+0000","last_fullsized":"2023-11-24T08:04:54.181304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:24.349560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180610+0000","last_change":"2023-11-24T08:04:51.863163+0000","last_active":"2023-11-24T08:04:54.180610+0000","last_peered":"2023-11-24T08:04:54.180610+0000","last_clean":"2023-11-24T08:04:54.180610+0000","last_became_active":"2023-11-24T08:04:51.862810+0000","last_became_peered":"2023-11-24T08:04:51.862810+0000","last_unstale":"2023-11-24T08:04:54.180610+0000","last_undegraded":"2023-11-24T08:04:54.180610+0000","last_fullsized":"2023-11-24T08:04:54.180610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:35:18.817150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878211+0000","last_change":"2023-11-24T08:04:52.894783+0000","last_active":"2023-11-24T08:04:53.878211+0000","last_peered":"2023-11-24T08:04:53.878211+0000","last_clean":"2023-11-24T08:04:53.878211+0000","last_became_active":"2023-11-24T08:04:52.894342+0000","last_became_peered":"2023-11-24T08:04:52.894342+0000","last_unstale":"2023-11-24T08:04:53.878211+0000","last_undegraded":"2023-11-24T08:04:53.878211+0000","last_fullsized":"2023-11-24T08:04:53.878211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180989+0000","last_change":"2023-11-24T08:04:51.866263+0000","last_active":"2023-11-24T08:04:54.180989+0000","last_peered":"2023-11-24T08:04:54.180989+0000","last_clean":"2023-11-24T08:04:54.180989+0000","last_became_active":"2023-11-24T08:04:51.865373+0000","last_became_peered":"2023-11-24T08:04:51.865373+0000","last_unstale":"2023-11-24T08:04:54.180989+0000","last_undegraded":"2023-11-24T08:04:54.180989+0000","last_fullsized":"2023-11-24T08:04:54.180989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:34.513648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182410+0000","last_change":"2023-11-24T08:04:52.884013+0000","last_active":"2023-11-24T08:04:54.182410+0000","last_peered":"2023-11-24T08:04:54.182410+0000","last_clean":"2023-11-24T08:04:54.182410+0000","last_became_active":"2023-11-24T08:04:52.883713+0000","last_became_peered":"2023-11-24T08:04:52.883713+0000","last_unstale":"2023-11-24T08:04:54.182410+0000","last_undegraded":"2023-11-24T08:04:54.182410+0000","last_fullsized":"2023-11-24T08:04:54.182410+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:08:48.972469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"36'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180899+0000","last_change":"2023-11-24T08:04:51.869002+0000","last_active":"2023-11-24T08:04:54.180899+0000","last_peered":"2023-11-24T08:04:54.180899+0000","last_clean":"2023-11-24T08:04:54.180899+0000","last_became_active":"2023-11-24T08:04:51.868676+0000","last_became_peered":"2023-11-24T08:04:51.868676+0000","last_unstale":"2023-11-24T08:04:54.180899+0000","last_undegraded":"2023-11-24T08:04:54.180899+0000","last_fullsized":"2023-11-24T08:04:54.180899+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:22.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182102+0000","last_change":"2023-11-24T08:04:52.889894+0000","last_active":"2023-11-24T08:04:54.182102+0000","last_peered":"2023-11-24T08:04:54.182102+0000","last_clean":"2023-11-24T08:04:54.182102+0000","last_became_active":"2023-11-24T08:04:52.889618+0000","last_became_peered":"2023-11-24T08:04:52.889618+0000","last_unstale":"2023-11-24T08:04:54.182102+0000","last_undegraded":"2023-11-24T08:04:54.182102+0000","last_fullsized":"2023-11-24T08:04:54.182102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:42.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182067+0000","last_change":"2023-11-24T08:04:51.868332+0000","last_active":"2023-11-24T08:04:54.182067+0000","last_peered":"2023-11-24T08:04:54.182067+0000","last_clean":"2023-11-24T08:04:54.182067+0000","last_became_active":"2023-11-24T08:04:51.867997+0000","last_became_peered":"2023-11-24T08:04:51.867997+0000","last_unstale":"2023-11-24T08:04:54.182067+0000","last_undegraded":"2023-11-24T08:04:54.182067+0000","last_fullsized":"2023-11-24T08:04:54.182067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:35.151891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182191+0000","last_change":"2023-11-24T08:04:52.884546+0000","last_active":"2023-11-24T08:04:54.182191+0000","last_peered":"2023-11-24T08:04:54.182191+0000","last_clean":"2023-11-24T08:04:54.182191+0000","last_became_active":"2023-11-24T08:04:52.883937+0000","last_became_peered":"2023-11-24T08:04:52.883937+0000","last_unstale":"2023-11-24T08:04:54.182191+0000","last_undegraded":"2023-11-24T08:04:54.182191+0000","last_fullsized":"2023-11-24T08:04:54.182191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:49.748948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182188+0000","last_change":"2023-11-24T08:04:51.863429+0000","last_active":"2023-11-24T08:04:54.182188+0000","last_peered":"2023-11-24T08:04:54.182188+0000","last_clean":"2023-11-24T08:04:54.182188+0000","last_became_active":"2023-11-24T08:04:51.863131+0000","last_became_peered":"2023-11-24T08:04:51.863131+0000","last_unstale":"2023-11-24T08:04:54.182188+0000","last_undegraded":"2023-11-24T08:04:54.182188+0000","last_fullsized":"2023-11-24T08:04:54.182188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:42.889618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180977+0000","last_change":"2023-11-24T08:04:52.891898+0000","last_active":"2023-11-24T08:04:54.180977+0000","last_peered":"2023-11-24T08:04:54.180977+0000","last_clean":"2023-11-24T08:04:54.180977+0000","last_became_active":"2023-11-24T08:04:52.891630+0000","last_became_peered":"2023-11-24T08:04:52.891630+0000","last_unstale":"2023-11-24T08:04:54.180977+0000","last_undegraded":"2023-11-24T08:04:54.180977+0000","last_fullsized":"2023-11-24T08:04:54.180977+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:41.704030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182036+0000","last_change":"2023-11-24T08:04:51.863447+0000","last_active":"2023-11-24T08:04:54.182036+0000","last_peered":"2023-11-24T08:04:54.182036+0000","last_clean":"2023-11-24T08:04:54.182036+0000","last_became_active":"2023-11-24T08:04:51.863148+0000","last_became_peered":"2023-11-24T08:04:51.863148+0000","last_unstale":"2023-11-24T08:04:54.182036+0000","last_undegraded":"2023-11-24T08:04:54.182036+0000","last_fullsized":"2023-11-24T08:04:54.182036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:38:16.557440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880824+0000","last_change":"2023-11-24T08:04:52.873299+0000","last_active":"2023-11-24T08:04:53.880824+0000","last_peered":"2023-11-24T08:04:53.880824+0000","last_clean":"2023-11-24T08:04:53.880824+0000","last_became_active":"2023-11-24T08:04:52.872997+0000","last_became_peered":"2023-11-24T08:04:52.872997+0000","last_unstale":"2023-11-24T08:04:53.880824+0000","last_undegraded":"2023-11-24T08:04:53.880824+0000","last_fullsized":"2023-11-24T08:04:53.880824+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:38:17.564417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182282+0000","last_change":"2023-11-24T08:04:51.870156+0000","last_active":"2023-11-24T08:04:54.182282+0000","last_peered":"2023-11-24T08:04:54.182282+0000","last_clean":"2023-11-24T08:04:54.182282+0000","last_became_active":"2023-11-24T08:04:51.869883+0000","last_became_peered":"2023-11-24T08:04:51.869883+0000","last_unstale":"2023-11-24T08:04:54.182282+0000","last_undegraded":"2023-11-24T08:04:54.182282+0000","last_fullsized":"2023-11-24T08:04:54.182282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:22.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880713+0000","last_change":"2023-11-24T08:04:52.875883+0000","last_active":"2023-11-24T08:04:53.880713+0000","last_peered":"2023-11-24T08:04:53.880713+0000","last_clean":"2023-11-24T08:04:53.880713+0000","last_became_active":"2023-11-24T08:04:52.875546+0000","last_became_peered":"2023-11-24T08:04:52.875546+0000","last_unstale":"2023-11-24T08:04:53.880713+0000","last_undegraded":"2023-11-24T08:04:53.880713+0000","last_fullsized":"2023-11-24T08:04:53.880713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:35.032094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879814+0000","last_change":"2023-11-24T08:04:51.852026+0000","last_active":"2023-11-24T08:04:53.879814+0000","last_peered":"2023-11-24T08:04:53.879814+0000","last_clean":"2023-11-24T08:04:53.879814+0000","last_became_active":"2023-11-24T08:04:51.851636+0000","last_became_peered":"2023-11-24T08:04:51.851636+0000","last_unstale":"2023-11-24T08:04:53.879814+0000","last_undegraded":"2023-11-24T08:04:53.879814+0000","last_fullsized":"2023-11-24T08:04:53.879814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:14.002513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880910+0000","last_change":"2023-11-24T08:04:52.863625+0000","last_active":"2023-11-24T08:04:53.880910+0000","last_peered":"2023-11-24T08:04:53.880910+0000","last_clean":"2023-11-24T08:04:53.880910+0000","last_became_active":"2023-11-24T08:04:52.863339+0000","last_became_peered":"2023-11-24T08:04:52.863339+0000","last_unstale":"2023-11-24T08:04:53.880910+0000","last_undegraded":"2023-11-24T08:04:53.880910+0000","last_fullsized":"2023-11-24T08:04:53.880910+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:53.424494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182402+0000","last_change":"2023-11-24T08:04:51.859890+0000","last_active":"2023-11-24T08:04:54.182402+0000","last_peered":"2023-11-24T08:04:54.182402+0000","last_clean":"2023-11-24T08:04:54.182402+0000","last_became_active":"2023-11-24T08:04:51.856249+0000","last_became_peered":"2023-11-24T08:04:51.856249+0000","last_unstale":"2023-11-24T08:04:54.182402+0000","last_undegraded":"2023-11-24T08:04:54.182402+0000","last_fullsized":"2023-11-24T08:04:54.182402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:42.889618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880517+0000","last_change":"2023-11-24T08:04:52.866375+0000","last_active":"2023-11-24T08:04:53.880517+0000","last_peered":"2023-11-24T08:04:53.880517+0000","last_clean":"2023-11-24T08:04:53.880517+0000","last_became_active":"2023-11-24T08:04:52.866108+0000","last_became_peered":"2023-11-24T08:04:52.866108+0000","last_unstale":"2023-11-24T08:04:53.880517+0000","last_undegraded":"2023-11-24T08:04:53.880517+0000","last_fullsized":"2023-11-24T08:04:53.880517+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:43:29.262169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181081+0000","last_change":"2023-11-24T08:04:51.861313+0000","last_active":"2023-11-24T08:04:54.181081+0000","last_peered":"2023-11-24T08:04:54.181081+0000","last_clean":"2023-11-24T08:04:54.181081+0000","last_became_active":"2023-11-24T08:04:51.861042+0000","last_became_peered":"2023-11-24T08:04:51.861042+0000","last_unstale":"2023-11-24T08:04:54.181081+0000","last_undegraded":"2023-11-24T08:04:54.181081+0000","last_fullsized":"2023-11-24T08:04:54.181081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:34.513648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878383+0000","last_change":"2023-11-24T08:04:52.891046+0000","last_active":"2023-11-24T08:04:53.878383+0000","last_peered":"2023-11-24T08:04:53.878383+0000","last_clean":"2023-11-24T08:04:53.878383+0000","last_became_active":"2023-11-24T08:04:52.877497+0000","last_became_peered":"2023-11-24T08:04:52.877497+0000","last_unstale":"2023-11-24T08:04:53.878383+0000","last_undegraded":"2023-11-24T08:04:53.878383+0000","last_fullsized":"2023-11-24T08:04:53.878383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:03.434551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180774+0000","last_change":"2023-11-24T08:04:51.862029+0000","last_active":"2023-11-24T08:04:54.180774+0000","last_peered":"2023-11-24T08:04:54.180774+0000","last_clean":"2023-11-24T08:04:54.180774+0000","last_became_active":"2023-11-24T08:04:51.861689+0000","last_became_peered":"2023-11-24T08:04:51.861689+0000","last_unstale":"2023-11-24T08:04:54.180774+0000","last_undegraded":"2023-11-24T08:04:54.180774+0000","last_fullsized":"2023-11-24T08:04:54.180774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:13.306963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.881199+0000","last_change":"2023-11-24T08:04:52.869013+0000","last_active":"2023-11-24T08:04:53.881199+0000","last_peered":"2023-11-24T08:04:53.881199+0000","last_clean":"2023-11-24T08:04:53.881199+0000","last_became_active":"2023-11-24T08:04:52.868692+0000","last_became_peered":"2023-11-24T08:04:52.868692+0000","last_unstale":"2023-11-24T08:04:53.881199+0000","last_undegraded":"2023-11-24T08:04:53.881199+0000","last_fullsized":"2023-11-24T08:04:53.881199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:02.678102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182085+0000","last_change":"2023-11-24T08:04:51.863308+0000","last_active":"2023-11-24T08:04:54.182085+0000","last_peered":"2023-11-24T08:04:54.182085+0000","last_clean":"2023-11-24T08:04:54.182085+0000","last_became_active":"2023-11-24T08:04:51.862942+0000","last_became_peered":"2023-11-24T08:04:51.862942+0000","last_unstale":"2023-11-24T08:04:54.182085+0000","last_undegraded":"2023-11-24T08:04:54.182085+0000","last_fullsized":"2023-11-24T08:04:54.182085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:11.054866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182314+0000","last_change":"2023-11-24T08:04:52.872362+0000","last_active":"2023-11-24T08:04:54.182314+0000","last_peered":"2023-11-24T08:04:54.182314+0000","last_clean":"2023-11-24T08:04:54.182314+0000","last_became_active":"2023-11-24T08:04:52.872106+0000","last_became_peered":"2023-11-24T08:04:52.872106+0000","last_unstale":"2023-11-24T08:04:54.182314+0000","last_undegraded":"2023-11-24T08:04:54.182314+0000","last_fullsized":"2023-11-24T08:04:54.182314+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:07.550669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.881080+0000","last_change":"2023-11-24T08:04:51.858761+0000","last_active":"2023-11-24T08:04:53.881080+0000","last_peered":"2023-11-24T08:04:53.881080+0000","last_clean":"2023-11-24T08:04:53.881080+0000","last_became_active":"2023-11-24T08:04:51.858461+0000","last_became_peered":"2023-11-24T08:04:51.858461+0000","last_unstale":"2023-11-24T08:04:53.881080+0000","last_undegraded":"2023-11-24T08:04:53.881080+0000","last_fullsized":"2023-11-24T08:04:53.881080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:27.833934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879908+0000","last_change":"2023-11-24T08:04:52.870981+0000","last_active":"2023-11-24T08:04:53.879908+0000","last_peered":"2023-11-24T08:04:53.879908+0000","last_clean":"2023-11-24T08:04:53.879908+0000","last_became_active":"2023-11-24T08:04:52.870708+0000","last_became_peered":"2023-11-24T08:04:52.870708+0000","last_unstale":"2023-11-24T08:04:53.879908+0000","last_undegraded":"2023-11-24T08:04:53.879908+0000","last_fullsized":"2023-11-24T08:04:53.879908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:46.130463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181058+0000","last_change":"2023-11-24T08:04:51.857961+0000","last_active":"2023-11-24T08:04:54.181058+0000","last_peered":"2023-11-24T08:04:54.181058+0000","last_clean":"2023-11-24T08:04:54.181058+0000","last_became_active":"2023-11-24T08:04:51.857412+0000","last_became_peered":"2023-11-24T08:04:51.857412+0000","last_unstale":"2023-11-24T08:04:54.181058+0000","last_undegraded":"2023-11-24T08:04:54.181058+0000","last_fullsized":"2023-11-24T08:04:54.181058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:37:25.458869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182449+0000","last_change":"2023-11-24T08:04:52.870418+0000","last_active":"2023-11-24T08:04:54.182449+0000","last_peered":"2023-11-24T08:04:54.182449+0000","last_clean":"2023-11-24T08:04:54.182449+0000","last_became_active":"2023-11-24T08:04:52.870147+0000","last_became_peered":"2023-11-24T08:04:52.870147+0000","last_unstale":"2023-11-24T08:04:54.182449+0000","last_undegraded":"2023-11-24T08:04:54.182449+0000","last_fullsized":"2023-11-24T08:04:54.182449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:23.236166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879936+0000","last_change":"2023-11-24T08:04:51.859500+0000","last_active":"2023-11-24T08:04:53.879936+0000","last_peered":"2023-11-24T08:04:53.879936+0000","last_clean":"2023-11-24T08:04:53.879936+0000","last_became_active":"2023-11-24T08:04:51.859139+0000","last_became_peered":"2023-11-24T08:04:51.859139+0000","last_unstale":"2023-11-24T08:04:53.879936+0000","last_undegraded":"2023-11-24T08:04:53.879936+0000","last_fullsized":"2023-11-24T08:04:53.879936+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:54.896422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879821+0000","last_change":"2023-11-24T08:04:52.873010+0000","last_active":"2023-11-24T08:04:53.879821+0000","last_peered":"2023-11-24T08:04:53.879821+0000","last_clean":"2023-11-24T08:04:53.879821+0000","last_became_active":"2023-11-24T08:04:52.872712+0000","last_became_peered":"2023-11-24T08:04:52.872712+0000","last_unstale":"2023-11-24T08:04:53.879821+0000","last_undegraded":"2023-11-24T08:04:53.879821+0000","last_fullsized":"2023-11-24T08:04:53.879821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:16.828884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180708+0000","last_change":"2023-11-24T08:04:51.863128+0000","last_active":"2023-11-24T08:04:54.180708+0000","last_peered":"2023-11-24T08:04:54.180708+0000","last_clean":"2023-11-24T08:04:54.180708+0000","last_became_active":"2023-11-24T08:04:51.862057+0000","last_became_peered":"2023-11-24T08:04:51.862057+0000","last_unstale":"2023-11-24T08:04:54.180708+0000","last_undegraded":"2023-11-24T08:04:54.180708+0000","last_fullsized":"2023-11-24T08:04:54.180708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:07.601525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180784+0000","last_change":"2023-11-24T08:04:52.880720+0000","last_active":"2023-11-24T08:04:54.180784+0000","last_peered":"2023-11-24T08:04:54.180784+0000","last_clean":"2023-11-24T08:04:54.180784+0000","last_became_active":"2023-11-24T08:04:52.878269+0000","last_became_peered":"2023-11-24T08:04:52.878269+0000","last_unstale":"2023-11-24T08:04:54.180784+0000","last_undegraded":"2023-11-24T08:04:54.180784+0000","last_fullsized":"2023-11-24T08:04:54.180784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181147+0000","last_change":"2023-11-24T08:04:51.859483+0000","last_active":"2023-11-24T08:04:54.181147+0000","last_peered":"2023-11-24T08:04:54.181147+0000","last_clean":"2023-11-24T08:04:54.181147+0000","last_became_active":"2023-11-24T08:04:51.859242+0000","last_became_peered":"2023-11-24T08:04:51.859242+0000","last_unstale":"2023-11-24T08:04:54.181147+0000","last_undegraded":"2023-11-24T08:04:54.181147+0000","last_fullsized":"2023-11-24T08:04:54.181147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:08:47.965492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181048+0000","last_change":"2023-11-24T08:04:52.880254+0000","last_active":"2023-11-24T08:04:54.181048+0000","last_peered":"2023-11-24T08:04:54.181048+0000","last_clean":"2023-11-24T08:04:54.181048+0000","last_became_active":"2023-11-24T08:04:52.880009+0000","last_became_peered":"2023-11-24T08:04:52.880009+0000","last_unstale":"2023-11-24T08:04:54.181048+0000","last_undegraded":"2023-11-24T08:04:54.181048+0000","last_fullsized":"2023-11-24T08:04:54.181048+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:37:26.465846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181005+0000","last_change":"2023-11-24T08:04:51.865118+0000","last_active":"2023-11-24T08:04:54.181005+0000","last_peered":"2023-11-24T08:04:54.181005+0000","last_clean":"2023-11-24T08:04:54.181005+0000","last_became_active":"2023-11-24T08:04:51.864763+0000","last_became_peered":"2023-11-24T08:04:51.864763+0000","last_unstale":"2023-11-24T08:04:54.181005+0000","last_undegraded":"2023-11-24T08:04:54.181005+0000","last_fullsized":"2023-11-24T08:04:54.181005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:40.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878228+0000","last_change":"2023-11-24T08:04:52.879429+0000","last_active":"2023-11-24T08:04:53.878228+0000","last_peered":"2023-11-24T08:04:53.878228+0000","last_clean":"2023-11-24T08:04:53.878228+0000","last_became_active":"2023-11-24T08:04:52.879104+0000","last_became_peered":"2023-11-24T08:04:52.879104+0000","last_unstale":"2023-11-24T08:04:53.878228+0000","last_undegraded":"2023-11-24T08:04:53.878228+0000","last_fullsized":"2023-11-24T08:04:53.878228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182530+0000","last_change":"2023-11-24T08:04:51.860907+0000","last_active":"2023-11-24T08:04:54.182530+0000","last_peered":"2023-11-24T08:04:54.182530+0000","last_clean":"2023-11-24T08:04:54.182530+0000","last_became_active":"2023-11-24T08:04:51.860583+0000","last_became_peered":"2023-11-24T08:04:51.860583+0000","last_unstale":"2023-11-24T08:04:54.182530+0000","last_undegraded":"2023-11-24T08:04:54.182530+0000","last_fullsized":"2023-11-24T08:04:54.182530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:08:44.738162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T08:04:52.863889+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:04:52.863889+0000","last_peered":"2023-11-24T08:04:52.863889+0000","last_clean":"2023-11-24T08:04:52.863889+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:04:52.863889+0000","last_undegraded":"2023-11-24T08:04:52.863889+0000","last_fullsized":"2023-11-24T08:04:52.863889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":752378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.4539999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4260000000000002,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.66200000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.747},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.64000000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.504},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60799999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":162536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":162592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.95199999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.875}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.627}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.79300000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":162024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.874},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59399999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":163554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59199999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":161990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.9139999999999997,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.442}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.371}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.907,"5min":5.907,"15min":5.907},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.624},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.68700000000000006}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":163554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.438}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.6059999999999999,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9320000000000004,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.752}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.628}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":752288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.880000000000001,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.439}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.9800000000000004,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.745}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":12.688000000000001,"5min":12.688000000000001,"15min":12.688000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.875},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1100000000000003,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":6.6390000000000002,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:56.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:04:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.166+0000 7fb973632640 1 Processor -- start 2023-11-24T08:04:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.166+0000 7fb973632640 1 -- start start 2023-11-24T08:04:57.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb973632640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb96c06e340 0x7fb96c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb973632640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb973632640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c06dc20 con 0x7fb96c158a50 2023-11-24T08:04:57.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb973632640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c06e0b0 con 0x7fb96c06e340 2023-11-24T08:04:57.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb973632640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c071140 con 0x7fb96c070cf0 2023-11-24T08:04:57.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb970bcd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb96c06e340 0x7fb96c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb9713ce640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb96c158a50 0x7fb96c06c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52394/0 (socket says 172.21.15.57:52394) 2023-11-24T08:04:57.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb9713ce640 1 -- 172.21.15.57:0/2542975216 learned_addr learned my addr 172.21.15.57:0/2542975216 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:57.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb971bcf640 1 --2- 172.21.15.57:0/2542975216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb970bcd640 1 -- 172.21.15.57:0/2542975216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 msgr2=0x7fb96c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb970bcd640 1 --2- 172.21.15.57:0/2542975216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb970bcd640 1 -- 172.21.15.57:0/2542975216 >> v1:172.21.15.57:6789/0 conn(0x7fb96c158a50 legacy=0x7fb96c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb970bcd640 1 -- 172.21.15.57:0/2542975216 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c06cd60 con 0x7fb96c06e340 2023-11-24T08:04:57.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.170+0000 7fb970bcd640 1 --2- 172.21.15.57:0/2542975216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c06e340 0x7fb96c0707b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0097c0 tx=0x7fb95c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e012f326781bf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb963fff640 1 -- 172.21.15.57:0/2542975216 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ab680 con 0x7fb96c06e340 2023-11-24T08:04:57.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb963fff640 1 -- 172.21.15.57:0/2542975216 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0ab7e0 con 0x7fb96c06e340 2023-11-24T08:04:57.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb963fff640 1 -- 172.21.15.57:0/2542975216 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0abb70 con 0x7fb96c06e340 2023-11-24T08:04:57.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- 172.21.15.57:0/2542975216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c06e340 msgr2=0x7fb96c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 --2- 172.21.15.57:0/2542975216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c06e340 0x7fb96c0707b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0097c0 tx=0x7fb95c01c480 comp rx=0 tx=0).stop 2023-11-24T08:04:57.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- 172.21.15.57:0/2542975216 shutdown_connections 2023-11-24T08:04:57.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 --2- 172.21.15.57:0/2542975216 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 --2- 172.21.15.57:0/2542975216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c06e340 0x7fb96c0707b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- 172.21.15.57:0/2542975216 >> 172.21.15.57:0/2542975216 conn(0x7fb96c0b0bf0 msgr2=0x7fb96c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- 172.21.15.57:0/2542975216 shutdown_connections 2023-11-24T08:04:57.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- 172.21.15.57:0/2542975216 wait complete. 2023-11-24T08:04:57.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 Processor -- start 2023-11-24T08:04:57.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- start start 2023-11-24T08:04:57.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96c06e340 0x7fb96c159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c158a50 0x7fb96c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c15cfe0 con 0x7fb96c158a50 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c1643a0 con 0x7fb96c06e340 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.174+0000 7fb973632640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c15c6b0 con 0x7fb96c070cf0 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c158a50 0x7fb96c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c158a50 0x7fb96c159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47624/0 (socket says 172.21.15.57:47624) 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 -- 172.21.15.57:0/231940413 learned_addr learned my addr 172.21.15.57:0/231940413 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb970bcd640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb9713ce640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96c06e340 0x7fb96c159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 -- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 msgr2=0x7fb96c1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 -- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96c06e340 msgr2=0x7fb96c159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96c06e340 0x7fb96c159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 -- 172.21.15.57:0/231940413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c009420 con 0x7fb96c158a50 2023-11-24T08:04:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb9713ce640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96c06e340 0x7fb96c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb971bcf640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c158a50 0x7fb96c159af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb964007e40 tx=0x7fb96400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb961ffb640 1 -- 172.21.15.57:0/231940413 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964014620 con 0x7fb96c158a50 2023-11-24T08:04:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb961ffb640 1 -- 172.21.15.57:0/231940413 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96400ee90 con 0x7fb96c158a50 2023-11-24T08:04:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb961ffb640 1 -- 172.21.15.57:0/231940413 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640149e0 con 0x7fb96c158a50 2023-11-24T08:04:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c15c990 con 0x7fb96c158a50 2023-11-24T08:04:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c15b830 con 0x7fb96c158a50 2023-11-24T08:04:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c15d190 con 0x7fb96c158a50 2023-11-24T08:04:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.178+0000 7fb961ffb640 1 -- 172.21.15.57:0/231940413 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb964014b40 con 0x7fb96c158a50 2023-11-24T08:04:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.182+0000 7fb961ffb640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb950066470 0x7fb950068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.182+0000 7fb961ffb640 1 -- 172.21.15.57:0/231940413 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb964084840 con 0x7fb96c158a50 2023-11-24T08:04:57.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.182+0000 7fb9713ce640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb950066470 0x7fb950068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.182+0000 7fb9713ce640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb950066470 0x7fb950068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb968005890 tx=0x7fb968009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.186+0000 7fb961ffb640 1 -- 172.21.15.57:0/231940413 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb96c15d190 con 0x7fb96c158a50 2023-11-24T08:04:57.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.338+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb96c06d5d0 con 0x7fb950066470 2023-11-24T08:04:57.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.346+0000 7fb961ffb640 1 -- 172.21.15.57:0/231940413 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288984 (secure 0 0 0) 0x7fb968001430 con 0x7fb950066470 2023-11-24T08:04:57.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:57.355 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:04:57.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb950066470 msgr2=0x7fb950068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb950066470 0x7fb950068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb968005890 tx=0x7fb968009040 comp rx=0 tx=0).stop 2023-11-24T08:04:57.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c158a50 msgr2=0x7fb96c159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c158a50 0x7fb96c159af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb964007e40 tx=0x7fb96400e4b0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 shutdown_connections 2023-11-24T08:04:57.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb950066470 0x7fb950068930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb96c158a50 0x7fb96c159af0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb96c070cf0 0x7fb96c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 --2- 172.21.15.57:0/231940413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96c06e340 0x7fb96c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 >> 172.21.15.57:0/231940413 conn(0x7fb96c0b0bf0 msgr2=0x7fb96c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 shutdown_connections 2023-11-24T08:04:57.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.350+0000 7fb973632640 1 -- 172.21.15.57:0/231940413 wait complete. 2023-11-24T08:04:57.373 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-24T08:04:56.693726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233104,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741616,"statfs":{"total":773094113280,"available":772855414784,"internally_reserved":0,"allocated":4562944,"data_stored":2480916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.861599"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182699+0000","last_change":"2023-11-24T08:04:52.866351+0000","last_active":"2023-11-24T08:04:54.182699+0000","last_peered":"2023-11-24T08:04:54.182699+0000","last_clean":"2023-11-24T08:04:54.182699+0000","last_became_active":"2023-11-24T08:04:52.866058+0000","last_became_peered":"2023-11-24T08:04:52.866058+0000","last_unstale":"2023-11-24T08:04:54.182699+0000","last_undegraded":"2023-11-24T08:04:54.182699+0000","last_fullsized":"2023-11-24T08:04:54.182699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:36.158868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181607+0000","last_change":"2023-11-24T08:04:52.876201+0000","last_active":"2023-11-24T08:04:54.181607+0000","last_peered":"2023-11-24T08:04:54.181607+0000","last_clean":"2023-11-24T08:04:54.181607+0000","last_became_active":"2023-11-24T08:04:52.875395+0000","last_became_peered":"2023-11-24T08:04:52.875395+0000","last_unstale":"2023-11-24T08:04:54.181607+0000","last_undegraded":"2023-11-24T08:04:54.181607+0000","last_fullsized":"2023-11-24T08:04:54.181607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:07.550669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181828+0000","last_change":"2023-11-24T08:04:52.873971+0000","last_active":"2023-11-24T08:04:54.181828+0000","last_peered":"2023-11-24T08:04:54.181828+0000","last_clean":"2023-11-24T08:04:54.181828+0000","last_became_active":"2023-11-24T08:04:52.872927+0000","last_became_peered":"2023-11-24T08:04:52.872927+0000","last_unstale":"2023-11-24T08:04:54.181828+0000","last_undegraded":"2023-11-24T08:04:54.181828+0000","last_fullsized":"2023-11-24T08:04:54.181828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:24.349560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180829+0000","last_change":"2023-11-24T08:04:52.890135+0000","last_active":"2023-11-24T08:04:54.180829+0000","last_peered":"2023-11-24T08:04:54.180829+0000","last_clean":"2023-11-24T08:04:54.180829+0000","last_became_active":"2023-11-24T08:04:52.889829+0000","last_became_peered":"2023-11-24T08:04:52.889829+0000","last_unstale":"2023-11-24T08:04:54.180829+0000","last_undegraded":"2023-11-24T08:04:54.180829+0000","last_fullsized":"2023-11-24T08:04:54.180829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:36.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880635+0000","last_change":"2023-11-24T08:04:52.866987+0000","last_active":"2023-11-24T08:04:53.880635+0000","last_peered":"2023-11-24T08:04:53.880635+0000","last_clean":"2023-11-24T08:04:53.880635+0000","last_became_active":"2023-11-24T08:04:52.866661+0000","last_became_peered":"2023-11-24T08:04:52.866661+0000","last_unstale":"2023-11-24T08:04:53.880635+0000","last_undegraded":"2023-11-24T08:04:53.880635+0000","last_fullsized":"2023-11-24T08:04:53.880635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:42:52.537643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181012+0000","last_change":"2023-11-24T08:04:52.872120+0000","last_active":"2023-11-24T08:04:54.181012+0000","last_peered":"2023-11-24T08:04:54.181012+0000","last_clean":"2023-11-24T08:04:54.181012+0000","last_became_active":"2023-11-24T08:04:52.871837+0000","last_became_peered":"2023-11-24T08:04:52.871837+0000","last_unstale":"2023-11-24T08:04:54.181012+0000","last_undegraded":"2023-11-24T08:04:54.181012+0000","last_fullsized":"2023-11-24T08:04:54.181012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878293+0000","last_change":"2023-11-24T08:04:52.878839+0000","last_active":"2023-11-24T08:04:53.878293+0000","last_peered":"2023-11-24T08:04:53.878293+0000","last_clean":"2023-11-24T08:04:53.878293+0000","last_became_active":"2023-11-24T08:04:52.877628+0000","last_became_peered":"2023-11-24T08:04:52.877628+0000","last_unstale":"2023-11-24T08:04:53.878293+0000","last_undegraded":"2023-11-24T08:04:53.878293+0000","last_fullsized":"2023-11-24T08:04:53.878293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:49.042270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878000+0000","last_change":"2023-11-24T08:04:52.884532+0000","last_active":"2023-11-24T08:04:53.878000+0000","last_peered":"2023-11-24T08:04:53.878000+0000","last_clean":"2023-11-24T08:04:53.878000+0000","last_became_active":"2023-11-24T08:04:52.884134+0000","last_became_peered":"2023-11-24T08:04:52.884134+0000","last_unstale":"2023-11-24T08:04:53.878000+0000","last_undegraded":"2023-11-24T08:04:53.878000+0000","last_fullsized":"2023-11-24T08:04:53.878000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:34.835875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182433+0000","last_change":"2023-11-24T08:04:52.881147+0000","last_active":"2023-11-24T08:04:54.182433+0000","last_peered":"2023-11-24T08:04:54.182433+0000","last_clean":"2023-11-24T08:04:54.182433+0000","last_became_active":"2023-11-24T08:04:52.879556+0000","last_became_peered":"2023-11-24T08:04:52.879556+0000","last_unstale":"2023-11-24T08:04:54.182433+0000","last_undegraded":"2023-11-24T08:04:54.182433+0000","last_fullsized":"2023-11-24T08:04:54.182433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:34.835875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181897+0000","last_change":"2023-11-24T08:04:52.872364+0000","last_active":"2023-11-24T08:04:54.181897+0000","last_peered":"2023-11-24T08:04:54.181897+0000","last_clean":"2023-11-24T08:04:54.181897+0000","last_became_active":"2023-11-24T08:04:52.872043+0000","last_became_peered":"2023-11-24T08:04:52.872043+0000","last_unstale":"2023-11-24T08:04:54.181897+0000","last_undegraded":"2023-11-24T08:04:54.181897+0000","last_fullsized":"2023-11-24T08:04:54.181897+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878173+0000","last_change":"2023-11-24T08:04:52.892219+0000","last_active":"2023-11-24T08:04:53.878173+0000","last_peered":"2023-11-24T08:04:53.878173+0000","last_clean":"2023-11-24T08:04:53.878173+0000","last_became_active":"2023-11-24T08:04:52.891938+0000","last_became_peered":"2023-11-24T08:04:52.891938+0000","last_unstale":"2023-11-24T08:04:53.878173+0000","last_undegraded":"2023-11-24T08:04:53.878173+0000","last_fullsized":"2023-11-24T08:04:53.878173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:31.794109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181470+0000","last_change":"2023-11-24T08:04:52.871589+0000","last_active":"2023-11-24T08:04:54.181470+0000","last_peered":"2023-11-24T08:04:54.181470+0000","last_clean":"2023-11-24T08:04:54.181470+0000","last_became_active":"2023-11-24T08:04:52.871340+0000","last_became_peered":"2023-11-24T08:04:52.871340+0000","last_unstale":"2023-11-24T08:04:54.181470+0000","last_undegraded":"2023-11-24T08:04:54.181470+0000","last_fullsized":"2023-11-24T08:04:54.181470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880770+0000","last_change":"2023-11-24T08:04:52.865341+0000","last_active":"2023-11-24T08:04:53.880770+0000","last_peered":"2023-11-24T08:04:53.880770+0000","last_clean":"2023-11-24T08:04:53.880770+0000","last_became_active":"2023-11-24T08:04:52.864979+0000","last_became_peered":"2023-11-24T08:04:52.864979+0000","last_unstale":"2023-11-24T08:04:53.880770+0000","last_undegraded":"2023-11-24T08:04:53.880770+0000","last_fullsized":"2023-11-24T08:04:53.880770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:12.300848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181075+0000","last_change":"2023-11-24T08:04:52.868201+0000","last_active":"2023-11-24T08:04:54.181075+0000","last_peered":"2023-11-24T08:04:54.181075+0000","last_clean":"2023-11-24T08:04:54.181075+0000","last_became_active":"2023-11-24T08:04:52.867698+0000","last_became_peered":"2023-11-24T08:04:52.867698+0000","last_unstale":"2023-11-24T08:04:54.181075+0000","last_undegraded":"2023-11-24T08:04:54.181075+0000","last_fullsized":"2023-11-24T08:04:54.181075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:49.042270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181077+0000","last_change":"2023-11-24T08:04:52.862741+0000","last_active":"2023-11-24T08:04:54.181077+0000","last_peered":"2023-11-24T08:04:54.181077+0000","last_clean":"2023-11-24T08:04:54.181077+0000","last_became_active":"2023-11-24T08:04:52.862131+0000","last_became_peered":"2023-11-24T08:04:52.862131+0000","last_unstale":"2023-11-24T08:04:54.181077+0000","last_undegraded":"2023-11-24T08:04:54.181077+0000","last_fullsized":"2023-11-24T08:04:54.181077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:03.959259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878377+0000","last_change":"2023-11-24T08:04:52.891217+0000","last_active":"2023-11-24T08:04:53.878377+0000","last_peered":"2023-11-24T08:04:53.878377+0000","last_clean":"2023-11-24T08:04:53.878377+0000","last_became_active":"2023-11-24T08:04:52.885264+0000","last_became_peered":"2023-11-24T08:04:52.885264+0000","last_unstale":"2023-11-24T08:04:53.878377+0000","last_undegraded":"2023-11-24T08:04:53.878377+0000","last_fullsized":"2023-11-24T08:04:53.878377+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:24.349560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878405+0000","last_change":"2023-11-24T08:04:52.891535+0000","last_active":"2023-11-24T08:04:53.878405+0000","last_peered":"2023-11-24T08:04:53.878405+0000","last_clean":"2023-11-24T08:04:53.878405+0000","last_became_active":"2023-11-24T08:04:52.891166+0000","last_became_peered":"2023-11-24T08:04:52.891166+0000","last_unstale":"2023-11-24T08:04:53.878405+0000","last_undegraded":"2023-11-24T08:04:53.878405+0000","last_fullsized":"2023-11-24T08:04:53.878405+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:49.748948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181686+0000","last_change":"2023-11-24T08:04:52.878810+0000","last_active":"2023-11-24T08:04:54.181686+0000","last_peered":"2023-11-24T08:04:54.181686+0000","last_clean":"2023-11-24T08:04:54.181686+0000","last_became_active":"2023-11-24T08:04:52.878412+0000","last_became_peered":"2023-11-24T08:04:52.878412+0000","last_unstale":"2023-11-24T08:04:54.181686+0000","last_undegraded":"2023-11-24T08:04:54.181686+0000","last_fullsized":"2023-11-24T08:04:54.181686+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:15.482400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181515+0000","last_change":"2023-11-24T08:04:52.878574+0000","last_active":"2023-11-24T08:04:54.181515+0000","last_peered":"2023-11-24T08:04:54.181515+0000","last_clean":"2023-11-24T08:04:54.181515+0000","last_became_active":"2023-11-24T08:04:52.878204+0000","last_became_peered":"2023-11-24T08:04:52.878204+0000","last_unstale":"2023-11-24T08:04:54.181515+0000","last_undegraded":"2023-11-24T08:04:54.181515+0000","last_fullsized":"2023-11-24T08:04:54.181515+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:49.748948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880874+0000","last_change":"2023-11-24T08:04:52.867316+0000","last_active":"2023-11-24T08:04:53.880874+0000","last_peered":"2023-11-24T08:04:53.880874+0000","last_clean":"2023-11-24T08:04:53.880874+0000","last_became_active":"2023-11-24T08:04:52.867012+0000","last_became_peered":"2023-11-24T08:04:52.867012+0000","last_unstale":"2023-11-24T08:04:53.880874+0000","last_undegraded":"2023-11-24T08:04:53.880874+0000","last_fullsized":"2023-11-24T08:04:53.880874+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:00.965775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181291+0000","last_change":"2023-11-24T08:04:52.884350+0000","last_active":"2023-11-24T08:04:54.181291+0000","last_peered":"2023-11-24T08:04:54.181291+0000","last_clean":"2023-11-24T08:04:54.181291+0000","last_became_active":"2023-11-24T08:04:52.884081+0000","last_became_peered":"2023-11-24T08:04:52.884081+0000","last_unstale":"2023-11-24T08:04:54.181291+0000","last_undegraded":"2023-11-24T08:04:54.181291+0000","last_fullsized":"2023-11-24T08:04:54.181291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:35:19.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181348+0000","last_change":"2023-11-24T08:04:52.872254+0000","last_active":"2023-11-24T08:04:54.181348+0000","last_peered":"2023-11-24T08:04:54.181348+0000","last_clean":"2023-11-24T08:04:54.181348+0000","last_became_active":"2023-11-24T08:04:52.871991+0000","last_became_peered":"2023-11-24T08:04:52.871991+0000","last_unstale":"2023-11-24T08:04:54.181348+0000","last_undegraded":"2023-11-24T08:04:54.181348+0000","last_fullsized":"2023-11-24T08:04:54.181348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:08.608502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879611+0000","last_change":"2023-11-24T08:04:52.866567+0000","last_active":"2023-11-24T08:04:53.879611+0000","last_peered":"2023-11-24T08:04:53.879611+0000","last_clean":"2023-11-24T08:04:53.879611+0000","last_became_active":"2023-11-24T08:04:52.866326+0000","last_became_peered":"2023-11-24T08:04:52.866326+0000","last_unstale":"2023-11-24T08:04:53.879611+0000","last_undegraded":"2023-11-24T08:04:53.879611+0000","last_fullsized":"2023-11-24T08:04:53.879611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:11:40.574217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180834+0000","last_change":"2023-11-24T08:04:52.867717+0000","last_active":"2023-11-24T08:04:54.180834+0000","last_peered":"2023-11-24T08:04:54.180834+0000","last_clean":"2023-11-24T08:04:54.180834+0000","last_became_active":"2023-11-24T08:04:52.867396+0000","last_became_peered":"2023-11-24T08:04:52.867396+0000","last_unstale":"2023-11-24T08:04:54.180834+0000","last_undegraded":"2023-11-24T08:04:54.180834+0000","last_fullsized":"2023-11-24T08:04:54.180834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:41.704030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182033+0000","last_change":"2023-11-24T08:04:52.869295+0000","last_active":"2023-11-24T08:04:54.182033+0000","last_peered":"2023-11-24T08:04:54.182033+0000","last_clean":"2023-11-24T08:04:54.182033+0000","last_became_active":"2023-11-24T08:04:52.869017+0000","last_became_peered":"2023-11-24T08:04:52.869017+0000","last_unstale":"2023-11-24T08:04:54.182033+0000","last_undegraded":"2023-11-24T08:04:54.182033+0000","last_fullsized":"2023-11-24T08:04:54.182033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181719+0000","last_change":"2023-11-24T08:04:52.896877+0000","last_active":"2023-11-24T08:04:54.181719+0000","last_peered":"2023-11-24T08:04:54.181719+0000","last_clean":"2023-11-24T08:04:54.181719+0000","last_became_active":"2023-11-24T08:04:52.896540+0000","last_became_peered":"2023-11-24T08:04:52.896540+0000","last_unstale":"2023-11-24T08:04:54.181719+0000","last_undegraded":"2023-11-24T08:04:54.181719+0000","last_fullsized":"2023-11-24T08:04:54.181719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:13:16.685459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181145+0000","last_change":"2023-11-24T08:04:52.882761+0000","last_active":"2023-11-24T08:04:54.181145+0000","last_peered":"2023-11-24T08:04:54.181145+0000","last_clean":"2023-11-24T08:04:54.181145+0000","last_became_active":"2023-11-24T08:04:52.881832+0000","last_became_peered":"2023-11-24T08:04:52.881832+0000","last_unstale":"2023-11-24T08:04:54.181145+0000","last_undegraded":"2023-11-24T08:04:54.181145+0000","last_fullsized":"2023-11-24T08:04:54.181145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:03.959259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181552+0000","last_change":"2023-11-24T08:04:52.862328+0000","last_active":"2023-11-24T08:04:54.181552+0000","last_peered":"2023-11-24T08:04:54.181552+0000","last_clean":"2023-11-24T08:04:54.181552+0000","last_became_active":"2023-11-24T08:04:52.862063+0000","last_became_peered":"2023-11-24T08:04:52.862063+0000","last_unstale":"2023-11-24T08:04:54.181552+0000","last_undegraded":"2023-11-24T08:04:54.181552+0000","last_fullsized":"2023-11-24T08:04:54.181552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181779+0000","last_change":"2023-11-24T08:04:52.879750+0000","last_active":"2023-11-24T08:04:54.181779+0000","last_peered":"2023-11-24T08:04:54.181779+0000","last_clean":"2023-11-24T08:04:54.181779+0000","last_became_active":"2023-11-24T08:04:52.878782+0000","last_became_peered":"2023-11-24T08:04:52.878782+0000","last_unstale":"2023-11-24T08:04:54.181779+0000","last_undegraded":"2023-11-24T08:04:54.181779+0000","last_fullsized":"2023-11-24T08:04:54.181779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:12.061843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878018+0000","last_change":"2023-11-24T08:04:52.881605+0000","last_active":"2023-11-24T08:04:53.878018+0000","last_peered":"2023-11-24T08:04:53.878018+0000","last_clean":"2023-11-24T08:04:53.878018+0000","last_became_active":"2023-11-24T08:04:52.881316+0000","last_became_peered":"2023-11-24T08:04:52.881316+0000","last_unstale":"2023-11-24T08:04:53.878018+0000","last_undegraded":"2023-11-24T08:04:53.878018+0000","last_fullsized":"2023-11-24T08:04:53.878018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:36.375879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182251+0000","last_change":"2023-11-24T08:04:52.869112+0000","last_active":"2023-11-24T08:04:54.182251+0000","last_peered":"2023-11-24T08:04:54.182251+0000","last_clean":"2023-11-24T08:04:54.182251+0000","last_became_active":"2023-11-24T08:04:52.868831+0000","last_became_peered":"2023-11-24T08:04:52.868831+0000","last_unstale":"2023-11-24T08:04:54.182251+0000","last_undegraded":"2023-11-24T08:04:54.182251+0000","last_fullsized":"2023-11-24T08:04:54.182251+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:35.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878054+0000","last_change":"2023-11-24T08:04:52.894331+0000","last_active":"2023-11-24T08:04:53.878054+0000","last_peered":"2023-11-24T08:04:53.878054+0000","last_clean":"2023-11-24T08:04:53.878054+0000","last_became_active":"2023-11-24T08:04:52.893972+0000","last_became_peered":"2023-11-24T08:04:52.893972+0000","last_unstale":"2023-11-24T08:04:53.878054+0000","last_undegraded":"2023-11-24T08:04:53.878054+0000","last_fullsized":"2023-11-24T08:04:53.878054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:41.704030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879909+0000","last_change":"2023-11-24T08:04:52.881360+0000","last_active":"2023-11-24T08:04:53.879909+0000","last_peered":"2023-11-24T08:04:53.879909+0000","last_clean":"2023-11-24T08:04:53.879909+0000","last_became_active":"2023-11-24T08:04:52.881088+0000","last_became_peered":"2023-11-24T08:04:52.881088+0000","last_unstale":"2023-11-24T08:04:53.879909+0000","last_undegraded":"2023-11-24T08:04:53.879909+0000","last_fullsized":"2023-11-24T08:04:53.879909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:54:24.299126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"36'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182749+0000","last_change":"2023-11-24T08:04:51.857287+0000","last_active":"2023-11-24T08:04:54.182749+0000","last_peered":"2023-11-24T08:04:54.182749+0000","last_clean":"2023-11-24T08:04:54.182749+0000","last_became_active":"2023-11-24T08:04:51.856848+0000","last_became_peered":"2023-11-24T08:04:51.856848+0000","last_unstale":"2023-11-24T08:04:54.182749+0000","last_undegraded":"2023-11-24T08:04:54.182749+0000","last_fullsized":"2023-11-24T08:04:54.182749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:26:57.159965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182690+0000","last_change":"2023-11-24T08:04:52.886428+0000","last_active":"2023-11-24T08:04:54.182690+0000","last_peered":"2023-11-24T08:04:54.182690+0000","last_clean":"2023-11-24T08:04:54.182690+0000","last_became_active":"2023-11-24T08:04:52.886140+0000","last_became_peered":"2023-11-24T08:04:52.886140+0000","last_unstale":"2023-11-24T08:04:54.182690+0000","last_undegraded":"2023-11-24T08:04:54.182690+0000","last_fullsized":"2023-11-24T08:04:54.182690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:37:26.465846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880345+0000","last_change":"2023-11-24T08:04:51.851952+0000","last_active":"2023-11-24T08:04:53.880345+0000","last_peered":"2023-11-24T08:04:53.880345+0000","last_clean":"2023-11-24T08:04:53.880345+0000","last_became_active":"2023-11-24T08:04:51.851653+0000","last_became_peered":"2023-11-24T08:04:51.851653+0000","last_unstale":"2023-11-24T08:04:53.880345+0000","last_undegraded":"2023-11-24T08:04:53.880345+0000","last_fullsized":"2023-11-24T08:04:53.880345+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:24:47.493894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182204+0000","last_change":"2023-11-24T08:04:52.889005+0000","last_active":"2023-11-24T08:04:54.182204+0000","last_peered":"2023-11-24T08:04:54.182204+0000","last_clean":"2023-11-24T08:04:54.182204+0000","last_became_active":"2023-11-24T08:04:52.887707+0000","last_became_peered":"2023-11-24T08:04:52.887707+0000","last_unstale":"2023-11-24T08:04:54.182204+0000","last_undegraded":"2023-11-24T08:04:54.182204+0000","last_fullsized":"2023-11-24T08:04:54.182204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:14.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181496+0000","last_change":"2023-11-24T08:04:51.871189+0000","last_active":"2023-11-24T08:04:54.181496+0000","last_peered":"2023-11-24T08:04:54.181496+0000","last_clean":"2023-11-24T08:04:54.181496+0000","last_became_active":"2023-11-24T08:04:51.870918+0000","last_became_peered":"2023-11-24T08:04:51.870918+0000","last_unstale":"2023-11-24T08:04:54.181496+0000","last_undegraded":"2023-11-24T08:04:54.181496+0000","last_fullsized":"2023-11-24T08:04:54.181496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:30.787131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181356+0000","last_change":"2023-11-24T08:04:52.876649+0000","last_active":"2023-11-24T08:04:54.181356+0000","last_peered":"2023-11-24T08:04:54.181356+0000","last_clean":"2023-11-24T08:04:54.181356+0000","last_became_active":"2023-11-24T08:04:52.876298+0000","last_became_peered":"2023-11-24T08:04:52.876298+0000","last_unstale":"2023-11-24T08:04:54.181356+0000","last_undegraded":"2023-11-24T08:04:54.181356+0000","last_fullsized":"2023-11-24T08:04:54.181356+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:31.794109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880983+0000","last_change":"2023-11-24T08:04:51.864476+0000","last_active":"2023-11-24T08:04:53.880983+0000","last_peered":"2023-11-24T08:04:53.880983+0000","last_clean":"2023-11-24T08:04:53.880983+0000","last_became_active":"2023-11-24T08:04:51.861634+0000","last_became_peered":"2023-11-24T08:04:51.861634+0000","last_unstale":"2023-11-24T08:04:53.880983+0000","last_undegraded":"2023-11-24T08:04:53.880983+0000","last_fullsized":"2023-11-24T08:04:53.880983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:36:12.868097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878055+0000","last_change":"2023-11-24T08:04:52.897754+0000","last_active":"2023-11-24T08:04:53.878055+0000","last_peered":"2023-11-24T08:04:53.878055+0000","last_clean":"2023-11-24T08:04:53.878055+0000","last_became_active":"2023-11-24T08:04:52.897470+0000","last_became_peered":"2023-11-24T08:04:52.897470+0000","last_unstale":"2023-11-24T08:04:53.878055+0000","last_undegraded":"2023-11-24T08:04:53.878055+0000","last_fullsized":"2023-11-24T08:04:53.878055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:03.959259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182466+0000","last_change":"2023-11-24T08:04:51.866805+0000","last_active":"2023-11-24T08:04:54.182466+0000","last_peered":"2023-11-24T08:04:54.182466+0000","last_clean":"2023-11-24T08:04:54.182466+0000","last_became_active":"2023-11-24T08:04:51.866521+0000","last_became_peered":"2023-11-24T08:04:51.866521+0000","last_unstale":"2023-11-24T08:04:54.182466+0000","last_undegraded":"2023-11-24T08:04:54.182466+0000","last_fullsized":"2023-11-24T08:04:54.182466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:01.671125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181467+0000","last_change":"2023-11-24T08:04:52.864592+0000","last_active":"2023-11-24T08:04:54.181467+0000","last_peered":"2023-11-24T08:04:54.181467+0000","last_clean":"2023-11-24T08:04:54.181467+0000","last_became_active":"2023-11-24T08:04:52.864330+0000","last_became_peered":"2023-11-24T08:04:52.864330+0000","last_unstale":"2023-11-24T08:04:54.181467+0000","last_undegraded":"2023-11-24T08:04:54.181467+0000","last_fullsized":"2023-11-24T08:04:54.181467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:31.794109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181216+0000","last_change":"2023-11-24T08:04:51.858242+0000","last_active":"2023-11-24T08:04:54.181216+0000","last_peered":"2023-11-24T08:04:54.181216+0000","last_clean":"2023-11-24T08:04:54.181216+0000","last_became_active":"2023-11-24T08:04:51.857935+0000","last_became_peered":"2023-11-24T08:04:51.857935+0000","last_unstale":"2023-11-24T08:04:54.181216+0000","last_undegraded":"2023-11-24T08:04:54.181216+0000","last_fullsized":"2023-11-24T08:04:54.181216+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:11.293871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181287+0000","last_change":"2023-11-24T08:04:52.888201+0000","last_active":"2023-11-24T08:04:54.181287+0000","last_peered":"2023-11-24T08:04:54.181287+0000","last_clean":"2023-11-24T08:04:54.181287+0000","last_became_active":"2023-11-24T08:04:52.883216+0000","last_became_peered":"2023-11-24T08:04:52.883216+0000","last_unstale":"2023-11-24T08:04:54.181287+0000","last_undegraded":"2023-11-24T08:04:54.181287+0000","last_fullsized":"2023-11-24T08:04:54.181287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:36.158868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180883+0000","last_change":"2023-11-24T08:04:51.860862+0000","last_active":"2023-11-24T08:04:54.180883+0000","last_peered":"2023-11-24T08:04:54.180883+0000","last_clean":"2023-11-24T08:04:54.180883+0000","last_became_active":"2023-11-24T08:04:51.860562+0000","last_became_peered":"2023-11-24T08:04:51.860562+0000","last_unstale":"2023-11-24T08:04:54.180883+0000","last_undegraded":"2023-11-24T08:04:54.180883+0000","last_fullsized":"2023-11-24T08:04:54.180883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:42.889618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180647+0000","last_change":"2023-11-24T08:04:52.867028+0000","last_active":"2023-11-24T08:04:54.180647+0000","last_peered":"2023-11-24T08:04:54.180647+0000","last_clean":"2023-11-24T08:04:54.180647+0000","last_became_active":"2023-11-24T08:04:52.866757+0000","last_became_peered":"2023-11-24T08:04:52.866757+0000","last_unstale":"2023-11-24T08:04:54.180647+0000","last_undegraded":"2023-11-24T08:04:54.180647+0000","last_fullsized":"2023-11-24T08:04:54.180647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:14.313940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182498+0000","last_change":"2023-11-24T08:04:51.857960+0000","last_active":"2023-11-24T08:04:54.182498+0000","last_peered":"2023-11-24T08:04:54.182498+0000","last_clean":"2023-11-24T08:04:54.182498+0000","last_became_active":"2023-11-24T08:04:51.857634+0000","last_became_peered":"2023-11-24T08:04:51.857634+0000","last_unstale":"2023-11-24T08:04:54.182498+0000","last_undegraded":"2023-11-24T08:04:54.182498+0000","last_fullsized":"2023-11-24T08:04:54.182498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:34.025117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181897+0000","last_change":"2023-11-24T08:04:52.875599+0000","last_active":"2023-11-24T08:04:54.181897+0000","last_peered":"2023-11-24T08:04:54.181897+0000","last_clean":"2023-11-24T08:04:54.181897+0000","last_became_active":"2023-11-24T08:04:52.875140+0000","last_became_peered":"2023-11-24T08:04:52.875140+0000","last_unstale":"2023-11-24T08:04:54.181897+0000","last_undegraded":"2023-11-24T08:04:54.181897+0000","last_fullsized":"2023-11-24T08:04:54.181897+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:03.434551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181664+0000","last_change":"2023-11-24T08:04:51.867070+0000","last_active":"2023-11-24T08:04:54.181664+0000","last_peered":"2023-11-24T08:04:54.181664+0000","last_clean":"2023-11-24T08:04:54.181664+0000","last_became_active":"2023-11-24T08:04:51.866755+0000","last_became_peered":"2023-11-24T08:04:51.866755+0000","last_unstale":"2023-11-24T08:04:54.181664+0000","last_undegraded":"2023-11-24T08:04:54.181664+0000","last_fullsized":"2023-11-24T08:04:54.181664+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:35.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181641+0000","last_change":"2023-11-24T08:04:52.873204+0000","last_active":"2023-11-24T08:04:54.181641+0000","last_peered":"2023-11-24T08:04:54.181641+0000","last_clean":"2023-11-24T08:04:54.181641+0000","last_became_active":"2023-11-24T08:04:52.872092+0000","last_became_peered":"2023-11-24T08:04:52.872092+0000","last_unstale":"2023-11-24T08:04:54.181641+0000","last_undegraded":"2023-11-24T08:04:54.181641+0000","last_fullsized":"2023-11-24T08:04:54.181641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:23.904435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.881162+0000","last_change":"2023-11-24T08:04:51.867470+0000","last_active":"2023-11-24T08:04:53.881162+0000","last_peered":"2023-11-24T08:04:53.881162+0000","last_clean":"2023-11-24T08:04:53.881162+0000","last_became_active":"2023-11-24T08:04:51.867131+0000","last_became_peered":"2023-11-24T08:04:51.867131+0000","last_unstale":"2023-11-24T08:04:53.881162+0000","last_undegraded":"2023-11-24T08:04:53.881162+0000","last_fullsized":"2023-11-24T08:04:53.881162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:35:12.972994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181341+0000","last_change":"2023-11-24T08:04:52.887400+0000","last_active":"2023-11-24T08:04:54.181341+0000","last_peered":"2023-11-24T08:04:54.181341+0000","last_clean":"2023-11-24T08:04:54.181341+0000","last_became_active":"2023-11-24T08:04:52.887182+0000","last_became_peered":"2023-11-24T08:04:52.887182+0000","last_unstale":"2023-11-24T08:04:54.181341+0000","last_undegraded":"2023-11-24T08:04:54.181341+0000","last_fullsized":"2023-11-24T08:04:54.181341+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:03.434551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"36'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181914+0000","last_change":"2023-11-24T08:04:51.862029+0000","last_active":"2023-11-24T08:04:54.181914+0000","last_peered":"2023-11-24T08:04:54.181914+0000","last_clean":"2023-11-24T08:04:54.181914+0000","last_became_active":"2023-11-24T08:04:51.861576+0000","last_became_peered":"2023-11-24T08:04:51.861576+0000","last_unstale":"2023-11-24T08:04:54.181914+0000","last_undegraded":"2023-11-24T08:04:54.181914+0000","last_fullsized":"2023-11-24T08:04:54.181914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:05:35.368902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181713+0000","last_change":"2023-11-24T08:04:52.874968+0000","last_active":"2023-11-24T08:04:54.181713+0000","last_peered":"2023-11-24T08:04:54.181713+0000","last_clean":"2023-11-24T08:04:54.181713+0000","last_became_active":"2023-11-24T08:04:52.874042+0000","last_became_peered":"2023-11-24T08:04:52.874042+0000","last_unstale":"2023-11-24T08:04:54.181713+0000","last_undegraded":"2023-11-24T08:04:54.181713+0000","last_fullsized":"2023-11-24T08:04:54.181713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:07:49.042270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181347+0000","last_change":"2023-11-24T08:04:51.868079+0000","last_active":"2023-11-24T08:04:54.181347+0000","last_peered":"2023-11-24T08:04:54.181347+0000","last_clean":"2023-11-24T08:04:54.181347+0000","last_became_active":"2023-11-24T08:04:51.867781+0000","last_became_peered":"2023-11-24T08:04:51.867781+0000","last_unstale":"2023-11-24T08:04:54.181347+0000","last_undegraded":"2023-11-24T08:04:54.181347+0000","last_fullsized":"2023-11-24T08:04:54.181347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:11.054866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180656+0000","last_change":"2023-11-24T08:04:52.868330+0000","last_active":"2023-11-24T08:04:54.180656+0000","last_peered":"2023-11-24T08:04:54.180656+0000","last_clean":"2023-11-24T08:04:54.180656+0000","last_became_active":"2023-11-24T08:04:52.868062+0000","last_became_peered":"2023-11-24T08:04:52.868062+0000","last_unstale":"2023-11-24T08:04:54.180656+0000","last_undegraded":"2023-11-24T08:04:54.180656+0000","last_fullsized":"2023-11-24T08:04:54.180656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:34.835875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181886+0000","last_change":"2023-11-24T08:04:51.858160+0000","last_active":"2023-11-24T08:04:54.181886+0000","last_peered":"2023-11-24T08:04:54.181886+0000","last_clean":"2023-11-24T08:04:54.181886+0000","last_became_active":"2023-11-24T08:04:51.857593+0000","last_became_peered":"2023-11-24T08:04:51.857593+0000","last_unstale":"2023-11-24T08:04:54.181886+0000","last_undegraded":"2023-11-24T08:04:54.181886+0000","last_fullsized":"2023-11-24T08:04:54.181886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:08:44.738162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181304+0000","last_change":"2023-11-24T08:04:52.870209+0000","last_active":"2023-11-24T08:04:54.181304+0000","last_peered":"2023-11-24T08:04:54.181304+0000","last_clean":"2023-11-24T08:04:54.181304+0000","last_became_active":"2023-11-24T08:04:52.869590+0000","last_became_peered":"2023-11-24T08:04:52.869590+0000","last_unstale":"2023-11-24T08:04:54.181304+0000","last_undegraded":"2023-11-24T08:04:54.181304+0000","last_fullsized":"2023-11-24T08:04:54.181304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:24.349560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180610+0000","last_change":"2023-11-24T08:04:51.863163+0000","last_active":"2023-11-24T08:04:54.180610+0000","last_peered":"2023-11-24T08:04:54.180610+0000","last_clean":"2023-11-24T08:04:54.180610+0000","last_became_active":"2023-11-24T08:04:51.862810+0000","last_became_peered":"2023-11-24T08:04:51.862810+0000","last_unstale":"2023-11-24T08:04:54.180610+0000","last_undegraded":"2023-11-24T08:04:54.180610+0000","last_fullsized":"2023-11-24T08:04:54.180610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:35:18.817150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878211+0000","last_change":"2023-11-24T08:04:52.894783+0000","last_active":"2023-11-24T08:04:53.878211+0000","last_peered":"2023-11-24T08:04:53.878211+0000","last_clean":"2023-11-24T08:04:53.878211+0000","last_became_active":"2023-11-24T08:04:52.894342+0000","last_became_peered":"2023-11-24T08:04:52.894342+0000","last_unstale":"2023-11-24T08:04:53.878211+0000","last_undegraded":"2023-11-24T08:04:53.878211+0000","last_fullsized":"2023-11-24T08:04:53.878211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180989+0000","last_change":"2023-11-24T08:04:51.866263+0000","last_active":"2023-11-24T08:04:54.180989+0000","last_peered":"2023-11-24T08:04:54.180989+0000","last_clean":"2023-11-24T08:04:54.180989+0000","last_became_active":"2023-11-24T08:04:51.865373+0000","last_became_peered":"2023-11-24T08:04:51.865373+0000","last_unstale":"2023-11-24T08:04:54.180989+0000","last_undegraded":"2023-11-24T08:04:54.180989+0000","last_fullsized":"2023-11-24T08:04:54.180989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:34.513648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182410+0000","last_change":"2023-11-24T08:04:52.884013+0000","last_active":"2023-11-24T08:04:54.182410+0000","last_peered":"2023-11-24T08:04:54.182410+0000","last_clean":"2023-11-24T08:04:54.182410+0000","last_became_active":"2023-11-24T08:04:52.883713+0000","last_became_peered":"2023-11-24T08:04:52.883713+0000","last_unstale":"2023-11-24T08:04:54.182410+0000","last_undegraded":"2023-11-24T08:04:54.182410+0000","last_fullsized":"2023-11-24T08:04:54.182410+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:08:48.972469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"36'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180899+0000","last_change":"2023-11-24T08:04:51.869002+0000","last_active":"2023-11-24T08:04:54.180899+0000","last_peered":"2023-11-24T08:04:54.180899+0000","last_clean":"2023-11-24T08:04:54.180899+0000","last_became_active":"2023-11-24T08:04:51.868676+0000","last_became_peered":"2023-11-24T08:04:51.868676+0000","last_unstale":"2023-11-24T08:04:54.180899+0000","last_undegraded":"2023-11-24T08:04:54.180899+0000","last_fullsized":"2023-11-24T08:04:54.180899+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:22.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182102+0000","last_change":"2023-11-24T08:04:52.889894+0000","last_active":"2023-11-24T08:04:54.182102+0000","last_peered":"2023-11-24T08:04:54.182102+0000","last_clean":"2023-11-24T08:04:54.182102+0000","last_became_active":"2023-11-24T08:04:52.889618+0000","last_became_peered":"2023-11-24T08:04:52.889618+0000","last_unstale":"2023-11-24T08:04:54.182102+0000","last_undegraded":"2023-11-24T08:04:54.182102+0000","last_fullsized":"2023-11-24T08:04:54.182102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:42.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182067+0000","last_change":"2023-11-24T08:04:51.868332+0000","last_active":"2023-11-24T08:04:54.182067+0000","last_peered":"2023-11-24T08:04:54.182067+0000","last_clean":"2023-11-24T08:04:54.182067+0000","last_became_active":"2023-11-24T08:04:51.867997+0000","last_became_peered":"2023-11-24T08:04:51.867997+0000","last_unstale":"2023-11-24T08:04:54.182067+0000","last_undegraded":"2023-11-24T08:04:54.182067+0000","last_fullsized":"2023-11-24T08:04:54.182067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:35.151891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182191+0000","last_change":"2023-11-24T08:04:52.884546+0000","last_active":"2023-11-24T08:04:54.182191+0000","last_peered":"2023-11-24T08:04:54.182191+0000","last_clean":"2023-11-24T08:04:54.182191+0000","last_became_active":"2023-11-24T08:04:52.883937+0000","last_became_peered":"2023-11-24T08:04:52.883937+0000","last_unstale":"2023-11-24T08:04:54.182191+0000","last_undegraded":"2023-11-24T08:04:54.182191+0000","last_fullsized":"2023-11-24T08:04:54.182191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:49.748948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182188+0000","last_change":"2023-11-24T08:04:51.863429+0000","last_active":"2023-11-24T08:04:54.182188+0000","last_peered":"2023-11-24T08:04:54.182188+0000","last_clean":"2023-11-24T08:04:54.182188+0000","last_became_active":"2023-11-24T08:04:51.863131+0000","last_became_peered":"2023-11-24T08:04:51.863131+0000","last_unstale":"2023-11-24T08:04:54.182188+0000","last_undegraded":"2023-11-24T08:04:54.182188+0000","last_fullsized":"2023-11-24T08:04:54.182188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:42.889618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180977+0000","last_change":"2023-11-24T08:04:52.891898+0000","last_active":"2023-11-24T08:04:54.180977+0000","last_peered":"2023-11-24T08:04:54.180977+0000","last_clean":"2023-11-24T08:04:54.180977+0000","last_became_active":"2023-11-24T08:04:52.891630+0000","last_became_peered":"2023-11-24T08:04:52.891630+0000","last_unstale":"2023-11-24T08:04:54.180977+0000","last_undegraded":"2023-11-24T08:04:54.180977+0000","last_fullsized":"2023-11-24T08:04:54.180977+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:41.704030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"36'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182036+0000","last_change":"2023-11-24T08:04:51.863447+0000","last_active":"2023-11-24T08:04:54.182036+0000","last_peered":"2023-11-24T08:04:54.182036+0000","last_clean":"2023-11-24T08:04:54.182036+0000","last_became_active":"2023-11-24T08:04:51.863148+0000","last_became_peered":"2023-11-24T08:04:51.863148+0000","last_unstale":"2023-11-24T08:04:54.182036+0000","last_undegraded":"2023-11-24T08:04:54.182036+0000","last_fullsized":"2023-11-24T08:04:54.182036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:38:16.557440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880824+0000","last_change":"2023-11-24T08:04:52.873299+0000","last_active":"2023-11-24T08:04:53.880824+0000","last_peered":"2023-11-24T08:04:53.880824+0000","last_clean":"2023-11-24T08:04:53.880824+0000","last_became_active":"2023-11-24T08:04:52.872997+0000","last_became_peered":"2023-11-24T08:04:52.872997+0000","last_unstale":"2023-11-24T08:04:53.880824+0000","last_undegraded":"2023-11-24T08:04:53.880824+0000","last_fullsized":"2023-11-24T08:04:53.880824+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:38:17.564417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182282+0000","last_change":"2023-11-24T08:04:51.870156+0000","last_active":"2023-11-24T08:04:54.182282+0000","last_peered":"2023-11-24T08:04:54.182282+0000","last_clean":"2023-11-24T08:04:54.182282+0000","last_became_active":"2023-11-24T08:04:51.869883+0000","last_became_peered":"2023-11-24T08:04:51.869883+0000","last_unstale":"2023-11-24T08:04:54.182282+0000","last_undegraded":"2023-11-24T08:04:54.182282+0000","last_fullsized":"2023-11-24T08:04:54.182282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:22.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880713+0000","last_change":"2023-11-24T08:04:52.875883+0000","last_active":"2023-11-24T08:04:53.880713+0000","last_peered":"2023-11-24T08:04:53.880713+0000","last_clean":"2023-11-24T08:04:53.880713+0000","last_became_active":"2023-11-24T08:04:52.875546+0000","last_became_peered":"2023-11-24T08:04:52.875546+0000","last_unstale":"2023-11-24T08:04:53.880713+0000","last_undegraded":"2023-11-24T08:04:53.880713+0000","last_fullsized":"2023-11-24T08:04:53.880713+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:29:35.032094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879814+0000","last_change":"2023-11-24T08:04:51.852026+0000","last_active":"2023-11-24T08:04:53.879814+0000","last_peered":"2023-11-24T08:04:53.879814+0000","last_clean":"2023-11-24T08:04:53.879814+0000","last_became_active":"2023-11-24T08:04:51.851636+0000","last_became_peered":"2023-11-24T08:04:51.851636+0000","last_unstale":"2023-11-24T08:04:53.879814+0000","last_undegraded":"2023-11-24T08:04:53.879814+0000","last_fullsized":"2023-11-24T08:04:53.879814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:14.002513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880910+0000","last_change":"2023-11-24T08:04:52.863625+0000","last_active":"2023-11-24T08:04:53.880910+0000","last_peered":"2023-11-24T08:04:53.880910+0000","last_clean":"2023-11-24T08:04:53.880910+0000","last_became_active":"2023-11-24T08:04:52.863339+0000","last_became_peered":"2023-11-24T08:04:52.863339+0000","last_unstale":"2023-11-24T08:04:53.880910+0000","last_undegraded":"2023-11-24T08:04:53.880910+0000","last_fullsized":"2023-11-24T08:04:53.880910+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:53.424494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182402+0000","last_change":"2023-11-24T08:04:51.859890+0000","last_active":"2023-11-24T08:04:54.182402+0000","last_peered":"2023-11-24T08:04:54.182402+0000","last_clean":"2023-11-24T08:04:54.182402+0000","last_became_active":"2023-11-24T08:04:51.856249+0000","last_became_peered":"2023-11-24T08:04:51.856249+0000","last_unstale":"2023-11-24T08:04:54.182402+0000","last_undegraded":"2023-11-24T08:04:54.182402+0000","last_fullsized":"2023-11-24T08:04:54.182402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:32:42.889618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.880517+0000","last_change":"2023-11-24T08:04:52.866375+0000","last_active":"2023-11-24T08:04:53.880517+0000","last_peered":"2023-11-24T08:04:53.880517+0000","last_clean":"2023-11-24T08:04:53.880517+0000","last_became_active":"2023-11-24T08:04:52.866108+0000","last_became_peered":"2023-11-24T08:04:52.866108+0000","last_unstale":"2023-11-24T08:04:53.880517+0000","last_undegraded":"2023-11-24T08:04:53.880517+0000","last_fullsized":"2023-11-24T08:04:53.880517+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:43:29.262169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181081+0000","last_change":"2023-11-24T08:04:51.861313+0000","last_active":"2023-11-24T08:04:54.181081+0000","last_peered":"2023-11-24T08:04:54.181081+0000","last_clean":"2023-11-24T08:04:54.181081+0000","last_became_active":"2023-11-24T08:04:51.861042+0000","last_became_peered":"2023-11-24T08:04:51.861042+0000","last_unstale":"2023-11-24T08:04:54.181081+0000","last_undegraded":"2023-11-24T08:04:54.181081+0000","last_fullsized":"2023-11-24T08:04:54.181081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:34.513648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878383+0000","last_change":"2023-11-24T08:04:52.891046+0000","last_active":"2023-11-24T08:04:53.878383+0000","last_peered":"2023-11-24T08:04:53.878383+0000","last_clean":"2023-11-24T08:04:53.878383+0000","last_became_active":"2023-11-24T08:04:52.877497+0000","last_became_peered":"2023-11-24T08:04:52.877497+0000","last_unstale":"2023-11-24T08:04:53.878383+0000","last_undegraded":"2023-11-24T08:04:53.878383+0000","last_fullsized":"2023-11-24T08:04:53.878383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:03.434551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180774+0000","last_change":"2023-11-24T08:04:51.862029+0000","last_active":"2023-11-24T08:04:54.180774+0000","last_peered":"2023-11-24T08:04:54.180774+0000","last_clean":"2023-11-24T08:04:54.180774+0000","last_became_active":"2023-11-24T08:04:51.861689+0000","last_became_peered":"2023-11-24T08:04:51.861689+0000","last_unstale":"2023-11-24T08:04:54.180774+0000","last_undegraded":"2023-11-24T08:04:54.180774+0000","last_fullsized":"2023-11-24T08:04:54.180774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:13.306963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.881199+0000","last_change":"2023-11-24T08:04:52.869013+0000","last_active":"2023-11-24T08:04:53.881199+0000","last_peered":"2023-11-24T08:04:53.881199+0000","last_clean":"2023-11-24T08:04:53.881199+0000","last_became_active":"2023-11-24T08:04:52.868692+0000","last_became_peered":"2023-11-24T08:04:52.868692+0000","last_unstale":"2023-11-24T08:04:53.881199+0000","last_undegraded":"2023-11-24T08:04:53.881199+0000","last_fullsized":"2023-11-24T08:04:53.881199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:02.678102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182085+0000","last_change":"2023-11-24T08:04:51.863308+0000","last_active":"2023-11-24T08:04:54.182085+0000","last_peered":"2023-11-24T08:04:54.182085+0000","last_clean":"2023-11-24T08:04:54.182085+0000","last_became_active":"2023-11-24T08:04:51.862942+0000","last_became_peered":"2023-11-24T08:04:51.862942+0000","last_unstale":"2023-11-24T08:04:54.182085+0000","last_undegraded":"2023-11-24T08:04:54.182085+0000","last_fullsized":"2023-11-24T08:04:54.182085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:11.054866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182314+0000","last_change":"2023-11-24T08:04:52.872362+0000","last_active":"2023-11-24T08:04:54.182314+0000","last_peered":"2023-11-24T08:04:54.182314+0000","last_clean":"2023-11-24T08:04:54.182314+0000","last_became_active":"2023-11-24T08:04:52.872106+0000","last_became_peered":"2023-11-24T08:04:52.872106+0000","last_unstale":"2023-11-24T08:04:54.182314+0000","last_undegraded":"2023-11-24T08:04:54.182314+0000","last_fullsized":"2023-11-24T08:04:54.182314+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:07.550669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.881080+0000","last_change":"2023-11-24T08:04:51.858761+0000","last_active":"2023-11-24T08:04:53.881080+0000","last_peered":"2023-11-24T08:04:53.881080+0000","last_clean":"2023-11-24T08:04:53.881080+0000","last_became_active":"2023-11-24T08:04:51.858461+0000","last_became_peered":"2023-11-24T08:04:51.858461+0000","last_unstale":"2023-11-24T08:04:53.881080+0000","last_undegraded":"2023-11-24T08:04:53.881080+0000","last_fullsized":"2023-11-24T08:04:53.881080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:33:27.833934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879908+0000","last_change":"2023-11-24T08:04:52.870981+0000","last_active":"2023-11-24T08:04:53.879908+0000","last_peered":"2023-11-24T08:04:53.879908+0000","last_clean":"2023-11-24T08:04:53.879908+0000","last_became_active":"2023-11-24T08:04:52.870708+0000","last_became_peered":"2023-11-24T08:04:52.870708+0000","last_unstale":"2023-11-24T08:04:53.879908+0000","last_undegraded":"2023-11-24T08:04:53.879908+0000","last_fullsized":"2023-11-24T08:04:53.879908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:55:46.130463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181058+0000","last_change":"2023-11-24T08:04:51.857961+0000","last_active":"2023-11-24T08:04:54.181058+0000","last_peered":"2023-11-24T08:04:54.181058+0000","last_clean":"2023-11-24T08:04:54.181058+0000","last_became_active":"2023-11-24T08:04:51.857412+0000","last_became_peered":"2023-11-24T08:04:51.857412+0000","last_unstale":"2023-11-24T08:04:54.181058+0000","last_undegraded":"2023-11-24T08:04:54.181058+0000","last_fullsized":"2023-11-24T08:04:54.181058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:37:25.458869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182449+0000","last_change":"2023-11-24T08:04:52.870418+0000","last_active":"2023-11-24T08:04:54.182449+0000","last_peered":"2023-11-24T08:04:54.182449+0000","last_clean":"2023-11-24T08:04:54.182449+0000","last_became_active":"2023-11-24T08:04:52.870147+0000","last_became_peered":"2023-11-24T08:04:52.870147+0000","last_unstale":"2023-11-24T08:04:54.182449+0000","last_undegraded":"2023-11-24T08:04:54.182449+0000","last_fullsized":"2023-11-24T08:04:54.182449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:23.236166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879936+0000","last_change":"2023-11-24T08:04:51.859500+0000","last_active":"2023-11-24T08:04:53.879936+0000","last_peered":"2023-11-24T08:04:53.879936+0000","last_clean":"2023-11-24T08:04:53.879936+0000","last_became_active":"2023-11-24T08:04:51.859139+0000","last_became_peered":"2023-11-24T08:04:51.859139+0000","last_unstale":"2023-11-24T08:04:53.879936+0000","last_undegraded":"2023-11-24T08:04:53.879936+0000","last_fullsized":"2023-11-24T08:04:53.879936+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:54.896422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.879821+0000","last_change":"2023-11-24T08:04:52.873010+0000","last_active":"2023-11-24T08:04:53.879821+0000","last_peered":"2023-11-24T08:04:53.879821+0000","last_clean":"2023-11-24T08:04:53.879821+0000","last_became_active":"2023-11-24T08:04:52.872712+0000","last_became_peered":"2023-11-24T08:04:52.872712+0000","last_unstale":"2023-11-24T08:04:53.879821+0000","last_undegraded":"2023-11-24T08:04:53.879821+0000","last_fullsized":"2023-11-24T08:04:53.879821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:16.828884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180708+0000","last_change":"2023-11-24T08:04:51.863128+0000","last_active":"2023-11-24T08:04:54.180708+0000","last_peered":"2023-11-24T08:04:54.180708+0000","last_clean":"2023-11-24T08:04:54.180708+0000","last_became_active":"2023-11-24T08:04:51.862057+0000","last_became_peered":"2023-11-24T08:04:51.862057+0000","last_unstale":"2023-11-24T08:04:54.180708+0000","last_undegraded":"2023-11-24T08:04:54.180708+0000","last_fullsized":"2023-11-24T08:04:54.180708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:07.601525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.180784+0000","last_change":"2023-11-24T08:04:52.880720+0000","last_active":"2023-11-24T08:04:54.180784+0000","last_peered":"2023-11-24T08:04:54.180784+0000","last_clean":"2023-11-24T08:04:54.180784+0000","last_became_active":"2023-11-24T08:04:52.878269+0000","last_became_peered":"2023-11-24T08:04:52.878269+0000","last_unstale":"2023-11-24T08:04:54.180784+0000","last_undegraded":"2023-11-24T08:04:54.180784+0000","last_fullsized":"2023-11-24T08:04:54.180784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:31.954801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181147+0000","last_change":"2023-11-24T08:04:51.859483+0000","last_active":"2023-11-24T08:04:54.181147+0000","last_peered":"2023-11-24T08:04:54.181147+0000","last_clean":"2023-11-24T08:04:54.181147+0000","last_became_active":"2023-11-24T08:04:51.859242+0000","last_became_peered":"2023-11-24T08:04:51.859242+0000","last_unstale":"2023-11-24T08:04:54.181147+0000","last_undegraded":"2023-11-24T08:04:54.181147+0000","last_fullsized":"2023-11-24T08:04:54.181147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:08:47.965492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181048+0000","last_change":"2023-11-24T08:04:52.880254+0000","last_active":"2023-11-24T08:04:54.181048+0000","last_peered":"2023-11-24T08:04:54.181048+0000","last_clean":"2023-11-24T08:04:54.181048+0000","last_became_active":"2023-11-24T08:04:52.880009+0000","last_became_peered":"2023-11-24T08:04:52.880009+0000","last_unstale":"2023-11-24T08:04:54.181048+0000","last_undegraded":"2023-11-24T08:04:54.181048+0000","last_fullsized":"2023-11-24T08:04:54.181048+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:37:26.465846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.181005+0000","last_change":"2023-11-24T08:04:51.865118+0000","last_active":"2023-11-24T08:04:54.181005+0000","last_peered":"2023-11-24T08:04:54.181005+0000","last_clean":"2023-11-24T08:04:54.181005+0000","last_became_active":"2023-11-24T08:04:51.864763+0000","last_became_peered":"2023-11-24T08:04:51.864763+0000","last_unstale":"2023-11-24T08:04:54.181005+0000","last_undegraded":"2023-11-24T08:04:54.181005+0000","last_fullsized":"2023-11-24T08:04:54.181005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:40.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:53.878228+0000","last_change":"2023-11-24T08:04:52.879429+0000","last_active":"2023-11-24T08:04:53.878228+0000","last_peered":"2023-11-24T08:04:53.878228+0000","last_clean":"2023-11-24T08:04:53.878228+0000","last_became_active":"2023-11-24T08:04:52.879104+0000","last_became_peered":"2023-11-24T08:04:52.879104+0000","last_unstale":"2023-11-24T08:04:53.878228+0000","last_undegraded":"2023-11-24T08:04:53.878228+0000","last_fullsized":"2023-11-24T08:04:53.878228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:51.830965+0000","last_clean_scrub_stamp":"2023-11-24T08:04:51.830965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:26.003348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-24T08:04:54.182530+0000","last_change":"2023-11-24T08:04:51.860907+0000","last_active":"2023-11-24T08:04:54.182530+0000","last_peered":"2023-11-24T08:04:54.182530+0000","last_clean":"2023-11-24T08:04:54.182530+0000","last_became_active":"2023-11-24T08:04:51.860583+0000","last_became_peered":"2023-11-24T08:04:51.860583+0000","last_unstale":"2023-11-24T08:04:54.182530+0000","last_undegraded":"2023-11-24T08:04:54.182530+0000","last_fullsized":"2023-11-24T08:04:54.182530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:50.823988+0000","last_clean_scrub_stamp":"2023-11-24T08:04:50.823988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:08:44.738162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T08:04:52.863889+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:04:52.863889+0000","last_peered":"2023-11-24T08:04:52.863889+0000","last_clean":"2023-11-24T08:04:52.863889+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:04:52.863889+0000","last_undegraded":"2023-11-24T08:04:52.863889+0000","last_fullsized":"2023-11-24T08:04:52.863889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":752378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.4539999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4260000000000002,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.66200000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.747},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.64000000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.504},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60799999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":162536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60399999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":162592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.95199999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.875}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.627}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.79300000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":162024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.874},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59399999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":163554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59199999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":161990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.9139999999999997,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.442}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.371}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.907,"5min":5.907,"15min":5.907},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.624},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.68700000000000006}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":163554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.438}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.6059999999999999,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9320000000000004,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.752}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.628}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":752288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.880000000000001,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.439}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.9800000000000004,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.505}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.745}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":12.688000000000001,"5min":12.688000000000001,"15min":12.688000000000001},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.875},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1100000000000003,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":6.6390000000000002,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:04:57.378 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:04:57.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:04:57.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09c0757640 1 Processor -- start 2023-11-24T08:04:57.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09c0757640 1 -- start start 2023-11-24T08:04:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09c0757640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09b8159aa0 0x7f09b80b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09c0757640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 0x7f09b80b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09c0757640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b80cf2c0 con 0x7f09b80b3280 2023-11-24T08:04:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09c0757640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b80ce6f0 con 0x7f09b8159aa0 2023-11-24T08:04:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09c0757640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80ce990 con 0x7f09b80aec90 2023-11-24T08:04:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09becf4640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f09b80b3280 0x7f09b815d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52408/0 (socket says 172.21.15.57:52408) 2023-11-24T08:04:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09becf4640 1 -- 172.21.15.57:0/4113748102 learned_addr learned my addr 172.21.15.57:0/4113748102 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09bdcf2640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 0x7f09b80b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4113748102 >> v2:172.21.15.132:3300/0 conn(0x7f09b8159aa0 0x7f09b80b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171744373 0 0) 0x7f09b80cf2c0 con 0x7f09b80b3280 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.566+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a4004640 con 0x7f09b80b3280 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1489712259 0 0) 0x7f09a4004640 con 0x7f09b80b3280 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 msgr2=0x7f09b80b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 0x7f09b80b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 >> v2:172.21.15.132:3300/0 conn(0x7f09b8159aa0 msgr2=0x7f09b80b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 --2- 172.21.15.57:0/4113748102 >> v2:172.21.15.132:3300/0 conn(0x7f09b8159aa0 0x7f09b80b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80cec70 con 0x7f09b80b3280 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f09b0001a00 con 0x7f09b80b3280 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 >> v1:172.21.15.57:6789/0 conn(0x7f09b80b3280 legacy=0x7f09b815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a4004a90 0x7f09a4004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 0x7f09a40058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4005e20 0x7f09a40062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80ce6f0 con 0x7f09a4004a90 2023-11-24T08:04:57.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80ce990 con 0x7f09a4005e20 2023-11-24T08:04:57.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a4003480 con 0x7f09b80aec90 2023-11-24T08:04:57.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a4004a90 0x7f09a4004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09bdcf2640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 0x7f09a40058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09becf4640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4005e20 0x7f09a40062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09be4f3640 1 -- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 msgr2=0x7f09a40058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b80aec90 0x7f09a40058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09be4f3640 1 -- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4005e20 msgr2=0x7f09a40062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4005e20 0x7f09a40062a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09be4f3640 1 -- 172.21.15.57:0/4113748102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a4004640 con 0x7f09a4004a90 2023-11-24T08:04:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09becf4640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4005e20 0x7f09a40062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:57.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.570+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a4004a90 0x7f09a4004eb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009ae0 tx=0x7f09b401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da54cb7f00a84027 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40a5540 con 0x7f09a4004a90 2023-11-24T08:04:57.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40a56a0 con 0x7f09a4004a90 2023-11-24T08:04:57.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09bd4f1640 1 -- 172.21.15.57:0/4113748102 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40a5a50 con 0x7f09a4004a90 2023-11-24T08:04:57.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- 172.21.15.57:0/4113748102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a4004a90 msgr2=0x7f09a4004eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 --2- 172.21.15.57:0/4113748102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09a4004a90 0x7f09a4004eb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009ae0 tx=0x7f09b401ca60 comp rx=0 tx=0).stop 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09becf4640 1 -- 172.21.15.57:0/4113748102 reap_dead start 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- 172.21.15.57:0/4113748102 shutdown_connections 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- 172.21.15.57:0/4113748102 >> 172.21.15.57:0/4113748102 conn(0x7f09b80cc390 msgr2=0x7f09b80cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- 172.21.15.57:0/4113748102 shutdown_connections 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- 172.21.15.57:0/4113748102 wait complete. 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 Processor -- start 2023-11-24T08:04:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- start start 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4004a90 0x7f09b81574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b8155450 0x7f09b8140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b8155c00 0x7f09b8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8158ca0 con 0x7f09b8155c00 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8156450 con 0x7f09a4004a90 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09c0757640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8156730 con 0x7f09b8155450 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.574+0000 7f09becf4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b8155c00 0x7f09b8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b8155c00 0x7f09b8157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47634/0 (socket says 172.21.15.57:47634) 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 -- 172.21.15.57:0/4238386570 learned_addr learned my addr 172.21.15.57:0/4238386570 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4004a90 0x7f09b81574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09bdcf2640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b8155450 0x7f09b8140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 -- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b8155450 msgr2=0x7f09b8140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b8155450 0x7f09b8140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 -- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4004a90 msgr2=0x7f09b81574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4004a90 0x7f09b81574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 -- 172.21.15.57:0/4238386570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8156a10 con 0x7f09b8155c00 2023-11-24T08:04:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09becf4640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b8155c00 0x7f09b8157fa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f09b806cdc0 tx=0x7f09b000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09aeffd640 1 -- 172.21.15.57:0/4238386570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000eb90 con 0x7f09b8155c00 2023-11-24T08:04:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09aeffd640 1 -- 172.21.15.57:0/4238386570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b000ecf0 con 0x7f09b8155c00 2023-11-24T08:04:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09aeffd640 1 -- 172.21.15.57:0/4238386570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0013660 con 0x7f09b8155c00 2023-11-24T08:04:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b8156cf0 con 0x7f09b8155c00 2023-11-24T08:04:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b8156080 con 0x7f09b8155c00 2023-11-24T08:04:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b8072850 con 0x7f09b8155c00 2023-11-24T08:04:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09aeffd640 1 -- 172.21.15.57:0/4238386570 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f09b00137c0 con 0x7f09b8155c00 2023-11-24T08:04:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.578+0000 7f09aeffd640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f099c0664a0 0x7f099c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.582+0000 7f09aeffd640 1 -- 172.21.15.57:0/4238386570 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09b0084120 con 0x7f09b8155c00 2023-11-24T08:04:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.582+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f099c0664a0 0x7f099c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.582+0000 7f09be4f3640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f099c0664a0 0x7f099c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09b40af000 tx=0x7f09b40046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.586+0000 7f09aeffd640 1 -- 172.21.15.57:0/4238386570 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09b00515a0 con 0x7f09b8155c00 2023-11-24T08:04:57.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.798+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f09b81571a0 con 0x7f09b8155c00 2023-11-24T08:04:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09aeffd640 1 -- 172.21.15.57:0/4238386570 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f09b0054bc0 con 0x7f09b8155c00 2023-11-24T08:04:57.814 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-11-24T08:04:57.814 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg== 2023-11-24T08:04:57.814 INFO:teuthology.orchestra.run.smithi057.stdout: caps mds = "allow" 2023-11-24T08:04:57.814 INFO:teuthology.orchestra.run.smithi057.stdout: caps mon = "allow r" 2023-11-24T08:04:57.814 INFO:teuthology.orchestra.run.smithi057.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:04:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f099c0664a0 msgr2=0x7f099c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f099c0664a0 0x7f099c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f09b40af000 tx=0x7f09b40046d0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b8155c00 msgr2=0x7f09b8157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b8155c00 0x7f09b8157fa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f09b806cdc0 tx=0x7f09b000e530 comp rx=0 tx=0).stop 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 shutdown_connections 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f099c0664a0 0x7f099c068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b8155c00 0x7f09b8157fa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f09b8155450 0x7f09b8140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 --2- 172.21.15.57:0/4238386570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09a4004a90 0x7f09b81574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 >> 172.21.15.57:0/4238386570 conn(0x7f09b80cc390 msgr2=0x7f09b806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 shutdown_connections 2023-11-24T08:04:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.806+0000 7f09c0757640 1 -- 172.21.15.57:0/4238386570 wait complete. 2023-11-24T08:04:57.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:57.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff48dd35640 1 Processor -- start 2023-11-24T08:04:57.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff48dd35640 1 -- start start 2023-11-24T08:04:57.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff48dd35640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880b25c0 0x7ff4880d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff48dd35640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4880d3880 0x7ff4880cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff48dd35640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48806d050 con 0x7ff48815d720 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff48dd35640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880d2240 con 0x7ff4880d3880 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff48dd35640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880d3d30 con 0x7ff4880b25c0 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff487fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4880d3880 0x7ff4880cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff487fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4880d3880 0x7ff4880cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47640/0 (socket says 172.21.15.57:47640) 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff487fff640 1 -- 172.21.15.57:0/205150709 learned_addr learned my addr 172.21.15.57:0/205150709 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff486ffd640 1 --2- 172.21.15.57:0/205150709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880b25c0 0x7ff4880d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff487fff640 1 -- 172.21.15.57:0/205150709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880b25c0 msgr2=0x7ff4880d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff487fff640 1 --2- 172.21.15.57:0/205150709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880b25c0 0x7ff4880d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff487fff640 1 -- 172.21.15.57:0/205150709 >> v1:172.21.15.132:6789/0 conn(0x7ff48815d720 legacy=0x7ff4880d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff487fff640 1 -- 172.21.15.57:0/205150709 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48806c720 con 0x7ff4880d3880 2023-11-24T08:04:57.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.970+0000 7ff486ffd640 1 --2- 172.21.15.57:0/205150709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880b25c0 0x7ff4880d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:57.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff487fff640 1 --2- 172.21.15.57:0/205150709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4880d3880 0x7ff4880cde10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff480009e50 tx=0x7ff48001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7521d4c5abaa93a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff4867fc640 1 -- 172.21.15.57:0/205150709 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800a57d0 con 0x7ff4880d3880 2023-11-24T08:04:57.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff4867fc640 1 -- 172.21.15.57:0/205150709 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4800a5930 con 0x7ff4880d3880 2023-11-24T08:04:57.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff4867fc640 1 -- 172.21.15.57:0/205150709 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800a5cc0 con 0x7ff4880d3880 2023-11-24T08:04:57.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 -- 172.21.15.57:0/205150709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4880d3880 msgr2=0x7ff4880cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 --2- 172.21.15.57:0/205150709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4880d3880 0x7ff4880cde10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff480009e50 tx=0x7ff48001ca10 comp rx=0 tx=0).stop 2023-11-24T08:04:57.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 -- 172.21.15.57:0/205150709 shutdown_connections 2023-11-24T08:04:57.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 --2- 172.21.15.57:0/205150709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4880d3880 0x7ff4880cde10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 --2- 172.21.15.57:0/205150709 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880b25c0 0x7ff4880d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 -- 172.21.15.57:0/205150709 >> 172.21.15.57:0/205150709 conn(0x7ff48808af70 msgr2=0x7ff48809c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 -- 172.21.15.57:0/205150709 shutdown_connections 2023-11-24T08:04:57.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.974+0000 7ff48dd35640 1 -- 172.21.15.57:0/205150709 wait complete. 2023-11-24T08:04:57.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 Processor -- start 2023-11-24T08:04:57.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 -- start start 2023-11-24T08:04:57.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880b25c0 0x7ff4880ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880d3880 0x7ff48814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48815d720 0x7ff488153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880cb310 con 0x7ff48815d720 2023-11-24T08:04:57.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48814ea10 con 0x7ff4880b25c0 2023-11-24T08:04:57.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880cad50 con 0x7ff4880d3880 2023-11-24T08:04:57.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48815d720 0x7ff488153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48815d720 0x7ff488153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47642/0 (socket says 172.21.15.57:47642) 2023-11-24T08:04:57.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 -- 172.21.15.57:0/354045055 learned_addr learned my addr 172.21.15.57:0/354045055 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff4877fe640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880b25c0 0x7ff4880ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff486ffd640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880d3880 0x7ff48814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 -- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880d3880 msgr2=0x7ff48814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880d3880 0x7ff48814e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 -- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880b25c0 msgr2=0x7ff4880ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880b25c0 0x7ff4880ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 -- 172.21.15.57:0/354045055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009b30 con 0x7ff48815d720 2023-11-24T08:04:57.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff486ffd640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880d3880 0x7ff48814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:57.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff4877fe640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880b25c0 0x7ff4880ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:57.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff487fff640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48815d720 0x7ff488153e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff4800af040 tx=0x7ff4800197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff46ffff640 1 -- 172.21.15.57:0/354045055 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800b8670 con 0x7ff48815d720 2023-11-24T08:04:57.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff46ffff640 1 -- 172.21.15.57:0/354045055 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4800b87d0 con 0x7ff48815d720 2023-11-24T08:04:57.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880cb030 con 0x7ff48815d720 2023-11-24T08:04:57.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff46ffff640 1 -- 172.21.15.57:0/354045055 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800b8b80 con 0x7ff48815d720 2023-11-24T08:04:57.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.978+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48814ef40 con 0x7ff48815d720 2023-11-24T08:04:57.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.982+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880cd700 con 0x7ff48815d720 2023-11-24T08:04:57.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.982+0000 7ff46ffff640 1 -- 172.21.15.57:0/354045055 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4800b8ce0 con 0x7ff48815d720 2023-11-24T08:04:57.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.982+0000 7ff46ffff640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff474066470 0x7ff474068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:57.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.982+0000 7ff46ffff640 1 -- 172.21.15.57:0/354045055 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff48011f5d0 con 0x7ff48815d720 2023-11-24T08:04:57.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.982+0000 7ff4877fe640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff474066470 0x7ff474068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:57.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.982+0000 7ff4877fe640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff474066470 0x7ff474068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff488156170 tx=0x7ff478009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:57.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:57.986+0000 7ff46ffff640 1 -- 172.21.15.57:0/354045055 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4800eca60 con 0x7ff48815d720 2023-11-24T08:04:58.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.174+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff48814f130 con 0x7ff48815d720 2023-11-24T08:04:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.174+0000 7ff46ffff640 1 -- 172.21.15.57:0/354045055 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7ff4800f0080 con 0x7ff48815d720 2023-11-24T08:04:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:04:58.181 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2109788946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2109788946},{"type":"v1","addr":"172.21.15.132:6835","nonce":2109788946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3040903718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3040903718},{"type":"v1","addr":"172.21.15.57:6834","nonce":3040903718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/412231567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":412231567},{"type":"v1","addr":"172.21.15.57:6835","nonce":412231567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:52.236854+0000","modified":"2023-11-24T08:04:55.272383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54689},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54689":{"gid":54689,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/404616365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":404616365},{"type":"v1","addr":"172.21.15.132:6837","nonce":404616365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:04:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2023-11-24T08:04:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff474066470 msgr2=0x7ff474068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff474066470 0x7ff474068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff488156170 tx=0x7ff478009040 comp rx=0 tx=0).stop 2023-11-24T08:04:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48815d720 msgr2=0x7ff488153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48815d720 0x7ff488153e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff4800af040 tx=0x7ff4800197b0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 shutdown_connections 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff474066470 0x7ff474068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48815d720 0x7ff488153e00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4880d3880 0x7ff48814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 --2- 172.21.15.57:0/354045055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4880b25c0 0x7ff4880ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 >> 172.21.15.57:0/354045055 conn(0x7ff48808af70 msgr2=0x7ff48806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 shutdown_connections 2023-11-24T08:04:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.178+0000 7ff48dd35640 1 -- 172.21.15.57:0/354045055 wait complete. 2023-11-24T08:04:58.605 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:04:52.236854+0000', 'modified': '2023-11-24T08:04:55.272383+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 54689}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_54689': {'gid': 54689, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6837/404616365', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 404616365}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 404616365}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:04:58.605 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:04:58.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T08:04:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63ed679640 1 Processor -- start 2023-11-24T08:04:58.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63ed679640 1 -- start start 2023-11-24T08:04:58.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63ed679640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 0x7f63e80c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63ed679640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80ca270 con 0x7f63e80725f0 2023-11-24T08:04:58.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63ed679640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80ce0e0 con 0x7f63e80707b0 2023-11-24T08:04:58.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63ed679640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80ca770 con 0x7f63e80c98f0 2023-11-24T08:04:58.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f63e80725f0 0x7f63e806c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52416/0 (socket says 172.21.15.57:52416) 2023-11-24T08:04:58.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3517548879 learned_addr learned my addr 172.21.15.57:0/3517548879 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:04:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248066402 0 0) 0x7f63e80ca270 con 0x7f63e80725f0 2023-11-24T08:04:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d4003530 con 0x7f63e80725f0 2023-11-24T08:04:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63dffff640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 0x7f63e80c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697449732 0 0) 0x7f63d4003530 con 0x7f63e80725f0 2023-11-24T08:04:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 msgr2=0x7f63e80c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 0x7f63e80c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 >> v1:172.21.15.132:6789/0 conn(0x7f63e80707b0 legacy=0x7f63e8070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e806ce10 con 0x7f63e80725f0 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f63d8001680 con 0x7f63e80725f0 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 >> v1:172.21.15.57:6789/0 conn(0x7f63e80725f0 legacy=0x7f63e806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d40047d0 0x7f63d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 0x7f63d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80ca770 con 0x7f63d40039b0 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d400bb00 con 0x7f63d40047d0 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d400ded0 con 0x7f63e80c98f0 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63dffff640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d40047d0 0x7f63d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e77fe640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 0x7f63d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 msgr2=0x7f63d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80c98f0 0x7f63d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d40047d0 msgr2=0x7f63d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63d40047d0 0x7f63d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.750+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3517548879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d4003530 con 0x7f63d40039b0 2023-11-24T08:04:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63d4003dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f63d8007fc0 tx=0x7f63d801f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa6c2013b7eb14e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80a8e90 con 0x7f63d40039b0 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d80058e0 con 0x7f63d40039b0 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63e67fc640 1 -- 172.21.15.57:0/3517548879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8005c70 con 0x7f63d40039b0 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63ed679640 1 -- 172.21.15.57:0/3517548879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 msgr2=0x7f63d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63ed679640 1 --2- 172.21.15.57:0/3517548879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63d4003dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f63d8007fc0 tx=0x7f63d801f270 comp rx=0 tx=0).stop 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63e77fe640 1 -- 172.21.15.57:0/3517548879 reap_dead start 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63ed679640 1 -- 172.21.15.57:0/3517548879 shutdown_connections 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63ed679640 1 -- 172.21.15.57:0/3517548879 >> 172.21.15.57:0/3517548879 conn(0x7f63e80b0bf0 msgr2=0x7f63e80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63ed679640 1 -- 172.21.15.57:0/3517548879 shutdown_connections 2023-11-24T08:04:58.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.754+0000 7f63ed679640 1 -- 172.21.15.57:0/3517548879 wait complete. 2023-11-24T08:04:58.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 Processor -- start 2023-11-24T08:04:58.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 -- start start 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63e8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80999e0 0x7f63e80b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63e8152240 0x7f63e81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8152c00 con 0x7f63d40039b0 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e809aad0 con 0x7f63e8152240 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8099f50 con 0x7f63e80999e0 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63e8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63e8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47668/0 (socket says 172.21.15.57:47668) 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3312197826 learned_addr learned my addr 172.21.15.57:0/3312197826 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63dffff640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80999e0 0x7f63e80b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e77fe640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63e8152240 0x7f63e81526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80999e0 msgr2=0x7f63e80b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80999e0 0x7f63e80b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63e8152240 msgr2=0x7f63e81526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63e8152240 0x7f63e81526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 -- 172.21.15.57:0/3312197826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e809a230 con 0x7f63d40039b0 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63dffff640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80999e0 0x7f63e80b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e77fe640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63e8152240 0x7f63e81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:58.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63e8159fa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f63d800c1a0 tx=0x7f63d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63df7fe640 1 -- 172.21.15.57:0/3312197826 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80b7070 con 0x7f63d40039b0 2023-11-24T08:04:58.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63df7fe640 1 -- 172.21.15.57:0/3312197826 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8005b10 con 0x7f63d40039b0 2023-11-24T08:04:58.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63df7fe640 1 -- 172.21.15.57:0/3312197826 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8005e80 con 0x7f63d40039b0 2023-11-24T08:04:58.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e809a510 con 0x7f63d40039b0 2023-11-24T08:04:58.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.758+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e8157900 con 0x7f63d40039b0 2023-11-24T08:04:58.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.762+0000 7f63df7fe640 1 -- 172.21.15.57:0/3312197826 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63d8007090 con 0x7f63d40039b0 2023-11-24T08:04:58.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.762+0000 7f63df7fe640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f63c80664a0 0x7f63c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.762+0000 7f63df7fe640 1 -- 172.21.15.57:0/3312197826 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63d81211d0 con 0x7f63d40039b0 2023-11-24T08:04:58.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.762+0000 7f63dffff640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f63c80664a0 0x7f63c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.762+0000 7f63f09ea000 1 Processor -- start 2023-11-24T08:04:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.762+0000 7f63f09ea000 1 -- start start 2023-11-24T08:04:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.762+0000 7f63dffff640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f63c80664a0 0x7f63c8068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63e806ca80 tx=0x7f63d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b19d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b152de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b153700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40afbd130 con 0x55e40b153320 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40afaa9a0 con 0x55e40b19cc90 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40afa7ed0 con 0x55e40b19d5b0 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47684/0 (socket says 172.21.15.57:47684) 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 -- 172.21.15.57:0/1645725138 learned_addr learned my addr 172.21.15.57:0/1645725138 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63dffff640 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b19d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 -- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 msgr2=0x55e40b152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 -- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 msgr2=0x55e40b19d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b19d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 -- 172.21.15.57:0/1645725138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e40ac9b890 con 0x55e40b153320 2023-11-24T08:04:58.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63e77fe640 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b153700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f63e80c2970 tx=0x7f63e0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808fbb3a365d1c2e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63dcff9640 1 -- 172.21.15.57:0/1645725138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00052d0 con 0x55e40b153320 2023-11-24T08:04:58.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63dcff9640 1 -- 172.21.15.57:0/1645725138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0005430 con 0x55e40b153320 2023-11-24T08:04:58.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63dcff9640 1 -- 172.21.15.57:0/1645725138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00057a0 con 0x55e40b153320 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- 172.21.15.57:0/1645725138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 msgr2=0x55e40b153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b153700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f63e80c2970 tx=0x7f63e0007f90 comp rx=0 tx=0).stop 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- 172.21.15.57:0/1645725138 shutdown_connections 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b153700 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 --2- 172.21.15.57:0/1645725138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b19d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- 172.21.15.57:0/1645725138 >> 172.21.15.57:0/1645725138 conn(0x55e40b14f2d0 msgr2=0x55e40b1516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- 172.21.15.57:0/1645725138 shutdown_connections 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- 172.21.15.57:0/1645725138 wait complete. 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 -- start start 2023-11-24T08:04:58.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.766+0000 7f63f09ea000 1 Processor -- start 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b157d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b158280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b16b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40afa37c0 con 0x55e40b153320 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40af5bbf0 con 0x55e40b19cc90 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40af61a90 con 0x55e40b19d5b0 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 10 client.0 _ll_register_callbacks cb 0x55e40b13e3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47692/0 (socket says 172.21.15.57:47692) 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 -- 172.21.15.57:0/829029340 learned_addr learned my addr 172.21.15.57:0/829029340 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63dffff640 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e77fe640 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b16b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 -- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 msgr2=0x55e40b16b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b16b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 -- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 msgr2=0x55e40b158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 -- 172.21.15.57:0/829029340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e80ce0e0 con 0x55e40b153320 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b157d40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63d809b9b0 tx=0x7f63d80f2a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3951b95963b354b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63c5ffb640 1 -- 172.21.15.57:0/829029340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80fa570 con 0x55e40b153320 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63c5ffb640 1 -- 172.21.15.57:0/829029340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63d8007c10 con 0x55e40b153320 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e40af65470 con 0x55e40b153320 2023-11-24T08:04:58.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63c5ffb640 1 -- 172.21.15.57:0/829029340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63d811f2a0 con 0x55e40b153320 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 10 client.5271 fetch_fsmap learned FSMap version 15 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55e40af64190 con 0x55e40b153320 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63c5ffb640 1 -- 172.21.15.57:0/829029340 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e40af65470 con 0x55e40b153320 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63c5ffb640 1 -- 172.21.15.57:0/829029340 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f63d80c3060 con 0x55e40b153320 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 10 client.5271 fetch_fsmap finished waiting for FSMap version 15 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 10 client.5271 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 20 client.5271 populate_metadata read hostname 'smithi057' 2023-11-24T08:04:58.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b16c320 0x55e40b1aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 4 client.5271 mds_command: new command op to 54689 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:04:58.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 --> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e40af68b50 con 0x55e40b16c320 2023-11-24T08:04:58.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63dffff640 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b16c320 0x55e40b1aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63dffff640 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b16c320 0x55e40b1aef50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d093aa8e5af99f21 server_cookie=7058fb9f827d1617 in_seq=0 out_seq=0 2023-11-24T08:04:58.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.770+0000 7f63c5ffb640 10 client.5271 ms_handle_connect on v2:172.21.15.132:6836/404616365 2023-11-24T08:04:58.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63c5ffb640 1 -- 172.21.15.57:0/829029340 <== mds.0 v2:172.21.15.132:6836/404616365 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e40af68b50 con 0x55e40b16c320 2023-11-24T08:04:58.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63c5ffb640 10 client.5271 handle_command_reply: tid=0 2023-11-24T08:04:58.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 client.5271 shutdown 2023-11-24T08:04:58.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 msgr2=0x55e40b157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b157d40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63d809b9b0 tx=0x7f63d80f2a30 comp rx=0 tx=0).stop 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 shutdown_connections 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b16c320 0x55e40b1aef50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19d5b0 0x55e40b16b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b19cc90 0x55e40b158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 --2- 172.21.15.57:0/829029340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b157d40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63c5ffb640 0 client.5271 ms_handle_reset on v2:172.21.15.132:6836/404616365 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 >> 172.21.15.57:0/829029340 conn(0x55e40b14f2d0 msgr2=0x55e40b1516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 shutdown_connections 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 1 -- 172.21.15.57:0/829029340 wait complete. 2023-11-24T08:04:58.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.774+0000 7f63f09ea000 20 client.5271 trim_cache size 0 max 16384 2023-11-24T08:04:58.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 Processor -- start 2023-11-24T08:04:58.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- start start 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b19b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19cc90 0x55e40b153700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40ac5c940 con 0x55e40b153320 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40af9f130 con 0x55e40b14f2d0 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40afa37c0 con 0x55e40b19cc90 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b19b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47694/0 (socket says 172.21.15.57:47694) 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 -- 172.21.15.57:0/2203755917 learned_addr learned my addr 172.21.15.57:0/2203755917 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63e77fe640 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19cc90 0x55e40b153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 -- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19cc90 msgr2=0x55e40b153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19cc90 0x55e40b153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 -- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 msgr2=0x55e40b19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 -- 172.21.15.57:0/2203755917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e40af4a490 con 0x55e40b153320 2023-11-24T08:04:58.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dffff640 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b19b070 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f63d00093f0 tx=0x7f63d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b8c4ea422fffd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dd7fa640 1 -- 172.21.15.57:0/2203755917 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d002a070 con 0x55e40b153320 2023-11-24T08:04:58.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dd7fa640 1 -- 172.21.15.57:0/2203755917 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d00259e0 con 0x55e40b153320 2023-11-24T08:04:58.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63dd7fa640 1 -- 172.21.15.57:0/2203755917 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0025b50 con 0x55e40b153320 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- 172.21.15.57:0/2203755917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 msgr2=0x55e40b19b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b19b070 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f63d00093f0 tx=0x7f63d0017000 comp rx=0 tx=0).stop 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- 172.21.15.57:0/2203755917 shutdown_connections 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b19cc90 0x55e40b153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b153320 0x55e40b19b070 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 --2- 172.21.15.57:0/2203755917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- 172.21.15.57:0/2203755917 >> 172.21.15.57:0/2203755917 conn(0x55e40b157f10 msgr2=0x55e40b1516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- 172.21.15.57:0/2203755917 shutdown_connections 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- 172.21.15.57:0/2203755917 wait complete. 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.790+0000 7f63f09ea000 1 -- start start 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 Processor -- start 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b1affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b153320 0x55e40b1b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b19cc90 0x55e40b1ba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40af61420 con 0x55e40b19cc90 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40afa2fd0 con 0x55e40b14f2d0 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40af609b0 con 0x55e40b153320 2023-11-24T08:04:58.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 10 client.0 _ll_register_callbacks cb 0x55e40aff1c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:04:58.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b19cc90 0x55e40b1ba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b19cc90 0x55e40b1ba9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47704/0 (socket says 172.21.15.57:47704) 2023-11-24T08:04:58.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 -- 172.21.15.57:0/890687414 learned_addr learned my addr 172.21.15.57:0/890687414 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:58.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b1affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63dffff640 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b153320 0x55e40b1b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 -- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b153320 msgr2=0x55e40b1b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b153320 0x55e40b1b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 -- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 msgr2=0x55e40b1affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b1affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 -- 172.21.15.57:0/890687414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d0014a90 con 0x55e40b19cc90 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e77fe640 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b19cc90 0x55e40b1ba9e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55e40b059e70 tx=0x7f63e0001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7b0d7e1f7b057a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63c5ffb640 1 -- 172.21.15.57:0/890687414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0015840 con 0x55e40b19cc90 2023-11-24T08:04:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63c5ffb640 1 -- 172.21.15.57:0/890687414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63e0003a60 con 0x55e40b19cc90 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e40afa2110 con 0x55e40b19cc90 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63c5ffb640 1 -- 172.21.15.57:0/890687414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63e0001260 con 0x55e40b19cc90 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 10 client.5277 fetch_fsmap learned FSMap version 15 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55e40ac9bcc0 con 0x55e40b19cc90 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63c5ffb640 1 -- 172.21.15.57:0/890687414 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e40afa2110 con 0x55e40b19cc90 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63c5ffb640 1 -- 172.21.15.57:0/890687414 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f63e0027070 con 0x55e40b19cc90 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 10 client.5277 fetch_fsmap finished waiting for FSMap version 15 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 10 client.5277 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 20 client.5277 populate_metadata read hostname 'smithi057' 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b19d5b0 0x55e40b205e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 4 client.5277 mds_command: new command op to 54689 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:04:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 --> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e40afd19a0 con 0x55e40b19d5b0 2023-11-24T08:04:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.794+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b19d5b0 0x55e40b205e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63e6ffd640 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b19d5b0 0x55e40b205e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51765d1a9ddcd351 server_cookie=d6ed7f0d28ae0f5b in_seq=0 out_seq=0 2023-11-24T08:04:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63c5ffb640 10 client.5277 ms_handle_connect on v2:172.21.15.132:6836/404616365 2023-11-24T08:04:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63c5ffb640 1 -- 172.21.15.57:0/890687414 <== mds.0 v2:172.21.15.132:6836/404616365 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e40afd19a0 con 0x55e40b19d5b0 2023-11-24T08:04:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63c5ffb640 10 client.5277 handle_command_reply: tid=0 2023-11-24T08:04:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 client.5277 shutdown 2023-11-24T08:04:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b19cc90 msgr2=0x55e40b1ba9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b19cc90 0x55e40b1ba9e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55e40b059e70 tx=0x7f63e0001520 comp rx=0 tx=0).stop 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 shutdown_connections 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:6836/404616365,v1:172.21.15.132:6837/404616365] conn(0x55e40b19d5b0 0x55e40b205e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e40b19cc90 0x55e40b1ba9e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e40b153320 0x55e40b1b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 --2- 172.21.15.57:0/890687414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e40b14f2d0 0x55e40b1affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63c5ffb640 0 client.5277 ms_handle_reset on v2:172.21.15.132:6836/404616365 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 >> 172.21.15.57:0/890687414 conn(0x55e40b157f10 msgr2=0x55e40b151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 shutdown_connections 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 1 -- 172.21.15.57:0/890687414 wait complete. 2023-11-24T08:04:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63f09ea000 20 client.5277 trim_cache size 0 max 16384 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "445cea61-e72c-4da9-979a-02ade002d7d6", 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 54689, 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 5.9380093150000004, 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 15, 2023-11-24T08:04:58.808 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 37, 2023-11-24T08:04:58.809 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 37, 2023-11-24T08:04:58.809 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 13.795640693999999 2023-11-24T08:04:58.809 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:04:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f63c80664a0 msgr2=0x7f63c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f63c80664a0 0x7f63c8068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63e806ca80 tx=0x7f63d0008040 comp rx=0 tx=0).stop 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 msgr2=0x7f63e8159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63e8159fa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f63d800c1a0 tx=0x7f63d4005800 comp rx=0 tx=0).stop 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 shutdown_connections 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f63c80664a0 0x7f63c8068960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63e8152240 0x7f63e81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63e80999e0 0x7f63e80b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 --2- 172.21.15.57:0/3312197826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63d40039b0 0x7f63e8159fa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 >> 172.21.15.57:0/3312197826 conn(0x7f63e80b0bf0 msgr2=0x7f63e8071950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 shutdown_connections 2023-11-24T08:04:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.798+0000 7f63ed679640 1 -- 172.21.15.57:0/3312197826 wait complete. 2023-11-24T08:04:58.821 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:04:58.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cc794640 1 Processor -- start 2023-11-24T08:04:58.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cc794640 1 -- start start 2023-11-24T08:04:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cc794640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69c40b36c0 0x7f69c40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cc794640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69c4070da0 0x7f69c40711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cc794640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c415a700 con 0x7f69c415a320 2023-11-24T08:04:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cc794640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c40b2430 con 0x7f69c40b36c0 2023-11-24T08:04:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cc794640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c40b2620 con 0x7f69c4070da0 2023-11-24T08:04:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69c9d2f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69c40b36c0 0x7f69c40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69c9d2f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69c40b36c0 0x7f69c40b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47716/0 (socket says 172.21.15.57:47716) 2023-11-24T08:04:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69c9d2f640 1 -- 172.21.15.57:0/3587698601 learned_addr learned my addr 172.21.15.57:0/3587698601 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:58.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cad31640 1 --2- 172.21.15.57:0/3587698601 >> v2:172.21.15.132:3300/0 conn(0x7f69c4070da0 0x7f69c40711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69c9d2f640 1 -- 172.21.15.57:0/3587698601 >> v2:172.21.15.132:3300/0 conn(0x7f69c4070da0 msgr2=0x7f69c40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69c9d2f640 1 --2- 172.21.15.57:0/3587698601 >> v2:172.21.15.132:3300/0 conn(0x7f69c4070da0 0x7f69c40711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69c9d2f640 1 -- 172.21.15.57:0/3587698601 >> v1:172.21.15.57:6789/0 conn(0x7f69c415a320 legacy=0x7f69c4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69c9d2f640 1 -- 172.21.15.57:0/3587698601 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40b2900 con 0x7f69c40b36c0 2023-11-24T08:04:58.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.962+0000 7f69cad31640 1 --2- 172.21.15.57:0/3587698601 >> v2:172.21.15.132:3300/0 conn(0x7f69c4070da0 0x7f69c40711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:58.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69c9d2f640 1 --2- 172.21.15.57:0/3587698601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c40b36c0 0x7f69c40b1ef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f69c406c2d0 tx=0x7f69b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c5f5afe1f26de3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69c952e640 1 -- 172.21.15.57:0/3587698601 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40aa430 con 0x7f69c40b36c0 2023-11-24T08:04:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69c952e640 1 -- 172.21.15.57:0/3587698601 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40aa590 con 0x7f69c40b36c0 2023-11-24T08:04:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69c952e640 1 -- 172.21.15.57:0/3587698601 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40aa920 con 0x7f69c40b36c0 2023-11-24T08:04:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 -- 172.21.15.57:0/3587698601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c40b36c0 msgr2=0x7f69c40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 --2- 172.21.15.57:0/3587698601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c40b36c0 0x7f69c40b1ef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f69c406c2d0 tx=0x7f69b401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 -- 172.21.15.57:0/3587698601 shutdown_connections 2023-11-24T08:04:58.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 --2- 172.21.15.57:0/3587698601 >> v2:172.21.15.132:3300/0 conn(0x7f69c4070da0 0x7f69c40711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 --2- 172.21.15.57:0/3587698601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c40b36c0 0x7f69c40b1ef0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 -- 172.21.15.57:0/3587698601 >> 172.21.15.57:0/3587698601 conn(0x7f69c40b0bf0 msgr2=0x7f69c40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 -- 172.21.15.57:0/3587698601 shutdown_connections 2023-11-24T08:04:58.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.966+0000 7f69cc794640 1 -- 172.21.15.57:0/3587698601 wait complete. 2023-11-24T08:04:58.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 Processor -- start 2023-11-24T08:04:58.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 -- start start 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c4070da0 0x7f69c406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69c40b36c0 0x7f69c40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69c415a320 0x7f69c4143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415d850 con 0x7f69c4070da0 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4158460 con 0x7f69c415a320 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415b680 con 0x7f69c40b36c0 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c4070da0 0x7f69c406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c4070da0 0x7f69c406d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47728/0 (socket says 172.21.15.57:47728) 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 -- 172.21.15.57:0/3846619398 learned_addr learned my addr 172.21.15.57:0/3846619398 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:04:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cad31640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69c415a320 0x7f69c4143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69c9d2f640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69c40b36c0 0x7f69c40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 -- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69c40b36c0 msgr2=0x7f69c40999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69c40b36c0 0x7f69c40999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 -- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69c415a320 msgr2=0x7f69c4143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69c415a320 0x7f69c4143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 -- 172.21.15.57:0/3846619398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40094d0 con 0x7f69c4070da0 2023-11-24T08:04:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69ca530640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c4070da0 0x7f69c406d140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f69c000c3f0 tx=0x7f69c000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69baffd640 1 -- 172.21.15.57:0/3846619398 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c00052d0 con 0x7f69c4070da0 2023-11-24T08:04:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69baffd640 1 -- 172.21.15.57:0/3846619398 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c0005430 con 0x7f69c4070da0 2023-11-24T08:04:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69baffd640 1 -- 172.21.15.57:0/3846619398 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0003840 con 0x7f69c4070da0 2023-11-24T08:04:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c4157ac0 con 0x7f69c4070da0 2023-11-24T08:04:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.970+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c4158080 con 0x7f69c4070da0 2023-11-24T08:04:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.974+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c4067520 con 0x7f69c4070da0 2023-11-24T08:04:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.974+0000 7f69baffd640 1 -- 172.21.15.57:0/3846619398 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69c00039a0 con 0x7f69c4070da0 2023-11-24T08:04:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.974+0000 7f69baffd640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69a8066470 0x7f69a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.974+0000 7f69baffd640 1 -- 172.21.15.57:0/3846619398 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69c00833f0 con 0x7f69c4070da0 2023-11-24T08:04:58.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.974+0000 7f69c9d2f640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69a8066470 0x7f69a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.974+0000 7f69c9d2f640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69a8066470 0x7f69a8068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ae000 tx=0x7f69b40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:58.978+0000 7f69baffd640 1 -- 172.21.15.57:0/3846619398 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69c0050870 con 0x7f69c4070da0 2023-11-24T08:04:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69c40ac1b0 con 0x7f69c4070da0 2023-11-24T08:04:59.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69baffd640 1 -- 172.21.15.57:0/3846619398 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f69c40ac1b0 con 0x7f69c4070da0 2023-11-24T08:04:59.179 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:04:59.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69a8066470 msgr2=0x7f69a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69a8066470 0x7f69a8068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ae000 tx=0x7f69b40a7000 comp rx=0 tx=0).stop 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c4070da0 msgr2=0x7f69c406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c4070da0 0x7f69c406d140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f69c000c3f0 tx=0x7f69c000c8b0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 shutdown_connections 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f69a8066470 0x7f69a8068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69c415a320 0x7f69c4143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69c40b36c0 0x7f69c40999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 --2- 172.21.15.57:0/3846619398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69c4070da0 0x7f69c406d140 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 >> 172.21.15.57:0/3846619398 conn(0x7f69c40b0bf0 msgr2=0x7f69c4070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 shutdown_connections 2023-11-24T08:04:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:04:59.174+0000 7f69cc794640 1 -- 172.21.15.57:0/3846619398 wait complete. 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:04:59.200 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:04:59.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.201 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-11-24T08:04:59.210 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:59.211 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42326sec preferred_lft 42326sec 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:04:59.212 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:79:99:46:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.213 INFO:teuthology.orchestra.run.smithi057.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:04:59.214 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:04:59.214 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T08:04:59.214 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:04:59.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.214 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:04:59.272 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-11-24T08:04:59.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.274 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-11-24T08:04:59.326 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-11-24T08:04:59.326 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:04:59.327 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T08:04:59.327 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:04:59.327 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T08:04:59.327 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:04:59.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.327 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:04:59.327 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:04:59.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T08:04:59.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T08:04:59.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T08:04:59.328 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:04:59.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.421 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:04:59.431 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:04:59.431 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:04:59.431 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:04:59.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-11-24T08:04:59.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:59.495 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:59.545 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:04:59.545 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:04:59.546 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:59.596 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T08:04:59.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:59.693 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:59.693 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:59.707 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:04:59.707 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:04:59.707 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:04:59.707 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with new device syntax: 0@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:04:59.707 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:04:59.710 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:04:59.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:04:59.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:59.732 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:04:59.793 INFO:teuthology.orchestra.run.smithi057.stdout:client5289 2023-11-24T08:04:59.794 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:04:59.794 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:59.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:00.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b0952a640 1 Processor -- start 2023-11-24T08:05:00.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b0952a640 1 -- start start 2023-11-24T08:05:00.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b0952a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b041682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b0952a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b040d14d0 con 0x7f1b04160aa0 2023-11-24T08:05:00.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b0952a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b04161540 con 0x7f1b04160f60 2023-11-24T08:05:00.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b0952a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04161820 con 0x7f1b040d08d0 2023-11-24T08:05:00.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b02ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1b04160aa0 0x7f1b040b8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52432/0 (socket says 172.21.15.57:52432) 2023-11-24T08:05:00.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b02ffd640 1 -- 172.21.15.57:0/639768293 learned_addr learned my addr 172.21.15.57:0/639768293 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:00.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b037fe640 1 --2- 172.21.15.57:0/639768293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b041682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b01ffb640 1 -- 172.21.15.57:0/639768293 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878267627 0 0) 0x7f1b040d14d0 con 0x7f1b04160aa0 2023-11-24T08:05:00.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b01ffb640 1 -- 172.21.15.57:0/639768293 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aec003530 con 0x7f1b04160aa0 2023-11-24T08:05:00.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b01ffb640 1 -- 172.21.15.57:0/639768293 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216383297 0 0) 0x7f1b04161540 con 0x7f1b04160f60 2023-11-24T08:05:00.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b01ffb640 1 -- 172.21.15.57:0/639768293 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b040d14d0 con 0x7f1b04160f60 2023-11-24T08:05:00.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b037fe640 1 -- 172.21.15.57:0/639768293 >> v1:172.21.15.132:6789/0 conn(0x7f1b04160f60 legacy=0x7f1b040d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b037fe640 1 -- 172.21.15.57:0/639768293 >> v1:172.21.15.57:6789/0 conn(0x7f1b04160aa0 legacy=0x7f1b040b8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.038+0000 7f1b037fe640 1 -- 172.21.15.57:0/639768293 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04161b00 con 0x7f1b040d08d0 2023-11-24T08:05:00.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b037fe640 1 --2- 172.21.15.57:0/639768293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b041682f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009dc0 tx=0x7f1afc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd2a1745b82a1a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b01ffb640 1 -- 172.21.15.57:0/639768293 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0a5880 con 0x7f1b040d08d0 2023-11-24T08:05:00.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b01ffb640 1 -- 172.21.15.57:0/639768293 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc0a59e0 con 0x7f1b040d08d0 2023-11-24T08:05:00.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b01ffb640 1 -- 172.21.15.57:0/639768293 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0a5d70 con 0x7f1b040d08d0 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b0952a640 1 -- 172.21.15.57:0/639768293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 msgr2=0x7f1b041682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b0952a640 1 --2- 172.21.15.57:0/639768293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b041682f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009dc0 tx=0x7f1afc01c8b0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b0952a640 1 -- 172.21.15.57:0/639768293 shutdown_connections 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b0952a640 1 --2- 172.21.15.57:0/639768293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b041682f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b0952a640 1 -- 172.21.15.57:0/639768293 >> 172.21.15.57:0/639768293 conn(0x7f1b040613d0 msgr2=0x7f1b040617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b0952a640 1 -- 172.21.15.57:0/639768293 shutdown_connections 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.042+0000 7f1b0952a640 1 -- 172.21.15.57:0/639768293 wait complete. 2023-11-24T08:05:00.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 Processor -- start 2023-11-24T08:05:00.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 -- start start 2023-11-24T08:05:00.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b04158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b04160aa0 0x7f1b0414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b04160f60 0x7f1b0414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04157a60 con 0x7f1b04160aa0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04162b20 con 0x7f1b04160f60 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b04157d00 con 0x7f1b040d08d0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b04160aa0 0x7f1b0414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b04160aa0 0x7f1b0414edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47740/0 (socket says 172.21.15.57:47740) 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 -- 172.21.15.57:0/2104479793 learned_addr learned my addr 172.21.15.57:0/2104479793 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b02ffd640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b04158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b037fe640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b04160f60 0x7f1b0414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 -- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 msgr2=0x7f1b04158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b04158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 -- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b04160f60 msgr2=0x7f1b0414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b04160f60 0x7f1b0414e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 -- 172.21.15.57:0/2104479793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc009a70 con 0x7f1b04160aa0 2023-11-24T08:05:00.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b027fc640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b04160aa0 0x7f1b0414edd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1af800c430 tx=0x7f1af800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1aeb7fe640 1 -- 172.21.15.57:0/2104479793 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80052d0 con 0x7f1b04160aa0 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1aeb7fe640 1 -- 172.21.15.57:0/2104479793 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af8005450 con 0x7f1b04160aa0 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1aeb7fe640 1 -- 172.21.15.57:0/2104479793 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8003840 con 0x7f1b04160aa0 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04162dc0 con 0x7f1b04160aa0 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.046+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b04157fe0 con 0x7f1b04160aa0 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.050+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b04163000 con 0x7f1b04160aa0 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.050+0000 7f1aeb7fe640 1 -- 172.21.15.57:0/2104479793 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1af80039a0 con 0x7f1b04160aa0 2023-11-24T08:05:00.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.050+0000 7f1aeb7fe640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1af0066470 0x7f1af0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.050+0000 7f1aeb7fe640 1 -- 172.21.15.57:0/2104479793 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1af80834a0 con 0x7f1b04160aa0 2023-11-24T08:05:00.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.050+0000 7f1b02ffd640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1af0066470 0x7f1af0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.050+0000 7f1b02ffd640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1af0066470 0x7f1af0068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1af4007fd0 tx=0x7f1af4007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.054+0000 7f1aeb7fe640 1 -- 172.21.15.57:0/2104479793 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b04163000 con 0x7f1b04160aa0 2023-11-24T08:05:00.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b04163000 con 0x7f1b04160aa0 2023-11-24T08:05:00.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1aeb7fe640 1 -- 172.21.15.57:0/2104479793 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1b04163000 con 0x7f1b04160aa0 2023-11-24T08:05:00.255 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1af0066470 msgr2=0x7f1af0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1af0066470 0x7f1af0068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1af4007fd0 tx=0x7f1af4007d60 comp rx=0 tx=0).stop 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b04160aa0 msgr2=0x7f1b0414edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b04160aa0 0x7f1b0414edd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1af800c430 tx=0x7f1af800c8f0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 shutdown_connections 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1af0066470 0x7f1af0068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b04160f60 0x7f1b0414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b04160aa0 0x7f1b0414edd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 --2- 172.21.15.57:0/2104479793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b040d08d0 0x7f1b04158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 >> 172.21.15.57:0/2104479793 conn(0x7f1b040613d0 msgr2=0x7f1b040ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 shutdown_connections 2023-11-24T08:05:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:00.250+0000 7f1b0952a640 1 -- 172.21.15.57:0/2104479793 wait complete. 2023-11-24T08:05:00.276 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:05:00.276 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:00.276 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-24T08:05:00.277 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:05:00.277 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:00.277 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:05:00.277 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:05:00.277 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:00.277 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:00.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.277 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-24T08:05:00.288 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:00.288 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:00.288 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:00.288 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.288 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:00.288 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.288 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42317sec preferred_lft 42317sec 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-24T08:05:00.289 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 02:42:35:0c:2c:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.290 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run.smithi132.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:00.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.291 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:00.347 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-24T08:05:00.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.349 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-24T08:05:00.404 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-24T08:05:00.404 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:00.404 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T08:05:00.404 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:00.404 INFO:teuthology.orchestra.run.smithi132.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:05:00.404 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:00.404 INFO:teuthology.orchestra.run.smithi132.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:05:00.405 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:05:00.405 INFO:teuthology.orchestra.run.smithi132.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:05:00.405 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:00.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.405 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:05:00.405 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:05:00.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:00.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:00.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:00.406 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:05:00.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.497 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:05:00.505 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:05:00.506 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:05:00.507 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:00.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:00.570 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:00.625 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:00.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:00.626 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:00.680 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T08:05:00.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:00.771 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:00.772 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:05:00.789 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:00.789 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:05:00.789 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:05:00.789 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with new device syntax: 1@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:05:00.789 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:05:00.793 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:05:00.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.794 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:00.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:00.814 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:05:00.869 INFO:teuthology.orchestra.run.smithi132.stdout:client54830 2023-11-24T08:05:00.869 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:00.870 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:00.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:05:01.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 Processor -- start 2023-11-24T08:05:01.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 -- start start 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b04144030 0x7f2b0406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b0409cc20 0x7f2b0406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b040709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b04145020 con 0x7f2b0409cc20 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0406d8b0 con 0x7f2b04144030 2023-11-24T08:05:01.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b0b4c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0409d0a0 con 0x7f2b0406e280 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b0409cc20 0x7f2b0406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b0409cc20 0x7f2b0406dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47744/0 (socket says 172.21.15.57:47744) 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 -- 172.21.15.57:0/1670860675 learned_addr learned my addr 172.21.15.57:0/1670860675 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b09a66640 1 --2- 172.21.15.57:0/1670860675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b040709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b09265640 1 --2- 172.21.15.57:0/1670860675 >> v2:172.21.15.132:3300/0 conn(0x7f2b04144030 0x7f2b0406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 -- 172.21.15.57:0/1670860675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 msgr2=0x7f2b040709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 --2- 172.21.15.57:0/1670860675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b040709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 -- 172.21.15.57:0/1670860675 >> v2:172.21.15.132:3300/0 conn(0x7f2b04144030 msgr2=0x7f2b0406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 --2- 172.21.15.57:0/1670860675 >> v2:172.21.15.132:3300/0 conn(0x7f2b04144030 0x7f2b0406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b08a64640 1 -- 172.21.15.57:0/1670860675 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0406cca0 con 0x7f2b0409cc20 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b09a66640 1 --2- 172.21.15.57:0/1670860675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b040709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.066+0000 7f2b09265640 1 --2- 172.21.15.57:0/1670860675 >> v2:172.21.15.132:3300/0 conn(0x7f2b04144030 0x7f2b0406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:01.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b08a64640 1 --2- 172.21.15.57:0/1670860675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0406dd40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b0406c2f0 tx=0x7f2af401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f37f2ad675cb964 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2afbfff640 1 -- 172.21.15.57:0/1670860675 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40aa5f0 con 0x7f2b0409cc20 2023-11-24T08:05:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2afbfff640 1 -- 172.21.15.57:0/1670860675 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40aa750 con 0x7f2b0409cc20 2023-11-24T08:05:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2afbfff640 1 -- 172.21.15.57:0/1670860675 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40aaae0 con 0x7f2b0409cc20 2023-11-24T08:05:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/1670860675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 msgr2=0x7f2b0406dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/1670860675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0406dd40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b0406c2f0 tx=0x7f2af401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/1670860675 shutdown_connections 2023-11-24T08:05:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/1670860675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b040709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/1670860675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0406dd40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/1670860675 >> v2:172.21.15.132:3300/0 conn(0x7f2b04144030 0x7f2b0406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/1670860675 >> 172.21.15.57:0/1670860675 conn(0x7f2b040b0bf0 msgr2=0x7f2b040b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/1670860675 shutdown_connections 2023-11-24T08:05:01.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.070+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/1670860675 wait complete. 2023-11-24T08:05:01.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 Processor -- start 2023-11-24T08:05:01.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 -- start start 2023-11-24T08:05:01.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b04135490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b04144030 0x7f2b0413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04143940 con 0x7f2b0409cc20 2023-11-24T08:05:01.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b041336a0 con 0x7f2b04144030 2023-11-24T08:05:01.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04133980 con 0x7f2b0406e280 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0415a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47746/0 (socket says 172.21.15.57:47746) 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 -- 172.21.15.57:0/2502194392 learned_addr learned my addr 172.21.15.57:0/2502194392 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b09265640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b04135490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b09a66640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b04144030 0x7f2b0413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 -- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 msgr2=0x7f2b04135490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b04135490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 -- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b04144030 msgr2=0x7f2b0413db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b04144030 0x7f2b0413db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 -- 172.21.15.57:0/2502194392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40094d0 con 0x7f2b0409cc20 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b08a64640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0415a5d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2af401ab80 tx=0x7f2af401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2af9ffb640 1 -- 172.21.15.57:0/2502194392 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40aa5f0 con 0x7f2b0409cc20 2023-11-24T08:05:01.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2af9ffb640 1 -- 172.21.15.57:0/2502194392 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40b3800 con 0x7f2b0409cc20 2023-11-24T08:05:01.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2af9ffb640 1 -- 172.21.15.57:0/2502194392 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40b3b90 con 0x7f2b0409cc20 2023-11-24T08:05:01.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b04133c60 con 0x7f2b0409cc20 2023-11-24T08:05:01.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.074+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b04133f40 con 0x7f2b0409cc20 2023-11-24T08:05:01.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.078+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b040b3100 con 0x7f2b0409cc20 2023-11-24T08:05:01.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.078+0000 7f2af9ffb640 1 -- 172.21.15.57:0/2502194392 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2af40b3cf0 con 0x7f2b0409cc20 2023-11-24T08:05:01.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.078+0000 7f2af9ffb640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2ae8066470 0x7f2ae8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.078+0000 7f2af9ffb640 1 -- 172.21.15.57:0/2502194392 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2af40a7070 con 0x7f2b0409cc20 2023-11-24T08:05:01.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.078+0000 7f2b09265640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2ae8066470 0x7f2ae8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.078+0000 7f2b09265640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2ae8066470 0x7f2ae8068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b00006e90 tx=0x7f2b00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.082+0000 7f2af9ffb640 1 -- 172.21.15.57:0/2502194392 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2af40ebcb0 con 0x7f2b0409cc20 2023-11-24T08:05:01.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.270+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2b04067520 con 0x7f2b0409cc20 2023-11-24T08:05:01.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.942+0000 7f2af9ffb640 1 -- 172.21.15.57:0/2502194392 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 136+0+0 (secure 0 0 0) 0x7f2af40ef2d0 con 0x7f2b0409cc20 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2ae8066470 msgr2=0x7f2ae8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2ae8066470 0x7f2ae8068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b00006e90 tx=0x7f2b00008040 comp rx=0 tx=0).stop 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 msgr2=0x7f2b0415a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0415a5d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2af401ab80 tx=0x7f2af401ad10 comp rx=0 tx=0).stop 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 shutdown_connections 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2ae8066470 0x7f2ae8068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b04144030 0x7f2b0413db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0409cc20 0x7f2b0415a5d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 --2- 172.21.15.57:0/2502194392 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b0406e280 0x7f2b04135490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 >> 172.21.15.57:0/2502194392 conn(0x7f2b040b0bf0 msgr2=0x7f2b040b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 shutdown_connections 2023-11-24T08:05:01.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:01.946+0000 7f2b0b4c9640 1 -- 172.21.15.57:0/2502194392 wait complete. 2023-11-24T08:05:01.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:05:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f9601f72640 1 Processor -- start 2023-11-24T08:05:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f9601f72640 1 -- start start 2023-11-24T08:05:02.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f9601f72640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f9601f72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95fc0c9650 0x7f95fc0c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f9601f72640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0c9fe0 con 0x7f95fc15b220 2023-11-24T08:05:02.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f9601f72640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc072710 con 0x7f95fc0c9650 2023-11-24T08:05:02.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f9601f72640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0abed0 con 0x7f95fc15b600 2023-11-24T08:05:02.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95fbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95fc0c9650 0x7f95fc0c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95fbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95fc0c9650 0x7f95fc0c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:38978/0 (socket says 172.21.15.57:38978) 2023-11-24T08:05:02.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95fbfff640 1 -- 172.21.15.57:0/693060155 learned_addr learned my addr 172.21.15.57:0/693060155 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95fb7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f95fc15b220 0x7f95fc06d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:59178/0 (socket says 172.21.15.57:59178) 2023-11-24T08:05:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95faffd640 1 --2- 172.21.15.57:0/693060155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95faffd640 1 -- 172.21.15.57:0/693060155 >> v2:172.21.15.132:3300/0 conn(0x7f95fc0c9650 msgr2=0x7f95fc0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95faffd640 1 --2- 172.21.15.57:0/693060155 >> v2:172.21.15.132:3300/0 conn(0x7f95fc0c9650 0x7f95fc0c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95faffd640 1 -- 172.21.15.57:0/693060155 >> v1:172.21.15.132:6789/0 conn(0x7f95fc15b220 legacy=0x7f95fc06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95faffd640 1 -- 172.21.15.57:0/693060155 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc072370 con 0x7f95fc15b600 2023-11-24T08:05:02.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.118+0000 7f95fbfff640 1 --2- 172.21.15.57:0/693060155 >> v2:172.21.15.132:3300/0 conn(0x7f95fc0c9650 0x7f95fc0c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f95faffd640 1 --2- 172.21.15.57:0/693060155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc0cada0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097c0 tx=0x7f95f001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a712d73eefad27d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f95fa7fc640 1 -- 172.21.15.57:0/693060155 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00ab650 con 0x7f95fc15b600 2023-11-24T08:05:02.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f95fa7fc640 1 -- 172.21.15.57:0/693060155 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f00ab7b0 con 0x7f95fc15b600 2023-11-24T08:05:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f95fa7fc640 1 -- 172.21.15.57:0/693060155 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00abb40 con 0x7f95fc15b600 2023-11-24T08:05:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 -- 172.21.15.57:0/693060155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 msgr2=0x7f95fc0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 --2- 172.21.15.57:0/693060155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc0cada0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097c0 tx=0x7f95f001c450 comp rx=0 tx=0).stop 2023-11-24T08:05:02.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 -- 172.21.15.57:0/693060155 shutdown_connections 2023-11-24T08:05:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 --2- 172.21.15.57:0/693060155 >> v2:172.21.15.132:3300/0 conn(0x7f95fc0c9650 0x7f95fc0c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 --2- 172.21.15.57:0/693060155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc0cada0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 -- 172.21.15.57:0/693060155 >> 172.21.15.57:0/693060155 conn(0x7f95fc0b0bf0 msgr2=0x7f95fc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 -- 172.21.15.57:0/693060155 shutdown_connections 2023-11-24T08:05:02.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.122+0000 7f9601f72640 1 -- 172.21.15.57:0/693060155 wait complete. 2023-11-24T08:05:02.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 Processor -- start 2023-11-24T08:05:02.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 -- start start 2023-11-24T08:05:02.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95fc0c9650 0x7f95fc0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95fc15b220 0x7f95fc1f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc1fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0999e0 con 0x7f95fc0c9650 2023-11-24T08:05:02.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0c80a0 con 0x7f95fc15b220 2023-11-24T08:05:02.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0c8380 con 0x7f95fc15b600 2023-11-24T08:05:02.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95fc0c9650 0x7f95fc0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95fc0c9650 0x7f95fc0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47760/0 (socket says 172.21.15.57:47760) 2023-11-24T08:05:02.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 -- 172.21.15.57:0/2021400721 learned_addr learned my addr 172.21.15.57:0/2021400721 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:02.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fbfff640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc1fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95faffd640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95fc15b220 0x7f95fc1f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 -- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 msgr2=0x7f95fc1fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc1fa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 -- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95fc15b220 msgr2=0x7f95fc1f9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95fc15b220 0x7f95fc1f9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 -- 172.21.15.57:0/2021400721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009b30 con 0x7f95fc0c9650 2023-11-24T08:05:02.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fbfff640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc1fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:02.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95faffd640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95fc15b220 0x7f95fc1f9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:02.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95fb7fe640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95fc0c9650 0x7f95fc0b1ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c420 tx=0x7f95ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95e3fff640 1 -- 172.21.15.57:0/2021400721 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0074e0 con 0x7f95fc0c9650 2023-11-24T08:05:02.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95e3fff640 1 -- 172.21.15.57:0/2021400721 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec007640 con 0x7f95fc0c9650 2023-11-24T08:05:02.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f95e3fff640 1 -- 172.21.15.57:0/2021400721 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec004a30 con 0x7f95fc0c9650 2023-11-24T08:05:02.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f0009420 con 0x7f95fc0c9650 2023-11-24T08:05:02.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.126+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc0c8940 con 0x7f95fc0c9650 2023-11-24T08:05:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.130+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc09d250 con 0x7f95fc0c9650 2023-11-24T08:05:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.130+0000 7f95e3fff640 1 -- 172.21.15.57:0/2021400721 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95ec004b90 con 0x7f95fc0c9650 2023-11-24T08:05:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.130+0000 7f95e3fff640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f95e80664a0 0x7f95e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.130+0000 7f95e3fff640 1 -- 172.21.15.57:0/2021400721 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95ec0837d0 con 0x7f95fc0c9650 2023-11-24T08:05:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.130+0000 7f95faffd640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f95e80664a0 0x7f95e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.130+0000 7f95faffd640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f95e80664a0 0x7f95e8068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f95f00af000 tx=0x7f95f00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.134+0000 7f95e3fff640 1 -- 172.21.15.57:0/2021400721 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95ec050bb0 con 0x7f95fc0c9650 2023-11-24T08:05:02.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.314+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f95fc0c9fe0 con 0x7f95e80664a0 2023-11-24T08:05:02.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f95e3fff640 1 -- 172.21.15.57:0/2021400721 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f95fc0c9fe0 con 0x7f95e80664a0 2023-11-24T08:05:02.322 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-11-24T08:05:02.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:02.322 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs" 2023-11-24T08:05:02.322 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:02.322 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-11-24T08:05:02.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f95e80664a0 msgr2=0x7f95e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f95e80664a0 0x7f95e8068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f95f00af000 tx=0x7f95f00a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95fc0c9650 msgr2=0x7f95fc0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95fc0c9650 0x7f95fc0b1ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c420 tx=0x7f95ec00c8e0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 shutdown_connections 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f95e80664a0 0x7f95e8068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f95fc15b600 0x7f95fc1fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95fc15b220 0x7f95fc1f9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 --2- 172.21.15.57:0/2021400721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95fc0c9650 0x7f95fc0b1ee0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 >> 172.21.15.57:0/2021400721 conn(0x7f95fc0b0bf0 msgr2=0x7f95fc0ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 shutdown_connections 2023-11-24T08:05:02.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.318+0000 7f9601f72640 1 -- 172.21.15.57:0/2021400721 wait complete. 2023-11-24T08:05:02.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:05:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc233794640 1 Processor -- start 2023-11-24T08:05:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc233794640 1 -- start start 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc233794640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0ae4a0 0x7fc22c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc233794640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc22c0cd850 0x7fc22c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc233794640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0b3510 con 0x7fc22c0ce250 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc233794640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c0ce6e0 con 0x7fc22c0cd850 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc233794640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0b37f0 con 0x7fc22c0ae4a0 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc230d2f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc22c0cd850 0x7fc22c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc230d2f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc22c0cd850 0x7fc22c0cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47772/0 (socket says 172.21.15.57:47772) 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc230d2f640 1 -- 172.21.15.57:0/2008720246 learned_addr learned my addr 172.21.15.57:0/2008720246 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc231530640 1 --2- 172.21.15.57:0/2008720246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0ae4a0 0x7fc22c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc230d2f640 1 -- 172.21.15.57:0/2008720246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0ae4a0 msgr2=0x7fc22c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc230d2f640 1 --2- 172.21.15.57:0/2008720246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0ae4a0 0x7fc22c15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc230d2f640 1 -- 172.21.15.57:0/2008720246 >> v1:172.21.15.132:6789/0 conn(0x7fc22c0ce250 legacy=0x7fc22c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.486+0000 7fc230d2f640 1 -- 172.21.15.57:0/2008720246 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c0b3ad0 con 0x7fc22c0cd850 2023-11-24T08:05:02.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc230d2f640 1 --2- 172.21.15.57:0/2008720246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0cd850 0x7fc22c0cdd10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009870 tx=0x7fc21c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbf5bf6bb6c256 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc223fff640 1 -- 172.21.15.57:0/2008720246 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0aa670 con 0x7fc22c0cd850 2023-11-24T08:05:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc223fff640 1 -- 172.21.15.57:0/2008720246 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0aa7d0 con 0x7fc22c0cd850 2023-11-24T08:05:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc223fff640 1 -- 172.21.15.57:0/2008720246 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0aab60 con 0x7fc22c0cd850 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 -- 172.21.15.57:0/2008720246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0cd850 msgr2=0x7fc22c0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 --2- 172.21.15.57:0/2008720246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0cd850 0x7fc22c0cdd10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009870 tx=0x7fc21c01c510 comp rx=0 tx=0).stop 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 -- 172.21.15.57:0/2008720246 shutdown_connections 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 --2- 172.21.15.57:0/2008720246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0cd850 0x7fc22c0cdd10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 --2- 172.21.15.57:0/2008720246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0ae4a0 0x7fc22c15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 -- 172.21.15.57:0/2008720246 >> 172.21.15.57:0/2008720246 conn(0x7fc22c0b0c80 msgr2=0x7fc22c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 -- 172.21.15.57:0/2008720246 shutdown_connections 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.490+0000 7fc233794640 1 -- 172.21.15.57:0/2008720246 wait complete. 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 Processor -- start 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 -- start start 2023-11-24T08:05:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22c0ae4a0 0x7fc22c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0cd850 0x7fc22c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0ce250 0x7fc22c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c09d130 con 0x7fc22c0ce250 2023-11-24T08:05:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c09cb70 con 0x7fc22c0ae4a0 2023-11-24T08:05:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c09ce50 con 0x7fc22c0cd850 2023-11-24T08:05:02.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0ce250 0x7fc22c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0ce250 0x7fc22c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47784/0 (socket says 172.21.15.57:47784) 2023-11-24T08:05:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 -- 172.21.15.57:0/3148087124 learned_addr learned my addr 172.21.15.57:0/3148087124 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231530640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22c0ae4a0 0x7fc22c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc230d2f640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0cd850 0x7fc22c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 -- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0cd850 msgr2=0x7fc22c14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0cd850 0x7fc22c14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 -- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22c0ae4a0 msgr2=0x7fc22c0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22c0ae4a0 0x7fc22c0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 -- 172.21.15.57:0/3148087124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0094d0 con 0x7fc22c0ce250 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc231d31640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0ce250 0x7fc22c154440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc22400c730 tx=0x7fc22400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc221ffb640 1 -- 172.21.15.57:0/3148087124 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224003b80 con 0x7fc22c0ce250 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc221ffb640 1 -- 172.21.15.57:0/3148087124 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224003ce0 con 0x7fc22c0ce250 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc221ffb640 1 -- 172.21.15.57:0/3148087124 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400aa30 con 0x7fc22c0ce250 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c153f20 con 0x7fc22c0ce250 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.494+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c09b160 con 0x7fc22c0ce250 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.498+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c154110 con 0x7fc22c0ce250 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.498+0000 7fc221ffb640 1 -- 172.21.15.57:0/3148087124 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc22400ab90 con 0x7fc22c0ce250 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.498+0000 7fc221ffb640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc210066470 0x7fc210068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.498+0000 7fc221ffb640 1 -- 172.21.15.57:0/3148087124 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc224083b00 con 0x7fc22c0ce250 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.498+0000 7fc231530640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc210066470 0x7fc210068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.498+0000 7fc231530640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc210066470 0x7fc210068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0cc610 tx=0x7fc228009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.502+0000 7fc221ffb640 1 -- 172.21.15.57:0/3148087124 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc224051020 con 0x7fc22c0ce250 2023-11-24T08:05:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.658+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc22c04e8c0 con 0x7fc22c0ce250 2023-11-24T08:05:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc221ffb640 1 -- 172.21.15.57:0/3148087124 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc224054640 con 0x7fc22c0ce250 2023-11-24T08:05:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc210066470 msgr2=0x7fc210068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc210066470 0x7fc210068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0cc610 tx=0x7fc228009190 comp rx=0 tx=0).stop 2023-11-24T08:05:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0ce250 msgr2=0x7fc22c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0ce250 0x7fc22c154440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc22400c730 tx=0x7fc22400cbf0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 shutdown_connections 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc210066470 0x7fc210068930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc22c0ce250 0x7fc22c154440 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22c0cd850 0x7fc22c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 --2- 172.21.15.57:0/3148087124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22c0ae4a0 0x7fc22c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 >> 172.21.15.57:0/3148087124 conn(0x7fc22c0b0c80 msgr2=0x7fc22c0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 shutdown_connections 2023-11-24T08:05:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:02.662+0000 7fc233794640 1 -- 172.21.15.57:0/3148087124 wait complete. 2023-11-24T08:05:02.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:02.687 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp3317/subvol9375) 2023-11-24T08:05:02.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:02.718 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2023-11-24T08:05:02.772 INFO:teuthology.orchestra.run.smithi057.stdout:cephfs_data 2023-11-24T08:05:02.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:02.773 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp3317/subvol9375) 2023-11-24T08:05:02.861 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:02.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp3317/subvol9375/.meta 2023-11-24T08:05:02.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol9375 subvol_grp3317 2023-11-24T08:05:03.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdcd22e3640 1 Processor -- start 2023-11-24T08:05:03.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdcd22e3640 1 -- start start 2023-11-24T08:05:03.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdcd22e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 0x7fdccc164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdcd22e3640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc15a700 con 0x7fdccc0b36c0 2023-11-24T08:05:03.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdcd22e3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0b2380 con 0x7fdccc15a320 2023-11-24T08:05:03.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdcd22e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b2620 con 0x7fdccc0b1ef0 2023-11-24T08:05:03.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdccb7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdccc0b36c0 0x7fdccc070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52436/0 (socket says 172.21.15.57:52436) 2023-11-24T08:05:03.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdccb7fe640 1 -- 172.21.15.57:0/3871396892 learned_addr learned my addr 172.21.15.57:0/3871396892 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:03.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdcd0880640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 0x7fdccc164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547990209 0 0) 0x7fdccc15a700 con 0x7fdccc0b36c0 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb4005740 con 0x7fdccc0b36c0 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382872884 0 0) 0x7fdccc0b2380 con 0x7fdccc15a320 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.118+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdccc15a700 con 0x7fdccc15a320 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518357897 0 0) 0x7fdcb4005740 con 0x7fdccc0b36c0 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 msgr2=0x7fdccc164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 0x7fdccc164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 >> v1:172.21.15.132:6789/0 conn(0x7fdccc15a320 legacy=0x7fdccc070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0b2900 con 0x7fdccc0b36c0 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fdcc0001680 con 0x7fdccc0b36c0 2023-11-24T08:05:03.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 >> v1:172.21.15.57:6789/0 conn(0x7fdccc0b36c0 legacy=0x7fdccc070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcb4005d50 0x7fdcb4006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 0x7fdcb40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4006f20 0x7fdcb40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b2620 con 0x7fdcb4005d50 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb400dc50 con 0x7fdcb4006f20 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb400ddc0 con 0x7fdccc0b1ef0 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccbfff640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcb4005d50 0x7fdcb4006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccb7fe640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 0x7fdcb40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdcd0880640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4006f20 0x7fdcb40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccbfff640 1 -- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 msgr2=0x7fdcb40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccbfff640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc0b1ef0 0x7fdcb40069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccbfff640 1 -- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4006f20 msgr2=0x7fdcb40073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccbfff640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4006f20 0x7fdcb40073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccbfff640 1 -- 172.21.15.57:0/3871396892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4005740 con 0x7fdcb4005d50 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccbfff640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcb4005d50 0x7fdcb4006150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0018d0 tx=0x7fdcbc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf76b11d150e032 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0052d0 con 0x7fdcb4005d50 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc005450 con 0x7fdcb4005d50 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.122+0000 7fdccaffd640 1 -- 172.21.15.57:0/3871396892 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc003840 con 0x7fdcb4005d50 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- 172.21.15.57:0/3871396892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcb4005d50 msgr2=0x7fdcb4006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 --2- 172.21.15.57:0/3871396892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcb4005d50 0x7fdcb4006150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0018d0 tx=0x7fdcbc01c560 comp rx=0 tx=0).stop 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd0880640 1 -- 172.21.15.57:0/3871396892 reap_dead start 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- 172.21.15.57:0/3871396892 shutdown_connections 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- 172.21.15.57:0/3871396892 >> 172.21.15.57:0/3871396892 conn(0x7fdccc0b0bf0 msgr2=0x7fdccc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- 172.21.15.57:0/3871396892 shutdown_connections 2023-11-24T08:05:03.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- 172.21.15.57:0/3871396892 wait complete. 2023-11-24T08:05:03.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 Processor -- start 2023-11-24T08:05:03.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- start start 2023-11-24T08:05:03.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4005d50 0x7fdccc09bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0999e0 0x7fdccc099e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc1f6330 0x7fdccc1f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc09b240 con 0x7fdccc0999e0 2023-11-24T08:05:03.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc09a3a0 con 0x7fdcb4005d50 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd22e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc09a5c0 con 0x7fdccc1f6330 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdccb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0999e0 0x7fdccc099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdccb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0999e0 0x7fdccc099e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47804/0 (socket says 172.21.15.57:47804) 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdccb7fe640 1 -- 172.21.15.57:0/1436198586 learned_addr learned my addr 172.21.15.57:0/1436198586 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdccbfff640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4005d50 0x7fdccc09bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.126+0000 7fdcd0880640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc1f6330 0x7fdccc1f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdccb7fe640 1 -- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc1f6330 msgr2=0x7fdccc1f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdccb7fe640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc1f6330 0x7fdccc1f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdccb7fe640 1 -- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4005d50 msgr2=0x7fdccc09bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdccb7fe640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4005d50 0x7fdccc09bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdccb7fe640 1 -- 172.21.15.57:0/1436198586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc09a8a0 con 0x7fdccc0999e0 2023-11-24T08:05:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcd0880640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc1f6330 0x7fdccc1f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:03.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdccb7fe640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0999e0 0x7fdccc099e60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000e740 tx=0x7fdcc000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcc8ff9640 1 -- 172.21.15.57:0/1436198586 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000ee50 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcc8ff9640 1 -- 172.21.15.57:0/1436198586 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc000c8d0 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc09ab80 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcc8ff9640 1 -- 172.21.15.57:0/1436198586 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000cc80 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc1f91b0 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc09b380 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcc8ff9640 1 -- 172.21.15.57:0/1436198586 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdcc001d460 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcc8ff9640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdcb8066470 0x7fdcb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdcc8ff9640 1 -- 172.21.15.57:0/1436198586 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcc0083dd0 con 0x7fdccc0999e0 2023-11-24T08:05:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.130+0000 7fdccbfff640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdcb8066470 0x7fdcb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.134+0000 7fdccbfff640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdcb8066470 0x7fdcb8068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0ad000 tx=0x7fdcbc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.134+0000 7fdcc8ff9640 1 -- 172.21.15.57:0/1436198586 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdccc09b380 con 0x7fdccc0999e0 2023-11-24T08:05:03.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.318+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol9375", "group_name": "subvol_grp3317", "target": ["mon-mgr", ""]}) v1 -- 0x7fdccc072990 con 0x7fdcb8066470 2023-11-24T08:05:03.328 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:03.321+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:03.328 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:03.321+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:03.328 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:03.321+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:03.328 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:03.321+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:03.328 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:03.321+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:03.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.470+0000 7fdcc8ff9640 1 -- 172.21.15.57:0/1436198586 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7fdccc072990 con 0x7fdcb8066470 2023-11-24T08:05:03.476 INFO:teuthology.orchestra.run.smithi057.stdout:/volumes/subvol_grp3317/subvol9375 2023-11-24T08:05:03.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdcb8066470 msgr2=0x7fdcb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdcb8066470 0x7fdcb8068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0ad000 tx=0x7fdcbc0a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:03.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0999e0 msgr2=0x7fdccc099e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0999e0 0x7fdccc099e60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000e740 tx=0x7fdcc000ec00 comp rx=0 tx=0).stop 2023-11-24T08:05:03.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 shutdown_connections 2023-11-24T08:05:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdcb8066470 0x7fdcb8068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdccc1f6330 0x7fdccc1f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdccc0999e0 0x7fdccc099e60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 --2- 172.21.15.57:0/1436198586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb4005d50 0x7fdccc09bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 >> 172.21.15.57:0/1436198586 conn(0x7fdccc0b0bf0 msgr2=0x7fdccc070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 shutdown_connections 2023-11-24T08:05:03.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.474+0000 7fdcd22e3640 1 -- 172.21.15.57:0/1436198586 wait complete. 2023-11-24T08:05:03.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol9375 subvol_grp3317 2023-11-24T08:05:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cbb6d6640 1 Processor -- start 2023-11-24T08:05:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cbb6d6640 1 -- start start 2023-11-24T08:05:03.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cbb6d6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cb40b07f0 0x7f8cb40b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cbb6d6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8cb40b0bd0 0x7f8cb406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cbb6d6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb4144400 con 0x7f8cb4146a20 2023-11-24T08:05:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cbb6d6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40b1480 con 0x7f8cb40b07f0 2023-11-24T08:05:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cbb6d6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb4147210 con 0x7f8cb40b0bd0 2023-11-24T08:05:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cb9c73640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8cb4146a20 0x7f8cb4161290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52452/0 (socket says 172.21.15.57:52452) 2023-11-24T08:05:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cb9c73640 1 -- 172.21.15.57:0/2735460726 learned_addr learned my addr 172.21.15.57:0/2735460726 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:03.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.638+0000 7f8cb9472640 1 --2- 172.21.15.57:0/2735460726 >> v2:172.21.15.57:3300/0 conn(0x7f8cb40b07f0 0x7f8cb40b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cb8c71640 1 --2- 172.21.15.57:0/2735460726 >> v2:172.21.15.132:3300/0 conn(0x7f8cb40b0bd0 0x7f8cb406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cabfff640 1 -- 172.21.15.57:0/2735460726 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086361974 0 0) 0x7f8cb4144400 con 0x7f8cb4146a20 2023-11-24T08:05:03.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cabfff640 1 -- 172.21.15.57:0/2735460726 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca0003530 con 0x7f8cb4146a20 2023-11-24T08:05:03.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cb9472640 1 -- 172.21.15.57:0/2735460726 >> v2:172.21.15.132:3300/0 conn(0x7f8cb40b0bd0 msgr2=0x7f8cb406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:03.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cb9472640 1 --2- 172.21.15.57:0/2735460726 >> v2:172.21.15.132:3300/0 conn(0x7f8cb40b0bd0 0x7f8cb406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cb9472640 1 -- 172.21.15.57:0/2735460726 >> v1:172.21.15.57:6789/0 conn(0x7f8cb4146a20 legacy=0x7f8cb4161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cb9472640 1 -- 172.21.15.57:0/2735460726 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40b1720 con 0x7f8cb40b07f0 2023-11-24T08:05:03.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cb9472640 1 --2- 172.21.15.57:0/2735460726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb40b30a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8cb41469b0 tx=0x7f8cb001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f346aa377b8b6638 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cabfff640 1 -- 172.21.15.57:0/2735460726 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00ac600 con 0x7f8cb40b07f0 2023-11-24T08:05:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cabfff640 1 -- 172.21.15.57:0/2735460726 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb00a8050 con 0x7f8cb40b07f0 2023-11-24T08:05:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.642+0000 7f8cabfff640 1 -- 172.21.15.57:0/2735460726 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00ac980 con 0x7f8cb40b07f0 2023-11-24T08:05:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2735460726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 msgr2=0x7f8cb40b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2735460726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb40b30a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8cb41469b0 tx=0x7f8cb001c3a0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2735460726 shutdown_connections 2023-11-24T08:05:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2735460726 >> v2:172.21.15.132:3300/0 conn(0x7f8cb40b0bd0 0x7f8cb406a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2735460726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb40b30a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2735460726 >> 172.21.15.57:0/2735460726 conn(0x7f8cb40b55c0 msgr2=0x7f8cb40b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2735460726 shutdown_connections 2023-11-24T08:05:03.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2735460726 wait complete. 2023-11-24T08:05:03.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 Processor -- start 2023-11-24T08:05:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- start start 2023-11-24T08:05:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb4142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb40b0bd0 0x7f8cb413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb4146a20 0x7f8cb413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb41f6860 con 0x7f8cb40b07f0 2023-11-24T08:05:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb415eed0 con 0x7f8cb4146a20 2023-11-24T08:05:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cbb6d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb415f1b0 con 0x7f8cb40b0bd0 2023-11-24T08:05:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb4142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb4142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47822/0 (socket says 172.21.15.57:47822) 2023-11-24T08:05:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 -- 172.21.15.57:0/2001137474 learned_addr learned my addr 172.21.15.57:0/2001137474 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb8c71640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb40b0bd0 0x7f8cb413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9c73640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb4146a20 0x7f8cb413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 -- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb40b0bd0 msgr2=0x7f8cb413f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb40b0bd0 0x7f8cb413f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 -- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb4146a20 msgr2=0x7f8cb413fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb4146a20 0x7f8cb413fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9472640 1 -- 172.21.15.57:0/2001137474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0009420 con 0x7f8cb40b07f0 2023-11-24T08:05:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb8c71640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb40b0bd0 0x7f8cb413f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.646+0000 7f8cb9c73640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb4146a20 0x7f8cb413fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8cb9472640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb4142c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0019fd0 tx=0x7f8cb001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8ca9ffb640 1 -- 172.21.15.57:0/2001137474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00b7420 con 0x7f8cb40b07f0 2023-11-24T08:05:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8ca9ffb640 1 -- 172.21.15.57:0/2001137474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb00b75a0 con 0x7f8cb40b07f0 2023-11-24T08:05:03.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb415f490 con 0x7f8cb40b07f0 2023-11-24T08:05:03.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8ca9ffb640 1 -- 172.21.15.57:0/2001137474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00b7950 con 0x7f8cb40b07f0 2023-11-24T08:05:03.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb415fa50 con 0x7f8cb40b07f0 2023-11-24T08:05:03.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb4067520 con 0x7f8cb40b07f0 2023-11-24T08:05:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8ca9ffb640 1 -- 172.21.15.57:0/2001137474 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8cb00b3040 con 0x7f8cb40b07f0 2023-11-24T08:05:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8ca9ffb640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8c98066470 0x7f8c98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8ca9ffb640 1 -- 172.21.15.57:0/2001137474 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cb011e300 con 0x7f8cb40b07f0 2023-11-24T08:05:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.650+0000 7f8cb8c71640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8c98066470 0x7f8c98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:03.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.654+0000 7f8cb8c71640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8c98066470 0x7f8c98068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4140750 tx=0x7f8ca4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:03.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.654+0000 7f8ca9ffb640 1 -- 172.21.15.57:0/2001137474 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8cb00eb890 con 0x7f8cb40b07f0 2023-11-24T08:05:03.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.838+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol9375", "group_name": "subvol_grp3317", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cb406af00 con 0x7f8c98066470 2023-11-24T08:05:03.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.842+0000 7f8ca9ffb640 1 -- 172.21.15.57:0/2001137474 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f8ca4009750 con 0x7f8c98066470 2023-11-24T08:05:03.849 INFO:teuthology.orchestra.run.smithi057.stdout:/volumes/subvol_grp3317/subvol9375 2023-11-24T08:05:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8c98066470 msgr2=0x7f8c98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8c98066470 0x7f8c98068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4140750 tx=0x7f8ca4008040 comp rx=0 tx=0).stop 2023-11-24T08:05:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 msgr2=0x7f8cb4142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb4142c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0019fd0 tx=0x7f8cb001abe0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 shutdown_connections 2023-11-24T08:05:03.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8c98066470 0x7f8c98068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb4146a20 0x7f8cb413fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb40b0bd0 0x7f8cb413f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 --2- 172.21.15.57:0/2001137474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cb40b07f0 0x7f8cb4142c90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 >> 172.21.15.57:0/2001137474 conn(0x7f8cb40b55c0 msgr2=0x7f8cb40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 shutdown_connections 2023-11-24T08:05:03.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:03.846+0000 7f8cbb6d6640 1 -- 172.21.15.57:0/2001137474 wait complete. 2023-11-24T08:05:03.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.870 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/5bd0ebc9a5435a48dbad3cd9893ce11c.meta) 2023-11-24T08:05:03.899 INFO:teuthology.orchestra.run.smithi057.stdout:[GLOBAL] 2023-11-24T08:05:03.899 INFO:teuthology.orchestra.run.smithi057.stdout:version = 1 2023-11-24T08:05:03.900 INFO:teuthology.orchestra.run.smithi057.stdout:type = subvolume 2023-11-24T08:05:03.900 INFO:teuthology.orchestra.run.smithi057.stdout:path = /volumes/subvol_grp3317/subvol9375 2023-11-24T08:05:03.900 INFO:teuthology.orchestra.run.smithi057.stdout:state = complete 2023-11-24T08:05:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:03.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol9375 subvol_grp3317 2023-11-24T08:05:04.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb182632640 1 Processor -- start 2023-11-24T08:05:04.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb182632640 1 -- start start 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb182632640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb17c0b36c0 0x7fb17c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb182632640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb17c070da0 0x7fb17c0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb182632640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c15a700 con 0x7fb17c15a320 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb182632640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0b2430 con 0x7fb17c0b36c0 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb182632640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0b2620 con 0x7fb17c070da0 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb17b7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb17c0b36c0 0x7fb17c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb17b7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb17c0b36c0 0x7fb17c0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47830/0 (socket says 172.21.15.57:47830) 2023-11-24T08:05:04.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.086+0000 7fb17b7fe640 1 -- 172.21.15.57:0/3004800885 learned_addr learned my addr 172.21.15.57:0/3004800885 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:04.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb180bcf640 1 --2- 172.21.15.57:0/3004800885 >> v2:172.21.15.132:3300/0 conn(0x7fb17c070da0 0x7fb17c0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17b7fe640 1 -- 172.21.15.57:0/3004800885 >> v2:172.21.15.132:3300/0 conn(0x7fb17c070da0 msgr2=0x7fb17c0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17b7fe640 1 --2- 172.21.15.57:0/3004800885 >> v2:172.21.15.132:3300/0 conn(0x7fb17c070da0 0x7fb17c0711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17b7fe640 1 -- 172.21.15.57:0/3004800885 >> v1:172.21.15.132:6789/0 conn(0x7fb17c15a320 legacy=0x7fb17c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17b7fe640 1 -- 172.21.15.57:0/3004800885 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0b2900 con 0x7fb17c0b36c0 2023-11-24T08:05:04.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17b7fe640 1 --2- 172.21.15.57:0/3004800885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c0b1ef0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06c2d0 tx=0x7fb17001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd6d5edc59613d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17affd640 1 -- 172.21.15.57:0/3004800885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700a7b70 con 0x7fb17c0b36c0 2023-11-24T08:05:04.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17affd640 1 -- 172.21.15.57:0/3004800885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1700a7cd0 con 0x7fb17c0b36c0 2023-11-24T08:05:04.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.090+0000 7fb17affd640 1 -- 172.21.15.57:0/3004800885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700af660 con 0x7fb17c0b36c0 2023-11-24T08:05:04.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- 172.21.15.57:0/3004800885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 msgr2=0x7fb17c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 --2- 172.21.15.57:0/3004800885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c0b1ef0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb17c06c2d0 tx=0x7fb17001eba0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- 172.21.15.57:0/3004800885 shutdown_connections 2023-11-24T08:05:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 --2- 172.21.15.57:0/3004800885 >> v2:172.21.15.132:3300/0 conn(0x7fb17c070da0 0x7fb17c0711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 --2- 172.21.15.57:0/3004800885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c0b1ef0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- 172.21.15.57:0/3004800885 >> 172.21.15.57:0/3004800885 conn(0x7fb17c0b0bf0 msgr2=0x7fb17c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- 172.21.15.57:0/3004800885 shutdown_connections 2023-11-24T08:05:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- 172.21.15.57:0/3004800885 wait complete. 2023-11-24T08:05:04.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 Processor -- start 2023-11-24T08:05:04.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- start start 2023-11-24T08:05:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb17c070da0 0x7fb17c147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb17c15a320 0x7fb17c145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c144d90 con 0x7fb17c0b36c0 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c12e5a0 con 0x7fb17c15a320 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb182632640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c1588c0 con 0x7fb17c070da0 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47844/0 (socket says 172.21.15.57:47844) 2023-11-24T08:05:04.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 -- 172.21.15.57:0/1091493249 learned_addr learned my addr 172.21.15.57:0/1091493249 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 -- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb17c070da0 msgr2=0x7fb17c147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb17c070da0 0x7fb17c147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 -- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb17c15a320 msgr2=0x7fb17c145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb17c15a320 0x7fb17c145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.094+0000 7fb17b7fe640 1 -- 172.21.15.57:0/1091493249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17000b770 con 0x7fb17c0b36c0 2023-11-24T08:05:04.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb17b7fe640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c157920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb17001b7b0 tx=0x7fb17001b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb178ff9640 1 -- 172.21.15.57:0/1091493249 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170006ee0 con 0x7fb17c0b36c0 2023-11-24T08:05:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb178ff9640 1 -- 172.21.15.57:0/1091493249 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1700ba640 con 0x7fb17c0b36c0 2023-11-24T08:05:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c158020 con 0x7fb17c0b36c0 2023-11-24T08:05:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb178ff9640 1 -- 172.21.15.57:0/1091493249 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700ba9f0 con 0x7fb17c0b36c0 2023-11-24T08:05:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c1585e0 con 0x7fb17c0b36c0 2023-11-24T08:05:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c067520 con 0x7fb17c0b36c0 2023-11-24T08:05:04.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb178ff9640 1 -- 172.21.15.57:0/1091493249 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1700b6040 con 0x7fb17c0b36c0 2023-11-24T08:05:04.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb178ff9640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb168066470 0x7fb168068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb178ff9640 1 -- 172.21.15.57:0/1091493249 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1700a7e40 con 0x7fb17c0b36c0 2023-11-24T08:05:04.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.098+0000 7fb17bfff640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb168066470 0x7fb168068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.102+0000 7fb17bfff640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb168066470 0x7fb168068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb16c000f70 tx=0x7fb16c0079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.102+0000 7fb178ff9640 1 -- 172.21.15.57:0/1091493249 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1700ee890 con 0x7fb17c0b36c0 2023-11-24T08:05:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.282+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol9375", "group_name": "subvol_grp3317", "target": ["mon-mgr", ""]}) v1 -- 0x7fb17c06efa0 con 0x7fb168066470 2023-11-24T08:05:04.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.302+0000 7fb178ff9640 1 -- 172.21.15.57:0/1091493249 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb17c06efa0 con 0x7fb168066470 2023-11-24T08:05:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb168066470 msgr2=0x7fb168068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb168066470 0x7fb168068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb16c000f70 tx=0x7fb16c0079c0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 msgr2=0x7fb17c157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c157920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb17001b7b0 tx=0x7fb17001b940 comp rx=0 tx=0).stop 2023-11-24T08:05:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 shutdown_connections 2023-11-24T08:05:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb168066470 0x7fb168068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb17c15a320 0x7fb17c145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb17c0b36c0 0x7fb17c157920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 --2- 172.21.15.57:0/1091493249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb17c070da0 0x7fb17c147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 >> 172.21.15.57:0/1091493249 conn(0x7fb17c0b0bf0 msgr2=0x7fb17c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 shutdown_connections 2023-11-24T08:05:04.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.306+0000 7fb182632640 1 -- 172.21.15.57:0/1091493249 wait complete. 2023-11-24T08:05:04.313 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.305+0000 7f5fc041f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.313 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.305+0000 7f5fc041f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.313 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.305+0000 7f5fc041f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.313 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.305+0000 7f5fc041f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.314 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.305+0000 7f5fc041f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:04.331 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-24T08:05:04.335 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.329+0000 7f5fc0c20640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.335 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.329+0000 7f5fc0c20640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.336 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.329+0000 7f5fc0c20640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.336 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.329+0000 7f5fc0c20640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.336 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:04.329+0000 7f5fc0c20640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:04.355 INFO:teuthology.orchestra.run.smithi057.stdout:2 2023-11-24T08:05:04.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp3317 2023-11-24T08:05:04.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1b025aa640 1 Processor -- start 2023-11-24T08:05:04.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1b025aa640 1 -- start start 2023-11-24T08:05:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1b025aa640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1afc146f60 0x7f1afc0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1b025aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1afc06acc0 0x7f1afc15ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1b025aa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc15fb20 con 0x7f1afc0b4fd0 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1b025aa640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc0b1b40 con 0x7f1afc146f60 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1b025aa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc0b1580 con 0x7f1afc06acc0 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1afbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1afc146f60 0x7f1afc0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1afbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1afc146f60 0x7f1afc0b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47852/0 (socket says 172.21.15.57:47852) 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1afbfff640 1 -- 172.21.15.57:0/2533049713 learned_addr learned my addr 172.21.15.57:0/2533049713 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1afbfff640 1 -- 172.21.15.57:0/2533049713 >> v2:172.21.15.132:3300/0 conn(0x7f1afc06acc0 msgr2=0x7f1afc15ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1afbfff640 1 --2- 172.21.15.57:0/2533049713 >> v2:172.21.15.132:3300/0 conn(0x7f1afc06acc0 0x7f1afc15ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1afbfff640 1 -- 172.21.15.57:0/2533049713 >> v1:172.21.15.132:6789/0 conn(0x7f1afc0b4fd0 legacy=0x7f1afc06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.538+0000 7f1afbfff640 1 -- 172.21.15.57:0/2533049713 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0b1860 con 0x7f1afc146f60 2023-11-24T08:05:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1afbfff640 1 --2- 172.21.15.57:0/2533049713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc146f60 0x7f1afc0b4a90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0716a0 tx=0x7f1aec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb71f35e1e7cd458 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1afaffd640 1 -- 172.21.15.57:0/2533049713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0ab600 con 0x7f1afc146f60 2023-11-24T08:05:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1afaffd640 1 -- 172.21.15.57:0/2533049713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0ab760 con 0x7f1afc146f60 2023-11-24T08:05:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1afaffd640 1 -- 172.21.15.57:0/2533049713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0abaf0 con 0x7f1afc146f60 2023-11-24T08:05:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 -- 172.21.15.57:0/2533049713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc146f60 msgr2=0x7f1afc0b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 --2- 172.21.15.57:0/2533049713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc146f60 0x7f1afc0b4a90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0716a0 tx=0x7f1aec01c440 comp rx=0 tx=0).stop 2023-11-24T08:05:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 -- 172.21.15.57:0/2533049713 shutdown_connections 2023-11-24T08:05:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 --2- 172.21.15.57:0/2533049713 >> v2:172.21.15.132:3300/0 conn(0x7f1afc06acc0 0x7f1afc15ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 --2- 172.21.15.57:0/2533049713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc146f60 0x7f1afc0b4a90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 -- 172.21.15.57:0/2533049713 >> 172.21.15.57:0/2533049713 conn(0x7f1afc0b5590 msgr2=0x7f1afc0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 -- 172.21.15.57:0/2533049713 shutdown_connections 2023-11-24T08:05:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.542+0000 7f1b025aa640 1 -- 172.21.15.57:0/2533049713 wait complete. 2023-11-24T08:05:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 Processor -- start 2023-11-24T08:05:04.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 -- start start 2023-11-24T08:05:04.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc06acc0 0x7f1afc15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1afc0b4fd0 0x7f1afc140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1afc146f60 0x7f1afc142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc138ef0 con 0x7f1afc06acc0 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c9da0 con 0x7f1afc146f60 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc140e50 con 0x7f1afc0b4fd0 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc06acc0 0x7f1afc15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc06acc0 0x7f1afc15d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47868/0 (socket says 172.21.15.57:47868) 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 -- 172.21.15.57:0/415155005 learned_addr learned my addr 172.21.15.57:0/415155005 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b00b47640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1afc146f60 0x7f1afc142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afb7fe640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1afc0b4fd0 0x7f1afc140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 -- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1afc0b4fd0 msgr2=0x7f1afc140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1afc0b4fd0 0x7f1afc140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 -- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1afc146f60 msgr2=0x7f1afc142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1afc146f60 0x7f1afc142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 -- 172.21.15.57:0/415155005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0094d0 con 0x7f1afc06acc0 2023-11-24T08:05:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1afbfff640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc06acc0 0x7f1afc15d1c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0ad040 tx=0x7f1aec01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1af8ff9640 1 -- 172.21.15.57:0/415155005 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0b4800 con 0x7f1afc06acc0 2023-11-24T08:05:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1af8ff9640 1 -- 172.21.15.57:0/415155005 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0b4960 con 0x7f1afc06acc0 2023-11-24T08:05:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc1410d0 con 0x7f1afc06acc0 2023-11-24T08:05:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1af8ff9640 1 -- 172.21.15.57:0/415155005 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0b4cd0 con 0x7f1afc06acc0 2023-11-24T08:05:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.546+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc141690 con 0x7f1afc06acc0 2023-11-24T08:05:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.550+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc04e8c0 con 0x7f1afc06acc0 2023-11-24T08:05:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.550+0000 7f1af8ff9640 1 -- 172.21.15.57:0/415155005 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1aec0c7440 con 0x7f1afc06acc0 2023-11-24T08:05:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.550+0000 7f1af8ff9640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1ae8066470 0x7f1ae8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.550+0000 7f1af8ff9640 1 -- 172.21.15.57:0/415155005 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aec11ea70 con 0x7f1afc06acc0 2023-11-24T08:05:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.550+0000 7f1afb7fe640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1ae8066470 0x7f1ae8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.550+0000 7f1afb7fe640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1ae8066470 0x7f1ae8068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1afc09e2c0 tx=0x7f1af0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.554+0000 7f1af8ff9640 1 -- 172.21.15.57:0/415155005 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1aec0ebee0 con 0x7f1afc06acc0 2023-11-24T08:05:04.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.734+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp3317", "target": ["mon-mgr", ""]}) v1 -- 0x7f1afc139030 con 0x7f1ae8066470 2023-11-24T08:05:04.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.738+0000 7f1af8ff9640 1 -- 172.21.15.57:0/415155005 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1af00012d0 con 0x7f1ae8066470 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1ae8066470 msgr2=0x7f1ae8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1ae8066470 0x7f1ae8068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1afc09e2c0 tx=0x7f1af0009040 comp rx=0 tx=0).stop 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc06acc0 msgr2=0x7f1afc15d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc06acc0 0x7f1afc15d1c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0ad040 tx=0x7f1aec01ac80 comp rx=0 tx=0).stop 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 shutdown_connections 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1ae8066470 0x7f1ae8068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1afc146f60 0x7f1afc142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1afc0b4fd0 0x7f1afc140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 --2- 172.21.15.57:0/415155005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc06acc0 0x7f1afc15d1c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 >> 172.21.15.57:0/415155005 conn(0x7f1afc0b5590 msgr2=0x7f1afc06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 shutdown_connections 2023-11-24T08:05:04.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:04.742+0000 7f1b025aa640 1 -- 172.21.15.57:0/415155005 wait complete. 2023-11-24T08:05:04.766 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:05:04.766 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:04.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:04.880 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:05:04.880 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:04.880 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:04.889 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:04.890 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:04.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:05.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.126+0000 7fd2c850f640 1 Processor -- start 2023-11-24T08:05:05.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.126+0000 7fd2c850f640 1 -- start start 2023-11-24T08:05:05.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c850f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2c00b3560 0x7fd2c006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c850f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00cee60 con 0x7fd2c00d01e0 2023-11-24T08:05:05.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c850f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00cf140 con 0x7fd2c0147020 2023-11-24T08:05:05.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c850f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00cf420 con 0x7fd2c00b3560 2023-11-24T08:05:05.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c5aaa640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd2c00d01e0 0x7fd2c00b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52464/0 (socket says 172.21.15.57:52464) 2023-11-24T08:05:05.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c5aaa640 1 -- 172.21.15.57:0/2536048806 learned_addr learned my addr 172.21.15.57:0/2536048806 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:05.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c6aac640 1 --2- 172.21.15.57:0/2536048806 >> v2:172.21.15.132:3300/0 conn(0x7fd2c00b3560 0x7fd2c006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350512810 0 0) 0x7fd2c00cee60 con 0x7fd2c00d01e0 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2ac003530 con 0x7fd2c00d01e0 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149030811 0 0) 0x7fd2c00cf140 con 0x7fd2c0147020 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c00cee60 con 0x7fd2c0147020 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 180940340 0 0) 0x7fd2ac003530 con 0x7fd2c00d01e0 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c6aac640 1 -- 172.21.15.57:0/2536048806 >> v1:172.21.15.132:6789/0 conn(0x7fd2c0147020 legacy=0x7fd2c00d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c6aac640 1 -- 172.21.15.57:0/2536048806 >> v1:172.21.15.57:6789/0 conn(0x7fd2c00d01e0 legacy=0x7fd2c00b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.130+0000 7fd2c6aac640 1 -- 172.21.15.57:0/2536048806 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00cf700 con 0x7fd2c00b3560 2023-11-24T08:05:05.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c6aac640 1 --2- 172.21.15.57:0/2536048806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c00b3560 0x7fd2c006b6c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d90 tx=0x7fd2b801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f72916eb78c462f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0001680 con 0x7fd2c00b3560 2023-11-24T08:05:05.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b80a56b0 con 0x7fd2c00b3560 2023-11-24T08:05:05.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c52a9640 1 -- 172.21.15.57:0/2536048806 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80a5a20 con 0x7fd2c00b3560 2023-11-24T08:05:05.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 -- 172.21.15.57:0/2536048806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c00b3560 msgr2=0x7fd2c006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 --2- 172.21.15.57:0/2536048806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c00b3560 0x7fd2c006b6c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d90 tx=0x7fd2b801c870 comp rx=0 tx=0).stop 2023-11-24T08:05:05.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 -- 172.21.15.57:0/2536048806 shutdown_connections 2023-11-24T08:05:05.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 --2- 172.21.15.57:0/2536048806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c00b3560 0x7fd2c006b6c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 -- 172.21.15.57:0/2536048806 >> 172.21.15.57:0/2536048806 conn(0x7fd2c0060fd0 msgr2=0x7fd2c00613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 -- 172.21.15.57:0/2536048806 shutdown_connections 2023-11-24T08:05:05.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 -- 172.21.15.57:0/2536048806 wait complete. 2023-11-24T08:05:05.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 Processor -- start 2023-11-24T08:05:05.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 -- start start 2023-11-24T08:05:05.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.134+0000 7fd2c850f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c00b3560 0x7fd2c01f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c00d01e0 0x7fd2c015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c0147020 0x7fd2c015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0160710 con 0x7fd2c00b3560 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c01fa4a0 con 0x7fd2c0147020 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00c8360 con 0x7fd2c00d01e0 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c00b3560 0x7fd2c01f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c00b3560 0x7fd2c01f9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47874/0 (socket says 172.21.15.57:47874) 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 -- 172.21.15.57:0/1918010742 learned_addr learned my addr 172.21.15.57:0/1918010742 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 -- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c00d01e0 msgr2=0x7fd2c015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c00d01e0 0x7fd2c015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 -- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c0147020 msgr2=0x7fd2c015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c0147020 0x7fd2c015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 -- 172.21.15.57:0/1918010742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8009a70 con 0x7fd2c00b3560 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c62ab640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c00b3560 0x7fd2c01f9f60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c460 tx=0x7fd2bc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2b6ffd640 1 -- 172.21.15.57:0/1918010742 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0052d0 con 0x7fd2c00b3560 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2b6ffd640 1 -- 172.21.15.57:0/1918010742 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc005450 con 0x7fd2c00b3560 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c01fa6d0 con 0x7fd2c00b3560 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2b6ffd640 1 -- 172.21.15.57:0/1918010742 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc003840 con 0x7fd2c00b3560 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c01fac90 con 0x7fd2c00b3560 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c01faeb0 con 0x7fd2c00b3560 2023-11-24T08:05:05.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2b6ffd640 1 -- 172.21.15.57:0/1918010742 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2bc0039a0 con 0x7fd2c00b3560 2023-11-24T08:05:05.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2b6ffd640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2a4066470 0x7fd2a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.138+0000 7fd2b6ffd640 1 -- 172.21.15.57:0/1918010742 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2bc0834e0 con 0x7fd2c00b3560 2023-11-24T08:05:05.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.142+0000 7fd2c5aaa640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2a4066470 0x7fd2a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.142+0000 7fd2c5aaa640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2a4066470 0x7fd2a4068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00cb3d0 tx=0x7fd2b00010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.146+0000 7fd2b6ffd640 1 -- 172.21.15.57:0/1918010742 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2c01faeb0 con 0x7fd2c00b3560 2023-11-24T08:05:05.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2c01faeb0 con 0x7fd2c00b3560 2023-11-24T08:05:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2b6ffd640 1 -- 172.21.15.57:0/1918010742 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16509 (secure 0 0 0) 0x7fd2c01faeb0 con 0x7fd2c00b3560 2023-11-24T08:05:05.311 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:05.311 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:53.859168+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2a4066470 msgr2=0x7fd2a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2a4066470 0x7fd2a4068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00cb3d0 tx=0x7fd2b00010b0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c00b3560 msgr2=0x7fd2c01f9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c00b3560 0x7fd2c01f9f60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c460 tx=0x7fd2bc00c920 comp rx=0 tx=0).stop 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 shutdown_connections 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2a4066470 0x7fd2a4068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c0147020 0x7fd2c015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c00d01e0 0x7fd2c015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 --2- 172.21.15.57:0/1918010742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c00b3560 0x7fd2c01f9f60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 >> 172.21.15.57:0/1918010742 conn(0x7fd2c0060fd0 msgr2=0x7fd2c006c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 shutdown_connections 2023-11-24T08:05:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.306+0000 7fd2c850f640 1 -- 172.21.15.57:0/1918010742 wait complete. 2023-11-24T08:05:05.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:50.817810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:51.228710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:05.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c0d69c640 1 Processor -- start 2023-11-24T08:05:05.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c0d69c640 1 -- start start 2023-11-24T08:05:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c0d69c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c080b1f80 0x7f5c080b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c0d69c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c08070f00 con 0x7f5c0815a290 2023-11-24T08:05:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c0d69c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c08071170 con 0x7f5c0815ec60 2023-11-24T08:05:05.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c0d69c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c080cb690 con 0x7f5c080b1f80 2023-11-24T08:05:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c06ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5c0815a290 0x7f5c080707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52478/0 (socket says 172.21.15.57:52478) 2023-11-24T08:05:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c06ffd640 1 -- 172.21.15.57:0/1608532340 learned_addr learned my addr 172.21.15.57:0/1608532340 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c077fe640 1 --2- 172.21.15.57:0/1608532340 >> v2:172.21.15.57:3300/0 conn(0x7f5c080b1f80 0x7f5c080b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c067fc640 1 -- 172.21.15.57:0/1608532340 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031320821 0 0) 0x7f5c08070f00 con 0x7f5c0815a290 2023-11-24T08:05:05.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c067fc640 1 -- 172.21.15.57:0/1608532340 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf4003530 con 0x7f5c0815a290 2023-11-24T08:05:05.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c077fe640 1 -- 172.21.15.57:0/1608532340 >> v1:172.21.15.132:6789/0 conn(0x7f5c0815ec60 legacy=0x7f5c080cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c067fc640 1 -- 172.21.15.57:0/1608532340 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551189722 0 0) 0x7f5c08071170 con 0x7f5c0815ec60 2023-11-24T08:05:05.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c077fe640 1 -- 172.21.15.57:0/1608532340 >> v1:172.21.15.57:6789/0 conn(0x7f5c0815a290 legacy=0x7f5c080707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.478+0000 7f5c077fe640 1 -- 172.21.15.57:0/1608532340 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c080cb970 con 0x7f5c080b1f80 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c077fe640 1 --2- 172.21.15.57:0/1608532340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c080b1f80 0x7f5c080b23f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009d90 tx=0x7f5c0001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd51f06347b588b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c067fc640 1 -- 172.21.15.57:0/1608532340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000a5890 con 0x7f5c080b1f80 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c067fc640 1 -- 172.21.15.57:0/1608532340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c000a59f0 con 0x7f5c080b1f80 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c067fc640 1 -- 172.21.15.57:0/1608532340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000a5d80 con 0x7f5c080b1f80 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1608532340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c080b1f80 msgr2=0x7f5c080b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1608532340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c080b1f80 0x7f5c080b23f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009d90 tx=0x7f5c0001c8c0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1608532340 shutdown_connections 2023-11-24T08:05:05.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1608532340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c080b1f80 0x7f5c080b23f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1608532340 >> 172.21.15.57:0/1608532340 conn(0x7f5c080b0c80 msgr2=0x7f5c080b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1608532340 shutdown_connections 2023-11-24T08:05:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.482+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1608532340 wait complete. 2023-11-24T08:05:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 Processor -- start 2023-11-24T08:05:05.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 -- start start 2023-11-24T08:05:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c080b1f80 0x7f5c081f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c0815a290 0x7f5c08158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c0815ec60 0x7f5c080ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081fa480 con 0x7f5c0815ec60 2023-11-24T08:05:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c08159b20 con 0x7f5c0815a290 2023-11-24T08:05:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081face0 con 0x7f5c080b1f80 2023-11-24T08:05:05.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c0815ec60 0x7f5c080ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c0815ec60 0x7f5c080ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47900/0 (socket says 172.21.15.57:47900) 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 -- 172.21.15.57:0/1107285722 learned_addr learned my addr 172.21.15.57:0/1107285722 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 -- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c080b1f80 msgr2=0x7f5c081f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c080b1f80 0x7f5c081f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 -- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c0815a290 msgr2=0x7f5c08158e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c0815a290 0x7f5c08158e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 -- 172.21.15.57:0/1107285722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00009a70 con 0x7f5c0815ec60 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c077fe640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c0815ec60 0x7f5c080ccef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009d90 tx=0x7f5c00019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5bff7fe640 1 -- 172.21.15.57:0/1107285722 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00003ba0 con 0x7f5c0815ec60 2023-11-24T08:05:05.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5bff7fe640 1 -- 172.21.15.57:0/1107285722 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c00003d00 con 0x7f5c0815ec60 2023-11-24T08:05:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5bff7fe640 1 -- 172.21.15.57:0/1107285722 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000b9860 con 0x7f5c0815ec60 2023-11-24T08:05:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c081f7e90 con 0x7f5c0815ec60 2023-11-24T08:05:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c081fa690 con 0x7f5c0815ec60 2023-11-24T08:05:05.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.486+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0804e8c0 con 0x7f5c0815ec60 2023-11-24T08:05:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.490+0000 7f5bff7fe640 1 -- 172.21.15.57:0/1107285722 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5c000b99c0 con 0x7f5c0815ec60 2023-11-24T08:05:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.490+0000 7f5bff7fe640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5be8066670 0x7f5be8068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.490+0000 7f5bff7fe640 1 -- 172.21.15.57:0/1107285722 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c0011f200 con 0x7f5c0815ec60 2023-11-24T08:05:05.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.490+0000 7f5c06ffd640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5be8066670 0x7f5be8068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.490+0000 7f5c06ffd640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5be8066670 0x7f5be8068b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8007fd0 tx=0x7f5bf8007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.494+0000 7f5bff7fe640 1 -- 172.21.15.57:0/1107285722 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c000ec470 con 0x7f5c0815ec60 2023-11-24T08:05:05.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.654+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c080b18e0 con 0x7f5c0815ec60 2023-11-24T08:05:05.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.654+0000 7f5bff7fe640 1 -- 172.21.15.57:0/1107285722 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c000a5850 con 0x7f5c0815ec60 2023-11-24T08:05:05.660 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:05:05.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5be8066670 msgr2=0x7f5be8068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5be8066670 0x7f5be8068b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8007fd0 tx=0x7f5bf8007900 comp rx=0 tx=0).stop 2023-11-24T08:05:05.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c0815ec60 msgr2=0x7f5c080ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c0815ec60 0x7f5c080ccef0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009d90 tx=0x7f5c00019660 comp rx=0 tx=0).stop 2023-11-24T08:05:05.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 shutdown_connections 2023-11-24T08:05:05.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5be8066670 0x7f5be8068b30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c0815ec60 0x7f5c080ccef0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c0815a290 0x7f5c08158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 --2- 172.21.15.57:0/1107285722 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c080b1f80 0x7f5c081f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 >> 172.21.15.57:0/1107285722 conn(0x7f5c080b0c80 msgr2=0x7f5c080b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 shutdown_connections 2023-11-24T08:05:05.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.658+0000 7f5c0d69c640 1 -- 172.21.15.57:0/1107285722 wait complete. 2023-11-24T08:05:05.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.822+0000 7f634bcc9640 1 Processor -- start 2023-11-24T08:05:05.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.822+0000 7f634bcc9640 1 -- start start 2023-11-24T08:05:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634bcc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63440ce310 0x7f63440d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634bcc9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63440d0670 con 0x7f63440cedc0 2023-11-24T08:05:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634bcc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63440cfa60 con 0x7f634415b320 2023-11-24T08:05:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634bcc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440d1040 con 0x7f63440ce310 2023-11-24T08:05:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f63440cedc0 0x7f63440cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60540/0 (socket says 172.21.15.57:60540) 2023-11-24T08:05:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 -- 172.21.15.57:0/2488476691 learned_addr learned my addr 172.21.15.57:0/2488476691 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:05.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6349264640 1 --2- 172.21.15.57:0/2488476691 >> v2:172.21.15.132:3300/0 conn(0x7f63440ce310 0x7f63440d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362055559 0 0) 0x7f63440d0670 con 0x7f63440cedc0 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6330003530 con 0x7f63440cedc0 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 451857192 0 0) 0x7f6330003530 con 0x7f63440cedc0 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 >> v2:172.21.15.132:3300/0 conn(0x7f63440ce310 msgr2=0x7f63440d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 --2- 172.21.15.57:0/2488476691 >> v2:172.21.15.132:3300/0 conn(0x7f63440ce310 0x7f63440d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 >> v1:172.21.15.132:6789/0 conn(0x7f634415b320 legacy=0x7f63440cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440cfd40 con 0x7f63440cedc0 2023-11-24T08:05:05.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f633c001a00 con 0x7f63440cedc0 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 >> v1:172.21.15.57:6789/0 conn(0x7f63440cedc0 legacy=0x7f63440cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6330003980 0x7f6330003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63300047d0 0x7f6330004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f633000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63440d1040 con 0x7f6330005190 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633000bf50 con 0x7f63300047d0 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633000c110 con 0x7f6330003980 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f633000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 -- 172.21.15.57:0/2488476691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6330003980 msgr2=0x7f6330003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6330003980 0x7f6330003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 -- 172.21.15.57:0/2488476691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63300047d0 msgr2=0x7f6330004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63300047d0 0x7f6330004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.826+0000 7f634a266640 1 -- 172.21.15.57:0/2488476691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330003530 con 0x7f6330005190 2023-11-24T08:05:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634a266640 1 -- 172.21.15.57:0/2488476691 reap_dead start 2023-11-24T08:05:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634a266640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f633000b990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a770 tx=0x7f633c01d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e797bf4f9a46e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0ac620 con 0x7f6330005190 2023-11-24T08:05:05.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0a8070 con 0x7f6330005190 2023-11-24T08:05:05.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f6348a63640 1 -- 172.21.15.57:0/2488476691 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0aca00 con 0x7f6330005190 2023-11-24T08:05:05.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 -- 172.21.15.57:0/2488476691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 msgr2=0x7f633000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f633000b990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a770 tx=0x7f633c01d260 comp rx=0 tx=0).stop 2023-11-24T08:05:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 -- 172.21.15.57:0/2488476691 shutdown_connections 2023-11-24T08:05:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 --2- 172.21.15.57:0/2488476691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f633000b990 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 -- 172.21.15.57:0/2488476691 >> 172.21.15.57:0/2488476691 conn(0x7f634406e860 msgr2=0x7f634406ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 -- 172.21.15.57:0/2488476691 shutdown_connections 2023-11-24T08:05:05.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 -- 172.21.15.57:0/2488476691 wait complete. 2023-11-24T08:05:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 Processor -- start 2023-11-24T08:05:05.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.830+0000 7f634bcc9640 1 -- start start 2023-11-24T08:05:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f63440b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63441efc50 0x7f63441f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63441f0610 0x7f63441f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63440c68a0 con 0x7f6330005190 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344155550 con 0x7f63441efc50 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634415cf90 con 0x7f63441f0610 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f63440b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f63440b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42214/0 (socket says 172.21.15.57:42214) 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 -- 172.21.15.57:0/1264111721 learned_addr learned my addr 172.21.15.57:0/1264111721 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634a266640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63441f0610 0x7f63441f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349264640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63441efc50 0x7f63441f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 -- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63441f0610 msgr2=0x7f63441f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63441f0610 0x7f63441f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 -- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63441efc50 msgr2=0x7f63441f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63441efc50 0x7f63441f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 -- 172.21.15.57:0/1264111721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344152f00 con 0x7f6330005190 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634a266640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63441f0610 0x7f63441f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349264640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63441efc50 0x7f63441f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f6349a65640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f63440b1e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f634000c750 tx=0x7f634000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f633a7fc640 1 -- 172.21.15.57:0/1264111721 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340005270 con 0x7f6330005190 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63441531e0 con 0x7f6330005190 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f633a7fc640 1 -- 172.21.15.57:0/1264111721 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63400053d0 con 0x7f6330005190 2023-11-24T08:05:05.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f633a7fc640 1 -- 172.21.15.57:0/1264111721 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000a840 con 0x7f6330005190 2023-11-24T08:05:05.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63440b2390 con 0x7f6330005190 2023-11-24T08:05:05.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.834+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6344152d60 con 0x7f6330005190 2023-11-24T08:05:05.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.838+0000 7f633a7fc640 1 -- 172.21.15.57:0/1264111721 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f634000a9a0 con 0x7f6330005190 2023-11-24T08:05:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.838+0000 7f633a7fc640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6328066650 0x7f6328068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.838+0000 7f633a7fc640 1 -- 172.21.15.57:0/1264111721 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6340083ed0 con 0x7f6330005190 2023-11-24T08:05:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.838+0000 7f6349264640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6328066650 0x7f6328068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:05.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.838+0000 7f6349264640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6328066650 0x7f6328068b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f63340047c0 tx=0x7f6334008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:05.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.842+0000 7f633a7fc640 1 -- 172.21.15.57:0/1264111721 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6344152d60 con 0x7f6330005190 2023-11-24T08:05:06.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.998+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6344152d60 con 0x7f6330005190 2023-11-24T08:05:06.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:05.998+0000 7f633a7fc640 1 -- 172.21.15.57:0/1264111721 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6344152d60 con 0x7f6330005190 2023-11-24T08:05:06.005 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:05:06.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6328066650 msgr2=0x7f6328068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6328066650 0x7f6328068b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f63340047c0 tx=0x7f6334008040 comp rx=0 tx=0).stop 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 msgr2=0x7f63440b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f63440b1e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f634000c750 tx=0x7f634000cc10 comp rx=0 tx=0).stop 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 shutdown_connections 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6328066650 0x7f6328068b10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63441f0610 0x7f63441f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63441efc50 0x7f63441f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 --2- 172.21.15.57:0/1264111721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330005190 0x7f63440b1e50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 >> 172.21.15.57:0/1264111721 conn(0x7f634406e860 msgr2=0x7f634415e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 shutdown_connections 2023-11-24T08:05:06.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.002+0000 7f634bcc9640 1 -- 172.21.15.57:0/1264111721 wait complete. 2023-11-24T08:05:06.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:06.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35c572640 1 Processor -- start 2023-11-24T08:05:06.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35c572640 1 -- start start 2023-11-24T08:05:06.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35c572640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc35415d8a0 0x7fc3540d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35c572640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc35406b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35c572640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3540ce5d0 con 0x7fc35406bd80 2023-11-24T08:05:06.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35c572640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3540d3ae0 con 0x7fc35415d8a0 2023-11-24T08:05:06.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35c572640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540d3dc0 con 0x7fc3540d3340 2023-11-24T08:05:06.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc359b0d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc35406b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35a30e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc35415d8a0 0x7fc3540d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35ab0f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc35406bd80 0x7fc3540cea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:45014/0 (socket says 172.21.15.57:45014) 2023-11-24T08:05:06.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35a30e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc35415d8a0 0x7fc3540d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:54356/0 (socket says 172.21.15.57:54356) 2023-11-24T08:05:06.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35ab0f640 1 -- 172.21.15.57:0/3073488440 learned_addr learned my addr 172.21.15.57:0/3073488440 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:06.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc359b0d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc35406b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:40110/0 (socket says 172.21.15.57:40110) 2023-11-24T08:05:06.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35a30e640 1 -- 172.21.15.57:0/3073488440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 msgr2=0x7fc35406b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:06.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35a30e640 1 --2- 172.21.15.57:0/3073488440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc35406b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35a30e640 1 -- 172.21.15.57:0/3073488440 >> v1:172.21.15.132:6789/0 conn(0x7fc35406bd80 legacy=0x7fc3540cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35a30e640 1 -- 172.21.15.57:0/3073488440 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3540ce260 con 0x7fc35415d8a0 2023-11-24T08:05:06.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.166+0000 7fc35930c640 1 -- 172.21.15.57:0/3073488440 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774164805 0 0) 0x7fc3540ce5d0 con 0x7fc35406bd80 2023-11-24T08:05:06.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35a30e640 1 --2- 172.21.15.57:0/3073488440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 0x7fc3540d0880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097c0 tx=0x7fc35001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62d1fc5984d66bfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35930c640 1 -- 172.21.15.57:0/3073488440 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500ad680 con 0x7fc35415d8a0 2023-11-24T08:05:06.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35930c640 1 -- 172.21.15.57:0/3073488440 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3500ad7e0 con 0x7fc35415d8a0 2023-11-24T08:05:06.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35930c640 1 -- 172.21.15.57:0/3073488440 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500adb70 con 0x7fc35415d8a0 2023-11-24T08:05:06.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 -- 172.21.15.57:0/3073488440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 msgr2=0x7fc3540d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 --2- 172.21.15.57:0/3073488440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 0x7fc3540d0880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097c0 tx=0x7fc35001c360 comp rx=0 tx=0).stop 2023-11-24T08:05:06.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 -- 172.21.15.57:0/3073488440 shutdown_connections 2023-11-24T08:05:06.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 --2- 172.21.15.57:0/3073488440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc35406b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 --2- 172.21.15.57:0/3073488440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 0x7fc3540d0880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 -- 172.21.15.57:0/3073488440 >> 172.21.15.57:0/3073488440 conn(0x7fc35409c790 msgr2=0x7fc35408af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:06.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 -- 172.21.15.57:0/3073488440 shutdown_connections 2023-11-24T08:05:06.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.170+0000 7fc35c572640 1 -- 172.21.15.57:0/3073488440 wait complete. 2023-11-24T08:05:06.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 Processor -- start 2023-11-24T08:05:06.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 -- start start 2023-11-24T08:05:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35406bd80 0x7fc3540b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc3540b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 0x7fc3540b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541fa750 con 0x7fc35406bd80 2023-11-24T08:05:06.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540b7110 con 0x7fc35415d8a0 2023-11-24T08:05:06.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540b6740 con 0x7fc3540d3340 2023-11-24T08:05:06.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35406bd80 0x7fc3540b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35406bd80 0x7fc3540b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42220/0 (socket says 172.21.15.57:42220) 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 -- 172.21.15.57:0/934752638 learned_addr learned my addr 172.21.15.57:0/934752638 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc359b0d640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc3540b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35ab0f640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 0x7fc3540b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 -- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 msgr2=0x7fc3540b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc3540b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 -- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 msgr2=0x7fc3540b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 0x7fc3540b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 -- 172.21.15.57:0/934752638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009420 con 0x7fc35406bd80 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35a30e640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35406bd80 0x7fc3540b6bd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097c0 tx=0x7fc350019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc34affd640 1 -- 172.21.15.57:0/934752638 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500add60 con 0x7fc35406bd80 2023-11-24T08:05:06.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc34affd640 1 -- 172.21.15.57:0/934752638 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350004030 con 0x7fc35406bd80 2023-11-24T08:05:06.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc34affd640 1 -- 172.21.15.57:0/934752638 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500043a0 con 0x7fc35406bd80 2023-11-24T08:05:06.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3541f7160 con 0x7fc35406bd80 2023-11-24T08:05:06.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.174+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3540b60f0 con 0x7fc35406bd80 2023-11-24T08:05:06.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.178+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35404e8c0 con 0x7fc35406bd80 2023-11-24T08:05:06.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.178+0000 7fc34affd640 1 -- 172.21.15.57:0/934752638 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc3500b4040 con 0x7fc35406bd80 2023-11-24T08:05:06.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.178+0000 7fc34affd640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.178+0000 7fc34affd640 1 -- 172.21.15.57:0/934752638 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc35011dfd0 con 0x7fc35406bd80 2023-11-24T08:05:06.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.178+0000 7fc359b0d640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.178+0000 7fc359b0d640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc354150590 tx=0x7fc344009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.182+0000 7fc34affd640 1 -- 172.21.15.57:0/934752638 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3500eb2b0 con 0x7fc35406bd80 2023-11-24T08:05:06.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3540d4130 con 0x7fc35406bd80 2023-11-24T08:05:06.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc34affd640 1 -- 172.21.15.57:0/934752638 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3500b2020 con 0x7fc35406bd80 2023-11-24T08:05:06.347 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:05:06.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 msgr2=0x7fc338068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc354150590 tx=0x7fc344009190 comp rx=0 tx=0).stop 2023-11-24T08:05:06.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35406bd80 msgr2=0x7fc3540b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35406bd80 0x7fc3540b6bd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097c0 tx=0x7fc350019100 comp rx=0 tx=0).stop 2023-11-24T08:05:06.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 shutdown_connections 2023-11-24T08:05:06.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc35415d8a0 0x7fc3540b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3540d3340 0x7fc3540b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 --2- 172.21.15.57:0/934752638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35406bd80 0x7fc3540b6bd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 >> 172.21.15.57:0/934752638 conn(0x7fc35409c790 msgr2=0x7fc3540b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 shutdown_connections 2023-11-24T08:05:06.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.342+0000 7fc35c572640 1 -- 172.21.15.57:0/934752638 wait complete. 2023-11-24T08:05:06.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.506+0000 7f9417e32640 1 Processor -- start 2023-11-24T08:05:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9417e32640 1 -- start start 2023-11-24T08:05:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9417e32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94100cad20 0x7f94100c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9417e32640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941015a8b0 con 0x7f941015a4d0 2023-11-24T08:05:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9417e32640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94100c9c30 con 0x7f941006d740 2023-11-24T08:05:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9417e32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94100c9f60 con 0x7f94100cad20 2023-11-24T08:05:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9415bce640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f941015a4d0 0x7f941015e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60554/0 (socket says 172.21.15.57:60554) 2023-11-24T08:05:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9415bce640 1 -- 172.21.15.57:0/4060606659 learned_addr learned my addr 172.21.15.57:0/4060606659 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94153cd640 1 --2- 172.21.15.57:0/4060606659 >> v2:172.21.15.132:3300/0 conn(0x7f94100cad20 0x7f94100c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723008988 0 0) 0x7f941015a8b0 con 0x7f941015a4d0 2023-11-24T08:05:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc003530 con 0x7f941015a4d0 2023-11-24T08:05:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674497161 0 0) 0x7f94100c9c30 con 0x7f941006d740 2023-11-24T08:05:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f941015a8b0 con 0x7f941006d740 2023-11-24T08:05:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 937694755 0 0) 0x7f93fc003530 con 0x7f941015a4d0 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 >> v2:172.21.15.132:3300/0 conn(0x7f94100cad20 msgr2=0x7f94100c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 --2- 172.21.15.57:0/4060606659 >> v2:172.21.15.132:3300/0 conn(0x7f94100cad20 0x7f94100c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 >> v1:172.21.15.132:6789/0 conn(0x7f941006d740 legacy=0x7f941006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94100ca240 con 0x7f941015a4d0 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f940c001680 con 0x7f941015a4d0 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 >> v1:172.21.15.57:6789/0 conn(0x7f941015a4d0 legacy=0x7f941015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc003b60 0x7f93fc003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc0047d0 0x7f93fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0051e0 0x7f93fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94100c9f60 con 0x7f93fc0047d0 2023-11-24T08:05:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00c110 con 0x7f93fc0051e0 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00c2d0 con 0x7f93fc003b60 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94153cd640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc0047d0 0x7f93fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94163cf640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0051e0 0x7f93fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94153cd640 1 -- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc003b60 msgr2=0x7f93fc003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94153cd640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc003b60 0x7f93fc003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94153cd640 1 -- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0051e0 msgr2=0x7f93fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94153cd640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0051e0 0x7f93fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94153cd640 1 -- 172.21.15.57:0/4060606659 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc003530 con 0x7f93fc0047d0 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94163cf640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0051e0 0x7f93fc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.510+0000 7f94163cf640 1 -- 172.21.15.57:0/4060606659 reap_dead start 2023-11-24T08:05:06.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f94153cd640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc0047d0 0x7f93fc004c50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f940000bd80 tx=0x7f940001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c001f60c84cb5d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000ae600 con 0x7f93fc0047d0 2023-11-24T08:05:06.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000aa050 con 0x7f93fc0047d0 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9414bcc640 1 -- 172.21.15.57:0/4060606659 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000ae9a0 con 0x7f93fc0047d0 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9417e32640 1 -- 172.21.15.57:0/4060606659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc0047d0 msgr2=0x7f93fc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9417e32640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc0047d0 0x7f93fc004c50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f940000bd80 tx=0x7f940001f370 comp rx=0 tx=0).stop 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9417e32640 1 -- 172.21.15.57:0/4060606659 shutdown_connections 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9417e32640 1 --2- 172.21.15.57:0/4060606659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc0047d0 0x7f93fc004c50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9417e32640 1 -- 172.21.15.57:0/4060606659 >> 172.21.15.57:0/4060606659 conn(0x7f94100b0bf0 msgr2=0x7f94100b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9417e32640 1 -- 172.21.15.57:0/4060606659 shutdown_connections 2023-11-24T08:05:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.514+0000 7f9417e32640 1 -- 172.21.15.57:0/4060606659 wait complete. 2023-11-24T08:05:06.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 Processor -- start 2023-11-24T08:05:06.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 -- start start 2023-11-24T08:05:06.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0047d0 0x7f941009a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f941009bb20 0x7f94100c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94101524a0 0x7f94100710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941009bfa0 con 0x7f94101524a0 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94100c52d0 con 0x7f93fc0047d0 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941009aa80 con 0x7f941009bb20 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94101524a0 0x7f94100710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94101524a0 0x7f94100710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42240/0 (socket says 172.21.15.57:42240) 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 -- 172.21.15.57:0/1843767476 learned_addr learned my addr 172.21.15.57:0/1843767476 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9415bce640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0047d0 0x7f941009a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94153cd640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f941009bb20 0x7f94100c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 -- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f941009bb20 msgr2=0x7f94100c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f941009bb20 0x7f94100c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 -- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0047d0 msgr2=0x7f941009a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0047d0 0x7f941009a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 -- 172.21.15.57:0/1843767476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941009ad60 con 0x7f94101524a0 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94163cf640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94101524a0 0x7f94100710b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f941006e540 tx=0x7f940800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94067fc640 1 -- 172.21.15.57:0/1843767476 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940800eec0 con 0x7f94101524a0 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94067fc640 1 -- 172.21.15.57:0/1843767476 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9408003b90 con 0x7f94101524a0 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941009b040 con 0x7f94101524a0 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f94067fc640 1 -- 172.21.15.57:0/1843767476 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408006b60 con 0x7f94101524a0 2023-11-24T08:05:06.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.518+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941009b600 con 0x7f94101524a0 2023-11-24T08:05:06.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.522+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941009b820 con 0x7f94101524a0 2023-11-24T08:05:06.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.522+0000 7f94067fc640 1 -- 172.21.15.57:0/1843767476 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f9408006cc0 con 0x7f94101524a0 2023-11-24T08:05:06.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.522+0000 7f94067fc640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f93f4066610 0x7f93f4068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:06.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.522+0000 7f94067fc640 1 -- 172.21.15.57:0/1843767476 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94080837a0 con 0x7f94101524a0 2023-11-24T08:05:06.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.522+0000 7f9415bce640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f93f4066610 0x7f93f4068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:06.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.522+0000 7f9415bce640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f93f4066610 0x7f93f4068ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f94100682a0 tx=0x7f940c0016c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:06.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.526+0000 7f94067fc640 1 -- 172.21.15.57:0/1843767476 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94080509c0 con 0x7f94101524a0 2023-11-24T08:05:06.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.698+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f941009d250 con 0x7f94101524a0 2023-11-24T08:05:06.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.698+0000 7f94067fc640 1 -- 172.21.15.57:0/1843767476 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9408019020 con 0x7f94101524a0 2023-11-24T08:05:06.705 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:05:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f93f4066610 msgr2=0x7f93f4068ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f93f4066610 0x7f93f4068ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f94100682a0 tx=0x7f940c0016c0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94101524a0 msgr2=0x7f94100710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94101524a0 0x7f94100710b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f941006e540 tx=0x7f940800ecd0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 shutdown_connections 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f93f4066610 0x7f93f4068ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94101524a0 0x7f94100710b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f941009bb20 0x7f94100c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 --2- 172.21.15.57:0/1843767476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0047d0 0x7f941009a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 >> 172.21.15.57:0/1843767476 conn(0x7f94100b0bf0 msgr2=0x7f94100cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 shutdown_connections 2023-11-24T08:05:06.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:06.702+0000 7f9417e32640 1 -- 172.21.15.57:0/1843767476 wait complete. 2023-11-24T08:05:06.725 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:05:06.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:06.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:06.812 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:05:06.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:06.813 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:05:06.825 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:06.825 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:06.834 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:06.834 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:06.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:07.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.022+0000 7f4b2d0d6640 1 Processor -- start 2023-11-24T08:05:07.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.022+0000 7f4b2d0d6640 1 -- start start 2023-11-24T08:05:07.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2d0d6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b28144030 0x7f4b2806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2d0d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 0x7f4b2806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2d0d6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2806d8b0 con 0x7f4b2806e280 2023-11-24T08:05:07.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2d0d6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b28145020 con 0x7f4b28144030 2023-11-24T08:05:07.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2d0d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2809d0a0 con 0x7f4b2809cc20 2023-11-24T08:05:07.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4b2806e280 0x7f4b280709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60570/0 (socket says 172.21.15.57:60570) 2023-11-24T08:05:07.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 -- 172.21.15.57:0/2132808877 learned_addr learned my addr 172.21.15.57:0/2132808877 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b26d9d640 1 --2- 172.21.15.57:0/2132808877 >> v2:172.21.15.132:3300/0 conn(0x7f4b28144030 0x7f4b2806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b1ffff640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 0x7f4b2806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377063348 0 0) 0x7f4b2806d8b0 con 0x7f4b2806e280 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b14003530 con 0x7f4b2806e280 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2028556645 0 0) 0x7f4b14003530 con 0x7f4b2806e280 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 msgr2=0x7f4b2806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 0x7f4b2806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 >> v2:172.21.15.132:3300/0 conn(0x7f4b28144030 msgr2=0x7f4b2806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 --2- 172.21.15.57:0/2132808877 >> v2:172.21.15.132:3300/0 conn(0x7f4b28144030 0x7f4b2806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2806cca0 con 0x7f4b2806e280 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f4b20001a00 con 0x7f4b2806e280 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 >> v1:172.21.15.57:6789/0 conn(0x7f4b2806e280 legacy=0x7f4b280709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b14003980 0x7f4b14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 0x7f4b140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2809d0a0 con 0x7f4b14004d10 2023-11-24T08:05:07.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1400b990 con 0x7f4b14003980 2023-11-24T08:05:07.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1400bad0 con 0x7f4b2809cc20 2023-11-24T08:05:07.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b1ffff640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 0x7f4b140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b26d9d640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b14003980 0x7f4b14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 -- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 msgr2=0x7f4b140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b2809cc20 0x7f4b140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 -- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b14003980 msgr2=0x7f4b14003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b14003980 0x7f4b14003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.026+0000 7f4b2759e640 1 -- 172.21.15.57:0/2132808877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14003530 con 0x7f4b14004d10 2023-11-24T08:05:07.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2759e640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b14005190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000a860 tx=0x7f4b2001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9a770acf93765c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200ad630 con 0x7f4b14004d10 2023-11-24T08:05:07.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b200a8070 con 0x7f4b14004d10 2023-11-24T08:05:07.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2659c640 1 -- 172.21.15.57:0/2132808877 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200ad9f0 con 0x7f4b14004d10 2023-11-24T08:05:07.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2132808877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 msgr2=0x7f4b14005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2d0d6640 1 --2- 172.21.15.57:0/2132808877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b14005190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000a860 tx=0x7f4b2001d360 comp rx=0 tx=0).stop 2023-11-24T08:05:07.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2759e640 1 -- 172.21.15.57:0/2132808877 reap_dead start 2023-11-24T08:05:07.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2132808877 shutdown_connections 2023-11-24T08:05:07.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2132808877 >> 172.21.15.57:0/2132808877 conn(0x7f4b280b0bf0 msgr2=0x7f4b280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2132808877 shutdown_connections 2023-11-24T08:05:07.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.030+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2132808877 wait complete. 2023-11-24T08:05:07.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 Processor -- start 2023-11-24T08:05:07.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 -- start start 2023-11-24T08:05:07.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b281ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b281e1140 0x7f4b281e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b2809ad60 0x7f4b2809b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280999e0 con 0x7f4b14004d10 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28099cc0 con 0x7f4b2809ad60 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28099fa0 con 0x7f4b281e1140 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b281ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b281ee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42262/0 (socket says 172.21.15.57:42262) 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 -- 172.21.15.57:0/2868893114 learned_addr learned my addr 172.21.15.57:0/2868893114 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b1ffff640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b281e1140 0x7f4b281e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2759e640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b2809ad60 0x7f4b2809b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 -- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b281e1140 msgr2=0x7f4b281e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b281e1140 0x7f4b281e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 -- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b2809ad60 msgr2=0x7f4b2809b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b2809ad60 0x7f4b2809b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 -- 172.21.15.57:0/2868893114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2809a280 con 0x7f4b14004d10 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b1ffff640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b281e1140 0x7f4b281e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b26d9d640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b281ee0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4b18011aa0 tx=0x7f4b18011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b1f7fe640 1 -- 172.21.15.57:0/2868893114 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800fb80 con 0x7f4b14004d10 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b1f7fe640 1 -- 172.21.15.57:0/2868893114 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800fce0 con 0x7f4b14004d10 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2809a560 con 0x7f4b14004d10 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b1f7fe640 1 -- 172.21.15.57:0/2868893114 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18014680 con 0x7f4b14004d10 2023-11-24T08:05:07.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b281ee610 con 0x7f4b14004d10 2023-11-24T08:05:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.034+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28067520 con 0x7f4b14004d10 2023-11-24T08:05:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.038+0000 7f4b1f7fe640 1 -- 172.21.15.57:0/2868893114 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f4b180147e0 con 0x7f4b14004d10 2023-11-24T08:05:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.038+0000 7f4b1f7fe640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4b08066650 0x7f4b08068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.038+0000 7f4b1f7fe640 1 -- 172.21.15.57:0/2868893114 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b18084b40 con 0x7f4b14004d10 2023-11-24T08:05:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.038+0000 7f4b1ffff640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4b08066650 0x7f4b08068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.038+0000 7f4b1ffff640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4b08066650 0x7f4b08068b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4b2813a900 tx=0x7f4b10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.042+0000 7f4b1f7fe640 1 -- 172.21.15.57:0/2868893114 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b18051ca0 con 0x7f4b14004d10 2023-11-24T08:05:07.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.198+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b2813e9c0 con 0x7f4b14004d10 2023-11-24T08:05:07.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b1f7fe640 1 -- 172.21.15.57:0/2868893114 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f4b18022020 con 0x7f4b14004d10 2023-11-24T08:05:07.207 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:07.207 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:53.859168+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:07.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4b08066650 msgr2=0x7f4b08068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4b08066650 0x7f4b08068b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4b2813a900 tx=0x7f4b10008040 comp rx=0 tx=0).stop 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 msgr2=0x7f4b281ee0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b281ee0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4b18011aa0 tx=0x7f4b18011f60 comp rx=0 tx=0).stop 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 shutdown_connections 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4b08066650 0x7f4b08068b10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b2809ad60 0x7f4b2809b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b281e1140 0x7f4b281e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 --2- 172.21.15.57:0/2868893114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b14004d10 0x7f4b281ee0d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 >> 172.21.15.57:0/2868893114 conn(0x7f4b280b0bf0 msgr2=0x7f4b2815ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 shutdown_connections 2023-11-24T08:05:07.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.202+0000 7f4b2d0d6640 1 -- 172.21.15.57:0/2868893114 wait complete. 2023-11-24T08:05:07.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:50.817810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:51.228710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:07.229 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:07.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d31c1640 1 Processor -- start 2023-11-24T08:05:07.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d31c1640 1 -- start start 2023-11-24T08:05:07.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d31c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d31c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01cc15ec60 0x7f01cc0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d31c1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc071170 con 0x7f01cc0cc6b0 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d31c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0cb690 con 0x7f01cc15ec60 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d31c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0cb970 con 0x7f01cc15a290 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d175e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f01cc0cc6b0 0x7f01cc0b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60578/0 (socket says 172.21.15.57:60578) 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d175e640 1 -- 172.21.15.57:0/3148799776 learned_addr learned my addr 172.21.15.57:0/3148799776 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01cbfff640 1 --2- 172.21.15.57:0/3148799776 >> v2:172.21.15.132:3300/0 conn(0x7f01cc15ec60 0x7f01cc0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01d0f5d640 1 --2- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01cb7fe640 1 -- 172.21.15.57:0/3148799776 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207563994 0 0) 0x7f01cc071170 con 0x7f01cc0cc6b0 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01cb7fe640 1 -- 172.21.15.57:0/3148799776 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01bc003530 con 0x7f01cc0cc6b0 2023-11-24T08:05:07.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01cbfff640 1 -- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 msgr2=0x7f01cc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01cbfff640 1 --2- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01cbfff640 1 -- 172.21.15.57:0/3148799776 >> v1:172.21.15.57:6789/0 conn(0x7f01cc0cc6b0 legacy=0x7f01cc0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.370+0000 7f01cbfff640 1 -- 172.21.15.57:0/3148799776 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0cbc50 con 0x7f01cc15ec60 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01cbfff640 1 --2- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cc170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097c0 tx=0x7f01b801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=936dea13dc90488d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01cb7fe640 1 -- 172.21.15.57:0/3148799776 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80ab610 con 0x7f01cc15ec60 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01cb7fe640 1 -- 172.21.15.57:0/3148799776 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b80ab770 con 0x7f01cc15ec60 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01cb7fe640 1 -- 172.21.15.57:0/3148799776 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80abb00 con 0x7f01cc15ec60 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 -- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc15ec60 msgr2=0x7f01cc0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 --2- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cc170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097c0 tx=0x7f01b801c3f0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 -- 172.21.15.57:0/3148799776 shutdown_connections 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 --2- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cc170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 --2- 172.21.15.57:0/3148799776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 -- 172.21.15.57:0/3148799776 >> 172.21.15.57:0/3148799776 conn(0x7f01cc0b0c80 msgr2=0x7f01cc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 -- 172.21.15.57:0/3148799776 shutdown_connections 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.374+0000 7f01d31c1640 1 -- 172.21.15.57:0/3148799776 wait complete. 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 Processor -- start 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 -- start start 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc0cc6b0 0x7f01cc141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc1588a0 con 0x7f01cc15ec60 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc158b80 con 0x7f01cc0cc6b0 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc158e60 con 0x7f01cc15a290 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42264/0 (socket says 172.21.15.57:42264) 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 -- 172.21.15.57:0/2062593428 learned_addr learned my addr 172.21.15.57:0/2062593428 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01cbfff640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d0f5d640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc0cc6b0 0x7f01cc141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 -- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 msgr2=0x7f01cc0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 -- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc0cc6b0 msgr2=0x7f01cc141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc0cc6b0 0x7f01cc141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 -- 172.21.15.57:0/2062593428 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b8009420 con 0x7f01cc15ec60 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d175e640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cd430 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f01c400cb40 tx=0x7f01c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01c97fa640 1 -- 172.21.15.57:0/2062593428 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400aca0 con 0x7f01cc15ec60 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01c97fa640 1 -- 172.21.15.57:0/2062593428 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c400ae00 con 0x7f01cc15ec60 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01c97fa640 1 -- 172.21.15.57:0/2062593428 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4012620 con 0x7f01cc15ec60 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc159140 con 0x7f01cc15ec60 2023-11-24T08:05:07.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.378+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc152190 con 0x7f01cc15ec60 2023-11-24T08:05:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.382+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc04e8c0 con 0x7f01cc15ec60 2023-11-24T08:05:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.382+0000 7f01c97fa640 1 -- 172.21.15.57:0/2062593428 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f01c4007070 con 0x7f01cc15ec60 2023-11-24T08:05:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.382+0000 7f01c97fa640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f01b0066620 0x7f01b0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.382+0000 7f01c97fa640 1 -- 172.21.15.57:0/2062593428 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01c4084230 con 0x7f01cc15ec60 2023-11-24T08:05:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.382+0000 7f01d0f5d640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f01b0066620 0x7f01b0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.382+0000 7f01d0f5d640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f01b0066620 0x7f01b0068ae0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009af0 tx=0x7f01c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.386+0000 7f01c97fa640 1 -- 172.21.15.57:0/2062593428 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01c4051420 con 0x7f01cc15ec60 2023-11-24T08:05:07.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.546+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01cc071c80 con 0x7f01cc15ec60 2023-11-24T08:05:07.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.546+0000 7f01c97fa640 1 -- 172.21.15.57:0/2062593428 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01c4054a40 con 0x7f01cc15ec60 2023-11-24T08:05:07.552 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:05:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f01b0066620 msgr2=0x7f01b0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f01b0066620 0x7f01b0068ae0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009af0 tx=0x7f01c0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01cc15ec60 msgr2=0x7f01cc0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cd430 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f01c400cb40 tx=0x7f01c400a060 comp rx=0 tx=0).stop 2023-11-24T08:05:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 shutdown_connections 2023-11-24T08:05:07.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f01b0066620 0x7f01b0068ae0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01cc15ec60 0x7f01cc0cd430 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01cc15a290 0x7f01cc0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 --2- 172.21.15.57:0/2062593428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01cc0cc6b0 0x7f01cc141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 >> 172.21.15.57:0/2062593428 conn(0x7f01cc0b0c80 msgr2=0x7f01cc0b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 shutdown_connections 2023-11-24T08:05:07.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.550+0000 7f01d31c1640 1 -- 172.21.15.57:0/2062593428 wait complete. 2023-11-24T08:05:07.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c3a5a640 1 Processor -- start 2023-11-24T08:05:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c3a5a640 1 -- start start 2023-11-24T08:05:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c3a5a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26bc15a290 0x7f26bc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c3a5a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26bc0b1f80 0x7f26bc0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c3a5a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc071170 con 0x7f26bc15ec60 2023-11-24T08:05:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c3a5a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc0cb690 con 0x7f26bc0b1f80 2023-11-24T08:05:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c3a5a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc0cb970 con 0x7f26bc15a290 2023-11-24T08:05:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c1ff7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26bc0b1f80 0x7f26bc0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c1ff7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26bc0b1f80 0x7f26bc0b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42276/0 (socket says 172.21.15.57:42276) 2023-11-24T08:05:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c1ff7640 1 -- 172.21.15.57:0/1768139969 learned_addr learned my addr 172.21.15.57:0/1768139969 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c17f6640 1 --2- 172.21.15.57:0/1768139969 >> v2:172.21.15.132:3300/0 conn(0x7f26bc15a290 0x7f26bc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c1ff7640 1 -- 172.21.15.57:0/1768139969 >> v2:172.21.15.132:3300/0 conn(0x7f26bc15a290 msgr2=0x7f26bc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c1ff7640 1 --2- 172.21.15.57:0/1768139969 >> v2:172.21.15.132:3300/0 conn(0x7f26bc15a290 0x7f26bc0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c1ff7640 1 -- 172.21.15.57:0/1768139969 >> v1:172.21.15.132:6789/0 conn(0x7f26bc15ec60 legacy=0x7f26bc0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.714+0000 7f26c1ff7640 1 -- 172.21.15.57:0/1768139969 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0cbc50 con 0x7f26bc0b1f80 2023-11-24T08:05:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c1ff7640 1 --2- 172.21.15.57:0/1768139969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc0b1f80 0x7f26bc0b23f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f26bc06c0d0 tx=0x7f26b401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feee584fa81a4ec2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26b3fff640 1 -- 172.21.15.57:0/1768139969 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40a5710 con 0x7f26bc0b1f80 2023-11-24T08:05:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26b3fff640 1 -- 172.21.15.57:0/1768139969 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b40a5870 con 0x7f26bc0b1f80 2023-11-24T08:05:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26b3fff640 1 -- 172.21.15.57:0/1768139969 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40a5c00 con 0x7f26bc0b1f80 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 -- 172.21.15.57:0/1768139969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc0b1f80 msgr2=0x7f26bc0b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/1768139969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc0b1f80 0x7f26bc0b23f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f26bc06c0d0 tx=0x7f26b401c940 comp rx=0 tx=0).stop 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 -- 172.21.15.57:0/1768139969 shutdown_connections 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/1768139969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc0b1f80 0x7f26bc0b23f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/1768139969 >> v2:172.21.15.132:3300/0 conn(0x7f26bc15a290 0x7f26bc0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 -- 172.21.15.57:0/1768139969 >> 172.21.15.57:0/1768139969 conn(0x7f26bc0b0c80 msgr2=0x7f26bc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 -- 172.21.15.57:0/1768139969 shutdown_connections 2023-11-24T08:05:07.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.718+0000 7f26c3a5a640 1 -- 172.21.15.57:0/1768139969 wait complete. 2023-11-24T08:05:07.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 Processor -- start 2023-11-24T08:05:07.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 -- start start 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26bc0b1f80 0x7f26bc150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26bc15a290 0x7f26bc0987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc15ec60 0x7f26bc0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc150850 con 0x7f26bc15ec60 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc14abd0 con 0x7f26bc15a290 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0af910 con 0x7f26bc0b1f80 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc15ec60 0x7f26bc0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc15ec60 0x7f26bc0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42288/0 (socket says 172.21.15.57:42288) 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 -- 172.21.15.57:0/920259298 learned_addr learned my addr 172.21.15.57:0/920259298 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c0ff5640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26bc15a290 0x7f26bc0987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c17f6640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26bc0b1f80 0x7f26bc150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 -- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26bc0b1f80 msgr2=0x7f26bc150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26bc0b1f80 0x7f26bc150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 -- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26bc15a290 msgr2=0x7f26bc0987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26bc15a290 0x7f26bc0987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 -- 172.21.15.57:0/920259298 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4009b30 con 0x7f26bc15ec60 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c0ff5640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26bc15a290 0x7f26bc0987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:07.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c1ff7640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc15ec60 0x7f26bc0aeda0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f26b40af040 tx=0x7f26b40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26b1ffb640 1 -- 172.21.15.57:0/920259298 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40b8670 con 0x7f26bc15ec60 2023-11-24T08:05:07.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26b1ffb640 1 -- 172.21.15.57:0/920259298 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b40b87f0 con 0x7f26bc15ec60 2023-11-24T08:05:07.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26b1ffb640 1 -- 172.21.15.57:0/920259298 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40b8ba0 con 0x7f26bc15ec60 2023-11-24T08:05:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc070f40 con 0x7f26bc15ec60 2023-11-24T08:05:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.722+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc14fb10 con 0x7f26bc15ec60 2023-11-24T08:05:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.726+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc04e8c0 con 0x7f26bc15ec60 2023-11-24T08:05:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.726+0000 7f26b1ffb640 1 -- 172.21.15.57:0/920259298 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f26b40b8d00 con 0x7f26bc15ec60 2023-11-24T08:05:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.726+0000 7f26b1ffb640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26a0066620 0x7f26a0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.726+0000 7f26b1ffb640 1 -- 172.21.15.57:0/920259298 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26b411f7c0 con 0x7f26bc15ec60 2023-11-24T08:05:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.726+0000 7f26c17f6640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26a0066620 0x7f26a0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.726+0000 7f26c17f6640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26a0066620 0x7f26a0068ae0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f26b800b9d0 tx=0x7f26b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.730+0000 7f26b1ffb640 1 -- 172.21.15.57:0/920259298 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26b40ecb90 con 0x7f26bc15ec60 2023-11-24T08:05:07.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26bc06e900 con 0x7f26bc15ec60 2023-11-24T08:05:07.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26b1ffb640 1 -- 172.21.15.57:0/920259298 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26b40f01b0 con 0x7f26bc15ec60 2023-11-24T08:05:07.895 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:05:07.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26a0066620 msgr2=0x7f26a0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26a0066620 0x7f26a0068ae0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f26b800b9d0 tx=0x7f26b8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:07.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc15ec60 msgr2=0x7f26bc0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc15ec60 0x7f26bc0aeda0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f26b40af040 tx=0x7f26b40196e0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 shutdown_connections 2023-11-24T08:05:07.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f26a0066620 0x7f26a0068ae0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26bc15ec60 0x7f26bc0aeda0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26bc15a290 0x7f26bc0987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 --2- 172.21.15.57:0/920259298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26bc0b1f80 0x7f26bc150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 >> 172.21.15.57:0/920259298 conn(0x7f26bc0b0c80 msgr2=0x7f26bc0b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 shutdown_connections 2023-11-24T08:05:07.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:07.890+0000 7f26c3a5a640 1 -- 172.21.15.57:0/920259298 wait complete. 2023-11-24T08:05:07.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41feba0640 1 Processor -- start 2023-11-24T08:05:08.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41feba0640 1 -- start start 2023-11-24T08:05:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41feba0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41f815d500 0x7f41f806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41feba0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f806bf80 0x7f41f80b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41feba0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f80d1400 con 0x7f41f80b8f90 2023-11-24T08:05:08.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41feba0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f806c410 con 0x7f41f815d500 2023-11-24T08:05:08.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41feba0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80b7d80 con 0x7f41f806bf80 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fdb9e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41f815d500 0x7f41f806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fe39f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f806bf80 0x7f41f80b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fd39d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f41f80b8f90 0x7f41f80d1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:45040/0 (socket says 172.21.15.57:45040) 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fd39d640 1 -- 172.21.15.57:0/3572838125 learned_addr learned my addr 172.21.15.57:0/3572838125 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fdb9e640 1 -- 172.21.15.57:0/3572838125 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f806bf80 msgr2=0x7f41f80b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fdb9e640 1 --2- 172.21.15.57:0/3572838125 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f806bf80 0x7f41f80b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fdb9e640 1 -- 172.21.15.57:0/3572838125 >> v1:172.21.15.132:6789/0 conn(0x7f41f80b8f90 legacy=0x7f41f80d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fdb9e640 1 -- 172.21.15.57:0/3572838125 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80b8060 con 0x7f41f815d500 2023-11-24T08:05:08.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.058+0000 7f41fcb9c640 1 -- 172.21.15.57:0/3572838125 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121350235 0 0) 0x7f41f80d1400 con 0x7f41f80b8f90 2023-11-24T08:05:08.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41fdb9e640 1 --2- 172.21.15.57:0/3572838125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f815d500 0x7f41f806ba40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f41f40097c0 tx=0x7f41f401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e56111a87a1c11a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41fcb9c640 1 -- 172.21.15.57:0/3572838125 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40a8970 con 0x7f41f815d500 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41fcb9c640 1 -- 172.21.15.57:0/3572838125 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f40a8ad0 con 0x7f41f815d500 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41fcb9c640 1 -- 172.21.15.57:0/3572838125 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40a8e60 con 0x7f41f815d500 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 -- 172.21.15.57:0/3572838125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f815d500 msgr2=0x7f41f806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 --2- 172.21.15.57:0/3572838125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f815d500 0x7f41f806ba40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f41f40097c0 tx=0x7f41f401ec70 comp rx=0 tx=0).stop 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 -- 172.21.15.57:0/3572838125 shutdown_connections 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 --2- 172.21.15.57:0/3572838125 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f806bf80 0x7f41f80b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 --2- 172.21.15.57:0/3572838125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f815d500 0x7f41f806ba40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 -- 172.21.15.57:0/3572838125 >> 172.21.15.57:0/3572838125 conn(0x7f41f80613d0 msgr2=0x7f41f80617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 -- 172.21.15.57:0/3572838125 shutdown_connections 2023-11-24T08:05:08.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.062+0000 7f41feba0640 1 -- 172.21.15.57:0/3572838125 wait complete. 2023-11-24T08:05:08.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 Processor -- start 2023-11-24T08:05:08.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 -- start start 2023-11-24T08:05:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f806bf80 0x7f41f80d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41f80b8f90 0x7f41f80cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f815d500 0x7f41f80cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80ca6d0 con 0x7f41f80b8f90 2023-11-24T08:05:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80ccc80 con 0x7f41f806bf80 2023-11-24T08:05:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80cc070 con 0x7f41f815d500 2023-11-24T08:05:08.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41f80b8f90 0x7f41f80cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41f80b8f90 0x7f41f80cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42290/0 (socket says 172.21.15.57:42290) 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 -- 172.21.15.57:0/2223225779 learned_addr learned my addr 172.21.15.57:0/2223225779 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fe39f640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f815d500 0x7f41f80cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 -- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f815d500 msgr2=0x7f41f80cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f815d500 0x7f41f80cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 -- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f806bf80 msgr2=0x7f41f80d2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f806bf80 0x7f41f80d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 -- 172.21.15.57:0/2223225779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009420 con 0x7f41f80b8f90 2023-11-24T08:05:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41fd39d640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41f80b8f90 0x7f41f80cb4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f41e80011f0 tx=0x7f41e800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41ee7fc640 1 -- 172.21.15.57:0/2223225779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e80074e0 con 0x7f41f80b8f90 2023-11-24T08:05:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41ee7fc640 1 -- 172.21.15.57:0/2223225779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e8007640 con 0x7f41f80b8f90 2023-11-24T08:05:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f80cc350 con 0x7f41f80b8f90 2023-11-24T08:05:08.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41ee7fc640 1 -- 172.21.15.57:0/2223225779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8004a10 con 0x7f41f80b8f90 2023-11-24T08:05:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.066+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f80cc910 con 0x7f41f80b8f90 2023-11-24T08:05:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.070+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f804e850 con 0x7f41f80b8f90 2023-11-24T08:05:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.070+0000 7f41ee7fc640 1 -- 172.21.15.57:0/2223225779 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f41e8004b70 con 0x7f41f80b8f90 2023-11-24T08:05:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.070+0000 7f41ee7fc640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41dc066620 0x7f41dc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.070+0000 7f41ee7fc640 1 -- 172.21.15.57:0/2223225779 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41e8083690 con 0x7f41f80b8f90 2023-11-24T08:05:08.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.074+0000 7f41fdb9e640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41dc066620 0x7f41dc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.074+0000 7f41fdb9e640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41dc066620 0x7f41dc068ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f41f40b2000 tx=0x7f41f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.074+0000 7f41ee7fc640 1 -- 172.21.15.57:0/2223225779 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41e8050930 con 0x7f41f80b8f90 2023-11-24T08:05:08.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41f80cce10 con 0x7f41f80b8f90 2023-11-24T08:05:08.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41ee7fc640 1 -- 172.21.15.57:0/2223225779 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41e8018020 con 0x7f41f80b8f90 2023-11-24T08:05:08.239 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:05:08.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41dc066620 msgr2=0x7f41dc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41dc066620 0x7f41dc068ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f41f40b2000 tx=0x7f41f4008040 comp rx=0 tx=0).stop 2023-11-24T08:05:08.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41f80b8f90 msgr2=0x7f41f80cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41f80b8f90 0x7f41f80cb4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f41e80011f0 tx=0x7f41e800c9b0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 shutdown_connections 2023-11-24T08:05:08.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41dc066620 0x7f41dc068ae0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f815d500 0x7f41f80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41f80b8f90 0x7f41f80cb4b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 --2- 172.21.15.57:0/2223225779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f806bf80 0x7f41f80d2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 >> 172.21.15.57:0/2223225779 conn(0x7f41f80613d0 msgr2=0x7f41f80617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 shutdown_connections 2023-11-24T08:05:08.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.234+0000 7f41feba0640 1 -- 172.21.15.57:0/2223225779 wait complete. 2023-11-24T08:05:08.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:08.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2623de7640 1 Processor -- start 2023-11-24T08:05:08.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2623de7640 1 -- start start 2023-11-24T08:05:08.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2623de7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f261c06f580 0x7f261c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2623de7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0616b0 con 0x7f261c06b9b0 2023-11-24T08:05:08.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2623de7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0b4750 con 0x7f261c15d7b0 2023-11-24T08:05:08.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2623de7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0b28a0 con 0x7f261c06f580 2023-11-24T08:05:08.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2622384640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f261c06b9b0 0x7f261c15db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60582/0 (socket says 172.21.15.57:60582) 2023-11-24T08:05:08.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2622384640 1 -- 172.21.15.57:0/572605858 learned_addr learned my addr 172.21.15.57:0/572605858 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:08.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.398+0000 7f2621382640 1 --2- 172.21.15.57:0/572605858 >> v2:172.21.15.132:3300/0 conn(0x7f261c06f580 0x7f261c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177704895 0 0) 0x7f261c0616b0 con 0x7f261c06b9b0 2023-11-24T08:05:08.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2608003530 con 0x7f261c06b9b0 2023-11-24T08:05:08.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817505048 0 0) 0x7f261c0b4750 con 0x7f261c15d7b0 2023-11-24T08:05:08.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f261c0616b0 con 0x7f261c15d7b0 2023-11-24T08:05:08.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2009430761 0 0) 0x7f2608003530 con 0x7f261c06b9b0 2023-11-24T08:05:08.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 >> v2:172.21.15.132:3300/0 conn(0x7f261c06f580 msgr2=0x7f261c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 --2- 172.21.15.57:0/572605858 >> v2:172.21.15.132:3300/0 conn(0x7f261c06f580 0x7f261c06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 >> v1:172.21.15.132:6789/0 conn(0x7f261c15d7b0 legacy=0x7f261c06b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0b2b80 con 0x7f261c06b9b0 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f2614001a00 con 0x7f261c06b9b0 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 >> v1:172.21.15.57:6789/0 conn(0x7f261c06b9b0 legacy=0x7f261c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2608003b10 0x7f2608003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26080047d0 0x7f2608004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f260800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b28a0 con 0x7f2608005190 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260800c0c0 con 0x7f2608003b10 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260800c280 con 0x7f26080047d0 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2622384640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f260800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2621b83640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2608003b10 0x7f2608003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2621382640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26080047d0 0x7f2608004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2622384640 1 -- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26080047d0 msgr2=0x7f2608004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2622384640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26080047d0 0x7f2608004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2622384640 1 -- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2608003b10 msgr2=0x7f2608003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2622384640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2608003b10 0x7f2608003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2622384640 1 -- 172.21.15.57:0/572605858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608003530 con 0x7f2608005190 2023-11-24T08:05:08.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2621382640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26080047d0 0x7f2608004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:08.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.402+0000 7f2622384640 1 -- 172.21.15.57:0/572605858 reap_dead start 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2622384640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f260800b990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f261400a7a0 tx=0x7f261401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09352842dd2cc97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26140ac620 con 0x7f2608005190 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26140a8070 con 0x7f2608005190 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2620b81640 1 -- 172.21.15.57:0/572605858 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26140ac9e0 con 0x7f2608005190 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- 172.21.15.57:0/572605858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 msgr2=0x7f260800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f260800b990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f261400a7a0 tx=0x7f261401d2a0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- 172.21.15.57:0/572605858 shutdown_connections 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 --2- 172.21.15.57:0/572605858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f260800b990 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- 172.21.15.57:0/572605858 >> 172.21.15.57:0/572605858 conn(0x7f261c0cc390 msgr2=0x7f261c0cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- 172.21.15.57:0/572605858 shutdown_connections 2023-11-24T08:05:08.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- 172.21.15.57:0/572605858 wait complete. 2023-11-24T08:05:08.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 Processor -- start 2023-11-24T08:05:08.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- start start 2023-11-24T08:05:08.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f261c151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f261c0ae0e0 0x7f261c157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f261c0ae540 0x7f261c158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c1570b0 con 0x7f2608005190 2023-11-24T08:05:08.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c156470 con 0x7f261c0ae0e0 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.406+0000 7f2623de7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c156710 con 0x7f261c0ae540 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f261c151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f261c151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42312/0 (socket says 172.21.15.57:42312) 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 -- 172.21.15.57:0/3297710669 learned_addr learned my addr 172.21.15.57:0/3297710669 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621382640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f261c0ae0e0 0x7f261c157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2622384640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f261c0ae540 0x7f261c158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 -- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f261c0ae540 msgr2=0x7f261c158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f261c0ae540 0x7f261c158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 -- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f261c0ae0e0 msgr2=0x7f261c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f261c0ae0e0 0x7f261c157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 -- 172.21.15.57:0/3297710669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c06bf60 con 0x7f2608005190 2023-11-24T08:05:08.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2621b83640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f261c151540 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2618012830 tx=0x7f2618012cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f26127fc640 1 -- 172.21.15.57:0/3297710669 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618012ee0 con 0x7f2608005190 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f26127fc640 1 -- 172.21.15.57:0/3297710669 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618010bf0 con 0x7f2608005190 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f26127fc640 1 -- 172.21.15.57:0/3297710669 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618016480 con 0x7f2608005190 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c1569f0 con 0x7f2608005190 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c151a80 con 0x7f2608005190 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c157320 con 0x7f2608005190 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f26127fc640 1 -- 172.21.15.57:0/3297710669 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f26180165e0 con 0x7f2608005190 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f26127fc640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2600066620 0x7f2600068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.410+0000 7f26127fc640 1 -- 172.21.15.57:0/3297710669 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2618087a50 con 0x7f2608005190 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.414+0000 7f2621382640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2600066620 0x7f2600068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.414+0000 7f2621382640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2600066620 0x7f2600068ae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f261c0b2f00 tx=0x7f260c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.414+0000 7f26127fc640 1 -- 172.21.15.57:0/3297710669 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2618054bb0 con 0x7f2608005190 2023-11-24T08:05:08.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f261c072850 con 0x7f2608005190 2023-11-24T08:05:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f26127fc640 1 -- 172.21.15.57:0/3297710669 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f26180581d0 con 0x7f2608005190 2023-11-24T08:05:08.592 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:05:08.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2600066620 msgr2=0x7f2600068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2600066620 0x7f2600068ae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f261c0b2f00 tx=0x7f260c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:08.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 msgr2=0x7f261c151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f261c151540 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2618012830 tx=0x7f2618012cf0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 shutdown_connections 2023-11-24T08:05:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2600066620 0x7f2600068ae0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f261c0ae540 0x7f261c158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f261c0ae0e0 0x7f261c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 --2- 172.21.15.57:0/3297710669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2608005190 0x7f261c151540 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 >> 172.21.15.57:0/3297710669 conn(0x7f261c0cc390 msgr2=0x7f261c06e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 shutdown_connections 2023-11-24T08:05:08.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.586+0000 7f2623de7640 1 -- 172.21.15.57:0/3297710669 wait complete. 2023-11-24T08:05:08.612 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:05:08.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:08.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:08.651 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:05:08.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:08.651 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:05:08.702 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:08.703 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:08.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:05:08.712 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:08.712 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:08.754 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:05:08.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:08.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22ea17640 1 Processor -- start 2023-11-24T08:05:08.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22ea17640 1 -- start start 2023-11-24T08:05:08.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22ea17640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe22815a320 0x7fe2280b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22ea17640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe228070da0 0x7fe2280711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22ea17640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22815a700 con 0x7fe2280b36c0 2023-11-24T08:05:08.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22ea17640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2280b2430 con 0x7fe228070da0 2023-11-24T08:05:08.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22ea17640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2280b2620 con 0x7fe22815a320 2023-11-24T08:05:08.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22cfb4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe228070da0 0x7fe2280711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22cfb4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe228070da0 0x7fe2280711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42322/0 (socket says 172.21.15.57:42322) 2023-11-24T08:05:08.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22cfb4640 1 -- 172.21.15.57:0/1682090876 learned_addr learned my addr 172.21.15.57:0/1682090876 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:08.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe227fff640 1 --2- 172.21.15.57:0/1682090876 >> v2:172.21.15.132:3300/0 conn(0x7fe22815a320 0x7fe2280b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22cfb4640 1 -- 172.21.15.57:0/1682090876 >> v2:172.21.15.132:3300/0 conn(0x7fe22815a320 msgr2=0x7fe2280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22cfb4640 1 --2- 172.21.15.57:0/1682090876 >> v2:172.21.15.132:3300/0 conn(0x7fe22815a320 0x7fe2280b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22cfb4640 1 -- 172.21.15.57:0/1682090876 >> v1:172.21.15.132:6789/0 conn(0x7fe2280b36c0 legacy=0x7fe228070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.898+0000 7fe22cfb4640 1 -- 172.21.15.57:0/1682090876 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2280b2900 con 0x7fe228070da0 2023-11-24T08:05:08.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22cfb4640 1 --2- 172.21.15.57:0/1682090876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe228070da0 0x7fe2280711f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe22806c0c0 tx=0x7fe22001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d505817d64e8121 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe226ffd640 1 -- 172.21.15.57:0/1682090876 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200a5720 con 0x7fe228070da0 2023-11-24T08:05:08.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe226ffd640 1 -- 172.21.15.57:0/1682090876 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2200a5880 con 0x7fe228070da0 2023-11-24T08:05:08.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe226ffd640 1 -- 172.21.15.57:0/1682090876 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200a5c10 con 0x7fe228070da0 2023-11-24T08:05:08.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 -- 172.21.15.57:0/1682090876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe228070da0 msgr2=0x7fe2280711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 --2- 172.21.15.57:0/1682090876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe228070da0 0x7fe2280711f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe22806c0c0 tx=0x7fe22001c960 comp rx=0 tx=0).stop 2023-11-24T08:05:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 -- 172.21.15.57:0/1682090876 shutdown_connections 2023-11-24T08:05:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 --2- 172.21.15.57:0/1682090876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe228070da0 0x7fe2280711f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 --2- 172.21.15.57:0/1682090876 >> v2:172.21.15.132:3300/0 conn(0x7fe22815a320 0x7fe2280b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 -- 172.21.15.57:0/1682090876 >> 172.21.15.57:0/1682090876 conn(0x7fe2280b0bf0 msgr2=0x7fe2280b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 -- 172.21.15.57:0/1682090876 shutdown_connections 2023-11-24T08:05:08.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.902+0000 7fe22ea17640 1 -- 172.21.15.57:0/1682090876 wait complete. 2023-11-24T08:05:08.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 Processor -- start 2023-11-24T08:05:08.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 -- start start 2023-11-24T08:05:08.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe228070da0 0x7fe22814aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2280b36c0 0x7fe22814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe22815a320 0x7fe228149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22814bf20 con 0x7fe22815a320 2023-11-24T08:05:08.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22814b310 con 0x7fe228070da0 2023-11-24T08:05:08.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22814b5f0 con 0x7fe2280b36c0 2023-11-24T08:05:08.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe22815a320 0x7fe228149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe22815a320 0x7fe228149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42332/0 (socket says 172.21.15.57:42332) 2023-11-24T08:05:08.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 -- 172.21.15.57:0/4267535026 learned_addr learned my addr 172.21.15.57:0/4267535026 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:08.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe227fff640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe228070da0 0x7fe22814aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe2277fe640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2280b36c0 0x7fe22814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 -- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2280b36c0 msgr2=0x7fe22814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2280b36c0 0x7fe22814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 -- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe228070da0 msgr2=0x7fe22814aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe228070da0 0x7fe22814aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 -- 172.21.15.57:0/4267535026 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220009b30 con 0x7fe22815a320 2023-11-24T08:05:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe227fff640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe228070da0 0x7fe22814aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe2277fe640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2280b36c0 0x7fe22814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22cfb4640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe22815a320 0x7fe228149430 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2200af040 tx=0x7fe220019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe224ff9640 1 -- 172.21.15.57:0/4267535026 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200b8670 con 0x7fe22815a320 2023-11-24T08:05:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe224ff9640 1 -- 172.21.15.57:0/4267535026 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2200b87d0 con 0x7fe22815a320 2023-11-24T08:05:08.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe224ff9640 1 -- 172.21.15.57:0/4267535026 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200b8b60 con 0x7fe22815a320 2023-11-24T08:05:08.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22814b8d0 con 0x7fe22815a320 2023-11-24T08:05:08.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.906+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2281560e0 con 0x7fe22815a320 2023-11-24T08:05:08.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.910+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22806e6d0 con 0x7fe22815a320 2023-11-24T08:05:08.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.910+0000 7fe224ff9640 1 -- 172.21.15.57:0/4267535026 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe2200b8cc0 con 0x7fe22815a320 2023-11-24T08:05:08.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.910+0000 7fe224ff9640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe214066620 0x7fe214068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.910+0000 7fe224ff9640 1 -- 172.21.15.57:0/4267535026 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe22011f780 con 0x7fe22815a320 2023-11-24T08:05:08.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.910+0000 7fe227fff640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe214066620 0x7fe214068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.910+0000 7fe227fff640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe214066620 0x7fe214068ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe2180097a0 tx=0x7fe218008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:08.914+0000 7fe224ff9640 1 -- 172.21.15.57:0/4267535026 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2200ecae0 con 0x7fe22815a320 2023-11-24T08:05:09.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.102+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe228067520 con 0x7fe22815a320 2023-11-24T08:05:09.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.102+0000 7fe224ff9640 1 -- 172.21.15.57:0/4267535026 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fe2200f0100 con 0x7fe22815a320 2023-11-24T08:05:09.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:09.109 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2109788946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2109788946},{"type":"v1","addr":"172.21.15.132:6835","nonce":2109788946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3040903718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3040903718},{"type":"v1","addr":"172.21.15.57:6834","nonce":3040903718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/412231567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":412231567},{"type":"v1","addr":"172.21.15.57:6835","nonce":412231567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:52.236854+0000","modified":"2023-11-24T08:04:55.272383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54689},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54689":{"gid":54689,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/404616365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":404616365},{"type":"v1","addr":"172.21.15.132:6837","nonce":404616365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:09.110 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2023-11-24T08:05:09.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe214066620 msgr2=0x7fe214068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe214066620 0x7fe214068ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe2180097a0 tx=0x7fe218008040 comp rx=0 tx=0).stop 2023-11-24T08:05:09.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe22815a320 msgr2=0x7fe228149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe22815a320 0x7fe228149430 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2200af040 tx=0x7fe220019700 comp rx=0 tx=0).stop 2023-11-24T08:05:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 shutdown_connections 2023-11-24T08:05:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe214066620 0x7fe214068ae0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe22815a320 0x7fe228149430 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2280b36c0 0x7fe22814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 --2- 172.21.15.57:0/4267535026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe228070da0 0x7fe22814aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 >> 172.21.15.57:0/4267535026 conn(0x7fe2280b0bf0 msgr2=0x7fe2280b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 shutdown_connections 2023-11-24T08:05:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.106+0000 7fe22ea17640 1 -- 172.21.15.57:0/4267535026 wait complete. 2023-11-24T08:05:09.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:09.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d832a640 1 Processor -- start 2023-11-24T08:05:09.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d832a640 1 -- start start 2023-11-24T08:05:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d832a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 0x7fd2d006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d832a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2d00709c0 0x7fd2d0070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d832a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d006d8b0 con 0x7fd2d009cc20 2023-11-24T08:05:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d832a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d0145020 con 0x7fd2d00709c0 2023-11-24T08:05:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d832a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d009d0a0 con 0x7fd2d0144030 2023-11-24T08:05:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d68c7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2d00709c0 0x7fd2d0070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d68c7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2d00709c0 0x7fd2d0070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42344/0 (socket says 172.21.15.57:42344) 2023-11-24T08:05:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d68c7640 1 -- 172.21.15.57:0/2914008641 learned_addr learned my addr 172.21.15.57:0/2914008641 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d58c5640 1 --1- 172.21.15.57:0/2914008641 >> v1:172.21.15.57:6789/0 conn(0x7fd2d009cc20 0x7fd2d006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60588/0 (socket says 172.21.15.57:60588) 2023-11-24T08:05:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d68c7640 1 -- 172.21.15.57:0/2914008641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 msgr2=0x7fd2d006c650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:05:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d68c7640 1 --2- 172.21.15.57:0/2914008641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 0x7fd2d006c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d68c7640 1 -- 172.21.15.57:0/2914008641 >> v1:172.21.15.57:6789/0 conn(0x7fd2d009cc20 legacy=0x7fd2d006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.270+0000 7fd2d68c7640 1 -- 172.21.15.57:0/2914008641 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0071390 con 0x7fd2d00709c0 2023-11-24T08:05:09.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d68c7640 1 --2- 172.21.15.57:0/2914008641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d00709c0 0x7fd2d0070e50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39aeb7f494a408a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d50c4640 1 -- 172.21.15.57:0/2914008641 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80a58d0 con 0x7fd2d00709c0 2023-11-24T08:05:09.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d50c4640 1 -- 172.21.15.57:0/2914008641 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c80a5a30 con 0x7fd2d00709c0 2023-11-24T08:05:09.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d50c4640 1 -- 172.21.15.57:0/2914008641 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80a5dc0 con 0x7fd2d00709c0 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 -- 172.21.15.57:0/2914008641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d00709c0 msgr2=0x7fd2d0070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 --2- 172.21.15.57:0/2914008641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d00709c0 0x7fd2d0070e50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009e50 tx=0x7fd2c801ca00 comp rx=0 tx=0).stop 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 -- 172.21.15.57:0/2914008641 shutdown_connections 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 --2- 172.21.15.57:0/2914008641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d00709c0 0x7fd2d0070e50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 --2- 172.21.15.57:0/2914008641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 0x7fd2d006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 -- 172.21.15.57:0/2914008641 >> 172.21.15.57:0/2914008641 conn(0x7fd2d00b0bf0 msgr2=0x7fd2d00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 -- 172.21.15.57:0/2914008641 shutdown_connections 2023-11-24T08:05:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.274+0000 7fd2d832a640 1 -- 172.21.15.57:0/2914008641 wait complete. 2023-11-24T08:05:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 Processor -- start 2023-11-24T08:05:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 -- start start 2023-11-24T08:05:09.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d00709c0 0x7fd2d00af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d009cc20 0x7fd2d01f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 0x7fd2d01f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00b3c30 con 0x7fd2d009cc20 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01f6280 con 0x7fd2d00709c0 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01f6560 con 0x7fd2d0144030 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d009cc20 0x7fd2d01f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d009cc20 0x7fd2d01f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42358/0 (socket says 172.21.15.57:42358) 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 -- 172.21.15.57:0/4235333305 learned_addr learned my addr 172.21.15.57:0/4235333305 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d68c7640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 0x7fd2d01f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d60c6640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d00709c0 0x7fd2d00af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 -- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 msgr2=0x7fd2d01f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 0x7fd2d01f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 -- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d00709c0 msgr2=0x7fd2d00af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d00709c0 0x7fd2d00af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 -- 172.21.15.57:0/4235333305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009b30 con 0x7fd2d009cc20 2023-11-24T08:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d58c5640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d009cc20 0x7fd2d01f5a00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c490 tx=0x7fd2c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2c6ffd640 1 -- 172.21.15.57:0/4235333305 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0007480 con 0x7fd2d009cc20 2023-11-24T08:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2c6ffd640 1 -- 172.21.15.57:0/4235333305 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c00075e0 con 0x7fd2d009cc20 2023-11-24T08:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d01f6840 con 0x7fd2d009cc20 2023-11-24T08:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2c6ffd640 1 -- 172.21.15.57:0/4235333305 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0004a10 con 0x7fd2d009cc20 2023-11-24T08:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.278+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d01f92e0 con 0x7fd2d009cc20 2023-11-24T08:05:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.282+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d01f9500 con 0x7fd2d009cc20 2023-11-24T08:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.282+0000 7fd2c6ffd640 1 -- 172.21.15.57:0/4235333305 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fd2c0004b70 con 0x7fd2d009cc20 2023-11-24T08:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.282+0000 7fd2c6ffd640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2b4066620 0x7fd2b4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.282+0000 7fd2c6ffd640 1 -- 172.21.15.57:0/4235333305 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2c0083490 con 0x7fd2d009cc20 2023-11-24T08:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.282+0000 7fd2d60c6640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2b4066620 0x7fd2b4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.282+0000 7fd2d60c6640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2b4066620 0x7fd2b4068ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0098e0 tx=0x7fd2cc009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.286+0000 7fd2c6ffd640 1 -- 172.21.15.57:0/4235333305 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2c00507e0 con 0x7fd2d009cc20 2023-11-24T08:05:09.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.446+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2d0067520 con 0x7fd2d009cc20 2023-11-24T08:05:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.446+0000 7fd2c6ffd640 1 -- 172.21.15.57:0/4235333305 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16509 (secure 0 0 0) 0x7fd2c0053e00 con 0x7fd2d009cc20 2023-11-24T08:05:09.453 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:09.453 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:53.859168+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2b4066620 msgr2=0x7fd2b4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2b4066620 0x7fd2b4068ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0098e0 tx=0x7fd2cc009060 comp rx=0 tx=0).stop 2023-11-24T08:05:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d009cc20 msgr2=0x7fd2d01f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d009cc20 0x7fd2d01f5a00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c490 tx=0x7fd2c000c950 comp rx=0 tx=0).stop 2023-11-24T08:05:09.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 shutdown_connections 2023-11-24T08:05:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd2b4066620 0x7fd2b4068ae0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d0144030 0x7fd2d01f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2d009cc20 0x7fd2d01f5a00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 --2- 172.21.15.57:0/4235333305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d00709c0 0x7fd2d00af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 >> 172.21.15.57:0/4235333305 conn(0x7fd2d00b0bf0 msgr2=0x7fd2d00723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 shutdown_connections 2023-11-24T08:05:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.450+0000 7fd2d832a640 1 -- 172.21.15.57:0/4235333305 wait complete. 2023-11-24T08:05:09.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:50.817810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:51.228710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:09.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:09.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.614+0000 7f4ecf35f640 1 Processor -- start 2023-11-24T08:05:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.614+0000 7f4ecf35f640 1 -- start start 2023-11-24T08:05:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ecf35f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ec8160970 0x7f4ec80d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ecf35f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ec80d1de0 0x7f4ec80cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ecf35f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80cf0a0 con 0x7f4ec80cdc60 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ecf35f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80ce490 con 0x7f4ec8160970 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ecf35f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80ce770 con 0x7f4ec80d1de0 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ece35d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ec8160970 0x7f4ec80d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ece35d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ec8160970 0x7f4ec80d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42362/0 (socket says 172.21.15.57:42362) 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ece35d640 1 -- 172.21.15.57:0/3279654797 learned_addr learned my addr 172.21.15.57:0/3279654797 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ecdb5c640 1 --1- 172.21.15.57:0/3279654797 >> v1:172.21.15.57:6789/0 conn(0x7f4ec80cdc60 0x7f4ec80d16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60598/0 (socket says 172.21.15.57:60598) 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4eceb5e640 1 --2- 172.21.15.57:0/3279654797 >> v2:172.21.15.132:3300/0 conn(0x7f4ec80d1de0 0x7f4ec80cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ece35d640 1 -- 172.21.15.57:0/3279654797 >> v2:172.21.15.132:3300/0 conn(0x7f4ec80d1de0 msgr2=0x7f4ec80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ece35d640 1 --2- 172.21.15.57:0/3279654797 >> v2:172.21.15.132:3300/0 conn(0x7f4ec80d1de0 0x7f4ec80cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ece35d640 1 -- 172.21.15.57:0/3279654797 >> v1:172.21.15.57:6789/0 conn(0x7f4ec80cdc60 legacy=0x7f4ec80d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.618+0000 7f4ece35d640 1 -- 172.21.15.57:0/3279654797 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80cea50 con 0x7f4ec8160970 2023-11-24T08:05:09.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ece35d640 1 --2- 172.21.15.57:0/3279654797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec8160970 0x7f4ec80d3d20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80b4920 tx=0x7f4ec401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8a564a54267795 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecd35b640 1 -- 172.21.15.57:0/3279654797 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40aa650 con 0x7f4ec8160970 2023-11-24T08:05:09.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecd35b640 1 -- 172.21.15.57:0/3279654797 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40aa7b0 con 0x7f4ec8160970 2023-11-24T08:05:09.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecd35b640 1 -- 172.21.15.57:0/3279654797 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40aab40 con 0x7f4ec8160970 2023-11-24T08:05:09.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3279654797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec8160970 msgr2=0x7f4ec80d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3279654797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec8160970 0x7f4ec80d3d20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80b4920 tx=0x7f4ec401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3279654797 shutdown_connections 2023-11-24T08:05:09.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3279654797 >> v2:172.21.15.132:3300/0 conn(0x7f4ec80d1de0 0x7f4ec80cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3279654797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec8160970 0x7f4ec80d3d20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3279654797 >> 172.21.15.57:0/3279654797 conn(0x7f4ec809c5c0 msgr2=0x7f4ec80d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3279654797 shutdown_connections 2023-11-24T08:05:09.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3279654797 wait complete. 2023-11-24T08:05:09.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 Processor -- start 2023-11-24T08:05:09.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- start start 2023-11-24T08:05:09.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ec80cdc60 0x7f4ec81f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec80d1de0 0x7f4ec814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ec8160970 0x7f4ec814f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec814f400 con 0x7f4ec80d1de0 2023-11-24T08:05:09.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec814fe10 con 0x7f4ec8160970 2023-11-24T08:05:09.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.622+0000 7f4ecf35f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8150290 con 0x7f4ec80cdc60 2023-11-24T08:05:09.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec80d1de0 0x7f4ec814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec80d1de0 0x7f4ec814eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42374/0 (socket says 172.21.15.57:42374) 2023-11-24T08:05:09.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 -- 172.21.15.57:0/3297646421 learned_addr learned my addr 172.21.15.57:0/3297646421 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:09.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ece35d640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ec80cdc60 0x7f4ec81f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4eceb5e640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ec8160970 0x7f4ec814f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 -- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ec80cdc60 msgr2=0x7f4ec81f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ec80cdc60 0x7f4ec81f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 -- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ec8160970 msgr2=0x7f4ec814f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ec8160970 0x7f4ec814f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 -- 172.21.15.57:0/3297646421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40094d0 con 0x7f4ec80d1de0 2023-11-24T08:05:09.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecdb5c640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec80d1de0 0x7f4ec814eec0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800c4c0 tx=0x7f4eb800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ebeffd640 1 -- 172.21.15.57:0/3297646421 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8007480 con 0x7f4ec80d1de0 2023-11-24T08:05:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ebeffd640 1 -- 172.21.15.57:0/3297646421 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80075e0 con 0x7f4ec80d1de0 2023-11-24T08:05:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec815ae60 con 0x7f4ec80d1de0 2023-11-24T08:05:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ebeffd640 1 -- 172.21.15.57:0/3297646421 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8004a10 con 0x7f4ec80d1de0 2023-11-24T08:05:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec815b420 con 0x7f4ec80d1de0 2023-11-24T08:05:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec804e850 con 0x7f4ec80d1de0 2023-11-24T08:05:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ebeffd640 1 -- 172.21.15.57:0/3297646421 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f4eb8004b70 con 0x7f4ec80d1de0 2023-11-24T08:05:09.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.626+0000 7f4ebeffd640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4eac066620 0x7f4eac068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.630+0000 7f4ebeffd640 1 -- 172.21.15.57:0/3297646421 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4eb8083210 con 0x7f4ec80d1de0 2023-11-24T08:05:09.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.630+0000 7f4ece35d640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4eac066620 0x7f4eac068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.630+0000 7f4ece35d640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4eac066620 0x7f4eac068ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40ae000 tx=0x7f4ec40b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.630+0000 7f4ebeffd640 1 -- 172.21.15.57:0/3297646421 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4eb8050560 con 0x7f4ec80d1de0 2023-11-24T08:05:09.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.790+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ec80d12a0 con 0x7f4ec80d1de0 2023-11-24T08:05:09.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.790+0000 7f4ebeffd640 1 -- 172.21.15.57:0/3297646421 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4eb8053b80 con 0x7f4ec80d1de0 2023-11-24T08:05:09.795 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:05:09.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.790+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4eac066620 msgr2=0x7f4eac068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.790+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4eac066620 0x7f4eac068ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40ae000 tx=0x7f4ec40b5040 comp rx=0 tx=0).stop 2023-11-24T08:05:09.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.790+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec80d1de0 msgr2=0x7f4ec814eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.790+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec80d1de0 0x7f4ec814eec0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800c4c0 tx=0x7f4eb800c980 comp rx=0 tx=0).stop 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 shutdown_connections 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4eac066620 0x7f4eac068ae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ec8160970 0x7f4ec814f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ec80d1de0 0x7f4ec814eec0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 --2- 172.21.15.57:0/3297646421 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ec80cdc60 0x7f4ec81f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 >> 172.21.15.57:0/3297646421 conn(0x7f4ec809c5c0 msgr2=0x7f4ec80b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 shutdown_connections 2023-11-24T08:05:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.794+0000 7f4ecf35f640 1 -- 172.21.15.57:0/3297646421 wait complete. 2023-11-24T08:05:09.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:09.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9ac1432640 1 Processor -- start 2023-11-24T08:05:09.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9ac1432640 1 -- start start 2023-11-24T08:05:09.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9ac1432640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9abc0b1f80 0x7f9abc0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9ac1432640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9abc070f00 con 0x7f9abc15a290 2023-11-24T08:05:09.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9ac1432640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9abc071170 con 0x7f9abc15ec60 2023-11-24T08:05:09.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9ac1432640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9abc0cb690 con 0x7f9abc0b1f80 2023-11-24T08:05:09.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9abaffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9abc15a290 0x7f9abc0707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60604/0 (socket says 172.21.15.57:60604) 2023-11-24T08:05:09.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9abaffd640 1 -- 172.21.15.57:0/2333967699 learned_addr learned my addr 172.21.15.57:0/2333967699 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9abb7fe640 1 --2- 172.21.15.57:0/2333967699 >> v2:172.21.15.132:3300/0 conn(0x7f9abc0b1f80 0x7f9abc0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238297024 0 0) 0x7f9abc070f00 con 0x7f9abc15a290 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa8003530 con 0x7f9abc15a290 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096421253 0 0) 0x7f9aa8003530 con 0x7f9abc15a290 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 >> v2:172.21.15.132:3300/0 conn(0x7f9abc0b1f80 msgr2=0x7f9abc0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 --2- 172.21.15.57:0/2333967699 >> v2:172.21.15.132:3300/0 conn(0x7f9abc0b1f80 0x7f9abc0b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 >> v1:172.21.15.132:6789/0 conn(0x7f9abc15ec60 legacy=0x7f9abc0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0cb970 con 0x7f9abc15a290 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f9aac001680 con 0x7f9abc15a290 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 >> v1:172.21.15.57:6789/0 conn(0x7f9abc15a290 legacy=0x7f9abc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9aa8003980 0x7f9aa8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aa80047d0 0x7f9aa8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa8005190 0x7f9aa800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0cb690 con 0x7f9aa80047d0 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa800e340 con 0x7f9aa8005190 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa800e500 con 0x7f9aa8003980 2023-11-24T08:05:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.958+0000 7f9ab3fff640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aa80047d0 0x7f9aa8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9abb7fe640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa8005190 0x7f9aa800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9abaffd640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9aa8003980 0x7f9aa8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9ab3fff640 1 -- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9aa8003980 msgr2=0x7f9aa8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9ab3fff640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9aa8003980 0x7f9aa8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9ab3fff640 1 -- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa8005190 msgr2=0x7f9aa800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9ab3fff640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa8005190 0x7f9aa800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9ab3fff640 1 -- 172.21.15.57:0/2333967699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8003530 con 0x7f9aa80047d0 2023-11-24T08:05:09.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9abb7fe640 1 -- 172.21.15.57:0/2333967699 reap_dead start 2023-11-24T08:05:09.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9ab3fff640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aa80047d0 0x7f9aa8004c50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4001750 tx=0x7f9aa401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0586790b690a9f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40052d0 con 0x7f9aa80047d0 2023-11-24T08:05:09.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40a7050 con 0x7f9aa80047d0 2023-11-24T08:05:09.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.962+0000 7f9aba7fc640 1 -- 172.21.15.57:0/2333967699 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4003600 con 0x7f9aa80047d0 2023-11-24T08:05:09.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- 172.21.15.57:0/2333967699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aa80047d0 msgr2=0x7f9aa8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aa80047d0 0x7f9aa8004c50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4001750 tx=0x7f9aa401c370 comp rx=0 tx=0).stop 2023-11-24T08:05:09.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- 172.21.15.57:0/2333967699 shutdown_connections 2023-11-24T08:05:09.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 --2- 172.21.15.57:0/2333967699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aa80047d0 0x7f9aa8004c50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- 172.21.15.57:0/2333967699 >> 172.21.15.57:0/2333967699 conn(0x7f9abc0b0c80 msgr2=0x7f9abc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- 172.21.15.57:0/2333967699 shutdown_connections 2023-11-24T08:05:09.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- 172.21.15.57:0/2333967699 wait complete. 2023-11-24T08:05:09.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 Processor -- start 2023-11-24T08:05:09.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- start start 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa80047d0 0x7f9abc14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9abc06d450 0x7f9abc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9abc1543e0 0x7f9abc154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc06de10 con 0x7f9abc06d450 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc1f3c50 con 0x7f9aa80047d0 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ac1432640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc14fde0 con 0x7f9abc1543e0 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9abc06d450 0x7f9abc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9abc06d450 0x7f9abc06d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42388/0 (socket says 172.21.15.57:42388) 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 -- 172.21.15.57:0/1946603896 learned_addr learned my addr 172.21.15.57:0/1946603896 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9abb7fe640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9abc1543e0 0x7f9abc154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9abaffd640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa80047d0 0x7f9abc14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 -- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9abc1543e0 msgr2=0x7f9abc154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9abc1543e0 0x7f9abc154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 -- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa80047d0 msgr2=0x7f9abc14f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa80047d0 0x7f9abc14f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 -- 172.21.15.57:0/1946603896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc1e61d0 con 0x7f9abc06d450 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9abaffd640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa80047d0 0x7f9abc14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.966+0000 7f9ab3fff640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9abc06d450 0x7f9abc06d8d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4005040 tx=0x7f9aa8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ab37fe640 1 -- 172.21.15.57:0/1946603896 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4007180 con 0x7f9abc06d450 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ab37fe640 1 -- 172.21.15.57:0/1946603896 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40072e0 con 0x7f9abc06d450 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc1e64b0 con 0x7f9abc06d450 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ab37fe640 1 -- 172.21.15.57:0/1946603896 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4007650 con 0x7f9abc06d450 2023-11-24T08:05:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc1e6a70 con 0x7f9abc06d450 2023-11-24T08:05:09.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc04e8c0 con 0x7f9abc06d450 2023-11-24T08:05:09.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ab37fe640 1 -- 172.21.15.57:0/1946603896 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f9aa40067e0 con 0x7f9abc06d450 2023-11-24T08:05:09.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ab37fe640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a9c066620 0x7f9a9c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9ab37fe640 1 -- 172.21.15.57:0/1946603896 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9aa411e4b0 con 0x7f9abc06d450 2023-11-24T08:05:09.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.970+0000 7f9abaffd640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a9c066620 0x7f9a9c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.974+0000 7f9abaffd640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a9c066620 0x7f9a9c068ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9abc1f5fe0 tx=0x7f9aac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:09.974+0000 7f9ab37fe640 1 -- 172.21.15.57:0/1946603896 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9aa40eb630 con 0x7f9abc06d450 2023-11-24T08:05:10.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.138+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9abc0cdee0 con 0x7f9abc06d450 2023-11-24T08:05:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.138+0000 7f9ab37fe640 1 -- 172.21.15.57:0/1946603896 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9aa40eec50 con 0x7f9abc06d450 2023-11-24T08:05:10.144 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:05:10.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a9c066620 msgr2=0x7f9a9c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a9c066620 0x7f9a9c068ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9abc1f5fe0 tx=0x7f9aac009040 comp rx=0 tx=0).stop 2023-11-24T08:05:10.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9abc06d450 msgr2=0x7f9abc06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9abc06d450 0x7f9abc06d8d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4005040 tx=0x7f9aa8005800 comp rx=0 tx=0).stop 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 shutdown_connections 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a9c066620 0x7f9a9c068ae0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9abc1543e0 0x7f9abc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9abc06d450 0x7f9abc06d8d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 --2- 172.21.15.57:0/1946603896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9aa80047d0 0x7f9abc14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 >> 172.21.15.57:0/1946603896 conn(0x7f9abc0b0c80 msgr2=0x7f9abc0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 shutdown_connections 2023-11-24T08:05:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.142+0000 7f9ac1432640 1 -- 172.21.15.57:0/1946603896 wait complete. 2023-11-24T08:05:10.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dbbf65640 1 Processor -- start 2023-11-24T08:05:10.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dbbf65640 1 -- start start 2023-11-24T08:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dbbf65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 0x7f9db40cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dbbf65640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db415dfd0 con 0x7f9db40cad30 2023-11-24T08:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dbbf65640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db40ae600 con 0x7f9db415a2a0 2023-11-24T08:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dbbf65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db415e220 con 0x7f9db406dd30 2023-11-24T08:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db9500640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9db40cad30 0x7f9db40cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60612/0 (socket says 172.21.15.57:60612) 2023-11-24T08:05:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db9500640 1 -- 172.21.15.57:0/3722592691 learned_addr learned my addr 172.21.15.57:0/3722592691 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dba502640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 0x7f9db40cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215522174 0 0) 0x7f9db415dfd0 con 0x7f9db40cad30 2023-11-24T08:05:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da0003530 con 0x7f9db40cad30 2023-11-24T08:05:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025453119 0 0) 0x7f9db40ae600 con 0x7f9db415a2a0 2023-11-24T08:05:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db415dfd0 con 0x7f9db415a2a0 2023-11-24T08:05:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3635979441 0 0) 0x7f9da0003530 con 0x7f9db40cad30 2023-11-24T08:05:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 msgr2=0x7f9db40cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 0x7f9db40cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 >> v1:172.21.15.132:6789/0 conn(0x7f9db415a2a0 legacy=0x7f9db406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db415e500 con 0x7f9db40cad30 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f9da4001680 con 0x7f9db40cad30 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9dba502640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 0x7f9db40cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 >> v1:172.21.15.57:6789/0 conn(0x7f9db40cad30 legacy=0x7f9db40cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da0003b40 0x7f9da0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da00047d0 0x7f9da0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 0x7f9da0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db415e220 con 0x7f9da0003b40 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da000dc00 con 0x7f9da00047d0 2023-11-24T08:05:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.306+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da000ddc0 con 0x7f9db406dd30 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9d01640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da0003b40 0x7f9da0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9dba502640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 0x7f9da0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9500640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da00047d0 0x7f9da0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9d01640 1 -- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 msgr2=0x7f9da0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9d01640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db406dd30 0x7f9da0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9d01640 1 -- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da00047d0 msgr2=0x7f9da0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9d01640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da00047d0 0x7f9da0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9d01640 1 -- 172.21.15.57:0/3722592691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac009a70 con 0x7f9da0003b40 2023-11-24T08:05:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9500640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da00047d0 0x7f9da0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:10.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db9d01640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da0003b40 0x7f9da0003f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9db0007fd0 tx=0x7f9db001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea3c64b49d1ae0f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00052d0 con 0x7f9da0003b40 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db00a7050 con 0x7f9da0003b40 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.310+0000 7f9db8cff640 1 -- 172.21.15.57:0/3722592691 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0003600 con 0x7f9da0003b40 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- 172.21.15.57:0/3722592691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da0003b40 msgr2=0x7f9da0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 --2- 172.21.15.57:0/3722592691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da0003b40 0x7f9da0003f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9db0007fd0 tx=0x7f9db001c4f0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dba502640 1 -- 172.21.15.57:0/3722592691 reap_dead start 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- 172.21.15.57:0/3722592691 shutdown_connections 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- 172.21.15.57:0/3722592691 >> 172.21.15.57:0/3722592691 conn(0x7f9db40b0d50 msgr2=0x7f9db40b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- 172.21.15.57:0/3722592691 shutdown_connections 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- 172.21.15.57:0/3722592691 wait complete. 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 Processor -- start 2023-11-24T08:05:10.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- start start 2023-11-24T08:05:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da0003b40 0x7f9db4099bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db4151c40 0x7f9db40abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9db40ac3f0 0x7f9db40ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4158550 con 0x7f9db40ac3f0 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40c6190 con 0x7f9da0003b40 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dbbf65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40c6470 con 0x7f9db4151c40 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dba502640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9db40ac3f0 0x7f9db40ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dba502640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9db40ac3f0 0x7f9db40ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42410/0 (socket says 172.21.15.57:42410) 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9dba502640 1 -- 172.21.15.57:0/2898782823 learned_addr learned my addr 172.21.15.57:0/2898782823 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9db9d01640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da0003b40 0x7f9db4099bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.314+0000 7f9db9500640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db4151c40 0x7f9db40abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dba502640 1 -- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db4151c40 msgr2=0x7f9db40abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dba502640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db4151c40 0x7f9db40abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dba502640 1 -- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da0003b40 msgr2=0x7f9db4099bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dba502640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da0003b40 0x7f9db4099bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dba502640 1 -- 172.21.15.57:0/2898782823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40c6750 con 0x7f9db40ac3f0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dba502640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9db40ac3f0 0x7f9db40ac870 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9db40b50b0 tx=0x7f9dac00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9daa7fc640 1 -- 172.21.15.57:0/2898782823 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00e040 con 0x7f9db40ac3f0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9daa7fc640 1 -- 172.21.15.57:0/2898782823 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00f040 con 0x7f9db40ac3f0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9daa7fc640 1 -- 172.21.15.57:0/2898782823 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac003de0 con 0x7f9db40ac3f0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40c6a30 con 0x7f9db40ac3f0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db4152a80 con 0x7f9db40ac3f0 2023-11-24T08:05:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db404e850 con 0x7f9db40ac3f0 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.318+0000 7f9daa7fc640 1 -- 172.21.15.57:0/2898782823 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f9dac003f40 con 0x7f9db40ac3f0 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.322+0000 7f9daa7fc640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d98066650 0x7f9d98068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.322+0000 7f9daa7fc640 1 -- 172.21.15.57:0/2898782823 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dac084b60 con 0x7f9db40ac3f0 2023-11-24T08:05:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.322+0000 7f9db9d01640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d98066650 0x7f9d98068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.322+0000 7f9db9d01640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d98066650 0x7f9d98068b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ac000 tx=0x7f9db00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.326+0000 7f9daa7fc640 1 -- 172.21.15.57:0/2898782823 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dac051da0 con 0x7f9db40ac3f0 2023-11-24T08:05:10.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.482+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9db40cd470 con 0x7f9db40ac3f0 2023-11-24T08:05:10.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.482+0000 7f9daa7fc640 1 -- 172.21.15.57:0/2898782823 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9dac0553c0 con 0x7f9db40ac3f0 2023-11-24T08:05:10.487 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:05:10.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.482+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d98066650 msgr2=0x7f9d98068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.482+0000 7f9dbbf65640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d98066650 0x7f9d98068b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ac000 tx=0x7f9db00a6000 comp rx=0 tx=0).stop 2023-11-24T08:05:10.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.482+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9db40ac3f0 msgr2=0x7f9db40ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.482+0000 7f9dbbf65640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9db40ac3f0 0x7f9db40ac870 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9db40b50b0 tx=0x7f9dac00f580 comp rx=0 tx=0).stop 2023-11-24T08:05:10.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 shutdown_connections 2023-11-24T08:05:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d98066650 0x7f9d98068b10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9db40ac3f0 0x7f9db40ac870 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9db4151c40 0x7f9db40abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 --2- 172.21.15.57:0/2898782823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da0003b40 0x7f9db4099bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 >> 172.21.15.57:0/2898782823 conn(0x7f9db40b0d50 msgr2=0x7f9db40cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 shutdown_connections 2023-11-24T08:05:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.486+0000 7f9dbbf65640 1 -- 172.21.15.57:0/2898782823 wait complete. 2023-11-24T08:05:10.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.646+0000 7fdee6617640 1 Processor -- start 2023-11-24T08:05:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.646+0000 7fdee6617640 1 -- start start 2023-11-24T08:05:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.646+0000 7fdee6617640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdee015d7a0 0x7fdee00d3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.646+0000 7fdee6617640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdee00d1880 0x7fdee00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.646+0000 7fdee6617640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee015db80 con 0x7fdee00cf700 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.646+0000 7fdee6617640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee00d2210 con 0x7fdee015d7a0 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.646+0000 7fdee6617640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee00cf270 con 0x7fdee00d1880 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdee015d7a0 0x7fdee00d3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdee015d7a0 0x7fdee00d3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42426/0 (socket says 172.21.15.57:42426) 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 -- 172.21.15.57:0/1946272994 learned_addr learned my addr 172.21.15.57:0/1946272994 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedf7fe640 1 --1- 172.21.15.57:0/1946272994 >> v1:172.21.15.57:6789/0 conn(0x7fdee00cf700 0x7fdee00cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60620/0 (socket says 172.21.15.57:60620) 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 -- 172.21.15.57:0/1946272994 >> v2:172.21.15.132:3300/0 conn(0x7fdee00d1880 msgr2=0x7fdee00d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 --2- 172.21.15.57:0/1946272994 >> v2:172.21.15.132:3300/0 conn(0x7fdee00d1880 0x7fdee00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 -- 172.21.15.57:0/1946272994 >> v1:172.21.15.57:6789/0 conn(0x7fdee00cf700 legacy=0x7fdee00cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 -- 172.21.15.57:0/1946272994 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee00ce660 con 0x7fdee015d7a0 2023-11-24T08:05:10.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedffff640 1 --2- 172.21.15.57:0/1946272994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee015d7a0 0x7fdee00d3e90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdee01622b0 tx=0x7fded001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cabc80b310614e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedeffd640 1 -- 172.21.15.57:0/1946272994 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00ad660 con 0x7fdee015d7a0 2023-11-24T08:05:10.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedeffd640 1 -- 172.21.15.57:0/1946272994 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded00ad7c0 con 0x7fdee015d7a0 2023-11-24T08:05:10.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.650+0000 7fdedeffd640 1 -- 172.21.15.57:0/1946272994 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00adb50 con 0x7fdee015d7a0 2023-11-24T08:05:10.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- 172.21.15.57:0/1946272994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee015d7a0 msgr2=0x7fdee00d3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 --2- 172.21.15.57:0/1946272994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee015d7a0 0x7fdee00d3e90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdee01622b0 tx=0x7fded001c470 comp rx=0 tx=0).stop 2023-11-24T08:05:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- 172.21.15.57:0/1946272994 shutdown_connections 2023-11-24T08:05:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 --2- 172.21.15.57:0/1946272994 >> v2:172.21.15.132:3300/0 conn(0x7fdee00d1880 0x7fdee00d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 --2- 172.21.15.57:0/1946272994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee015d7a0 0x7fdee00d3e90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- 172.21.15.57:0/1946272994 >> 172.21.15.57:0/1946272994 conn(0x7fdee009c780 msgr2=0x7fdee00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- 172.21.15.57:0/1946272994 shutdown_connections 2023-11-24T08:05:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- 172.21.15.57:0/1946272994 wait complete. 2023-11-24T08:05:10.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 Processor -- start 2023-11-24T08:05:10.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- start start 2023-11-24T08:05:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee00cf700 0x7fdee00c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee00d1880 0x7fdee015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee015d7a0 0x7fdee015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee015b620 con 0x7fdee00d1880 2023-11-24T08:05:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee015c450 con 0x7fdee00cf700 2023-11-24T08:05:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee6617640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee015b860 con 0x7fdee015d7a0 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee00d1880 0x7fdee015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee00d1880 0x7fdee015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42432/0 (socket says 172.21.15.57:42432) 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 -- 172.21.15.57:0/380598617 learned_addr learned my addr 172.21.15.57:0/380598617 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedffff640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee00cf700 0x7fdee00c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdee4bb4640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee015d7a0 0x7fdee015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 -- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee015d7a0 msgr2=0x7fdee015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee015d7a0 0x7fdee015c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 -- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee00cf700 msgr2=0x7fdee00c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee00cf700 0x7fdee00c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedf7fe640 1 -- 172.21.15.57:0/380598617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00094d0 con 0x7fdee00d1880 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.654+0000 7fdedffff640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee00cf700 0x7fdee00c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdedf7fe640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee00d1880 0x7fdee015b0e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fded400c490 tx=0x7fded400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdedcff9640 1 -- 172.21.15.57:0/380598617 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4007480 con 0x7fdee00d1880 2023-11-24T08:05:10.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdedcff9640 1 -- 172.21.15.57:0/380598617 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded40075e0 con 0x7fdee00d1880 2023-11-24T08:05:10.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdedcff9640 1 -- 172.21.15.57:0/380598617 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4004a10 con 0x7fdee00d1880 2023-11-24T08:05:10.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee015bb20 con 0x7fdee00d1880 2023-11-24T08:05:10.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee015c0e0 con 0x7fdee00d1880 2023-11-24T08:05:10.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee0067520 con 0x7fdee00d1880 2023-11-24T08:05:10.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdedcff9640 1 -- 172.21.15.57:0/380598617 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fded4004b70 con 0x7fdee00d1880 2023-11-24T08:05:10.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdedcff9640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdecc066620 0x7fdecc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.658+0000 7fdedcff9640 1 -- 172.21.15.57:0/380598617 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fded4083390 con 0x7fdee00d1880 2023-11-24T08:05:10.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.662+0000 7fdedffff640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdecc066620 0x7fdecc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.662+0000 7fdedcff9640 1 -- 172.21.15.57:0/380598617 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fded4050590 con 0x7fdee00d1880 2023-11-24T08:05:10.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.666+0000 7fdedffff640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdecc066620 0x7fdecc068ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fded00af000 tx=0x7fded00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdee00d1450 con 0x7fdee00d1880 2023-11-24T08:05:10.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdedcff9640 1 -- 172.21.15.57:0/380598617 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fded4053bb0 con 0x7fdee00d1880 2023-11-24T08:05:10.858 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:10.858 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2109788946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2109788946},{"type":"v1","addr":"172.21.15.132:6835","nonce":2109788946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3040903718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3040903718},{"type":"v1","addr":"172.21.15.57:6834","nonce":3040903718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/412231567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":412231567},{"type":"v1","addr":"172.21.15.57:6835","nonce":412231567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:52.236854+0000","modified":"2023-11-24T08:04:55.272383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54689},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54689":{"gid":54689,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/404616365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":404616365},{"type":"v1","addr":"172.21.15.132:6837","nonce":404616365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:10.859 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2023-11-24T08:05:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdecc066620 msgr2=0x7fdecc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdecc066620 0x7fdecc068ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fded00af000 tx=0x7fded00a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee00d1880 msgr2=0x7fdee015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee00d1880 0x7fdee015b0e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fded400c490 tx=0x7fded400c950 comp rx=0 tx=0).stop 2023-11-24T08:05:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 shutdown_connections 2023-11-24T08:05:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdecc066620 0x7fdecc068ae0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdee015d7a0 0x7fdee015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee00d1880 0x7fdee015b0e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 --2- 172.21.15.57:0/380598617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee00cf700 0x7fdee00c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 >> 172.21.15.57:0/380598617 conn(0x7fdee009c780 msgr2=0x7fdee0159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 shutdown_connections 2023-11-24T08:05:10.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:10.854+0000 7fdee6617640 1 -- 172.21.15.57:0/380598617 wait complete. 2023-11-24T08:05:10.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:11.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa665679640 1 Processor -- start 2023-11-24T08:05:11.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa665679640 1 -- start start 2023-11-24T08:05:11.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa665679640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d3e90 0x7fa6600cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa665679640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6600d1880 0x7fa6600d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa665679640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66015db80 con 0x7fa66015d7a0 2023-11-24T08:05:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa665679640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600d2250 con 0x7fa6600d1880 2023-11-24T08:05:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa665679640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600cf270 con 0x7fa6600d3e90 2023-11-24T08:05:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6600d1880 0x7fa6600d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa66015d7a0 0x7fa6600cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:45092/0 (socket says 172.21.15.57:45092) 2023-11-24T08:05:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa657fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d3e90 0x7fa6600cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65effd640 1 -- 172.21.15.57:0/829788729 learned_addr learned my addr 172.21.15.57:0/829788729 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65f7fe640 1 --2- 172.21.15.57:0/829788729 >> v2:172.21.15.132:3300/0 conn(0x7fa6600d1880 0x7fa6600d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:54648/0 (socket says 172.21.15.57:54648) 2023-11-24T08:05:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65e7fc640 1 -- 172.21.15.57:0/829788729 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062239449 0 0) 0x7fa66015db80 con 0x7fa66015d7a0 2023-11-24T08:05:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65e7fc640 1 -- 172.21.15.57:0/829788729 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c003530 con 0x7fa66015d7a0 2023-11-24T08:05:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65f7fe640 1 -- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d3e90 msgr2=0x7fa6600cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65f7fe640 1 --2- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d3e90 0x7fa6600cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65f7fe640 1 -- 172.21.15.57:0/829788729 >> v1:172.21.15.132:6789/0 conn(0x7fa66015d7a0 legacy=0x7fa6600cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa65f7fe640 1 -- 172.21.15.57:0/829788729 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600d42f0 con 0x7fa6600d1880 2023-11-24T08:05:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.018+0000 7fa657fff640 1 --2- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d3e90 0x7fa6600cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa65f7fe640 1 --2- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d1880 0x7fa6600d1d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa658009d90 tx=0x7fa65801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfcd559d442dce15 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa65e7fc640 1 -- 172.21.15.57:0/829788729 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6580a5980 con 0x7fa6600d1880 2023-11-24T08:05:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa65e7fc640 1 -- 172.21.15.57:0/829788729 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6580a5ae0 con 0x7fa6600d1880 2023-11-24T08:05:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa65e7fc640 1 -- 172.21.15.57:0/829788729 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6580a5e70 con 0x7fa6600d1880 2023-11-24T08:05:11.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 -- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d1880 msgr2=0x7fa6600d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 --2- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d1880 0x7fa6600d1d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa658009d90 tx=0x7fa65801c8c0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 -- 172.21.15.57:0/829788729 shutdown_connections 2023-11-24T08:05:11.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 --2- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d1880 0x7fa6600d1d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 --2- 172.21.15.57:0/829788729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d3e90 0x7fa6600cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 -- 172.21.15.57:0/829788729 >> 172.21.15.57:0/829788729 conn(0x7fa66009c780 msgr2=0x7fa6600d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 -- 172.21.15.57:0/829788729 shutdown_connections 2023-11-24T08:05:11.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.022+0000 7fa665679640 1 -- 172.21.15.57:0/829788729 wait complete. 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 Processor -- start 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 -- start start 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d1880 0x7fa660158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d3e90 0x7fa6600cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66015d7a0 0x7fa6600c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600cd7c0 con 0x7fa66015d7a0 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa660159280 con 0x7fa6600d3e90 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa660159560 con 0x7fa6600d1880 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66015d7a0 0x7fa6600c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66015d7a0 0x7fa6600c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42436/0 (socket says 172.21.15.57:42436) 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65f7fe640 1 -- 172.21.15.57:0/3571342942 learned_addr learned my addr 172.21.15.57:0/3571342942 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65effd640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d1880 0x7fa660158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa657fff640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d3e90 0x7fa6600cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65effd640 1 -- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d3e90 msgr2=0x7fa6600cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65effd640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d3e90 0x7fa6600cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65effd640 1 -- 172.21.15.57:0/3571342942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66015d7a0 msgr2=0x7fa6600c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65effd640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66015d7a0 0x7fa6600c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65effd640 1 -- 172.21.15.57:0/3571342942 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648009420 con 0x7fa6600d1880 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65f7fe640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66015d7a0 0x7fa6600c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa65effd640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d1880 0x7fa660158bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa650001ec0 tx=0x7fa65000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa6577fe640 1 -- 172.21.15.57:0/3571342942 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650005cf0 con 0x7fa6600d1880 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa6577fe640 1 -- 172.21.15.57:0/3571342942 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650005e50 con 0x7fa6600d1880 2023-11-24T08:05:11.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa658009a70 con 0x7fa6600d1880 2023-11-24T08:05:11.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa6577fe640 1 -- 172.21.15.57:0/3571342942 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6500072d0 con 0x7fa6600d1880 2023-11-24T08:05:11.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.026+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660159b20 con 0x7fa6600d1880 2023-11-24T08:05:11.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.030+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa660067520 con 0x7fa6600d1880 2023-11-24T08:05:11.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.030+0000 7fa6577fe640 1 -- 172.21.15.57:0/3571342942 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fa650007430 con 0x7fa6600d1880 2023-11-24T08:05:11.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.030+0000 7fa6577fe640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa640066620 0x7fa640068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.030+0000 7fa6577fe640 1 -- 172.21.15.57:0/3571342942 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa650083a70 con 0x7fa6600d1880 2023-11-24T08:05:11.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.030+0000 7fa657fff640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa640066620 0x7fa640068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.030+0000 7fa657fff640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa640066620 0x7fa640068ae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa6600c8a20 tx=0x7fa648009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.034+0000 7fa6577fe640 1 -- 172.21.15.57:0/3571342942 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa650050db0 con 0x7fa6600d1880 2023-11-24T08:05:11.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.190+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa660168150 con 0x7fa6600d1880 2023-11-24T08:05:11.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa6577fe640 1 -- 172.21.15.57:0/3571342942 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16509 (secure 0 0 0) 0x7fa6500543d0 con 0x7fa6600d1880 2023-11-24T08:05:11.199 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:11.199 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:53.859168+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa640066620 msgr2=0x7fa640068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa640066620 0x7fa640068ae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa6600c8a20 tx=0x7fa648009190 comp rx=0 tx=0).stop 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d1880 msgr2=0x7fa660158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d1880 0x7fa660158bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa650001ec0 tx=0x7fa65000c820 comp rx=0 tx=0).stop 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 shutdown_connections 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa640066620 0x7fa640068ae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66015d7a0 0x7fa6600c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6600d3e90 0x7fa6600cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 --2- 172.21.15.57:0/3571342942 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa6600d1880 0x7fa660158bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 >> 172.21.15.57:0/3571342942 conn(0x7fa66009c780 msgr2=0x7fa66015edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 shutdown_connections 2023-11-24T08:05:11.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.194+0000 7fa665679640 1 -- 172.21.15.57:0/3571342942 wait complete. 2023-11-24T08:05:11.220 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:05:11.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:11.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.358+0000 7f17c7ba1640 1 Processor -- start 2023-11-24T08:05:11.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.358+0000 7f17c7ba1640 1 -- start start 2023-11-24T08:05:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.358+0000 7f17c7ba1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17c0160be0 0x7f17c015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.358+0000 7f17c7ba1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 0x7f17c00b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.358+0000 7f17c7ba1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c015e680 con 0x7f17c00b37b0 2023-11-24T08:05:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.358+0000 7f17c7ba1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c006c650 con 0x7f17c0160be0 2023-11-24T08:05:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.358+0000 7f17c7ba1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b4180 con 0x7f17c015e250 2023-11-24T08:05:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c513c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f17c00b37b0 0x7f17c015db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60622/0 (socket says 172.21.15.57:60622) 2023-11-24T08:05:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c513c640 1 -- 172.21.15.57:0/3912688779 learned_addr learned my addr 172.21.15.57:0/3912688779 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c613e640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 0x7f17c00b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c593d640 1 --2- 172.21.15.57:0/3912688779 >> v2:172.21.15.132:3300/0 conn(0x7f17c0160be0 0x7f17c015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059078581 0 0) 0x7f17c015e680 con 0x7f17c00b37b0 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ac003530 con 0x7f17c00b37b0 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 920593085 0 0) 0x7f17ac003530 con 0x7f17c00b37b0 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 msgr2=0x7f17c00b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 0x7f17c00b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 >> v2:172.21.15.132:3300/0 conn(0x7f17c0160be0 msgr2=0x7f17c015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 --2- 172.21.15.57:0/3912688779 >> v2:172.21.15.132:3300/0 conn(0x7f17c0160be0 0x7f17c015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c015e900 con 0x7f17c00b37b0 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f17b0001680 con 0x7f17c00b37b0 2023-11-24T08:05:11.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 >> v1:172.21.15.57:6789/0 conn(0x7f17c00b37b0 legacy=0x7f17c015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ac003980 0x7f17ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ac0047d0 0x7f17ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 0x7f17ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c006c650 con 0x7f17ac003980 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b4180 con 0x7f17ac0047d0 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac00b990 con 0x7f17c015e250 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c593d640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ac003980 0x7f17ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c513c640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ac0047d0 0x7f17ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c613e640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 0x7f17ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c593d640 1 -- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 msgr2=0x7f17ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c593d640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 0x7f17ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c593d640 1 -- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ac0047d0 msgr2=0x7f17ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c593d640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ac0047d0 0x7f17ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c593d640 1 -- 172.21.15.57:0/3912688779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac003530 con 0x7f17ac003980 2023-11-24T08:05:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c513c640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17ac0047d0 0x7f17ac004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.362+0000 7f17c613e640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17c015e250 0x7f17ac005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:11.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c593d640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ac003980 0x7f17ac003da0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009ae0 tx=0x7f17bc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8258addb12720f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0a6470 con 0x7f17ac003980 2023-11-24T08:05:11.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc0a65d0 con 0x7f17ac003980 2023-11-24T08:05:11.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c493b640 1 -- 172.21.15.57:0/3912688779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0a6980 con 0x7f17ac003980 2023-11-24T08:05:11.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3912688779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ac003980 msgr2=0x7f17ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 --2- 172.21.15.57:0/3912688779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17ac003980 0x7f17ac003da0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009ae0 tx=0x7f17bc01ca00 comp rx=0 tx=0).stop 2023-11-24T08:05:11.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c613e640 1 -- 172.21.15.57:0/3912688779 reap_dead start 2023-11-24T08:05:11.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3912688779 shutdown_connections 2023-11-24T08:05:11.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3912688779 >> 172.21.15.57:0/3912688779 conn(0x7f17c00b0bf0 msgr2=0x7f17c00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3912688779 shutdown_connections 2023-11-24T08:05:11.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3912688779 wait complete. 2023-11-24T08:05:11.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 Processor -- start 2023-11-24T08:05:11.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.366+0000 7f17c7ba1640 1 -- start start 2023-11-24T08:05:11.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ac003980 0x7f17c0099b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c00ad0d0 0x7f17c0145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00adbb0 0x7f17c0159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00accb0 con 0x7f17c00adbb0 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01460b0 con 0x7f17c00ad0d0 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00ac070 con 0x7f17ac003980 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00adbb0 0x7f17c0159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00adbb0 0x7f17c0159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42464/0 (socket says 172.21.15.57:42464) 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 -- 172.21.15.57:0/3087914609 learned_addr learned my addr 172.21.15.57:0/3087914609 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c593d640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ac003980 0x7f17c0099b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c513c640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c00ad0d0 0x7f17c0145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 -- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ac003980 msgr2=0x7f17c0099b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ac003980 0x7f17c0099b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 -- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c00ad0d0 msgr2=0x7f17c0145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c00ad0d0 0x7f17c0145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 -- 172.21.15.57:0/3087914609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c00ac310 con 0x7f17c00adbb0 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c613e640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00adbb0 0x7f17c0159220 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f17c0072680 tx=0x7f17b8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17b67fc640 1 -- 172.21.15.57:0/3087914609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800e050 con 0x7f17c00adbb0 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17b67fc640 1 -- 172.21.15.57:0/3087914609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b800f040 con 0x7f17c00adbb0 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c00ac5f0 con 0x7f17c00adbb0 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17b67fc640 1 -- 172.21.15.57:0/3087914609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8003be0 con 0x7f17c00adbb0 2023-11-24T08:05:11.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c00ae030 con 0x7f17c00adbb0 2023-11-24T08:05:11.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c00acdf0 con 0x7f17c00adbb0 2023-11-24T08:05:11.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.370+0000 7f17b67fc640 1 -- 172.21.15.57:0/3087914609 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f17b8003d40 con 0x7f17c00adbb0 2023-11-24T08:05:11.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.374+0000 7f17b67fc640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17a4066650 0x7f17a4068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.374+0000 7f17b67fc640 1 -- 172.21.15.57:0/3087914609 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17b8084820 con 0x7f17c00adbb0 2023-11-24T08:05:11.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.374+0000 7f17c593d640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17a4066650 0x7f17a4068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.374+0000 7f17c593d640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17a4066650 0x7f17a4068b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ad000 tx=0x7f17bc0b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.378+0000 7f17b67fc640 1 -- 172.21.15.57:0/3087914609 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17c00acdf0 con 0x7f17c00adbb0 2023-11-24T08:05:11.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.566+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17c00acdf0 con 0x7f17c00adbb0 2023-11-24T08:05:11.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17b67fc640 1 -- 172.21.15.57:0/3087914609 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f17c00acdf0 con 0x7f17c00adbb0 2023-11-24T08:05:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:11.574 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2109788946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2109788946},{"type":"v1","addr":"172.21.15.132:6835","nonce":2109788946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3040903718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3040903718},{"type":"v1","addr":"172.21.15.57:6834","nonce":3040903718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/412231567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":412231567},{"type":"v1","addr":"172.21.15.57:6835","nonce":412231567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:52.236854+0000","modified":"2023-11-24T08:04:55.272383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54689},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54689":{"gid":54689,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/404616365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":404616365},{"type":"v1","addr":"172.21.15.132:6837","nonce":404616365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:11.574 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17a4066650 msgr2=0x7f17a4068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17a4066650 0x7f17a4068b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ad000 tx=0x7f17bc0b3040 comp rx=0 tx=0).stop 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00adbb0 msgr2=0x7f17c0159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00adbb0 0x7f17c0159220 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f17c0072680 tx=0x7f17b8010590 comp rx=0 tx=0).stop 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 shutdown_connections 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f17a4066650 0x7f17a4068b10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c00adbb0 0x7f17c0159220 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c00ad0d0 0x7f17c0145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 --2- 172.21.15.57:0/3087914609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17ac003980 0x7f17c0099b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 >> 172.21.15.57:0/3087914609 conn(0x7f17c00b0bf0 msgr2=0x7f17c00b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 shutdown_connections 2023-11-24T08:05:11.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.570+0000 7f17c7ba1640 1 -- 172.21.15.57:0/3087914609 wait complete. 2023-11-24T08:05:11.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd6b13e640 1 Processor -- start 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd6b13e640 1 -- start start 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd6b13e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efd640b36c0 0x7efd640b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd6b13e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efd64070da0 0x7efd640711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd6b13e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6415a700 con 0x7efd6415a320 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd6b13e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd640b2430 con 0x7efd64070da0 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd6b13e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd640b2620 con 0x7efd640b36c0 2023-11-24T08:05:11.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd68eda640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efd6415a320 0x7efd64070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60624/0 (socket says 172.21.15.57:60624) 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd696db640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efd64070da0 0x7efd640711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd68eda640 1 -- 172.21.15.57:0/2594054350 learned_addr learned my addr 172.21.15.57:0/2594054350 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd63fff640 1 --2- 172.21.15.57:0/2594054350 >> v2:172.21.15.132:3300/0 conn(0x7efd640b36c0 0x7efd640b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd696db640 1 -- 172.21.15.57:0/2594054350 >> v2:172.21.15.132:3300/0 conn(0x7efd640b36c0 msgr2=0x7efd640b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd696db640 1 --2- 172.21.15.57:0/2594054350 >> v2:172.21.15.132:3300/0 conn(0x7efd640b36c0 0x7efd640b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd696db640 1 -- 172.21.15.57:0/2594054350 >> v1:172.21.15.57:6789/0 conn(0x7efd6415a320 legacy=0x7efd64070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd696db640 1 -- 172.21.15.57:0/2594054350 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640b2900 con 0x7efd64070da0 2023-11-24T08:05:11.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.734+0000 7efd63fff640 1 --2- 172.21.15.57:0/2594054350 >> v2:172.21.15.132:3300/0 conn(0x7efd640b36c0 0x7efd640b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd696db640 1 --2- 172.21.15.57:0/2594054350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd64070da0 0x7efd640711f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7efd6406c180 tx=0x7efd5c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8191e38d1bd55a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd637fe640 1 -- 172.21.15.57:0/2594054350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0a59a0 con 0x7efd64070da0 2023-11-24T08:05:11.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd637fe640 1 -- 172.21.15.57:0/2594054350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c0a5b00 con 0x7efd64070da0 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd637fe640 1 -- 172.21.15.57:0/2594054350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0a5e90 con 0x7efd64070da0 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 -- 172.21.15.57:0/2594054350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd64070da0 msgr2=0x7efd640711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2594054350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd64070da0 0x7efd640711f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7efd6406c180 tx=0x7efd5c01c8e0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 -- 172.21.15.57:0/2594054350 shutdown_connections 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2594054350 >> v2:172.21.15.132:3300/0 conn(0x7efd640b36c0 0x7efd640b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2594054350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd64070da0 0x7efd640711f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 -- 172.21.15.57:0/2594054350 >> 172.21.15.57:0/2594054350 conn(0x7efd640b0bf0 msgr2=0x7efd640b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 -- 172.21.15.57:0/2594054350 shutdown_connections 2023-11-24T08:05:11.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.738+0000 7efd6b13e640 1 -- 172.21.15.57:0/2594054350 wait complete. 2023-11-24T08:05:11.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 Processor -- start 2023-11-24T08:05:11.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 -- start start 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd64070da0 0x7efd6415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd640b36c0 0x7efd640afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd6415a320 0x7efd64142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd641f6090 con 0x7efd6415a320 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6414f450 con 0x7efd64070da0 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6415d190 con 0x7efd640b36c0 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd6415a320 0x7efd64142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd6415a320 0x7efd64142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42488/0 (socket says 172.21.15.57:42488) 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 -- 172.21.15.57:0/2465780676 learned_addr learned my addr 172.21.15.57:0/2465780676 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:11.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd63fff640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd640b36c0 0x7efd640afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd68eda640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd64070da0 0x7efd6415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 -- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd640b36c0 msgr2=0x7efd640afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd640b36c0 0x7efd640afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 -- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd64070da0 msgr2=0x7efd6415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd64070da0 0x7efd6415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 -- 172.21.15.57:0/2465780676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c009a70 con 0x7efd6415a320 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd696db640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd6415a320 0x7efd64142490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0194f0 tx=0x7efd5c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd617fa640 1 -- 172.21.15.57:0/2465780676 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0ade20 con 0x7efd6415a320 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd617fa640 1 -- 172.21.15.57:0/2465780676 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c0b9450 con 0x7efd6415a320 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd617fa640 1 -- 172.21.15.57:0/2465780676 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0b9800 con 0x7efd6415a320 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6415d470 con 0x7efd6415a320 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.742+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6415da30 con 0x7efd6415a320 2023-11-24T08:05:11.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.746+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6414f5c0 con 0x7efd6415a320 2023-11-24T08:05:11.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.746+0000 7efd617fa640 1 -- 172.21.15.57:0/2465780676 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7efd5c0b9960 con 0x7efd6415a320 2023-11-24T08:05:11.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.746+0000 7efd617fa640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd48066620 0x7efd48068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.746+0000 7efd617fa640 1 -- 172.21.15.57:0/2465780676 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd5c11fa00 con 0x7efd6415a320 2023-11-24T08:05:11.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.746+0000 7efd68eda640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd48066620 0x7efd48068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.746+0000 7efd68eda640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd48066620 0x7efd48068ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd58005890 tx=0x7efd58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.750+0000 7efd617fa640 1 -- 172.21.15.57:0/2465780676 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd5c0ecc00 con 0x7efd6415a320 2023-11-24T08:05:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.938+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd64067520 con 0x7efd6415a320 2023-11-24T08:05:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.938+0000 7efd617fa640 1 -- 172.21.15.57:0/2465780676 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7efd5c0b2090 con 0x7efd6415a320 2023-11-24T08:05:11.946 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:11.946 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2109788946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2109788946},{"type":"v1","addr":"172.21.15.132:6835","nonce":2109788946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3040903718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3040903718},{"type":"v1","addr":"172.21.15.57:6834","nonce":3040903718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/412231567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":412231567},{"type":"v1","addr":"172.21.15.57:6835","nonce":412231567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:52.236854+0000","modified":"2023-11-24T08:04:55.272383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":54689},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54689":{"gid":54689,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/404616365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":404616365},{"type":"v1","addr":"172.21.15.132:6837","nonce":404616365}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:05:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 16 2023-11-24T08:05:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd48066620 msgr2=0x7efd48068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd48066620 0x7efd48068ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd58005890 tx=0x7efd58009040 comp rx=0 tx=0).stop 2023-11-24T08:05:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd6415a320 msgr2=0x7efd64142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd6415a320 0x7efd64142490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0194f0 tx=0x7efd5c019680 comp rx=0 tx=0).stop 2023-11-24T08:05:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 shutdown_connections 2023-11-24T08:05:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd48066620 0x7efd48068ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd6415a320 0x7efd64142490 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd640b36c0 0x7efd640afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 --2- 172.21.15.57:0/2465780676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd64070da0 0x7efd6415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 >> 172.21.15.57:0/2465780676 conn(0x7efd640b0bf0 msgr2=0x7efd641647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 shutdown_connections 2023-11-24T08:05:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:11.942+0000 7efd6b13e640 1 -- 172.21.15.57:0/2465780676 wait complete. 2023-11-24T08:05:11.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:12.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.102+0000 7f4aa7c32640 1 Processor -- start 2023-11-24T08:05:12.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.102+0000 7f4aa7c32640 1 -- start start 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa7c32640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4aa0147020 0x7f4aa00d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa7c32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4aa00d0150 0x7f4aa006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa7c32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa00d05d0 0x7f4aa006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa7c32640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa00cee60 con 0x7f4aa0147020 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa7c32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa00cf0b0 con 0x7f4aa00d0150 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa7c32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00cf390 con 0x7f4aa00d05d0 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4aa0147020 0x7f4aa00d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4aa0147020 0x7f4aa00d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42502/0 (socket says 172.21.15.57:42502) 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 -- 172.21.15.57:0/318803560 learned_addr learned my addr 172.21.15.57:0/318803560 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:12.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa51cd640 1 --2- 172.21.15.57:0/318803560 >> v2:172.21.15.132:3300/0 conn(0x7f4aa00d0150 0x7f4aa006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa61cf640 1 --2- 172.21.15.57:0/318803560 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa00d05d0 0x7f4aa006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 -- 172.21.15.57:0/318803560 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa00d05d0 msgr2=0x7f4aa006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 --2- 172.21.15.57:0/318803560 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa00d05d0 0x7f4aa006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 -- 172.21.15.57:0/318803560 >> v2:172.21.15.132:3300/0 conn(0x7f4aa00d0150 msgr2=0x7f4aa006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 --2- 172.21.15.57:0/318803560 >> v2:172.21.15.132:3300/0 conn(0x7f4aa00d0150 0x7f4aa006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.106+0000 7f4aa59ce640 1 -- 172.21.15.57:0/318803560 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00cf670 con 0x7f4aa0147020 2023-11-24T08:05:12.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa59ce640 1 --2- 172.21.15.57:0/318803560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa0147020 0x7f4aa00d1a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0061db0 tx=0x7f4a9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829a4672b2a7461b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa49cc640 1 -- 172.21.15.57:0/318803560 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0aa5f0 con 0x7f4aa0147020 2023-11-24T08:05:12.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa49cc640 1 -- 172.21.15.57:0/318803560 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c0aa750 con 0x7f4aa0147020 2023-11-24T08:05:12.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa49cc640 1 -- 172.21.15.57:0/318803560 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0aaae0 con 0x7f4aa0147020 2023-11-24T08:05:12.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 -- 172.21.15.57:0/318803560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa0147020 msgr2=0x7f4aa00d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/318803560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa0147020 0x7f4aa00d1a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0061db0 tx=0x7f4a9c01c4d0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 -- 172.21.15.57:0/318803560 shutdown_connections 2023-11-24T08:05:12.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/318803560 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa00d05d0 0x7f4aa006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/318803560 >> v2:172.21.15.132:3300/0 conn(0x7f4aa00d0150 0x7f4aa006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/318803560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa0147020 0x7f4aa00d1a90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 -- 172.21.15.57:0/318803560 >> 172.21.15.57:0/318803560 conn(0x7f4aa0060fd0 msgr2=0x7f4aa00613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 -- 172.21.15.57:0/318803560 shutdown_connections 2023-11-24T08:05:12.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 -- 172.21.15.57:0/318803560 wait complete. 2023-11-24T08:05:12.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 Processor -- start 2023-11-24T08:05:12.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.110+0000 7f4aa7c32640 1 -- start start 2023-11-24T08:05:12.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa00d0150 0x7f4aa0141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa00d05d0 0x7f4aa013d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa0147020 0x7f4aa015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00b5910 con 0x7f4aa00d0150 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa013ece0 con 0x7f4aa00d05d0 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0143750 con 0x7f4aa0147020 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa00d0150 0x7f4aa0141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa00d0150 0x7f4aa0141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42508/0 (socket says 172.21.15.57:42508) 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 -- 172.21.15.57:0/4064535860 learned_addr learned my addr 172.21.15.57:0/4064535860 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 -- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa0147020 msgr2=0x7f4aa015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa61cf640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa0147020 0x7f4aa015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa51cd640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa00d05d0 0x7f4aa013d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa0147020 0x7f4aa015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 -- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa00d05d0 msgr2=0x7f4aa013d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa00d05d0 0x7f4aa013d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 -- 172.21.15.57:0/4064535860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0094d0 con 0x7f4aa00d0150 2023-11-24T08:05:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa61cf640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa0147020 0x7f4aa015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa51cd640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa00d05d0 0x7f4aa013d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa59ce640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa00d0150 0x7f4aa0141690 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c01ab80 tx=0x7f4a9c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4a967fc640 1 -- 172.21.15.57:0/4064535860 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0b3800 con 0x7f4aa00d0150 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4a967fc640 1 -- 172.21.15.57:0/4064535860 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c0b3980 con 0x7f4aa00d0150 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4a967fc640 1 -- 172.21.15.57:0/4064535860 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0b3d30 con 0x7f4aa00d0150 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa0141bd0 con 0x7f4aa00d0150 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0143470 con 0x7f4aa00d0150 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa0067520 con 0x7f4aa00d0150 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.114+0000 7f4a967fc640 1 -- 172.21.15.57:0/4064535860 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f4a9c0b2380 con 0x7f4aa00d0150 2023-11-24T08:05:12.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.118+0000 7f4a967fc640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a84066620 0x7f4a84068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.118+0000 7f4a967fc640 1 -- 172.21.15.57:0/4064535860 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a9c0a7070 con 0x7f4aa00d0150 2023-11-24T08:05:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.118+0000 7f4aa51cd640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a84066620 0x7f4a84068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.118+0000 7f4aa51cd640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a84066620 0x7f4a84068ae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4aa01f9a30 tx=0x7f4a90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.122+0000 7f4a967fc640 1 -- 172.21.15.57:0/4064535860 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a9c0eb960 con 0x7f4aa00d0150 2023-11-24T08:05:12.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4aa0167f40 con 0x7f4aa00d0150 2023-11-24T08:05:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4a967fc640 1 -- 172.21.15.57:0/4064535860 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f4a9c0eef80 con 0x7f4aa00d0150 2023-11-24T08:05:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:04:53.859168+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:50.817810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:51.228710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:12.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a84066620 msgr2=0x7f4a84068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a84066620 0x7f4a84068ae0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4aa01f9a30 tx=0x7f4a90008040 comp rx=0 tx=0).stop 2023-11-24T08:05:12.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa00d0150 msgr2=0x7f4aa0141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa00d0150 0x7f4aa0141690 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c01ab80 tx=0x7f4a9c01ad10 comp rx=0 tx=0).stop 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 shutdown_connections 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a84066620 0x7f4a84068ae0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4aa0147020 0x7f4aa015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa00d05d0 0x7f4aa013d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 --2- 172.21.15.57:0/4064535860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4aa00d0150 0x7f4aa0141690 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 >> 172.21.15.57:0/4064535860 conn(0x7f4aa0060fd0 msgr2=0x7f4aa015d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.282+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 shutdown_connections 2023-11-24T08:05:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.286+0000 7f4aa7c32640 1 -- 172.21.15.57:0/4064535860 wait complete. 2023-11-24T08:05:12.310 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:05:12.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5ca4ebb640 1 Processor -- start 2023-11-24T08:05:12.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5ca4ebb640 1 -- start start 2023-11-24T08:05:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5ca4ebb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ca015a4d0 0x7f5ca00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5ca4ebb640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca015a8b0 con 0x7f5ca00cad20 2023-11-24T08:05:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5ca4ebb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca00c9c30 con 0x7f5ca006d740 2023-11-24T08:05:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5ca4ebb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca00c9f60 con 0x7f5ca015a4d0 2023-11-24T08:05:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ca00cad20 0x7f5ca015e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60636/0 (socket says 172.21.15.57:60636) 2023-11-24T08:05:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 -- 172.21.15.57:0/2139096555 learned_addr learned my addr 172.21.15.57:0/2139096555 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9e59c640 1 --2- 172.21.15.57:0/2139096555 >> v2:172.21.15.132:3300/0 conn(0x7f5ca015a4d0 0x7f5ca00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278389584 0 0) 0x7f5ca015a8b0 con 0x7f5ca00cad20 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c8c003530 con 0x7f5ca00cad20 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175781329 0 0) 0x7f5c8c003530 con 0x7f5ca00cad20 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 >> v2:172.21.15.132:3300/0 conn(0x7f5ca015a4d0 msgr2=0x7f5ca00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 --2- 172.21.15.57:0/2139096555 >> v2:172.21.15.132:3300/0 conn(0x7f5ca015a4d0 0x7f5ca00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 >> v1:172.21.15.132:6789/0 conn(0x7f5ca006d740 legacy=0x7f5ca006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca00ca240 con 0x7f5ca00cad20 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f5c88001680 con 0x7f5ca00cad20 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 >> v1:172.21.15.57:6789/0 conn(0x7f5ca00cad20 legacy=0x7f5ca015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0039d0 0x7f5c8c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c8c0047d0 0x7f5c8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c8c0051e0 0x7f5c8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00c9f60 con 0x7f5c8c0047d0 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c00c130 con 0x7f5c8c0051e0 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c00e500 con 0x7f5c8c0039d0 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c8c0047d0 0x7f5c8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9e59c640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0039d0 0x7f5c8c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9ed9d640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c8c0051e0 0x7f5c8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 -- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0039d0 msgr2=0x7f5c8c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0039d0 0x7f5c8c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 -- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c8c0051e0 msgr2=0x7f5c8c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c8c0051e0 0x7f5c8c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c9ed9d640 1 -- 172.21.15.57:0/2139096555 reap_dead start 2023-11-24T08:05:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.450+0000 7f5c97fff640 1 -- 172.21.15.57:0/2139096555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c003530 con 0x7f5c8c0047d0 2023-11-24T08:05:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5c97fff640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c8c0047d0 0x7f5c8c004c50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5c88001ec0 tx=0x7f5c8801cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ef4cbfb9747da7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88005ae0 con 0x7f5c8c0047d0 2023-11-24T08:05:12.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88005c40 con 0x7f5c8c0047d0 2023-11-24T08:05:12.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5c9dd9b640 1 -- 172.21.15.57:0/2139096555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880072b0 con 0x7f5c8c0047d0 2023-11-24T08:05:12.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/2139096555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c8c0047d0 msgr2=0x7f5c8c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c8c0047d0 0x7f5c8c004c50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5c88001ec0 tx=0x7f5c8801cb10 comp rx=0 tx=0).stop 2023-11-24T08:05:12.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/2139096555 shutdown_connections 2023-11-24T08:05:12.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/2139096555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c8c0047d0 0x7f5c8c004c50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/2139096555 >> 172.21.15.57:0/2139096555 conn(0x7f5ca00b0bf0 msgr2=0x7f5ca00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/2139096555 shutdown_connections 2023-11-24T08:05:12.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.454+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/2139096555 wait complete. 2023-11-24T08:05:12.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 Processor -- start 2023-11-24T08:05:12.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 -- start start 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0047d0 0x7f5ca00b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca01525e0 0x7f5ca009bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca0157970 0x7f5ca0157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca009c830 con 0x7f5ca0157970 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0158340 con 0x7f5ca01525e0 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00b3ec0 con 0x7f5c8c0047d0 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca0157970 0x7f5ca0157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca0157970 0x7f5ca0157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42528/0 (socket says 172.21.15.57:42528) 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 -- 172.21.15.57:0/1217487046 learned_addr learned my addr 172.21.15.57:0/1217487046 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:12.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9e59c640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0047d0 0x7f5ca00b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 -- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0047d0 msgr2=0x7f5ca00b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0047d0 0x7f5ca00b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c97fff640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca01525e0 0x7f5ca009bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 -- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca01525e0 msgr2=0x7f5ca009bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca01525e0 0x7f5ca009bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 -- 172.21.15.57:0/1217487046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca00b4890 con 0x7f5ca0157970 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9e59c640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0047d0 0x7f5ca00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c97fff640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca01525e0 0x7f5ca009bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c9ed9d640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca0157970 0x7f5ca0157e00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00729f0 tx=0x7f5c9800fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c96ffd640 1 -- 172.21.15.57:0/1217487046 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98006d70 con 0x7f5ca0157970 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c96ffd640 1 -- 172.21.15.57:0/1217487046 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98003980 con 0x7f5ca0157970 2023-11-24T08:05:12.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5c96ffd640 1 -- 172.21.15.57:0/1217487046 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98003d30 con 0x7f5ca0157970 2023-11-24T08:05:12.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca00b32b0 con 0x7f5ca0157970 2023-11-24T08:05:12.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.458+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca00b3870 con 0x7f5ca0157970 2023-11-24T08:05:12.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.462+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca00b4030 con 0x7f5ca0157970 2023-11-24T08:05:12.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.462+0000 7f5c96ffd640 1 -- 172.21.15.57:0/1217487046 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5c98005070 con 0x7f5ca0157970 2023-11-24T08:05:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.462+0000 7f5c96ffd640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5c80066620 0x7f5c80068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.462+0000 7f5c96ffd640 1 -- 172.21.15.57:0/1217487046 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c98083660 con 0x7f5ca0157970 2023-11-24T08:05:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.462+0000 7f5c9e59c640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5c80066620 0x7f5c80068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.462+0000 7f5c9e59c640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5c80066620 0x7f5c80068ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ca009b870 tx=0x7f5c90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.466+0000 7f5c96ffd640 1 -- 172.21.15.57:0/1217487046 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c980507c0 con 0x7f5ca0157970 2023-11-24T08:05:12.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.658+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5ca009d250 con 0x7f5ca0157970 2023-11-24T08:05:12.664 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-11-24T08:05:12.658+0000 7f305c7a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:05:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5c96ffd640 1 -- 172.21.15.57:0/1217487046 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5c98053de0 con 0x7f5ca0157970 2023-11-24T08:05:12.670 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:05:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5c80066620 msgr2=0x7f5c80068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5c80066620 0x7f5c80068ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5ca009b870 tx=0x7f5c90008040 comp rx=0 tx=0).stop 2023-11-24T08:05:12.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca0157970 msgr2=0x7f5ca0157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca0157970 0x7f5ca0157e00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00729f0 tx=0x7f5c9800fc70 comp rx=0 tx=0).stop 2023-11-24T08:05:12.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 shutdown_connections 2023-11-24T08:05:12.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5c80066620 0x7f5c80068ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca0157970 0x7f5ca0157e00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca01525e0 0x7f5ca009bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 --2- 172.21.15.57:0/1217487046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c8c0047d0 0x7f5ca00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 >> 172.21.15.57:0/1217487046 conn(0x7f5ca00b0bf0 msgr2=0x7f5ca00710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 shutdown_connections 2023-11-24T08:05:12.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.666+0000 7f5ca4ebb640 1 -- 172.21.15.57:0/1217487046 wait complete. 2023-11-24T08:05:12.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:05:12.748 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-11-24T08:05:12.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46ca7c1640 1 Processor -- start 2023-11-24T08:05:12.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46ca7c1640 1 -- start start 2023-11-24T08:05:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46ca7c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46c415d450 0x7f46c4161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46ca7c1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c406b460 con 0x7f46c406b8f0 2023-11-24T08:05:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46ca7c1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c406a5b0 con 0x7f46c406dac0 2023-11-24T08:05:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46ca7c1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c4162030 con 0x7f46c415d450 2023-11-24T08:05:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46c415d450 0x7f46c4161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c37fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f46c406b8f0 0x7f46c406d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60648/0 (socket says 172.21.15.57:60648) 2023-11-24T08:05:12.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c37fe640 1 -- 172.21.15.57:0/397330664 learned_addr learned my addr 172.21.15.57:0/397330664 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c2ffd640 1 -- 172.21.15.57:0/397330664 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808198537 0 0) 0x7f46c406b460 con 0x7f46c406b8f0 2023-11-24T08:05:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c2ffd640 1 -- 172.21.15.57:0/397330664 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b0003530 con 0x7f46c406b8f0 2023-11-24T08:05:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c3fff640 1 -- 172.21.15.57:0/397330664 >> v1:172.21.15.132:6789/0 conn(0x7f46c406dac0 legacy=0x7f46c40ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c3fff640 1 -- 172.21.15.57:0/397330664 >> v1:172.21.15.57:6789/0 conn(0x7f46c406b8f0 legacy=0x7f46c406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.837+0000 7f46c3fff640 1 -- 172.21.15.57:0/397330664 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c406a850 con 0x7f46c415d450 2023-11-24T08:05:12.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46c3fff640 1 --2- 172.21.15.57:0/397330664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c415d450 0x7f46c4161af0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097c0 tx=0x7f46ac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402d3eadb4282f14 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46c2ffd640 1 -- 172.21.15.57:0/397330664 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0ab670 con 0x7f46c415d450 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46c2ffd640 1 -- 172.21.15.57:0/397330664 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac0ab7d0 con 0x7f46c415d450 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46c2ffd640 1 -- 172.21.15.57:0/397330664 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0abb60 con 0x7f46c415d450 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46ca7c1640 1 -- 172.21.15.57:0/397330664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c415d450 msgr2=0x7f46c4161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/397330664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c415d450 0x7f46c4161af0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0097c0 tx=0x7f46ac01c450 comp rx=0 tx=0).stop 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46ca7c1640 1 -- 172.21.15.57:0/397330664 shutdown_connections 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/397330664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c415d450 0x7f46c4161af0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46ca7c1640 1 -- 172.21.15.57:0/397330664 >> 172.21.15.57:0/397330664 conn(0x7f46c40cf8f0 msgr2=0x7f46c40cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46ca7c1640 1 -- 172.21.15.57:0/397330664 shutdown_connections 2023-11-24T08:05:12.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.841+0000 7f46ca7c1640 1 -- 172.21.15.57:0/397330664 wait complete. 2023-11-24T08:05:12.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 Processor -- start 2023-11-24T08:05:12.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 -- start start 2023-11-24T08:05:12.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c406b8f0 0x7f46c4155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f46c406dac0 0x7f46c415f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46c415d450 0x7f46c414f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4155f40 con 0x7f46c406b8f0 2023-11-24T08:05:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c415fb00 con 0x7f46c415d450 2023-11-24T08:05:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c414e570 con 0x7f46c406dac0 2023-11-24T08:05:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c406b8f0 0x7f46c4155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c406b8f0 0x7f46c4155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42540/0 (socket says 172.21.15.57:42540) 2023-11-24T08:05:12.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 -- 172.21.15.57:0/1265380241 learned_addr learned my addr 172.21.15.57:0/1265380241 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c8d5e640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46c415d450 0x7f46c414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c37fe640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f46c406dac0 0x7f46c415f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 -- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f46c406dac0 msgr2=0x7f46c415f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f46c406dac0 0x7f46c415f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 -- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46c415d450 msgr2=0x7f46c414f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46c415d450 0x7f46c414f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 -- 172.21.15.57:0/1265380241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac009420 con 0x7f46c406b8f0 2023-11-24T08:05:12.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c3fff640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c406b8f0 0x7f46c4155a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0ad040 tx=0x7f46ac01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c0ff9640 1 -- 172.21.15.57:0/1265380241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0bf610 con 0x7f46c406b8f0 2023-11-24T08:05:12.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c0ff9640 1 -- 172.21.15.57:0/1265380241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac0bf770 con 0x7f46c406b8f0 2023-11-24T08:05:12.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c413a150 con 0x7f46c406b8f0 2023-11-24T08:05:12.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46c0ff9640 1 -- 172.21.15.57:0/1265380241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0bfae0 con 0x7f46c406b8f0 2023-11-24T08:05:12.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.845+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c413a710 con 0x7f46c406b8f0 2023-11-24T08:05:12.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.849+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c404e8c0 con 0x7f46c406b8f0 2023-11-24T08:05:12.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.849+0000 7f46c0ff9640 1 -- 172.21.15.57:0/1265380241 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f46ac0bfc40 con 0x7f46c406b8f0 2023-11-24T08:05:12.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.849+0000 7f46c0ff9640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f46a4066620 0x7f46a4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.849+0000 7f46c0ff9640 1 -- 172.21.15.57:0/1265380241 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f46ac11eff0 con 0x7f46c406b8f0 2023-11-24T08:05:12.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.849+0000 7f46c37fe640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f46a4066620 0x7f46a4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.849+0000 7f46c37fe640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f46a4066620 0x7f46a4068ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46c4157d20 tx=0x7f46b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:12.853+0000 7f46c0ff9640 1 -- 172.21.15.57:0/1265380241 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f46ac0ec1b0 con 0x7f46c406b8f0 2023-11-24T08:05:13.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.045+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f46c40612e0 con 0x7f46c406b8f0 2023-11-24T08:05:13.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46c0ff9640 1 -- 172.21.15.57:0/1265380241 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46ac0ef7d0 con 0x7f46c406b8f0 2023-11-24T08:05:13.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f46a4066620 msgr2=0x7f46a4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f46a4066620 0x7f46a4068ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46c4157d20 tx=0x7f46b4009040 comp rx=0 tx=0).stop 2023-11-24T08:05:13.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c406b8f0 msgr2=0x7f46c4155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c406b8f0 0x7f46c4155a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0ad040 tx=0x7f46ac01ac90 comp rx=0 tx=0).stop 2023-11-24T08:05:13.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 shutdown_connections 2023-11-24T08:05:13.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f46a4066620 0x7f46a4068ae0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46c415d450 0x7f46c414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f46c406dac0 0x7f46c415f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 --2- 172.21.15.57:0/1265380241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46c406b8f0 0x7f46c4155a00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 >> 172.21.15.57:0/1265380241 conn(0x7f46c40cf8f0 msgr2=0x7f46c4158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:13.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 shutdown_connections 2023-11-24T08:05:13.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.677+0000 7f46ca7c1640 1 -- 172.21.15.57:0/1265380241 wait complete. 2023-11-24T08:05:13.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:05:13.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd24b5df640 1 Processor -- start 2023-11-24T08:05:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd24b5df640 1 -- start start 2023-11-24T08:05:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd24b5df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd24406c650 0x7fd24409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd24b5df640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2440709c0 0x7fd244070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd24b5df640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24406d8b0 con 0x7fd244144030 2023-11-24T08:05:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd24b5df640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd244145020 con 0x7fd2440709c0 2023-11-24T08:05:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd24b5df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd244071370 con 0x7fd24406c650 2023-11-24T08:05:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd249b7c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2440709c0 0x7fd244070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd249b7c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2440709c0 0x7fd244070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42544/0 (socket says 172.21.15.57:42544) 2023-11-24T08:05:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd249b7c640 1 -- 172.21.15.57:0/1283224808 learned_addr learned my addr 172.21.15.57:0/1283224808 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:13.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd248b7a640 1 --2- 172.21.15.57:0/1283224808 >> v2:172.21.15.132:3300/0 conn(0x7fd24406c650 0x7fd24409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd249b7c640 1 -- 172.21.15.57:0/1283224808 >> v2:172.21.15.132:3300/0 conn(0x7fd24406c650 msgr2=0x7fd24409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:13.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd249b7c640 1 --2- 172.21.15.57:0/1283224808 >> v2:172.21.15.132:3300/0 conn(0x7fd24406c650 0x7fd24409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd249b7c640 1 -- 172.21.15.57:0/1283224808 >> v1:172.21.15.132:6789/0 conn(0x7fd244144030 legacy=0x7fd24406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.857+0000 7fd249b7c640 1 -- 172.21.15.57:0/1283224808 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24406cca0 con 0x7fd2440709c0 2023-11-24T08:05:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd249b7c640 1 --2- 172.21.15.57:0/1283224808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd244070e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd2440700a0 tx=0x7fd23c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ebab68dad9b138 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd23bfff640 1 -- 172.21.15.57:0/1283224808 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0a5780 con 0x7fd2440709c0 2023-11-24T08:05:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd23bfff640 1 -- 172.21.15.57:0/1283224808 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c0a58e0 con 0x7fd2440709c0 2023-11-24T08:05:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd23bfff640 1 -- 172.21.15.57:0/1283224808 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0a5c70 con 0x7fd2440709c0 2023-11-24T08:05:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 -- 172.21.15.57:0/1283224808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 msgr2=0x7fd244070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 --2- 172.21.15.57:0/1283224808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd244070e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd2440700a0 tx=0x7fd23c01c9d0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 -- 172.21.15.57:0/1283224808 shutdown_connections 2023-11-24T08:05:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 --2- 172.21.15.57:0/1283224808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd244070e30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 --2- 172.21.15.57:0/1283224808 >> v2:172.21.15.132:3300/0 conn(0x7fd24406c650 0x7fd24409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 -- 172.21.15.57:0/1283224808 >> 172.21.15.57:0/1283224808 conn(0x7fd2440b0bf0 msgr2=0x7fd2440b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 -- 172.21.15.57:0/1283224808 shutdown_connections 2023-11-24T08:05:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.861+0000 7fd24b5df640 1 -- 172.21.15.57:0/1283224808 wait complete. 2023-11-24T08:05:13.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 Processor -- start 2023-11-24T08:05:13.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 -- start start 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd24406c650 0x7fd24415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd24409a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd244144030 0x7fd2440b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440b3fc0 con 0x7fd2440709c0 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440b3ce0 con 0x7fd244144030 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd244159d80 con 0x7fd24406c650 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd24409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd24409a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42546/0 (socket says 172.21.15.57:42546) 2023-11-24T08:05:13.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 -- 172.21.15.57:0/2642873091 learned_addr learned my addr 172.21.15.57:0/2642873091 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:13.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24937b640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd24406c650 0x7fd24415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd249b7c640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd244144030 0x7fd2440b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 -- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd24406c650 msgr2=0x7fd24415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd24406c650 0x7fd24415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 -- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd244144030 msgr2=0x7fd2440b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd244144030 0x7fd2440b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 -- 172.21.15.57:0/2642873091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c009b30 con 0x7fd2440709c0 2023-11-24T08:05:13.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd248b7a640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd24409a320 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd23400d5f0 tx=0x7fd23400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd239ffb640 1 -- 172.21.15.57:0/2642873091 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340125f0 con 0x7fd2440709c0 2023-11-24T08:05:13.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd239ffb640 1 -- 172.21.15.57:0/2642873091 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234012750 con 0x7fd2440709c0 2023-11-24T08:05:13.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd239ffb640 1 -- 172.21.15.57:0/2642873091 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234012b00 con 0x7fd2440709c0 2023-11-24T08:05:13.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24415a060 con 0x7fd2440709c0 2023-11-24T08:05:13.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.865+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24409a860 con 0x7fd2440709c0 2023-11-24T08:05:13.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.869+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd244067520 con 0x7fd2440709c0 2023-11-24T08:05:13.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.869+0000 7fd239ffb640 1 -- 172.21.15.57:0/2642873091 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fd234012c60 con 0x7fd2440709c0 2023-11-24T08:05:13.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.869+0000 7fd239ffb640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd228066620 0x7fd228068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.869+0000 7fd239ffb640 1 -- 172.21.15.57:0/2642873091 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd2340846a0 con 0x7fd2440709c0 2023-11-24T08:05:13.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.869+0000 7fd24937b640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd228066620 0x7fd228068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.869+0000 7fd24937b640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd228066620 0x7fd228068ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd244139cd0 tx=0x7fd240009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:13.873+0000 7fd239ffb640 1 -- 172.21.15.57:0/2642873091 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd234051850 con 0x7fd2440709c0 2023-11-24T08:05:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.033+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd24415a510 con 0x7fd2440709c0 2023-11-24T08:05:14.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.681+0000 7fd239ffb640 1 -- 172.21.15.57:0/2642873091 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd234054e70 con 0x7fd2440709c0 2023-11-24T08:05:14.688 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:05:14.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd228066620 msgr2=0x7fd228068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd228066620 0x7fd228068ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd244139cd0 tx=0x7fd240009040 comp rx=0 tx=0).stop 2023-11-24T08:05:14.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 msgr2=0x7fd24409a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd24409a320 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd23400d5f0 tx=0x7fd23400dab0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 shutdown_connections 2023-11-24T08:05:14.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd228066620 0x7fd228068ae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd244144030 0x7fd2440b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2440709c0 0x7fd24409a320 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 --2- 172.21.15.57:0/2642873091 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd24406c650 0x7fd24415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 >> 172.21.15.57:0/2642873091 conn(0x7fd2440b0bf0 msgr2=0x7fd24406dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:14.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 shutdown_connections 2023-11-24T08:05:14.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.685+0000 7fd24b5df640 1 -- 172.21.15.57:0/2642873091 wait complete. 2023-11-24T08:05:14.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:05:14.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.861+0000 7f8efefc1640 1 Processor -- start 2023-11-24T08:05:14.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efefc1640 1 -- start start 2023-11-24T08:05:14.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efefc1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ef815a320 0x7f8ef80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efefc1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef815a700 con 0x7f8ef8070da0 2023-11-24T08:05:14.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efefc1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef80b2620 con 0x7f8ef80b36c0 2023-11-24T08:05:14.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efefc1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef80b2430 con 0x7f8ef815a320 2023-11-24T08:05:14.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efcd5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ef815a320 0x7f8ef80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efcd5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ef815a320 0x7f8ef80b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42562/0 (socket says 172.21.15.57:42562) 2023-11-24T08:05:14.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efd55e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8ef8070da0 0x7f8ef815ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60660/0 (socket says 172.21.15.57:60660) 2023-11-24T08:05:14.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efcd5d640 1 -- 172.21.15.57:0/699366429 learned_addr learned my addr 172.21.15.57:0/699366429 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:14.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efcd5d640 1 -- 172.21.15.57:0/699366429 >> v1:172.21.15.132:6789/0 conn(0x7f8ef80b36c0 legacy=0x7f8ef8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:14.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efcd5d640 1 -- 172.21.15.57:0/699366429 >> v1:172.21.15.57:6789/0 conn(0x7f8ef8070da0 legacy=0x7f8ef815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.865+0000 7f8efcd5d640 1 -- 172.21.15.57:0/699366429 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef80b2900 con 0x7f8ef815a320 2023-11-24T08:05:14.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efcd5d640 1 --2- 172.21.15.57:0/699366429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef815a320 0x7f8ef80b1ef0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00acde3ca7de15 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8ef77fe640 1 -- 172.21.15.57:0/699366429 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0ac640 con 0x7f8ef815a320 2023-11-24T08:05:14.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8ef77fe640 1 -- 172.21.15.57:0/699366429 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0ac7a0 con 0x7f8ef815a320 2023-11-24T08:05:14.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8ef77fe640 1 -- 172.21.15.57:0/699366429 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0acb30 con 0x7f8ef815a320 2023-11-24T08:05:14.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 -- 172.21.15.57:0/699366429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef815a320 msgr2=0x7f8ef80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 --2- 172.21.15.57:0/699366429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef815a320 0x7f8ef80b1ef0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec01c4d0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 -- 172.21.15.57:0/699366429 shutdown_connections 2023-11-24T08:05:14.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 --2- 172.21.15.57:0/699366429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef815a320 0x7f8ef80b1ef0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 -- 172.21.15.57:0/699366429 >> 172.21.15.57:0/699366429 conn(0x7f8ef80b0bf0 msgr2=0x7f8ef80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:14.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 -- 172.21.15.57:0/699366429 shutdown_connections 2023-11-24T08:05:14.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 -- 172.21.15.57:0/699366429 wait complete. 2023-11-24T08:05:14.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 Processor -- start 2023-11-24T08:05:14.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.869+0000 7f8efefc1640 1 -- start start 2023-11-24T08:05:14.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ef8070da0 0x7f8ef815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef80b36c0 0x7f8ef80cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ef815a320 0x7f8ef8156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8141840 con 0x7f8ef80b36c0 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8141b20 con 0x7f8ef8070da0 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8141e00 con 0x7f8ef815a320 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef80b36c0 0x7f8ef80cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef80b36c0 0x7f8ef80cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42578/0 (socket says 172.21.15.57:42578) 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 -- 172.21.15.57:0/2874321655 learned_addr learned my addr 172.21.15.57:0/2874321655 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efcd5d640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ef8070da0 0x7f8ef815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efd55e640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ef815a320 0x7f8ef8156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 -- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ef815a320 msgr2=0x7f8ef8156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ef815a320 0x7f8ef8156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 -- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ef8070da0 msgr2=0x7f8ef815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ef8070da0 0x7f8ef815f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 -- 172.21.15.57:0/2874321655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec0094d0 con 0x7f8ef80b36c0 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef7fff640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef80b36c0 0x7f8ef80cc3e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c450 tx=0x7f8ee400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef57fa640 1 -- 172.21.15.57:0/2874321655 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4012830 con 0x7f8ef80b36c0 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef57fa640 1 -- 172.21.15.57:0/2874321655 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee40129b0 con 0x7f8ef80b36c0 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef81420e0 con 0x7f8ef80b36c0 2023-11-24T08:05:14.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8ef57fa640 1 -- 172.21.15.57:0/2874321655 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4012d60 con 0x7f8ef80b36c0 2023-11-24T08:05:14.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef8156990 con 0x7f8ef80b36c0 2023-11-24T08:05:14.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.873+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef8142320 con 0x7f8ef80b36c0 2023-11-24T08:05:14.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.877+0000 7f8ef57fa640 1 -- 172.21.15.57:0/2874321655 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f8ee401c460 con 0x7f8ef80b36c0 2023-11-24T08:05:14.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.877+0000 7f8ef57fa640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8edc066620 0x7f8edc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.877+0000 7f8ef57fa640 1 -- 172.21.15.57:0/2874321655 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f8ee4083e40 con 0x7f8ef80b36c0 2023-11-24T08:05:14.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.877+0000 7f8efcd5d640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8edc066620 0x7f8edc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.877+0000 7f8efcd5d640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8edc066620 0x7f8edc068ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ae000 tx=0x7f8eec0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:14.881+0000 7f8ef57fa640 1 -- 172.21.15.57:0/2874321655 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ef8142320 con 0x7f8ef80b36c0 2023-11-24T08:05:15.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.041+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ef8142320 con 0x7f8ef80b36c0 2023-11-24T08:05:15.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8ef57fa640 1 -- 172.21.15.57:0/2874321655 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8ef8142320 con 0x7f8ef80b36c0 2023-11-24T08:05:15.702 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-11-24T08:05:15.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8edc066620 msgr2=0x7f8edc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8edc066620 0x7f8edc068ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ae000 tx=0x7f8eec0a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:15.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef80b36c0 msgr2=0x7f8ef80cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef80b36c0 0x7f8ef80cc3e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c450 tx=0x7f8ee400c910 comp rx=0 tx=0).stop 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 shutdown_connections 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8edc066620 0x7f8edc068ae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ef815a320 0x7f8ef8156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ef80b36c0 0x7f8ef80cc3e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 --2- 172.21.15.57:0/2874321655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ef8070da0 0x7f8ef815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 >> 172.21.15.57:0/2874321655 conn(0x7f8ef80b0bf0 msgr2=0x7f8ef815c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 shutdown_connections 2023-11-24T08:05:15.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.697+0000 7f8efefc1640 1 -- 172.21.15.57:0/2874321655 wait complete. 2023-11-24T08:05:15.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:05:15.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.873+0000 7f5dc9172640 1 Processor -- start 2023-11-24T08:05:15.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.873+0000 7f5dc9172640 1 -- start start 2023-11-24T08:05:15.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc9172640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5dc40ae4a0 0x7f5dc415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc9172640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 0x7f5dc40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc9172640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc40b3510 con 0x7f5dc40ce250 2023-11-24T08:05:15.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc9172640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40ce6e0 con 0x7f5dc40ae4a0 2023-11-24T08:05:15.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc9172640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b37f0 con 0x7f5dc40cd850 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5dc40ce250 0x7f5dc415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55506/0 (socket says 172.21.15.57:55506) 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 -- 172.21.15.57:0/102465321 learned_addr learned my addr 172.21.15.57:0/102465321 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc2d9d640 1 --2- 172.21.15.57:0/102465321 >> v2:172.21.15.132:3300/0 conn(0x7f5dc40ae4a0 0x7f5dc415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dbbfff640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 0x7f5dc40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103457371 0 0) 0x7f5dc40b3510 con 0x7f5dc40ce250 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5db0003530 con 0x7f5dc40ce250 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76509619 0 0) 0x7f5db0003530 con 0x7f5dc40ce250 2023-11-24T08:05:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 msgr2=0x7f5dc40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 0x7f5dc40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 >> v2:172.21.15.132:3300/0 conn(0x7f5dc40ae4a0 msgr2=0x7f5dc415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 --2- 172.21.15.57:0/102465321 >> v2:172.21.15.132:3300/0 conn(0x7f5dc40ae4a0 0x7f5dc415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40b3ad0 con 0x7f5dc40ce250 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f5dbc001a00 con 0x7f5dc40ce250 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 >> v1:172.21.15.57:6789/0 conn(0x7f5dc40ce250 legacy=0x7f5dc415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0003980 0x7f5db0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 0x7f5db00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0004d10 0x7f5db0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40ce6e0 con 0x7f5db0004d10 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b37f0 con 0x7f5db0003980 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db000b990 con 0x7f5dc40cd850 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0004d10 0x7f5db0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc2d9d640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0003980 0x7f5db0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dbbfff640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 0x7f5db00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 -- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 msgr2=0x7f5db00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc40cd850 0x7f5db00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 -- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0003980 msgr2=0x7f5db0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0003980 0x7f5db0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc359e640 1 -- 172.21.15.57:0/102465321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db0003530 con 0x7f5db0004d10 2023-11-24T08:05:15.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.877+0000 7f5dc2d9d640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0003980 0x7f5db0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:15.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc359e640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0004d10 0x7f5db0005190 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00a890 tx=0x7f5dbc01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1a92a1ceb96169 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0ad630 con 0x7f5db0004d10 2023-11-24T08:05:15.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc0a8070 con 0x7f5db0004d10 2023-11-24T08:05:15.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc259c640 1 -- 172.21.15.57:0/102465321 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0ad9f0 con 0x7f5db0004d10 2023-11-24T08:05:15.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc9172640 1 -- 172.21.15.57:0/102465321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0004d10 msgr2=0x7f5db0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc9172640 1 --2- 172.21.15.57:0/102465321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0004d10 0x7f5db0005190 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00a890 tx=0x7f5dbc01d360 comp rx=0 tx=0).stop 2023-11-24T08:05:15.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc359e640 1 -- 172.21.15.57:0/102465321 reap_dead start 2023-11-24T08:05:15.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc9172640 1 -- 172.21.15.57:0/102465321 shutdown_connections 2023-11-24T08:05:15.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc9172640 1 -- 172.21.15.57:0/102465321 >> 172.21.15.57:0/102465321 conn(0x7f5dc40b0c80 msgr2=0x7f5dc40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:15.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc9172640 1 -- 172.21.15.57:0/102465321 shutdown_connections 2023-11-24T08:05:15.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.881+0000 7f5dc9172640 1 -- 172.21.15.57:0/102465321 wait complete. 2023-11-24T08:05:15.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 Processor -- start 2023-11-24T08:05:15.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 -- start start 2023-11-24T08:05:15.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0004d10 0x7f5dc4071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc414b7f0 0x7f5dc4071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dc415ae50 0x7f5dc415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc415b810 con 0x7f5dc415ae50 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc414bc70 con 0x7f5db0004d10 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc415a440 con 0x7f5dc414b7f0 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dc415ae50 0x7f5dc415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dc415ae50 0x7f5dc415b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34698/0 (socket says 172.21.15.57:34698) 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 -- 172.21.15.57:0/2860382262 learned_addr learned my addr 172.21.15.57:0/2860382262 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dbbfff640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc414b7f0 0x7f5dc4071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc2d9d640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0004d10 0x7f5dc4071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 -- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc414b7f0 msgr2=0x7f5dc4071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc414b7f0 0x7f5dc4071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 -- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0004d10 msgr2=0x7f5dc4071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0004d10 0x7f5dc4071250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 -- 172.21.15.57:0/2860382262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc415a6b0 con 0x7f5dc415ae50 2023-11-24T08:05:15.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc2d9d640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0004d10 0x7f5dc4071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:15.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc359e640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dc415ae50 0x7f5dc415b2d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00a7b0 tx=0x7f5db0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dbb7fe640 1 -- 172.21.15.57:0/2860382262 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0017c0 con 0x7f5dc415ae50 2023-11-24T08:05:15.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dbb7fe640 1 -- 172.21.15.57:0/2860382262 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc001920 con 0x7f5dc415ae50 2023-11-24T08:05:15.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc415a990 con 0x7f5dc415ae50 2023-11-24T08:05:15.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dbb7fe640 1 -- 172.21.15.57:0/2860382262 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc004d70 con 0x7f5dc415ae50 2023-11-24T08:05:15.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc41f6d00 con 0x7f5dc415ae50 2023-11-24T08:05:15.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.885+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc414d470 con 0x7f5dc415ae50 2023-11-24T08:05:15.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.889+0000 7f5dbb7fe640 1 -- 172.21.15.57:0/2860382262 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5dbc0aa030 con 0x7f5dc415ae50 2023-11-24T08:05:15.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.889+0000 7f5dbb7fe640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5da4066620 0x7f5da4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.889+0000 7f5dbb7fe640 1 -- 172.21.15.57:0/2860382262 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5dbc11da20 con 0x7f5dc415ae50 2023-11-24T08:05:15.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.889+0000 7f5dc2d9d640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5da4066620 0x7f5da4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.889+0000 7f5dc2d9d640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5da4066620 0x7f5da4068ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5dc41f6c60 tx=0x7f5db4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:15.893+0000 7f5dbb7fe640 1 -- 172.21.15.57:0/2860382262 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5dc414d470 con 0x7f5dc415ae50 2023-11-24T08:05:16.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.049+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5dc414d470 con 0x7f5dc415ae50 2023-11-24T08:05:16.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.053+0000 7f5dbb7fe640 1 -- 172.21.15.57:0/2860382262 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5dc414d470 con 0x7f5dc415ae50 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5da4066620 msgr2=0x7f5da4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5da4066620 0x7f5da4068ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5dc41f6c60 tx=0x7f5db4008040 comp rx=0 tx=0).stop 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dc415ae50 msgr2=0x7f5dc415b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dc415ae50 0x7f5dc415b2d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00a7b0 tx=0x7f5db0005800 comp rx=0 tx=0).stop 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 shutdown_connections 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5da4066620 0x7f5da4068ae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dc415ae50 0x7f5dc415b2d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dc414b7f0 0x7f5dc4071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 --2- 172.21.15.57:0/2860382262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5db0004d10 0x7f5dc4071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 >> 172.21.15.57:0/2860382262 conn(0x7f5dc40b0c80 msgr2=0x7f5dc415cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 shutdown_connections 2023-11-24T08:05:16.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.057+0000 7f5dc9172640 1 -- 172.21.15.57:0/2860382262 wait complete. 2023-11-24T08:05:16.082 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:05:16.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.217+0000 7f2d558bb640 1 Processor -- start 2023-11-24T08:05:16.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.217+0000 7f2d558bb640 1 -- start start 2023-11-24T08:05:16.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d558bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d5015a320 0x7f2d500b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d558bb640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5015a700 con 0x7f2d50070da0 2023-11-24T08:05:16.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d558bb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500b2620 con 0x7f2d500b36c0 2023-11-24T08:05:16.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d558bb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500b2430 con 0x7f2d5015a320 2023-11-24T08:05:16.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4f7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2d50070da0 0x7f2d5015ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55520/0 (socket says 172.21.15.57:55520) 2023-11-24T08:05:16.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4f7fe640 1 -- 172.21.15.57:0/1307315813 learned_addr learned my addr 172.21.15.57:0/1307315813 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:16.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4effd640 1 --2- 172.21.15.57:0/1307315813 >> v2:172.21.15.132:3300/0 conn(0x7f2d5015a320 0x7f2d500b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4e7fc640 1 -- 172.21.15.57:0/1307315813 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322151958 0 0) 0x7f2d5015a700 con 0x7f2d50070da0 2023-11-24T08:05:16.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4e7fc640 1 -- 172.21.15.57:0/1307315813 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d3c003530 con 0x7f2d50070da0 2023-11-24T08:05:16.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4effd640 1 -- 172.21.15.57:0/1307315813 >> v1:172.21.15.132:6789/0 conn(0x7f2d500b36c0 legacy=0x7f2d50070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4effd640 1 -- 172.21.15.57:0/1307315813 >> v1:172.21.15.57:6789/0 conn(0x7f2d50070da0 legacy=0x7f2d5015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.221+0000 7f2d4effd640 1 -- 172.21.15.57:0/1307315813 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500b2900 con 0x7f2d5015a320 2023-11-24T08:05:16.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d4effd640 1 --2- 172.21.15.57:0/1307315813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500b1ef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d400097c0 tx=0x7f2d4001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8dc8aa10ab3e479 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d4e7fc640 1 -- 172.21.15.57:0/1307315813 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d400ad660 con 0x7f2d5015a320 2023-11-24T08:05:16.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d4e7fc640 1 -- 172.21.15.57:0/1307315813 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d400ad7c0 con 0x7f2d5015a320 2023-11-24T08:05:16.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d4e7fc640 1 -- 172.21.15.57:0/1307315813 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d400adb50 con 0x7f2d5015a320 2023-11-24T08:05:16.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- 172.21.15.57:0/1307315813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 msgr2=0x7f2d500b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 --2- 172.21.15.57:0/1307315813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500b1ef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d400097c0 tx=0x7f2d4001c450 comp rx=0 tx=0).stop 2023-11-24T08:05:16.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- 172.21.15.57:0/1307315813 shutdown_connections 2023-11-24T08:05:16.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 --2- 172.21.15.57:0/1307315813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500b1ef0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- 172.21.15.57:0/1307315813 >> 172.21.15.57:0/1307315813 conn(0x7f2d500b0bf0 msgr2=0x7f2d500b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- 172.21.15.57:0/1307315813 shutdown_connections 2023-11-24T08:05:16.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- 172.21.15.57:0/1307315813 wait complete. 2023-11-24T08:05:16.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 Processor -- start 2023-11-24T08:05:16.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- start start 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d50070da0 0x7f2d500cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d500b36c0 0x7f2d50145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d50146020 con 0x7f2d50070da0 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015c560 con 0x7f2d5015a320 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.225+0000 7f2d558bb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500cba70 con 0x7f2d500b36c0 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d50070da0 0x7f2d500cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d50070da0 0x7f2d500cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34714/0 (socket says 172.21.15.57:34714) 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 -- 172.21.15.57:0/3251402552 learned_addr learned my addr 172.21.15.57:0/3251402552 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d47fff640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d500b36c0 0x7f2d50145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4f7fe640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 -- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d500b36c0 msgr2=0x7f2d50145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d500b36c0 0x7f2d50145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 -- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 msgr2=0x7f2d500af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 -- 172.21.15.57:0/3251402552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009420 con 0x7f2d50070da0 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d47fff640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d500b36c0 0x7f2d50145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4f7fe640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:16.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4effd640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d50070da0 0x7f2d500cc830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2d400b0040 tx=0x7f2d400191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4cff9640 1 -- 172.21.15.57:0/3251402552 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d400ad660 con 0x7f2d50070da0 2023-11-24T08:05:16.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4cff9640 1 -- 172.21.15.57:0/3251402552 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d400b6410 con 0x7f2d50070da0 2023-11-24T08:05:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4cff9640 1 -- 172.21.15.57:0/3251402552 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d400b67e0 con 0x7f2d50070da0 2023-11-24T08:05:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d500cbd50 con 0x7f2d50070da0 2023-11-24T08:05:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d500cc310 con 0x7f2d50070da0 2023-11-24T08:05:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d50067520 con 0x7f2d50070da0 2023-11-24T08:05:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4cff9640 1 -- 172.21.15.57:0/3251402552 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f2d400b4040 con 0x7f2d50070da0 2023-11-24T08:05:16.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.229+0000 7f2d4cff9640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d30066620 0x7f2d30068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.233+0000 7f2d4cff9640 1 -- 172.21.15.57:0/3251402552 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2d4011e270 con 0x7f2d50070da0 2023-11-24T08:05:16.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.233+0000 7f2d47fff640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d30066620 0x7f2d30068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.233+0000 7f2d47fff640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d30066620 0x7f2d30068ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d50070940 tx=0x7f2d38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.237+0000 7f2d4cff9640 1 -- 172.21.15.57:0/3251402552 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d400eb6f0 con 0x7f2d50070da0 2023-11-24T08:05:16.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.445+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f2d500b14f0 con 0x7f2d50070da0 2023-11-24T08:05:16.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.697+0000 7f2d4cff9640 1 -- 172.21.15.57:0/3251402552 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v98) v1 ==== 158+0+0 (secure 0 0 0) 0x7f2d400eed10 con 0x7f2d50070da0 2023-11-24T08:05:16.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d30066620 msgr2=0x7f2d30068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d30066620 0x7f2d30068ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d50070940 tx=0x7f2d38009040 comp rx=0 tx=0).stop 2023-11-24T08:05:16.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d50070da0 msgr2=0x7f2d500cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d50070da0 0x7f2d500cc830 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2d400b0040 tx=0x7f2d400191f0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 shutdown_connections 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2d30066620 0x7f2d30068ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015a320 0x7f2d500af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d500b36c0 0x7f2d50145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 --2- 172.21.15.57:0/3251402552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d50070da0 0x7f2d500cc830 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 >> 172.21.15.57:0/3251402552 conn(0x7f2d500b0bf0 msgr2=0x7f2d5009c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 shutdown_connections 2023-11-24T08:05:16.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.701+0000 7f2d558bb640 1 -- 172.21.15.57:0/3251402552 wait complete. 2023-11-24T08:05:16.726 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2023-11-24T08:05:16.726 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:05:16.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:16.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a71e7640 1 Processor -- start 2023-11-24T08:05:16.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a71e7640 1 -- start start 2023-11-24T08:05:16.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a71e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97a00d3020 0x7f97a00d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a71e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00ce8b0 0x7f97a00ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a71e7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a006c0e0 con 0x7f97a015d570 2023-11-24T08:05:16.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a71e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a00d39f0 con 0x7f97a00d3020 2023-11-24T08:05:16.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a71e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00d1cc0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a4f83640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f97a015d570 0x7f97a006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55536/0 (socket says 172.21.15.57:55536) 2023-11-24T08:05:16.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a4f83640 1 -- 172.21.15.57:0/1808938969 learned_addr learned my addr 172.21.15.57:0/1808938969 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:16.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f979ffff640 1 --2- 172.21.15.57:0/1808938969 >> v2:172.21.15.132:3300/0 conn(0x7f97a00d3020 0x7f97a00d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a5784640 1 --2- 172.21.15.57:0/1808938969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00ce8b0 0x7f97a00ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f979f7fe640 1 -- 172.21.15.57:0/1808938969 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361545183 0 0) 0x7f97a006c0e0 con 0x7f97a015d570 2023-11-24T08:05:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f979f7fe640 1 -- 172.21.15.57:0/1808938969 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9790003530 con 0x7f97a015d570 2023-11-24T08:05:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a5784640 1 -- 172.21.15.57:0/1808938969 >> v2:172.21.15.132:3300/0 conn(0x7f97a00d3020 msgr2=0x7f97a00d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a5784640 1 --2- 172.21.15.57:0/1808938969 >> v2:172.21.15.132:3300/0 conn(0x7f97a00d3020 0x7f97a00d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a5784640 1 -- 172.21.15.57:0/1808938969 >> v1:172.21.15.57:6789/0 conn(0x7f97a015d570 legacy=0x7f97a006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f97a5784640 1 -- 172.21.15.57:0/1808938969 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00d1fa0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.865+0000 7f979ffff640 1 --2- 172.21.15.57:0/1808938969 >> v2:172.21.15.132:3300/0 conn(0x7f97a00d3020 0x7f97a00d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:16.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a5784640 1 --2- 172.21.15.57:0/1808938969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00ce8b0 0x7f97a00ced40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9798009d90 tx=0x7f979801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94fa3d131d98c4d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f979f7fe640 1 -- 172.21.15.57:0/1808938969 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97980a59e0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f979f7fe640 1 -- 172.21.15.57:0/1808938969 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97980a5b40 con 0x7f97a00ce8b0 2023-11-24T08:05:16.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f979f7fe640 1 -- 172.21.15.57:0/1808938969 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97980ad440 con 0x7f97a00ce8b0 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 -- 172.21.15.57:0/1808938969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00ce8b0 msgr2=0x7f97a00ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 --2- 172.21.15.57:0/1808938969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00ce8b0 0x7f97a00ced40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9798009d90 tx=0x7f979801c920 comp rx=0 tx=0).stop 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 -- 172.21.15.57:0/1808938969 shutdown_connections 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 --2- 172.21.15.57:0/1808938969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00ce8b0 0x7f97a00ced40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 --2- 172.21.15.57:0/1808938969 >> v2:172.21.15.132:3300/0 conn(0x7f97a00d3020 0x7f97a00d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 -- 172.21.15.57:0/1808938969 >> 172.21.15.57:0/1808938969 conn(0x7f97a008ceb0 msgr2=0x7f97a009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 -- 172.21.15.57:0/1808938969 shutdown_connections 2023-11-24T08:05:16.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.869+0000 7f97a71e7640 1 -- 172.21.15.57:0/1808938969 wait complete. 2023-11-24T08:05:16.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 Processor -- start 2023-11-24T08:05:16.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 -- start start 2023-11-24T08:05:16.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00ce8b0 0x7f97a015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d3020 0x7f97a00c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d570 0x7f97a00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c82b0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c8520 con 0x7f97a015d570 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c8800 con 0x7f97a00d3020 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00ce8b0 0x7f97a015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00ce8b0 0x7f97a015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34730/0 (socket says 172.21.15.57:34730) 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 -- 172.21.15.57:0/3356615525 learned_addr learned my addr 172.21.15.57:0/3356615525 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f979ffff640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d3020 0x7f97a00c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a5784640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d570 0x7f97a00c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 -- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d3020 msgr2=0x7f97a00c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d3020 0x7f97a00c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 -- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d570 msgr2=0x7f97a00c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d570 0x7f97a00c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 -- 172.21.15.57:0/3356615525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c009420 con 0x7f97a00ce8b0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a4f83640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00ce8b0 0x7f97a015eb40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f979400c420 tx=0x7f979400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f979d7fa640 1 -- 172.21.15.57:0/3356615525 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794005cf0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f979d7fa640 1 -- 172.21.15.57:0/3356615525 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9794005e50 con 0x7f97a00ce8b0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9798009a70 con 0x7f97a00ce8b0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f979d7fa640 1 -- 172.21.15.57:0/3356615525 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940072d0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.873+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a00c8dc0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.877+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a0067520 con 0x7f97a00ce8b0 2023-11-24T08:05:16.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.877+0000 7f979d7fa640 1 -- 172.21.15.57:0/3356615525 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f9794007430 con 0x7f97a00ce8b0 2023-11-24T08:05:16.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.877+0000 7f979d7fa640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9784066620 0x7f9784068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.877+0000 7f979d7fa640 1 -- 172.21.15.57:0/3356615525 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f97940833a0 con 0x7f97a00ce8b0 2023-11-24T08:05:16.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.877+0000 7f979ffff640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9784066620 0x7f9784068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.877+0000 7f979ffff640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9784066620 0x7f9784068ae0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97a015ea70 tx=0x7f978c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:16.881+0000 7f979d7fa640 1 -- 172.21.15.57:0/3356615525 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9794050960 con 0x7f97a00ce8b0 2023-11-24T08:05:17.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.041+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97a006b7b0 con 0x7f97a00ce8b0 2023-11-24T08:05:17.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.041+0000 7f979d7fa640 1 -- 172.21.15.57:0/3356615525 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12926 (secure 0 0 0) 0x7f9794053f80 con 0x7f97a00ce8b0 2023-11-24T08:05:17.048 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:17.048 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":40,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:15.688004+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6837/404616365":"2023-11-25T08:05:12.662905+0000","172.21.15.132:6836/404616365":"2023-11-25T08:05:12.662905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:17.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.041+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9784066620 msgr2=0x7f9784068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.041+0000 7f97a71e7640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9784066620 0x7f9784068ae0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97a015ea70 tx=0x7f978c009190 comp rx=0 tx=0).stop 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.041+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00ce8b0 msgr2=0x7f97a015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.041+0000 7f97a71e7640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00ce8b0 0x7f97a015eb40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f979400c420 tx=0x7f979400c8e0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 shutdown_connections 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9784066620 0x7f9784068ae0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97a015d570 0x7f97a00c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97a00d3020 0x7f97a00c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 --2- 172.21.15.57:0/3356615525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97a00ce8b0 0x7f97a015eb40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 >> 172.21.15.57:0/3356615525 conn(0x7f97a008ceb0 msgr2=0x7f97a006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 shutdown_connections 2023-11-24T08:05:17.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.045+0000 7f97a71e7640 1 -- 172.21.15.57:0/3356615525 wait complete. 2023-11-24T08:05:17.070 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:17.071 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:17.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.209+0000 7f86cc101640 1 Processor -- start 2023-11-24T08:05:17.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86cc101640 1 -- start start 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86cc101640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86c40ae4a0 0x7f86c415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86cc101640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40cd850 0x7f86c40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86cc101640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40b3510 con 0x7f86c40ce250 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86cc101640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c40ce6e0 con 0x7f86c40ae4a0 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86cc101640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40b37f0 con 0x7f86c40cd850 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c9e9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86c40ae4a0 0x7f86c415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c9e9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86c40ae4a0 0x7f86c415ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34742/0 (socket says 172.21.15.57:34742) 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c9e9d640 1 -- 172.21.15.57:0/1147637655 learned_addr learned my addr 172.21.15.57:0/1147637655 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:17.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c969c640 1 --2- 172.21.15.57:0/1147637655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40cd850 0x7f86c40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c9e9d640 1 -- 172.21.15.57:0/1147637655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40cd850 msgr2=0x7f86c40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c9e9d640 1 --2- 172.21.15.57:0/1147637655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40cd850 0x7f86c40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c9e9d640 1 -- 172.21.15.57:0/1147637655 >> v1:172.21.15.132:6789/0 conn(0x7f86c40ce250 legacy=0x7f86c415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.213+0000 7f86c9e9d640 1 -- 172.21.15.57:0/1147637655 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40b3ad0 con 0x7f86c40ae4a0 2023-11-24T08:05:17.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86c9e9d640 1 --2- 172.21.15.57:0/1147637655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c415ba00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3da157df627112 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86c8e9b640 1 -- 172.21.15.57:0/1147637655 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00aa670 con 0x7f86c40ae4a0 2023-11-24T08:05:17.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86c8e9b640 1 -- 172.21.15.57:0/1147637655 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00aa7d0 con 0x7f86c40ae4a0 2023-11-24T08:05:17.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86c8e9b640 1 -- 172.21.15.57:0/1147637655 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00aab60 con 0x7f86c40ae4a0 2023-11-24T08:05:17.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 -- 172.21.15.57:0/1147637655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 msgr2=0x7f86c415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 --2- 172.21.15.57:0/1147637655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c415ba00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c001c510 comp rx=0 tx=0).stop 2023-11-24T08:05:17.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 -- 172.21.15.57:0/1147637655 shutdown_connections 2023-11-24T08:05:17.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 --2- 172.21.15.57:0/1147637655 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40cd850 0x7f86c40cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 --2- 172.21.15.57:0/1147637655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c415ba00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 -- 172.21.15.57:0/1147637655 >> 172.21.15.57:0/1147637655 conn(0x7f86c40b0c80 msgr2=0x7f86c40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 -- 172.21.15.57:0/1147637655 shutdown_connections 2023-11-24T08:05:17.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 -- 172.21.15.57:0/1147637655 wait complete. 2023-11-24T08:05:17.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 Processor -- start 2023-11-24T08:05:17.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.217+0000 7f86cc101640 1 -- start start 2023-11-24T08:05:17.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86c40cd850 0x7f86c41534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40ce250 0x7f86c40af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c413af40 con 0x7f86c40ae4a0 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c414e3b0 con 0x7f86c40cd850 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c413d4d0 con 0x7f86c40ce250 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c414de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34748/0 (socket says 172.21.15.57:34748) 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 -- 172.21.15.57:0/3774779858 learned_addr learned my addr 172.21.15.57:0/3774779858 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 -- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40ce250 msgr2=0x7f86c40af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40ce250 0x7f86c40af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 -- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86c40cd850 msgr2=0x7f86c41534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86c40cd850 0x7f86c41534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 -- 172.21.15.57:0/3774779858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00094d0 con 0x7f86c40ae4a0 2023-11-24T08:05:17.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86c9e9d640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c414de70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f86c00ac040 tx=0x7f86c001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86ba7fc640 1 -- 172.21.15.57:0/3774779858 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b3800 con 0x7f86c40ae4a0 2023-11-24T08:05:17.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86ba7fc640 1 -- 172.21.15.57:0/3774779858 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00b3980 con 0x7f86c40ae4a0 2023-11-24T08:05:17.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86ba7fc640 1 -- 172.21.15.57:0/3774779858 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b3d30 con 0x7f86c40ae4a0 2023-11-24T08:05:17.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c413d7b0 con 0x7f86c40ae4a0 2023-11-24T08:05:17.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c413dd70 con 0x7f86c40ae4a0 2023-11-24T08:05:17.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c413df60 con 0x7f86c40ae4a0 2023-11-24T08:05:17.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.221+0000 7f86ba7fc640 1 -- 172.21.15.57:0/3774779858 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f86c00b2380 con 0x7f86c40ae4a0 2023-11-24T08:05:17.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.225+0000 7f86ba7fc640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86a8066620 0x7f86a8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.225+0000 7f86ba7fc640 1 -- 172.21.15.57:0/3774779858 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86c011e790 con 0x7f86c40ae4a0 2023-11-24T08:05:17.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.225+0000 7f86c969c640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86a8066620 0x7f86a8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.225+0000 7f86c969c640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86a8066620 0x7f86a8068ae0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f86b4006aa0 tx=0x7f86b4006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.229+0000 7f86ba7fc640 1 -- 172.21.15.57:0/3774779858 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86c413df60 con 0x7f86c40ae4a0 2023-11-24T08:05:17.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86c413df60 con 0x7f86c40ae4a0 2023-11-24T08:05:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86ba7fc640 1 -- 172.21.15.57:0/3774779858 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86c413df60 con 0x7f86c40ae4a0 2023-11-24T08:05:17.394 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:05:17.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86a8066620 msgr2=0x7f86a8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86a8066620 0x7f86a8068ae0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f86b4006aa0 tx=0x7f86b4006a30 comp rx=0 tx=0).stop 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 msgr2=0x7f86c414de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c414de70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f86c00ac040 tx=0x7f86c001ad50 comp rx=0 tx=0).stop 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 shutdown_connections 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86a8066620 0x7f86a8068ae0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86c40ce250 0x7f86c40af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86c40cd850 0x7f86c41534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 --2- 172.21.15.57:0/3774779858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c40ae4a0 0x7f86c414de70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 >> 172.21.15.57:0/3774779858 conn(0x7f86c40b0c80 msgr2=0x7f86c40cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 shutdown_connections 2023-11-24T08:05:17.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.389+0000 7f86cc101640 1 -- 172.21.15.57:0/3774779858 wait complete. 2023-11-24T08:05:17.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T08:05:17.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8cb2c8640 1 Processor -- start 2023-11-24T08:05:17.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8cb2c8640 1 -- start start 2023-11-24T08:05:17.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8cb2c8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c415d500 0x7fa8c40ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8cb2c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8c40cfc10 0x7fa8c40d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8cb2c8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c40d21c0 con 0x7fa8c40d3e80 2023-11-24T08:05:17.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8cb2c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c40d0600 con 0x7fa8c40cfc10 2023-11-24T08:05:17.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8cb2c8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40cdcd0 con 0x7fa8c415d500 2023-11-24T08:05:17.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8c9ac5640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa8c40d3e80 0x7fa8c40d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55542/0 (socket says 172.21.15.57:55542) 2023-11-24T08:05:17.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8c9ac5640 1 -- 172.21.15.57:0/1263632795 learned_addr learned my addr 172.21.15.57:0/1263632795 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8caac7640 1 --2- 172.21.15.57:0/1263632795 >> v2:172.21.15.132:3300/0 conn(0x7fa8c40cfc10 0x7fa8c40d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8ca2c6640 1 --2- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c415d500 0x7fa8c40ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8c92c4640 1 -- 172.21.15.57:0/1263632795 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442958391 0 0) 0x7fa8c40d21c0 con 0x7fa8c40d3e80 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8c92c4640 1 -- 172.21.15.57:0/1263632795 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b0003530 con 0x7fa8c40d3e80 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8caac7640 1 -- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c415d500 msgr2=0x7fa8c40ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8caac7640 1 --2- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c415d500 0x7fa8c40ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8caac7640 1 -- 172.21.15.57:0/1263632795 >> v1:172.21.15.57:6789/0 conn(0x7fa8c40d3e80 legacy=0x7fa8c40d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.553+0000 7fa8caac7640 1 -- 172.21.15.57:0/1263632795 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c40d1ef0 con 0x7fa8c40cfc10 2023-11-24T08:05:17.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8caac7640 1 --2- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40cfc10 0x7fa8c40d00c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009d90 tx=0x7fa8bc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374017e844c39eae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8c92c4640 1 -- 172.21.15.57:0/1263632795 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0a59e0 con 0x7fa8c40cfc10 2023-11-24T08:05:17.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8c92c4640 1 -- 172.21.15.57:0/1263632795 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0a5b40 con 0x7fa8c40cfc10 2023-11-24T08:05:17.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8c92c4640 1 -- 172.21.15.57:0/1263632795 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0ad440 con 0x7fa8c40cfc10 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40cfc10 msgr2=0x7fa8c40d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40cfc10 0x7fa8c40d00c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009d90 tx=0x7fa8bc01c920 comp rx=0 tx=0).stop 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/1263632795 shutdown_connections 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40cfc10 0x7fa8c40d00c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/1263632795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c415d500 0x7fa8c40ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/1263632795 >> 172.21.15.57:0/1263632795 conn(0x7fa8c409c540 msgr2=0x7fa8c40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/1263632795 shutdown_connections 2023-11-24T08:05:17.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.557+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/1263632795 wait complete. 2023-11-24T08:05:17.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 Processor -- start 2023-11-24T08:05:17.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 -- start start 2023-11-24T08:05:17.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c40cfc10 0x7fa8c414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40d3e80 0x7fa8c41584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8c415d500 0x7fa8c415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41551c0 con 0x7fa8c415d500 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41554a0 con 0x7fa8c40d3e80 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c415c2d0 con 0x7fa8c40cfc10 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8c415d500 0x7fa8c415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8c415d500 0x7fa8c415eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34762/0 (socket says 172.21.15.57:34762) 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 -- 172.21.15.57:0/3583191231 learned_addr learned my addr 172.21.15.57:0/3583191231 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8c9ac5640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40d3e80 0x7fa8c41584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8ca2c6640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c40cfc10 0x7fa8c414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 -- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c40cfc10 msgr2=0x7fa8c414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c40cfc10 0x7fa8c414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 -- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40d3e80 msgr2=0x7fa8c41584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40d3e80 0x7fa8c41584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 -- 172.21.15.57:0/3583191231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009a70 con 0x7fa8c415d500 2023-11-24T08:05:17.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8caac7640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8c415d500 0x7fa8c415eab0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b0040 tx=0x7fa8bc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8baffd640 1 -- 172.21.15.57:0/3583191231 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0adce0 con 0x7fa8c415d500 2023-11-24T08:05:17.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8baffd640 1 -- 172.21.15.57:0/3583191231 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0ade40 con 0x7fa8c415d500 2023-11-24T08:05:17.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8baffd640 1 -- 172.21.15.57:0/3583191231 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0b9690 con 0x7fa8c415d500 2023-11-24T08:05:17.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c415c5b0 con 0x7fa8c415d500 2023-11-24T08:05:17.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.561+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c41589e0 con 0x7fa8c415d500 2023-11-24T08:05:17.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.565+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c415c410 con 0x7fa8c415d500 2023-11-24T08:05:17.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.565+0000 7fa8baffd640 1 -- 172.21.15.57:0/3583191231 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fa8bc0b97f0 con 0x7fa8c415d500 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.565+0000 7fa8baffd640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa8a8066620 0x7fa8a8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.565+0000 7fa8baffd640 1 -- 172.21.15.57:0/3583191231 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8bc11f3e0 con 0x7fa8c415d500 2023-11-24T08:05:17.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.565+0000 7fa8ca2c6640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa8a8066620 0x7fa8a8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.565+0000 7fa8ca2c6640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa8a8066620 0x7fa8a8068ae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009ac0 tx=0x7fa8c0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.569+0000 7fa8baffd640 1 -- 172.21.15.57:0/3583191231 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8c415c410 con 0x7fa8c415d500 2023-11-24T08:05:17.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:17.785+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7fa8c415c410 con 0x7fa8c415d500 2023-11-24T08:05:18.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:18.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.705+0000 7fa8baffd640 1 -- 172.21.15.57:0/3583191231 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v100) v1 ==== 143+0+0 (secure 0 0 0) 0x7fa8c415c410 con 0x7fa8c415d500 2023-11-24T08:05:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa8a8066620 msgr2=0x7fa8a8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa8a8066620 0x7fa8a8068ae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009ac0 tx=0x7fa8c0009190 comp rx=0 tx=0).stop 2023-11-24T08:05:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8c415d500 msgr2=0x7fa8c415eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8c415d500 0x7fa8c415eab0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b0040 tx=0x7fa8bc0196c0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 shutdown_connections 2023-11-24T08:05:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa8a8066620 0x7fa8a8068ae0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8c415d500 0x7fa8c415eab0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8c40d3e80 0x7fa8c41584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 --2- 172.21.15.57:0/3583191231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8c40cfc10 0x7fa8c414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 >> 172.21.15.57:0/3583191231 conn(0x7fa8c409c540 msgr2=0x7fa8c4156160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:18.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 shutdown_connections 2023-11-24T08:05:18.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.709+0000 7fa8cb2c8640 1 -- 172.21.15.57:0/3583191231 wait complete. 2023-11-24T08:05:18.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:05:18.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.881+0000 7feb0f59e640 1 Processor -- start 2023-11-24T08:05:18.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.881+0000 7feb0f59e640 1 -- start start 2023-11-24T08:05:18.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0f59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feb100cdf10 0x7feb1015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0f59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb10161570 0x7feb10161a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0f59e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb10161090 con 0x7feb100cdb30 2023-11-24T08:05:18.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0f59e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb100cf620 con 0x7feb100cdf10 2023-11-24T08:05:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0f59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb10161f40 con 0x7feb10161570 2023-11-24T08:05:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb07fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feb100cdf10 0x7feb1015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0e59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7feb100cdb30 0x7feb100cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55556/0 (socket says 172.21.15.57:55556) 2023-11-24T08:05:18.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0e59c640 1 -- 172.21.15.57:0/1258998337 learned_addr learned my addr 172.21.15.57:0/1258998337 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:18.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb0ed9d640 1 --2- 172.21.15.57:0/1258998337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb10161570 0x7feb10161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb07fff640 1 -- 172.21.15.57:0/1258998337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb10161570 msgr2=0x7feb10161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:18.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb07fff640 1 --2- 172.21.15.57:0/1258998337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb10161570 0x7feb10161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb07fff640 1 -- 172.21.15.57:0/1258998337 >> v1:172.21.15.57:6789/0 conn(0x7feb100cdb30 legacy=0x7feb100cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.885+0000 7feb07fff640 1 -- 172.21.15.57:0/1258998337 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1015e010 con 0x7feb100cdf10 2023-11-24T08:05:18.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb07fff640 1 --2- 172.21.15.57:0/1258998337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb100cdf10 0x7feb1015da00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feaf80097c0 tx=0x7feaf801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec55603a010b370 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0dd9b640 1 -- 172.21.15.57:0/1258998337 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80ab650 con 0x7feb100cdf10 2023-11-24T08:05:18.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0dd9b640 1 -- 172.21.15.57:0/1258998337 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf80ab7b0 con 0x7feb100cdf10 2023-11-24T08:05:18.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0dd9b640 1 -- 172.21.15.57:0/1258998337 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80abb40 con 0x7feb100cdf10 2023-11-24T08:05:18.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 -- 172.21.15.57:0/1258998337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb100cdf10 msgr2=0x7feb1015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 --2- 172.21.15.57:0/1258998337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb100cdf10 0x7feb1015da00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feaf80097c0 tx=0x7feaf801c450 comp rx=0 tx=0).stop 2023-11-24T08:05:18.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 -- 172.21.15.57:0/1258998337 shutdown_connections 2023-11-24T08:05:18.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 --2- 172.21.15.57:0/1258998337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb10161570 0x7feb10161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 --2- 172.21.15.57:0/1258998337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb100cdf10 0x7feb1015da00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 -- 172.21.15.57:0/1258998337 >> 172.21.15.57:0/1258998337 conn(0x7feb10060fd0 msgr2=0x7feb100613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:18.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 -- 172.21.15.57:0/1258998337 shutdown_connections 2023-11-24T08:05:18.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 -- 172.21.15.57:0/1258998337 wait complete. 2023-11-24T08:05:18.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 Processor -- start 2023-11-24T08:05:18.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.889+0000 7feb0f59e640 1 -- start start 2023-11-24T08:05:18.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb100cdb30 0x7feb1014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb100cdf10 0x7feb100c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb10161570 0x7feb1015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb101486c0 con 0x7feb10161570 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb10148c80 con 0x7feb100cdf10 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1014c700 con 0x7feb100cdb30 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb10161570 0x7feb1015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb10161570 0x7feb1015c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34780/0 (socket says 172.21.15.57:34780) 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 -- 172.21.15.57:0/679229122 learned_addr learned my addr 172.21.15.57:0/679229122 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0e59c640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb100cdb30 0x7feb1014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb07fff640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb100cdf10 0x7feb100c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 -- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb100cdb30 msgr2=0x7feb1014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb100cdb30 0x7feb1014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 -- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb100cdf10 msgr2=0x7feb100c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb100cdf10 0x7feb100c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 -- 172.21.15.57:0/679229122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009420 con 0x7feb10161570 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0ed9d640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb10161570 0x7feb1015c710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feb08007ec0 tx=0x7feb0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb06ffd640 1 -- 172.21.15.57:0/679229122 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08014620 con 0x7feb10161570 2023-11-24T08:05:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb06ffd640 1 -- 172.21.15.57:0/679229122 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb080147a0 con 0x7feb10161570 2023-11-24T08:05:18.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb10160640 con 0x7feb10161570 2023-11-24T08:05:18.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb06ffd640 1 -- 172.21.15.57:0/679229122 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08014b50 con 0x7feb10161570 2023-11-24T08:05:18.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb10148910 con 0x7feb10161570 2023-11-24T08:05:18.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb10148e10 con 0x7feb10161570 2023-11-24T08:05:18.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.893+0000 7feb06ffd640 1 -- 172.21.15.57:0/679229122 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7feb08014cb0 con 0x7feb10161570 2023-11-24T08:05:18.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.897+0000 7feb06ffd640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feaf0066620 0x7feaf0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.897+0000 7feb06ffd640 1 -- 172.21.15.57:0/679229122 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb08084670 con 0x7feb10161570 2023-11-24T08:05:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.897+0000 7feb0e59c640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feaf0066620 0x7feaf0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.897+0000 7feb0e59c640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feaf0066620 0x7feaf0068ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb00000f70 tx=0x7feb00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:18.901+0000 7feb06ffd640 1 -- 172.21.15.57:0/679229122 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb08051c10 con 0x7feb10161570 2023-11-24T08:05:19.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.057+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feb1004e850 con 0x7feb10161570 2023-11-24T08:05:19.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb06ffd640 1 -- 172.21.15.57:0/679229122 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7feb08055230 con 0x7feb10161570 2023-11-24T08:05:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feaf0066620 msgr2=0x7feaf0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feaf0066620 0x7feaf0068ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb00000f70 tx=0x7feb00009040 comp rx=0 tx=0).stop 2023-11-24T08:05:19.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb10161570 msgr2=0x7feb1015c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb10161570 0x7feb1015c710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feb08007ec0 tx=0x7feb0800e4b0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 shutdown_connections 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feaf0066620 0x7feaf0068ae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb10161570 0x7feb1015c710 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb100cdf10 0x7feb100c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 --2- 172.21.15.57:0/679229122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb100cdb30 0x7feb1014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 >> 172.21.15.57:0/679229122 conn(0x7feb10060fd0 msgr2=0x7feb1006e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 shutdown_connections 2023-11-24T08:05:19.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.065+0000 7feb0f59e640 1 -- 172.21.15.57:0/679229122 wait complete. 2023-11-24T08:05:19.091 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:05:19.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:19.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:19.299 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:05:19.299 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:19.299 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:19.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:05:19.309 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:19.309 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:19.318 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:05:19.318 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:19.318 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:19.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:05:19.362 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:19.362 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:19.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:05:19.373 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:05:19.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:19.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.545+0000 7f31b8db8640 1 Processor -- start 2023-11-24T08:05:19.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.545+0000 7f31b8db8640 1 -- start start 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b8db8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 0x7f31b4164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b8db8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b415a700 con 0x7f31b40b36c0 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b8db8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40b2380 con 0x7f31b415a320 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b8db8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b2620 con 0x7f31b40b1ef0 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31abfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f31b40b36c0 0x7f31b4070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55572/0 (socket says 172.21.15.57:55572) 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31abfff640 1 -- 172.21.15.57:0/3126872247 learned_addr learned my addr 172.21.15.57:0/3126872247 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b2d9d640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 0x7f31b4164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721730976 0 0) 0x7f31b415a700 con 0x7f31b40b36c0 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a0003530 con 0x7f31b40b36c0 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803232784 0 0) 0x7f31a0003530 con 0x7f31b40b36c0 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 msgr2=0x7f31b4164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 0x7f31b4164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 >> v1:172.21.15.132:6789/0 conn(0x7f31b415a320 legacy=0x7f31b4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40b2900 con 0x7f31b40b36c0 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f319c001680 con 0x7f31b40b36c0 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 >> v1:172.21.15.57:6789/0 conn(0x7f31b40b36c0 legacy=0x7f31b4070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 0x7f31a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31a0004d10 0x7f31a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b2620 con 0x7f31a00039b0 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a000b990 con 0x7f31a0004d10 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a000bb50 con 0x7f31b40b1ef0 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b259c640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31abfff640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 0x7f31a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b2d9d640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31a0004d10 0x7f31a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b259c640 1 -- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 msgr2=0x7f31a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b259c640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b40b1ef0 0x7f31a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b259c640 1 -- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31a0004d10 msgr2=0x7f31a0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b259c640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31a0004d10 0x7f31a0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.549+0000 7f31b259c640 1 -- 172.21.15.57:0/3126872247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0003530 con 0x7f31a00039b0 2023-11-24T08:05:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b259c640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31a0003d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f31a4001910 tx=0x7f31a401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3660899b1ef4e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40a7a00 con 0x7f31a00039b0 2023-11-24T08:05:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a40a7b80 con 0x7f31a00039b0 2023-11-24T08:05:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b1d9b640 1 -- 172.21.15.57:0/3126872247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40af440 con 0x7f31a00039b0 2023-11-24T08:05:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b8db8640 1 -- 172.21.15.57:0/3126872247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 msgr2=0x7f31a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b8db8640 1 --2- 172.21.15.57:0/3126872247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31a0003d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f31a4001910 tx=0x7f31a401eb10 comp rx=0 tx=0).stop 2023-11-24T08:05:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b2d9d640 1 -- 172.21.15.57:0/3126872247 reap_dead start 2023-11-24T08:05:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b8db8640 1 -- 172.21.15.57:0/3126872247 shutdown_connections 2023-11-24T08:05:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b8db8640 1 -- 172.21.15.57:0/3126872247 >> 172.21.15.57:0/3126872247 conn(0x7f31b40b0bf0 msgr2=0x7f31b40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:19.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b8db8640 1 -- 172.21.15.57:0/3126872247 shutdown_connections 2023-11-24T08:05:19.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.553+0000 7f31b8db8640 1 -- 172.21.15.57:0/3126872247 wait complete. 2023-11-24T08:05:19.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 Processor -- start 2023-11-24T08:05:19.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 -- start start 2023-11-24T08:05:19.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31b41453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b409a190 0x7f31b409a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b4158ee0 0x7f31b4159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b41598a0 con 0x7f31a00039b0 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4145910 con 0x7f31b4158ee0 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b409ac30 con 0x7f31b409a190 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31b41453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31b41453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34802/0 (socket says 172.21.15.57:34802) 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 -- 172.21.15.57:0/2985703540 learned_addr learned my addr 172.21.15.57:0/2985703540 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31abfff640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b409a190 0x7f31b409a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b2d9d640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b4158ee0 0x7f31b4159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 -- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b409a190 msgr2=0x7f31b409a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b409a190 0x7f31b409a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 -- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b4158ee0 msgr2=0x7f31b4159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b4158ee0 0x7f31b4159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 -- 172.21.15.57:0/2985703540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b409af10 con 0x7f31a00039b0 2023-11-24T08:05:19.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b259c640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31b41453d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f31a4025020 tx=0x7f31a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31aaffd640 1 -- 172.21.15.57:0/2985703540 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40a7a00 con 0x7f31a00039b0 2023-11-24T08:05:19.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31aaffd640 1 -- 172.21.15.57:0/2985703540 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a40afa80 con 0x7f31a00039b0 2023-11-24T08:05:19.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b409b1f0 con 0x7f31a00039b0 2023-11-24T08:05:19.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31aaffd640 1 -- 172.21.15.57:0/2985703540 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40afdf0 con 0x7f31a00039b0 2023-11-24T08:05:19.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b415c010 con 0x7f31a00039b0 2023-11-24T08:05:19.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.557+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b4067520 con 0x7f31a00039b0 2023-11-24T08:05:19.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.561+0000 7f31aaffd640 1 -- 172.21.15.57:0/2985703540 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f31a40b6070 con 0x7f31a00039b0 2023-11-24T08:05:19.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.561+0000 7f31aaffd640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3194066650 0x7f3194068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.561+0000 7f31aaffd640 1 -- 172.21.15.57:0/2985703540 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31a411db60 con 0x7f31a00039b0 2023-11-24T08:05:19.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.561+0000 7f31abfff640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3194066650 0x7f3194068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.561+0000 7f31abfff640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3194066650 0x7f3194068b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31b409cd10 tx=0x7f319c001c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.565+0000 7f31aaffd640 1 -- 172.21.15.57:0/2985703540 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31a40eb050 con 0x7f31a00039b0 2023-11-24T08:05:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.757+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31b40ad590 con 0x7f31a00039b0 2023-11-24T08:05:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31aaffd640 1 -- 172.21.15.57:0/2985703540 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f31a40ee670 con 0x7f31a00039b0 2023-11-24T08:05:19.766 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4999,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2109788946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2109788946},{"type":"v1","addr":"172.21.15.132:6835","nonce":2109788946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5088,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3040903718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3040903718},{"type":"v1","addr":"172.21.15.57:6834","nonce":3040903718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/412231567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":412231567},{"type":"v1","addr":"172.21.15.57:6835","nonce":412231567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5344,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/4041442033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4041442033},{"type":"v1","addr":"172.21.15.132:6837","nonce":4041442033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-11-24T08:05:19.766 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3194066650 msgr2=0x7f3194068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3194066650 0x7f3194068b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31b409cd10 tx=0x7f319c001c00 comp rx=0 tx=0).stop 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 msgr2=0x7f31b41453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31b41453d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f31a4025020 tx=0x7f31a0005800 comp rx=0 tx=0).stop 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 shutdown_connections 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3194066650 0x7f3194068b10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31b4158ee0 0x7f31b4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31b409a190 0x7f31b409a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 --2- 172.21.15.57:0/2985703540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31a00039b0 0x7f31b41453d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 >> 172.21.15.57:0/2985703540 conn(0x7f31b40b0bf0 msgr2=0x7f31b40afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 shutdown_connections 2023-11-24T08:05:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:19.761+0000 7f31b8db8640 1 -- 172.21.15.57:0/2985703540 wait complete. 2023-11-24T08:05:19.787 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:05:19.787 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:05:19.788 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:05:19.788 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:19.788 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:05:19.788 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:05:19.789 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:05:19.789 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:19.789 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:05:19.789 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:05:19.789 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:05:19.789 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:19.790 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:05:19.790 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:05:19.790 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:05:19.790 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:19.801 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:05:19.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:05:19.802 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:05:19.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:05:19.804 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:05:19.805 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:05:19.806 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:05:19.806 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:05:19.852 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:05:19.852 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:19.854 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:05:19.855 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:19.855 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:05:19.855 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:19.858 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:05:19.858 DEBUG:teuthology.parallel:result is None 2023-11-24T08:05:19.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:05:19.943 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-11-24T08:05:19.943 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-11-24T08:05:19.945 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-11-24T08:05:19.946 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-11-24T08:05:19.948 INFO:tasks.ceph.mds.b.smithi132.stderr:2023-11-24T08:05:19.941+0000 7fb79ca90640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6835/0: (98) Address already in use 2023-11-24T08:05:20.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7b3a1640 1 Processor -- start 2023-11-24T08:05:20.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7b3a1640 1 -- start start 2023-11-24T08:05:20.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7b3a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 0x7fec740cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7b3a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec740c9650 0x7fec740c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7b3a1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740c9fe0 con 0x7fec7415b220 2023-11-24T08:05:20.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7b3a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec74072710 con 0x7fec740c9650 2023-11-24T08:05:20.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7b3a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740abed0 con 0x7fec7415b600 2023-11-24T08:05:20.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7913d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fec7415b220 0x7fec7406d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55612/0 (socket says 172.21.15.57:55612) 2023-11-24T08:05:20.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7913d640 1 -- 172.21.15.57:0/479347481 learned_addr learned my addr 172.21.15.57:0/479347481 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7893c640 1 --2- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 0x7fec740cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7993e640 1 --2- 172.21.15.57:0/479347481 >> v2:172.21.15.132:3300/0 conn(0x7fec740c9650 0x7fec740c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec6bfff640 1 -- 172.21.15.57:0/479347481 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349177994 0 0) 0x7fec70001120 con 0x7fec7415b220 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec6bfff640 1 -- 172.21.15.57:0/479347481 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec60003530 con 0x7fec7415b220 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec6bfff640 1 -- 172.21.15.57:0/479347481 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 627097216 0 0) 0x7fec60003530 con 0x7fec7415b220 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7993e640 1 -- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 msgr2=0x7fec740cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7993e640 1 --2- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 0x7fec740cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7993e640 1 -- 172.21.15.57:0/479347481 >> v1:172.21.15.57:6789/0 conn(0x7fec7415b220 legacy=0x7fec7406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.001+0000 7fec7993e640 1 -- 172.21.15.57:0/479347481 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74072370 con 0x7fec740c9650 2023-11-24T08:05:20.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec7993e640 1 --2- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec740c9650 0x7fec740c9aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009d90 tx=0x7fec6c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a2b61ea43a7b6f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec6bfff640 1 -- 172.21.15.57:0/479347481 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70001810 con 0x7fec740c9650 2023-11-24T08:05:20.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec6bfff640 1 -- 172.21.15.57:0/479347481 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c0a5640 con 0x7fec740c9650 2023-11-24T08:05:20.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec6bfff640 1 -- 172.21.15.57:0/479347481 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0a59b0 con 0x7fec740c9650 2023-11-24T08:05:20.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec7b3a1640 1 -- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec740c9650 msgr2=0x7fec740c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec740c9650 0x7fec740c9aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009d90 tx=0x7fec6c01c840 comp rx=0 tx=0).stop 2023-11-24T08:05:20.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec7b3a1640 1 -- 172.21.15.57:0/479347481 shutdown_connections 2023-11-24T08:05:20.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec740c9650 0x7fec740c9aa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/479347481 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 0x7fec740cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.005+0000 7fec7b3a1640 1 -- 172.21.15.57:0/479347481 >> 172.21.15.57:0/479347481 conn(0x7fec740b0bf0 msgr2=0x7fec740b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:20.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 -- 172.21.15.57:0/479347481 shutdown_connections 2023-11-24T08:05:20.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 -- 172.21.15.57:0/479347481 wait complete. 2023-11-24T08:05:20.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 Processor -- start 2023-11-24T08:05:20.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 -- start start 2023-11-24T08:05:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec740c9650 0x7fec740ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7415b220 0x7fec74154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 0x7fec74145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec741528a0 con 0x7fec740c9650 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec741458c0 con 0x7fec7415b220 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec741565c0 con 0x7fec7415b600 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec740c9650 0x7fec740ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec740c9650 0x7fec740ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34840/0 (socket says 172.21.15.57:34840) 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 -- 172.21.15.57:0/672531594 learned_addr learned my addr 172.21.15.57:0/672531594 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 -- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 msgr2=0x7fec74145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 0x7fec74145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7893c640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7415b220 0x7fec74154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 -- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7415b220 msgr2=0x7fec74154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7415b220 0x7fec74154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 -- 172.21.15.57:0/672531594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009a70 con 0x7fec740c9650 2023-11-24T08:05:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7893c640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7415b220 0x7fec74154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7913d640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec740c9650 0x7fec740ce560 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fec7000c780 tx=0x7fec7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec69ffb640 1 -- 172.21.15.57:0/672531594 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70005ae0 con 0x7fec740c9650 2023-11-24T08:05:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec69ffb640 1 -- 172.21.15.57:0/672531594 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec70005c60 con 0x7fec740c9650 2023-11-24T08:05:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec69ffb640 1 -- 172.21.15.57:0/672531594 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70007070 con 0x7fec740c9650 2023-11-24T08:05:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.009+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec74157140 con 0x7fec740c9650 2023-11-24T08:05:20.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.013+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec74156af0 con 0x7fec740c9650 2023-11-24T08:05:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.013+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7409d250 con 0x7fec740c9650 2023-11-24T08:05:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.013+0000 7fec69ffb640 1 -- 172.21.15.57:0/672531594 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fec700071d0 con 0x7fec740c9650 2023-11-24T08:05:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.013+0000 7fec69ffb640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fec58066620 0x7fec58068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.013+0000 7fec69ffb640 1 -- 172.21.15.57:0/672531594 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fec70083460 con 0x7fec740c9650 2023-11-24T08:05:20.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.013+0000 7fec7893c640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fec58066620 0x7fec58068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.017+0000 7fec7893c640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fec58066620 0x7fec58068ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec740c90d0 tx=0x7fec64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.017+0000 7fec69ffb640 1 -- 172.21.15.57:0/672531594 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec70050950 con 0x7fec740c9650 2023-11-24T08:05:20.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.185+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fec740c9fe0 con 0x7fec740c9650 2023-11-24T08:05:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.725+0000 7fec69ffb640 1 -- 172.21.15.57:0/672531594 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7fec740c9fe0 con 0x7fec740c9650 2023-11-24T08:05:20.731 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blocklist entries 2023-11-24T08:05:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fec58066620 msgr2=0x7fec58068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fec58066620 0x7fec58068ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec740c90d0 tx=0x7fec64008040 comp rx=0 tx=0).stop 2023-11-24T08:05:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec740c9650 msgr2=0x7fec740ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec740c9650 0x7fec740ce560 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fec7000c780 tx=0x7fec7000cc40 comp rx=0 tx=0).stop 2023-11-24T08:05:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 shutdown_connections 2023-11-24T08:05:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fec58066620 0x7fec58068ae0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fec7415b600 0x7fec74145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7415b220 0x7fec74154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 --2- 172.21.15.57:0/672531594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec740c9650 0x7fec740ce560 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 >> 172.21.15.57:0/672531594 conn(0x7fec740b0bf0 msgr2=0x7fec7415e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 shutdown_connections 2023-11-24T08:05:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.729+0000 7fec7b3a1640 1 -- 172.21.15.57:0/672531594 wait complete. 2023-11-24T08:05:20.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:05:20.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.897+0000 7fafb649c640 1 Processor -- start 2023-11-24T08:05:20.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.897+0000 7fafb649c640 1 -- start start 2023-11-24T08:05:20.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafb649c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafb0147140 0x7fafb01612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafb649c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00caf20 con 0x7fafb00cee80 2023-11-24T08:05:20.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafb649c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb0161d40 con 0x7fafb0161830 2023-11-24T08:05:20.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafb649c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb0147520 con 0x7fafb0147140 2023-11-24T08:05:20.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafb4a39640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fafb00cee80 0x7fafb00cb9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55626/0 (socket says 172.21.15.57:55626) 2023-11-24T08:05:20.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafaffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafb0147140 0x7fafb01612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafb4a39640 1 -- 172.21.15.57:0/292245171 learned_addr learned my addr 172.21.15.57:0/292245171 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:20.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafaffff640 1 -- 172.21.15.57:0/292245171 >> v1:172.21.15.132:6789/0 conn(0x7fafb0161830 legacy=0x7fafb00ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafaeffd640 1 -- 172.21.15.57:0/292245171 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144754271 0 0) 0x7fafb00caf20 con 0x7fafb00cee80 2023-11-24T08:05:20.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafaffff640 1 -- 172.21.15.57:0/292245171 >> v1:172.21.15.57:6789/0 conn(0x7fafb00cee80 legacy=0x7fafb00cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.901+0000 7fafaffff640 1 -- 172.21.15.57:0/292245171 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0162020 con 0x7fafb0147140 2023-11-24T08:05:20.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafaffff640 1 --2- 172.21.15.57:0/292245171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb01612f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fafa00097c0 tx=0x7fafa001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df66f7f144a7b5f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafaeffd640 1 -- 172.21.15.57:0/292245171 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00ab680 con 0x7fafb0147140 2023-11-24T08:05:20.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafaeffd640 1 -- 172.21.15.57:0/292245171 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa00ab7e0 con 0x7fafb0147140 2023-11-24T08:05:20.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafaeffd640 1 -- 172.21.15.57:0/292245171 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00abb70 con 0x7fafb0147140 2023-11-24T08:05:20.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 -- 172.21.15.57:0/292245171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 msgr2=0x7fafb01612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 --2- 172.21.15.57:0/292245171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb01612f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fafa00097c0 tx=0x7fafa001c480 comp rx=0 tx=0).stop 2023-11-24T08:05:20.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 -- 172.21.15.57:0/292245171 shutdown_connections 2023-11-24T08:05:20.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 --2- 172.21.15.57:0/292245171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb01612f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 -- 172.21.15.57:0/292245171 >> 172.21.15.57:0/292245171 conn(0x7fafb00b1180 msgr2=0x7fafb00b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:20.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 -- 172.21.15.57:0/292245171 shutdown_connections 2023-11-24T08:05:20.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 -- 172.21.15.57:0/292245171 wait complete. 2023-11-24T08:05:20.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 Processor -- start 2023-11-24T08:05:20.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 -- start start 2023-11-24T08:05:20.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafb00cee80 0x7fafb013cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.905+0000 7fafb649c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb649c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafb0161830 0x7fafb0157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb649c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb015f9e0 con 0x7fafb0147140 2023-11-24T08:05:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb649c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb013d450 con 0x7fafb0161830 2023-11-24T08:05:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb649c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb015edd0 con 0x7fafb00cee80 2023-11-24T08:05:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb015e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34852/0 (socket says 172.21.15.57:34852) 2023-11-24T08:05:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 -- 172.21.15.57:0/1799145182 learned_addr learned my addr 172.21.15.57:0/1799145182 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb4a39640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafb0161830 0x7fafb0157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaffff640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafb00cee80 0x7fafb013cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 -- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafb00cee80 msgr2=0x7fafb013cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafb00cee80 0x7fafb013cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 -- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafb0161830 msgr2=0x7fafb0157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafb0161830 0x7fafb0157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 -- 172.21.15.57:0/1799145182 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0009420 con 0x7fafb0147140 2023-11-24T08:05:20.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaffff640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafb00cee80 0x7fafb013cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:20.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafaf7fe640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb015e3f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c3c0 tx=0x7fafa400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafacff9640 1 -- 172.21.15.57:0/1799145182 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa40052d0 con 0x7fafb0147140 2023-11-24T08:05:20.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafacff9640 1 -- 172.21.15.57:0/1799145182 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4005450 con 0x7fafb0147140 2023-11-24T08:05:20.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafacff9640 1 -- 172.21.15.57:0/1799145182 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4003890 con 0x7fafb0147140 2023-11-24T08:05:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb015f0b0 con 0x7fafb0147140 2023-11-24T08:05:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb015f670 con 0x7fafb0147140 2023-11-24T08:05:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0071cd0 con 0x7fafb0147140 2023-11-24T08:05:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.909+0000 7fafacff9640 1 -- 172.21.15.57:0/1799145182 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fafa40039f0 con 0x7fafb0147140 2023-11-24T08:05:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.913+0000 7fafacff9640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf9c066670 0x7faf9c068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.913+0000 7fafacff9640 1 -- 172.21.15.57:0/1799145182 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fafa40832f0 con 0x7fafb0147140 2023-11-24T08:05:20.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.913+0000 7fafaffff640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf9c066670 0x7faf9c068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.913+0000 7fafaffff640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf9c066670 0x7faf9c068b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fafa00af000 tx=0x7fafa00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:20.917+0000 7fafacff9640 1 -- 172.21.15.57:0/1799145182 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafa40508d0 con 0x7fafb0147140 2023-11-24T08:05:21.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.125+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fafb0067520 con 0x7fafb0147140 2023-11-24T08:05:21.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.125+0000 7fafacff9640 1 -- 172.21.15.57:0/1799145182 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fafa4053ef0 con 0x7fafb0147140 2023-11-24T08:05:21.132 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBli5Y5IBAAnvP0ucgaWCMVrPGzxD66SA==", 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlIvACLRAA3GBFpw4471E7VMC1v83uKw==", 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBltsHpJxAA4cXeOlSioW+qpB6iET0JYA==", 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.135 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.d", 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlMAZmNBAAJ764yAUaJrB0C/NMgccnIQ==", 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCxWGBlL0EOIRAAGl5XgP5YNoKHFXcAZ7x8Dw==", 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.136 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC0WGBllgHlKBAAs4PpDKC95e8EbMikLNYamg==", 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.137 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC3WGBl0BHZMBAAO9QEi1GOOfCUoxneHsmMtQ==", 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC6WGBl7854ORAAjYNCXFSYc+rSJHmK5WNuBQ==", 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2023-11-24T08:05:21.139 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDBWGBlOWLlCBAAn/3woUG2ZUM65EvKQ/plBg==", 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDEWGBlbNduDxAABASB690ioHFg1QYgfbclaA==", 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.140 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDHWGBlpKlsFRAAIIo9fYbozro/Zf40wo7pqg==", 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDKWGBlVZj5GxAAkCx/Ev5UjrAu+8MKzlZrWw==", 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2023-11-24T08:05:21.142 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg==", 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2023-11-24T08:05:21.143 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBl+4YCBxAAKfb7t9BjuhCDnWDrdkswdA==", 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.2", 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBlzP4XAxAAgbiVgyWCJo76uqBghI1FOw==", 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.3", 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBlm45BDRAAv46vHB8X5TFKK0XqdxA1tQ==", 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:05:21.146 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:05:21.146 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:05:21.146 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:05:21.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.146 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2023-11-24T08:05:21.147 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlCwEjAxAAPy/bfz67KrMkV+ORpi2LWA==", 2023-11-24T08:05:21.147 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.147 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:05:21.147 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlE12EGxAAnyGvPcM8AfeaVmxsl+MaBg==", 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-11-24T08:05:21.148 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlAy9zFxAA6XZfIsLKTOoOTouFh2tD9w==", 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:21.149 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-11-24T08:05:21.150 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:05:21.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf9c066670 msgr2=0x7faf9c068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf9c066670 0x7faf9c068b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fafa00af000 tx=0x7fafa00a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 msgr2=0x7fafb015e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb015e3f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c3c0 tx=0x7fafa400c880 comp rx=0 tx=0).stop 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 shutdown_connections 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf9c066670 0x7faf9c068b30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafb0161830 0x7fafb0157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb0147140 0x7fafb015e3f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 --2- 172.21.15.57:0/1799145182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafb00cee80 0x7fafb013cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 >> 172.21.15.57:0/1799145182 conn(0x7fafb00b1180 msgr2=0x7fafb00b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 shutdown_connections 2023-11-24T08:05:21.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.129+0000 7fafb649c640 1 -- 172.21.15.57:0/1799145182 wait complete. 2023-11-24T08:05:21.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:21.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5d4fdf640 1 Processor -- start 2023-11-24T08:05:21.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5d4fdf640 1 -- start start 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5d4fdf640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5d015d570 0x7fc5d006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5d4fdf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5d4fdf640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d00d39c0 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5d4fdf640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00d1cc0 con 0x7fc5d015d570 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5d4fdf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00d1fa0 con 0x7fc5d00d3020 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5ced9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc5d00ce8b0 0x7fc5d00ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55632/0 (socket says 172.21.15.57:55632) 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5ce59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5d015d570 0x7fc5d006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5ced9d640 1 -- 172.21.15.57:0/2160102599 learned_addr learned my addr 172.21.15.57:0/2160102599 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:21.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5c7fff640 1 --2- 172.21.15.57:0/2160102599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5ce59c640 1 -- 172.21.15.57:0/2160102599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 msgr2=0x7fc5d00d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5ce59c640 1 --2- 172.21.15.57:0/2160102599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5ce59c640 1 -- 172.21.15.57:0/2160102599 >> v1:172.21.15.57:6789/0 conn(0x7fc5d00ce8b0 legacy=0x7fc5d00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5cdd9b640 1 -- 172.21.15.57:0/2160102599 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887816764 0 0) 0x7fc5d00d39c0 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5ce59c640 1 -- 172.21.15.57:0/2160102599 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00ce0b0 con 0x7fc5d015d570 2023-11-24T08:05:21.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.293+0000 7fc5c7fff640 1 --2- 172.21.15.57:0/2160102599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:21.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5ce59c640 1 --2- 172.21.15.57:0/2160102599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d015d570 0x7fc5d006b9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00097c0 tx=0x7fc5c001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682081eebbe7e4a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5cdd9b640 1 -- 172.21.15.57:0/2160102599 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00ac640 con 0x7fc5d015d570 2023-11-24T08:05:21.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5cdd9b640 1 -- 172.21.15.57:0/2160102599 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c00ac7a0 con 0x7fc5d015d570 2023-11-24T08:05:21.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5cdd9b640 1 -- 172.21.15.57:0/2160102599 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00acb30 con 0x7fc5d015d570 2023-11-24T08:05:21.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/2160102599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d015d570 msgr2=0x7fc5d006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/2160102599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d015d570 0x7fc5d006b9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00097c0 tx=0x7fc5c001c3c0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/2160102599 shutdown_connections 2023-11-24T08:05:21.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/2160102599 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/2160102599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d015d570 0x7fc5d006b9d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/2160102599 >> 172.21.15.57:0/2160102599 conn(0x7fc5d008ceb0 msgr2=0x7fc5d009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/2160102599 shutdown_connections 2023-11-24T08:05:21.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/2160102599 wait complete. 2023-11-24T08:05:21.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.297+0000 7fc5d4fdf640 1 Processor -- start 2023-11-24T08:05:21.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 -- start start 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d00ce8b0 0x7fc5d014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5d015d570 0x7fc5d00c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d014c6e0 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d015c290 con 0x7fc5d015d570 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d015dc00 con 0x7fc5d00d3020 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d00ce8b0 0x7fc5d014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d00ce8b0 0x7fc5d014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34858/0 (socket says 172.21.15.57:34858) 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 -- 172.21.15.57:0/4252157458 learned_addr learned my addr 172.21.15.57:0/4252157458 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5c7fff640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ced9d640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5d015d570 0x7fc5d00c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 -- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 msgr2=0x7fc5d00c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 -- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5d015d570 msgr2=0x7fc5d00c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5d015d570 0x7fc5d00c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 -- 172.21.15.57:0/4252157458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c0009420 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5c7fff640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5ce59c640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d00ce8b0 0x7fc5d014c1a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00af040 tx=0x7fc5c001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5c6ffd640 1 -- 172.21.15.57:0/4252157458 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00b8650 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5c6ffd640 1 -- 172.21.15.57:0/4252157458 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c00b87b0 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5c6ffd640 1 -- 172.21.15.57:0/4252157458 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00b8b40 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d015dee0 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d015e4a0 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.301+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d0067520 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.305+0000 7fc5c6ffd640 1 -- 172.21.15.57:0/4252157458 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc5c00b8ca0 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.305+0000 7fc5c6ffd640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066620 0x7fc5b0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.305+0000 7fc5c6ffd640 1 -- 172.21.15.57:0/4252157458 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc5c011ec10 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.305+0000 7fc5c7fff640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066620 0x7fc5b0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.305+0000 7fc5c7fff640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066620 0x7fc5b0068ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc5d01602b0 tx=0x7fc5b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.309+0000 7fc5c6ffd640 1 -- 172.21.15.57:0/4252157458 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5c00ec030 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.465+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5d0159340 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5c6ffd640 1 -- 172.21.15.57:0/4252157458 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fc5c00b1070 con 0x7fc5d00ce8b0 2023-11-24T08:05:21.474 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:21.474 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":44,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:20.738050+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:21.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066620 msgr2=0x7fc5b0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066620 0x7fc5b0068ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc5d01602b0 tx=0x7fc5b8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:21.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d00ce8b0 msgr2=0x7fc5d014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d00ce8b0 0x7fc5d014c1a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00af040 tx=0x7fc5c001ac00 comp rx=0 tx=0).stop 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 shutdown_connections 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc5b0066620 0x7fc5b0068ae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5d015d570 0x7fc5d00c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5d00d3020 0x7fc5d00c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 --2- 172.21.15.57:0/4252157458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5d00ce8b0 0x7fc5d014c1a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 >> 172.21.15.57:0/4252157458 conn(0x7fc5d008ceb0 msgr2=0x7fc5d00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 shutdown_connections 2023-11-24T08:05:21.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.469+0000 7fc5d4fdf640 1 -- 172.21.15.57:0/4252157458 wait complete. 2023-11-24T08:05:21.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:21.496 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:21.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.633+0000 7f4dbb1aa640 1 Processor -- start 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4dbb1aa640 1 -- start start 2023-11-24T08:05:21.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4dbb1aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4db415a290 0x7f4db40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4dbb1aa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db40b1f80 0x7f4db40b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4dbb1aa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db4071170 con 0x7f4db415ec60 2023-11-24T08:05:21.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4dbb1aa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40cb690 con 0x7f4db415a290 2023-11-24T08:05:21.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4dbb1aa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db40cb970 con 0x7f4db40b1f80 2023-11-24T08:05:21.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db8f46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4db415a290 0x7f4db40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db9747640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db40b1f80 0x7f4db40b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4db415ec60 0x7f4db40cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:57458/0 (socket says 172.21.15.57:57458) 2023-11-24T08:05:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db3fff640 1 -- 172.21.15.57:0/459858452 learned_addr learned my addr 172.21.15.57:0/459858452 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db37fe640 1 -- 172.21.15.57:0/459858452 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418399928 0 0) 0x7f4db4071170 con 0x7f4db415ec60 2023-11-24T08:05:21.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db37fe640 1 -- 172.21.15.57:0/459858452 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da4003530 con 0x7f4db415ec60 2023-11-24T08:05:21.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db8f46640 1 -- 172.21.15.57:0/459858452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db40b1f80 msgr2=0x7f4db40b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db8f46640 1 --2- 172.21.15.57:0/459858452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db40b1f80 0x7f4db40b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db8f46640 1 -- 172.21.15.57:0/459858452 >> v1:172.21.15.132:6789/0 conn(0x7f4db415ec60 legacy=0x7f4db40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.637+0000 7f4db8f46640 1 -- 172.21.15.57:0/459858452 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db40cbc50 con 0x7f4db415a290 2023-11-24T08:05:21.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4db8f46640 1 --2- 172.21.15.57:0/459858452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db415a290 0x7f4db40707f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4da80097c0 tx=0x7f4da801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee5ec09de3f84e51 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4db37fe640 1 -- 172.21.15.57:0/459858452 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80ab600 con 0x7f4db415a290 2023-11-24T08:05:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4db37fe640 1 -- 172.21.15.57:0/459858452 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da80a7050 con 0x7f4db415a290 2023-11-24T08:05:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4db37fe640 1 -- 172.21.15.57:0/459858452 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80ab960 con 0x7f4db415a290 2023-11-24T08:05:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/459858452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db415a290 msgr2=0x7f4db40707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/459858452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db415a290 0x7f4db40707f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4da80097c0 tx=0x7f4da801c3f0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/459858452 shutdown_connections 2023-11-24T08:05:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/459858452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db40b1f80 0x7f4db40b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/459858452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db415a290 0x7f4db40707f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/459858452 >> 172.21.15.57:0/459858452 conn(0x7f4db40b0c80 msgr2=0x7f4db40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/459858452 shutdown_connections 2023-11-24T08:05:21.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.641+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/459858452 wait complete. 2023-11-24T08:05:21.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 Processor -- start 2023-11-24T08:05:21.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 -- start start 2023-11-24T08:05:21.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db40b1f80 0x7f4db4149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db415a290 0x7f4db4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4db415ec60 0x7f4db41580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db41575b0 con 0x7f4db415ec60 2023-11-24T08:05:21.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4155730 con 0x7f4db40b1f80 2023-11-24T08:05:21.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4154bb0 con 0x7f4db415a290 2023-11-24T08:05:21.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4db415ec60 0x7f4db41580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4db415ec60 0x7f4db41580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34866/0 (socket says 172.21.15.57:34866) 2023-11-24T08:05:21.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db8f46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db40b1f80 0x7f4db4149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 -- 172.21.15.57:0/497176833 learned_addr learned my addr 172.21.15.57:0/497176833 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:21.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db3fff640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db415a290 0x7f4db4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 -- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db415a290 msgr2=0x7f4db4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db415a290 0x7f4db4157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 -- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db40b1f80 msgr2=0x7f4db4149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db40b1f80 0x7f4db4149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 -- 172.21.15.57:0/497176833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009420 con 0x7f4db415ec60 2023-11-24T08:05:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db8f46640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db40b1f80 0x7f4db4149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db9747640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4db415ec60 0x7f4db41580e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00efc0 tx=0x7f4dac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db17fa640 1 -- 172.21.15.57:0/497176833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac009ba0 con 0x7f4db415ec60 2023-11-24T08:05:21.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db17fa640 1 -- 172.21.15.57:0/497176833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac00f040 con 0x7f4db415ec60 2023-11-24T08:05:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4db17fa640 1 -- 172.21.15.57:0/497176833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0146c0 con 0x7f4db415ec60 2023-11-24T08:05:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db4070f40 con 0x7f4db415ec60 2023-11-24T08:05:21.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db4155170 con 0x7f4db415ec60 2023-11-24T08:05:21.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.645+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db404e8c0 con 0x7f4db415ec60 2023-11-24T08:05:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.649+0000 7f4db17fa640 1 -- 172.21.15.57:0/497176833 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f4dac014820 con 0x7f4db415ec60 2023-11-24T08:05:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.649+0000 7f4db17fa640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4d98066620 0x7f4d98068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.649+0000 7f4db17fa640 1 -- 172.21.15.57:0/497176833 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4dac0848b0 con 0x7f4db415ec60 2023-11-24T08:05:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.649+0000 7f4db8f46640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4d98066620 0x7f4d98068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.649+0000 7f4db8f46640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4d98066620 0x7f4d98068ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4da80ad000 tx=0x7f4da80a4f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.653+0000 7f4db17fa640 1 -- 172.21.15.57:0/497176833 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4dac051d90 con 0x7f4db415ec60 2023-11-24T08:05:21.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4db41565b0 con 0x7f4db415ec60 2023-11-24T08:05:21.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4db17fa640 1 -- 172.21.15.57:0/497176833 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4dac0180a0 con 0x7f4db415ec60 2023-11-24T08:05:21.820 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:05:21.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4d98066620 msgr2=0x7f4d98068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4d98066620 0x7f4d98068ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4da80ad000 tx=0x7f4da80a4f90 comp rx=0 tx=0).stop 2023-11-24T08:05:21.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4db415ec60 msgr2=0x7f4db41580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4db415ec60 0x7f4db41580e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00efc0 tx=0x7f4dac00c490 comp rx=0 tx=0).stop 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 shutdown_connections 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4d98066620 0x7f4d98068ae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4db415ec60 0x7f4db41580e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4db415a290 0x7f4db4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 --2- 172.21.15.57:0/497176833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db40b1f80 0x7f4db4149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.813+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 >> 172.21.15.57:0/497176833 conn(0x7f4db40b0c80 msgr2=0x7f4db40aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.817+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 shutdown_connections 2023-11-24T08:05:21.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.817+0000 7f4dbb1aa640 1 -- 172.21.15.57:0/497176833 wait complete. 2023-11-24T08:05:21.841 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:05:21.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.977+0000 7f077cefe640 1 Processor -- start 2023-11-24T08:05:21.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.977+0000 7f077cefe640 1 -- start start 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f077cefe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778145630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f077cefe640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780b1b70 con 0x7f077806acc0 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f077cefe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780b15b0 con 0x7f07780b0a00 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f077cefe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780b1890 con 0x7f07780b30a0 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f076ffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f077806acc0 0x7f0778144f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55646/0 (socket says 172.21.15.57:55646) 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f076ffff640 1 -- 172.21.15.57:0/1616245306 learned_addr learned my addr 172.21.15.57:0/1616245306 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0776d9d640 1 --2- 172.21.15.57:0/1616245306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0775d9b640 1 -- 172.21.15.57:0/1616245306 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570435964 0 0) 0x7f07780b1b70 con 0x7f077806acc0 2023-11-24T08:05:21.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0775d9b640 1 -- 172.21.15.57:0/1616245306 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0764003530 con 0x7f077806acc0 2023-11-24T08:05:21.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0776d9d640 1 -- 172.21.15.57:0/1616245306 >> v1:172.21.15.132:6789/0 conn(0x7f07780b0a00 legacy=0x7f077806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0775d9b640 1 -- 172.21.15.57:0/1616245306 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157232707 0 0) 0x7f07780b15b0 con 0x7f07780b0a00 2023-11-24T08:05:21.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0776d9d640 1 -- 172.21.15.57:0/1616245306 >> v1:172.21.15.57:6789/0 conn(0x7f077806acc0 legacy=0x7f0778144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0776d9d640 1 -- 172.21.15.57:0/1616245306 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780b4ca0 con 0x7f07780b30a0 2023-11-24T08:05:21.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.981+0000 7f0776d9d640 1 --2- 172.21.15.57:0/1616245306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778145630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0770009dc0 tx=0x7f077001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d237329002d7b5be server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f0775d9b640 1 -- 172.21.15.57:0/1616245306 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07700a59d0 con 0x7f07780b30a0 2023-11-24T08:05:21.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f0775d9b640 1 -- 172.21.15.57:0/1616245306 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07700a5b30 con 0x7f07780b30a0 2023-11-24T08:05:21.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f0775d9b640 1 -- 172.21.15.57:0/1616245306 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07700ad440 con 0x7f07780b30a0 2023-11-24T08:05:21.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- 172.21.15.57:0/1616245306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 msgr2=0x7f0778145630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 --2- 172.21.15.57:0/1616245306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778145630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0770009dc0 tx=0x7f077001c970 comp rx=0 tx=0).stop 2023-11-24T08:05:21.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- 172.21.15.57:0/1616245306 shutdown_connections 2023-11-24T08:05:21.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 --2- 172.21.15.57:0/1616245306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778145630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- 172.21.15.57:0/1616245306 >> 172.21.15.57:0/1616245306 conn(0x7f07780b55c0 msgr2=0x7f07780b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- 172.21.15.57:0/1616245306 shutdown_connections 2023-11-24T08:05:21.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- 172.21.15.57:0/1616245306 wait complete. 2023-11-24T08:05:21.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 Processor -- start 2023-11-24T08:05:21.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- start start 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077806acc0 0x7f077809b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07780b0a00 0x7f077809cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077809bb60 con 0x7f077806acc0 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077809be40 con 0x7f07780b0a00 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077cefe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077809c120 con 0x7f07780b30a0 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077806acc0 0x7f077809b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077806acc0 0x7f077809b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34872/0 (socket says 172.21.15.57:34872) 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.985+0000 7f077659c640 1 -- 172.21.15.57:0/1401680053 learned_addr learned my addr 172.21.15.57:0/1401680053 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:21.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f0776d9d640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f076ffff640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07780b0a00 0x7f077809cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077659c640 1 -- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 msgr2=0x7f0778140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077659c640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077659c640 1 -- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07780b0a00 msgr2=0x7f077809cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077659c640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07780b0a00 0x7f077809cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077659c640 1 -- 172.21.15.57:0/1401680053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770009a70 con 0x7f077806acc0 2023-11-24T08:05:21.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077659c640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077806acc0 0x7f077809b4f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f076800c4d0 tx=0x7f076800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f076effd640 1 -- 172.21.15.57:0/1401680053 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768005480 con 0x7f077806acc0 2023-11-24T08:05:21.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f076effd640 1 -- 172.21.15.57:0/1401680053 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768003600 con 0x7f077806acc0 2023-11-24T08:05:21.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f076effd640 1 -- 172.21.15.57:0/1401680053 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680039b0 con 0x7f077806acc0 2023-11-24T08:05:21.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077809c400 con 0x7f077806acc0 2023-11-24T08:05:21.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077809d140 con 0x7f077806acc0 2023-11-24T08:05:21.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778067520 con 0x7f077806acc0 2023-11-24T08:05:21.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f076effd640 1 -- 172.21.15.57:0/1401680053 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f0768003b10 con 0x7f077806acc0 2023-11-24T08:05:21.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f076effd640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0758066650 0x7f0758068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.989+0000 7f076effd640 1 -- 172.21.15.57:0/1401680053 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07680833c0 con 0x7f077806acc0 2023-11-24T08:05:21.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.993+0000 7f076ffff640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0758066650 0x7f0758068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.993+0000 7f076ffff640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0758066650 0x7f0758068b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f077815ce40 tx=0x7f0760009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:21.997+0000 7f076effd640 1 -- 172.21.15.57:0/1401680053 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0768050a60 con 0x7f077806acc0 2023-11-24T08:05:22.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.153+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f07781418a0 con 0x7f077806acc0 2023-11-24T08:05:22.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.153+0000 7f076effd640 1 -- 172.21.15.57:0/1401680053 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0768017020 con 0x7f077806acc0 2023-11-24T08:05:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:22.161 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-11-24T08:05:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-11-24T08:05:22.161 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-11-24T08:05:22.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:22.162 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-11-24T08:05:22.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0758066650 msgr2=0x7f0758068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0758066650 0x7f0758068b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f077815ce40 tx=0x7f0760009040 comp rx=0 tx=0).stop 2023-11-24T08:05:22.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077806acc0 msgr2=0x7f077809b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077806acc0 0x7f077809b4f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f076800c4d0 tx=0x7f076800c990 comp rx=0 tx=0).stop 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 shutdown_connections 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0758066650 0x7f0758068b10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07780b30a0 0x7f0778140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07780b0a00 0x7f077809cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 --2- 172.21.15.57:0/1401680053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077806acc0 0x7f077809b4f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 >> 172.21.15.57:0/1401680053 conn(0x7f07780b55c0 msgr2=0x7f07780afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 shutdown_connections 2023-11-24T08:05:22.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.157+0000 7f077cefe640 1 -- 172.21.15.57:0/1401680053 wait complete. 2023-11-24T08:05:22.182 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:05:22.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:05:22.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.321+0000 7f2a64a16640 1 Processor -- start 2023-11-24T08:05:22.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.321+0000 7f2a64a16640 1 -- start start 2023-11-24T08:05:22.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a64a16640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a6015d730 0x7f2a600cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a64a16640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a600d04f0 0x7f2a600999e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a64a16640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a600cb9f0 con 0x7f2a60099f20 2023-11-24T08:05:22.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a64a16640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6009a3b0 con 0x7f2a600d04f0 2023-11-24T08:05:22.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a64a16640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600cbfb0 con 0x7f2a6015d730 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5dd9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a600d04f0 0x7f2a600999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5ed9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2a60099f20 0x7f2a6006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55652/0 (socket says 172.21.15.57:55652) 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5ed9d640 1 -- 172.21.15.57:0/3029920043 learned_addr learned my addr 172.21.15.57:0/3029920043 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5e59c640 1 --2- 172.21.15.57:0/3029920043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a6015d730 0x7f2a600cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5dd9b640 1 -- 172.21.15.57:0/3029920043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a6015d730 msgr2=0x7f2a600cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5dd9b640 1 --2- 172.21.15.57:0/3029920043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a6015d730 0x7f2a600cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5dd9b640 1 -- 172.21.15.57:0/3029920043 >> v1:172.21.15.57:6789/0 conn(0x7f2a60099f20 legacy=0x7f2a6006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5dd9b640 1 -- 172.21.15.57:0/3029920043 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6015db10 con 0x7f2a600d04f0 2023-11-24T08:05:22.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.325+0000 7f2a5d59a640 1 -- 172.21.15.57:0/3029920043 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534550005 0 0) 0x7f2a600cb9f0 con 0x7f2a60099f20 2023-11-24T08:05:22.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a5dd9b640 1 --2- 172.21.15.57:0/3029920043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a600d04f0 0x7f2a600999e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a540097c0 tx=0x7f2a5401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0ce7ce025ccb4a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a5d59a640 1 -- 172.21.15.57:0/3029920043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540ac620 con 0x7f2a600d04f0 2023-11-24T08:05:22.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a5d59a640 1 -- 172.21.15.57:0/3029920043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a540ac780 con 0x7f2a600d04f0 2023-11-24T08:05:22.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a5d59a640 1 -- 172.21.15.57:0/3029920043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540acb10 con 0x7f2a600d04f0 2023-11-24T08:05:22.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 -- 172.21.15.57:0/3029920043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a600d04f0 msgr2=0x7f2a600999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 --2- 172.21.15.57:0/3029920043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a600d04f0 0x7f2a600999e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a540097c0 tx=0x7f2a5401c3c0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 -- 172.21.15.57:0/3029920043 shutdown_connections 2023-11-24T08:05:22.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 --2- 172.21.15.57:0/3029920043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a600d04f0 0x7f2a600999e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 --2- 172.21.15.57:0/3029920043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a6015d730 0x7f2a600cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 -- 172.21.15.57:0/3029920043 >> 172.21.15.57:0/3029920043 conn(0x7f2a600b2e90 msgr2=0x7f2a600b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 -- 172.21.15.57:0/3029920043 shutdown_connections 2023-11-24T08:05:22.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 -- 172.21.15.57:0/3029920043 wait complete. 2023-11-24T08:05:22.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 Processor -- start 2023-11-24T08:05:22.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.329+0000 7f2a64a16640 1 -- start start 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a60099f20 0x7f2a60154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a600d04f0 0x7f2a600c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a6015d730 0x7f2a60152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c7cd0 con 0x7f2a6015d730 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600cb510 con 0x7f2a60099f20 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600cb7b0 con 0x7f2a600d04f0 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a6015d730 0x7f2a60152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a6015d730 0x7f2a60152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34888/0 (socket says 172.21.15.57:34888) 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 -- 172.21.15.57:0/342524320 learned_addr learned my addr 172.21.15.57:0/342524320 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:22.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5dd9b640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a600d04f0 0x7f2a600c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5e59c640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a60099f20 0x7f2a60154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 -- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a600d04f0 msgr2=0x7f2a600c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a600d04f0 0x7f2a600c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 -- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a60099f20 msgr2=0x7f2a60154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a60099f20 0x7f2a60154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 -- 172.21.15.57:0/342524320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009420 con 0x7f2a6015d730 2023-11-24T08:05:22.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a5ed9d640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a6015d730 0x7f2a60152300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c7a0 tx=0x7f2a5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a4effd640 1 -- 172.21.15.57:0/342524320 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800a640 con 0x7f2a6015d730 2023-11-24T08:05:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a4effd640 1 -- 172.21.15.57:0/342524320 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5800a7a0 con 0x7f2a6015d730 2023-11-24T08:05:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a600c78f0 con 0x7f2a6015d730 2023-11-24T08:05:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a4effd640 1 -- 172.21.15.57:0/342524320 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800ab90 con 0x7f2a6015d730 2023-11-24T08:05:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600c75a0 con 0x7f2a6015d730 2023-11-24T08:05:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600cb9d0 con 0x7f2a6015d730 2023-11-24T08:05:22.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.333+0000 7f2a4effd640 1 -- 172.21.15.57:0/342524320 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f2a5800acf0 con 0x7f2a6015d730 2023-11-24T08:05:22.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.337+0000 7f2a4effd640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2a40066620 0x7f2a40068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.337+0000 7f2a4effd640 1 -- 172.21.15.57:0/342524320 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a58083560 con 0x7f2a6015d730 2023-11-24T08:05:22.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.337+0000 7f2a5e59c640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2a40066620 0x7f2a40068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.337+0000 7f2a5e59c640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2a40066620 0x7f2a40068ae0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a600b2520 tx=0x7f2a50009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.341+0000 7f2a4effd640 1 -- 172.21.15.57:0/342524320 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a58050b70 con 0x7f2a6015d730 2023-11-24T08:05:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.501+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2a6006b4b0 con 0x7f2a6015d730 2023-11-24T08:05:22.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.745+0000 7f2a4effd640 1 -- 172.21.15.57:0/342524320 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2a580180b0 con 0x7f2a6015d730 2023-11-24T08:05:22.753 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-11-24T08:05:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2a40066620 msgr2=0x7f2a40068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2a40066620 0x7f2a40068ae0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a600b2520 tx=0x7f2a50009190 comp rx=0 tx=0).stop 2023-11-24T08:05:22.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a6015d730 msgr2=0x7f2a60152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a6015d730 0x7f2a60152300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c7a0 tx=0x7f2a5800cc60 comp rx=0 tx=0).stop 2023-11-24T08:05:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 shutdown_connections 2023-11-24T08:05:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2a40066620 0x7f2a40068ae0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a6015d730 0x7f2a60152300 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a600d04f0 0x7f2a600c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 --2- 172.21.15.57:0/342524320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a60099f20 0x7f2a60154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 >> 172.21.15.57:0/342524320 conn(0x7f2a600b2e90 msgr2=0x7f2a600b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 shutdown_connections 2023-11-24T08:05:22.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.749+0000 7f2a64a16640 1 -- 172.21.15.57:0/342524320 wait complete. 2023-11-24T08:05:22.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:05:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f449932a640 1 Processor -- start 2023-11-24T08:05:22.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f449932a640 1 -- start start 2023-11-24T08:05:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f449932a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f449415d7b0 0x7f449406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f449932a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f449406b9b0 0x7f449415db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f449932a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940616b0 con 0x7f449406f580 2023-11-24T08:05:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f449932a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940b4750 con 0x7f449415d7b0 2023-11-24T08:05:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f449932a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940b28a0 con 0x7f449406b9b0 2023-11-24T08:05:22.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f4492ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f449415d7b0 0x7f449406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f44927fc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f449406f580 0x7f449406b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55666/0 (socket says 172.21.15.57:55666) 2023-11-24T08:05:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f44927fc640 1 -- 172.21.15.57:0/4284619884 learned_addr learned my addr 172.21.15.57:0/4284619884 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f4492ffd640 1 -- 172.21.15.57:0/4284619884 >> v2:172.21.15.132:3300/0 conn(0x7f449406b9b0 msgr2=0x7f449415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f4492ffd640 1 --2- 172.21.15.57:0/4284619884 >> v2:172.21.15.132:3300/0 conn(0x7f449406b9b0 0x7f449415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f4492ffd640 1 -- 172.21.15.57:0/4284619884 >> v1:172.21.15.57:6789/0 conn(0x7f449406f580 legacy=0x7f449406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.925+0000 7f4492ffd640 1 -- 172.21.15.57:0/4284619884 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940b2b80 con 0x7f449415d7b0 2023-11-24T08:05:22.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f4492ffd640 1 --2- 172.21.15.57:0/4284619884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449415d7b0 0x7f449406cf00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f44940727b0 tx=0x7f448401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71d666959eb148d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f4491ffb640 1 -- 172.21.15.57:0/4284619884 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840ab600 con 0x7f449415d7b0 2023-11-24T08:05:22.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f4491ffb640 1 -- 172.21.15.57:0/4284619884 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840a7050 con 0x7f449415d7b0 2023-11-24T08:05:22.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f4491ffb640 1 -- 172.21.15.57:0/4284619884 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840ab980 con 0x7f449415d7b0 2023-11-24T08:05:22.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 -- 172.21.15.57:0/4284619884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449415d7b0 msgr2=0x7f449406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 --2- 172.21.15.57:0/4284619884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449415d7b0 0x7f449406cf00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f44940727b0 tx=0x7f448401c3d0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 -- 172.21.15.57:0/4284619884 shutdown_connections 2023-11-24T08:05:22.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 --2- 172.21.15.57:0/4284619884 >> v2:172.21.15.132:3300/0 conn(0x7f449406b9b0 0x7f449415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 --2- 172.21.15.57:0/4284619884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449415d7b0 0x7f449406cf00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 -- 172.21.15.57:0/4284619884 >> 172.21.15.57:0/4284619884 conn(0x7f44940cc390 msgr2=0x7f44940cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 -- 172.21.15.57:0/4284619884 shutdown_connections 2023-11-24T08:05:22.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.929+0000 7f449932a640 1 -- 172.21.15.57:0/4284619884 wait complete. 2023-11-24T08:05:22.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 Processor -- start 2023-11-24T08:05:22.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 -- start start 2023-11-24T08:05:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449406b9b0 0x7f4494142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f449406f580 0x7f4494155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f449415d7b0 0x7f4494155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415f1a0 con 0x7f449406b9b0 2023-11-24T08:05:22.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415f480 con 0x7f449415d7b0 2023-11-24T08:05:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4494154b70 con 0x7f449406f580 2023-11-24T08:05:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449406b9b0 0x7f4494142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449406b9b0 0x7f4494142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34902/0 (socket says 172.21.15.57:34902) 2023-11-24T08:05:22.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 -- 172.21.15.57:0/4006779340 learned_addr learned my addr 172.21.15.57:0/4006779340 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f44927fc640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f449406f580 0x7f4494155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f44937fe640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f449415d7b0 0x7f4494155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 -- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f449406f580 msgr2=0x7f4494155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f449406f580 0x7f4494155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 -- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f449415d7b0 msgr2=0x7f4494155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f449415d7b0 0x7f4494155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 -- 172.21.15.57:0/4006779340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484009420 con 0x7f449406b9b0 2023-11-24T08:05:22.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f4492ffd640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449406b9b0 0x7f4494142390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f44840ae040 tx=0x7f448401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f447b7fe640 1 -- 172.21.15.57:0/4006779340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840b7650 con 0x7f449406b9b0 2023-11-24T08:05:22.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f447b7fe640 1 -- 172.21.15.57:0/4006779340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840b77b0 con 0x7f449406b9b0 2023-11-24T08:05:22.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f447b7fe640 1 -- 172.21.15.57:0/4006779340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840b7b60 con 0x7f449406b9b0 2023-11-24T08:05:22.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494154e50 con 0x7f449406b9b0 2023-11-24T08:05:22.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44941428d0 con 0x7f449406b9b0 2023-11-24T08:05:22.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.933+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4494072850 con 0x7f449406b9b0 2023-11-24T08:05:22.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.937+0000 7f447b7fe640 1 -- 172.21.15.57:0/4006779340 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f44840b7cc0 con 0x7f449406b9b0 2023-11-24T08:05:22.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.937+0000 7f447b7fe640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4480066650 0x7f4480068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.937+0000 7f447b7fe640 1 -- 172.21.15.57:0/4006779340 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f448411e940 con 0x7f449406b9b0 2023-11-24T08:05:22.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.937+0000 7f44927fc640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4480066650 0x7f4480068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.937+0000 7f44927fc640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4480066650 0x7f4480068b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44940b0950 tx=0x7f4488009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:22.941+0000 7f447b7fe640 1 -- 172.21.15.57:0/4006779340 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44840ebd20 con 0x7f449406b9b0 2023-11-24T08:05:23.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.097+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f449404e930 con 0x7f449406b9b0 2023-11-24T08:05:23.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.753+0000 7f447b7fe640 1 -- 172.21.15.57:0/4006779340 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f44840b00d0 con 0x7f449406b9b0 2023-11-24T08:05:23.759 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4480066650 msgr2=0x7f4480068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4480066650 0x7f4480068b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f44940b0950 tx=0x7f4488009040 comp rx=0 tx=0).stop 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449406b9b0 msgr2=0x7f4494142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449406b9b0 0x7f4494142390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f44840ae040 tx=0x7f448401ac10 comp rx=0 tx=0).stop 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 shutdown_connections 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4480066650 0x7f4480068b10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f449415d7b0 0x7f4494155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f449406f580 0x7f4494155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 --2- 172.21.15.57:0/4006779340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f449406b9b0 0x7f4494142390 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 >> 172.21.15.57:0/4006779340 conn(0x7f44940cc390 msgr2=0x7f44940cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 shutdown_connections 2023-11-24T08:05:23.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.757+0000 7f449932a640 1 -- 172.21.15.57:0/4006779340 wait complete. 2023-11-24T08:05:23.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:05:23.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.941+0000 7f68e07b8640 1 Processor -- start 2023-11-24T08:05:23.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68e07b8640 1 -- start start 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68e07b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f68d80ce420 0x7f68d815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68e07b8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68d80cd850 0x7f68d806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68e07b8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d80b3510 con 0x7f68d80ae4a0 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68e07b8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80b37f0 con 0x7f68d80cd850 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68e07b8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80b3ad0 con 0x7f68d80ce420 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ded55640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68d80cd850 0x7f68d806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ded55640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68d80cd850 0x7f68d806c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34916/0 (socket says 172.21.15.57:34916) 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ded55640 1 -- 172.21.15.57:0/1972896036 learned_addr learned my addr 172.21.15.57:0/1972896036 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ddd53640 1 --2- 172.21.15.57:0/1972896036 >> v2:172.21.15.132:3300/0 conn(0x7f68d80ce420 0x7f68d815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ded55640 1 -- 172.21.15.57:0/1972896036 >> v2:172.21.15.132:3300/0 conn(0x7f68d80ce420 msgr2=0x7f68d815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:23.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ded55640 1 --2- 172.21.15.57:0/1972896036 >> v2:172.21.15.132:3300/0 conn(0x7f68d80ce420 0x7f68d815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ded55640 1 -- 172.21.15.57:0/1972896036 >> v1:172.21.15.132:6789/0 conn(0x7f68d80ae4a0 legacy=0x7f68d80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.945+0000 7f68ded55640 1 -- 172.21.15.57:0/1972896036 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80b3db0 con 0x7f68d80cd850 2023-11-24T08:05:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68ded55640 1 --2- 172.21.15.57:0/1972896036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80cd850 0x7f68d806c640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f68d80b45b0 tx=0x7f68d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69da91d671d0a054 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68dd552640 1 -- 172.21.15.57:0/1972896036 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00a5880 con 0x7f68d80cd850 2023-11-24T08:05:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68dd552640 1 -- 172.21.15.57:0/1972896036 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00a59e0 con 0x7f68d80cd850 2023-11-24T08:05:23.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68dd552640 1 -- 172.21.15.57:0/1972896036 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00a5d70 con 0x7f68d80cd850 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 -- 172.21.15.57:0/1972896036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80cd850 msgr2=0x7f68d806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 --2- 172.21.15.57:0/1972896036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80cd850 0x7f68d806c640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f68d80b45b0 tx=0x7f68d001c9a0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 -- 172.21.15.57:0/1972896036 shutdown_connections 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 --2- 172.21.15.57:0/1972896036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80cd850 0x7f68d806c640 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 --2- 172.21.15.57:0/1972896036 >> v2:172.21.15.132:3300/0 conn(0x7f68d80ce420 0x7f68d815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 -- 172.21.15.57:0/1972896036 >> 172.21.15.57:0/1972896036 conn(0x7f68d80b0c80 msgr2=0x7f68d80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 -- 172.21.15.57:0/1972896036 shutdown_connections 2023-11-24T08:05:23.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 -- 172.21.15.57:0/1972896036 wait complete. 2023-11-24T08:05:23.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.949+0000 7f68e07b8640 1 Processor -- start 2023-11-24T08:05:23.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 -- start start 2023-11-24T08:05:23.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68d80ae4a0 0x7f68d809cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68d80cd850 0x7f68d80988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80ce420 0x7f68d809af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d809c640 con 0x7f68d80ce420 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d809d010 con 0x7f68d80ae4a0 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d809ba30 con 0x7f68d80cd850 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80ce420 0x7f68d809af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80ce420 0x7f68d809af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34926/0 (socket says 172.21.15.57:34926) 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 -- 172.21.15.57:0/918850766 learned_addr learned my addr 172.21.15.57:0/918850766 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ddd53640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68d80cd850 0x7f68d80988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68de554640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68d80ae4a0 0x7f68d809cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 -- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68d80cd850 msgr2=0x7f68d80988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68d80cd850 0x7f68d80988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 -- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68d80ae4a0 msgr2=0x7f68d809cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68d80ae4a0 0x7f68d809cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 -- 172.21.15.57:0/918850766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009b30 con 0x7f68d80ce420 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68de554640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68d80ae4a0 0x7f68d809cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ded55640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80ce420 0x7f68d809af50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f68d00af040 tx=0x7f68d0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ceffd640 1 -- 172.21.15.57:0/918850766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00b8670 con 0x7f68d80ce420 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ceffd640 1 -- 172.21.15.57:0/918850766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00b8810 con 0x7f68d80ce420 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68ceffd640 1 -- 172.21.15.57:0/918850766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00b8bc0 con 0x7f68d80ce420 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d809bd10 con 0x7f68d80ce420 2023-11-24T08:05:23.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d809c2d0 con 0x7f68d80ce420 2023-11-24T08:05:23.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.953+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d8070680 con 0x7f68d80ce420 2023-11-24T08:05:23.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.957+0000 7f68ceffd640 1 -- 172.21.15.57:0/918850766 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f68d00b8d20 con 0x7f68d80ce420 2023-11-24T08:05:23.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.957+0000 7f68ceffd640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f68bc066650 0x7f68bc068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.957+0000 7f68ceffd640 1 -- 172.21.15.57:0/918850766 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f68d0120110 con 0x7f68d80ce420 2023-11-24T08:05:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.957+0000 7f68de554640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f68bc066650 0x7f68bc068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.957+0000 7f68de554640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f68bc066650 0x7f68bc068b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f68d4000f70 tx=0x7f68d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:23.961+0000 7f68ceffd640 1 -- 172.21.15.57:0/918850766 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68d00ed490 con 0x7f68d80ce420 2023-11-24T08:05:24.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.153+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f68d804e8c0 con 0x7f68d80ce420 2023-11-24T08:05:24.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.789+0000 7f68ceffd640 1 -- 172.21.15.57:0/918850766 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f68d00f0ab0 con 0x7f68d80ce420 2023-11-24T08:05:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 6 and data pool 7 2023-11-24T08:05:24.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f68bc066650 msgr2=0x7f68bc068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f68bc066650 0x7f68bc068b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f68d4000f70 tx=0x7f68d4009040 comp rx=0 tx=0).stop 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80ce420 msgr2=0x7f68d809af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80ce420 0x7f68d809af50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f68d00af040 tx=0x7f68d0019740 comp rx=0 tx=0).stop 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 shutdown_connections 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f68bc066650 0x7f68bc068b10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d80ce420 0x7f68d809af50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68d80cd850 0x7f68d80988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 --2- 172.21.15.57:0/918850766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68d80ae4a0 0x7f68d809cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 >> 172.21.15.57:0/918850766 conn(0x7f68d80b0c80 msgr2=0x7f68d8155470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 shutdown_connections 2023-11-24T08:05:24.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.801+0000 7f68e07b8640 1 -- 172.21.15.57:0/918850766 wait complete. 2023-11-24T08:05:24.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:24.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.981+0000 7fa7485f5640 1 Processor -- start 2023-11-24T08:05:24.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.981+0000 7fa7485f5640 1 -- start start 2023-11-24T08:05:24.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.981+0000 7fa7485f5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7400b0a00 0x7fa74006a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.981+0000 7fa7485f5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7400b30a0 0x7fa74006aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa7485f5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa740146a70 0x7fa7401612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa7485f5640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400b1b70 con 0x7fa7400b0a00 2023-11-24T08:05:24.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa7485f5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400b15b0 con 0x7fa740146a70 2023-11-24T08:05:24.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa7485f5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400b1890 con 0x7fa7400b30a0 2023-11-24T08:05:24.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7400b0a00 0x7fa74006a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7400b0a00 0x7fa74006a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34934/0 (socket says 172.21.15.57:34934) 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 -- 172.21.15.57:0/2071802277 learned_addr learned my addr 172.21.15.57:0/2071802277 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746b92640 1 --2- 172.21.15.57:0/2071802277 >> v2:172.21.15.132:3300/0 conn(0x7fa740146a70 0x7fa7401612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa745b90640 1 --2- 172.21.15.57:0/2071802277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7400b30a0 0x7fa74006aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 -- 172.21.15.57:0/2071802277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7400b30a0 msgr2=0x7fa74006aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 --2- 172.21.15.57:0/2071802277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7400b30a0 0x7fa74006aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 -- 172.21.15.57:0/2071802277 >> v2:172.21.15.132:3300/0 conn(0x7fa740146a70 msgr2=0x7fa7401612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 --2- 172.21.15.57:0/2071802277 >> v2:172.21.15.132:3300/0 conn(0x7fa740146a70 0x7fa7401612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 -- 172.21.15.57:0/2071802277 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400b4ca0 con 0x7fa7400b0a00 2023-11-24T08:05:24.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa746391640 1 --2- 172.21.15.57:0/2071802277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa74006a5b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa740072a10 tx=0x7fa73c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef18b72ec308669 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:24.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.985+0000 7fa74538f640 1 -- 172.21.15.57:0/2071802277 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ab600 con 0x7fa7400b0a00 2023-11-24T08:05:24.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa74538f640 1 -- 172.21.15.57:0/2071802277 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0a7050 con 0x7fa7400b0a00 2023-11-24T08:05:24.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa74538f640 1 -- 172.21.15.57:0/2071802277 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ab980 con 0x7fa7400b0a00 2023-11-24T08:05:24.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- 172.21.15.57:0/2071802277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 msgr2=0x7fa74006a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 --2- 172.21.15.57:0/2071802277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa74006a5b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa740072a10 tx=0x7fa73c01c240 comp rx=0 tx=0).stop 2023-11-24T08:05:24.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- 172.21.15.57:0/2071802277 shutdown_connections 2023-11-24T08:05:24.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 --2- 172.21.15.57:0/2071802277 >> v2:172.21.15.132:3300/0 conn(0x7fa740146a70 0x7fa7401612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 --2- 172.21.15.57:0/2071802277 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7400b30a0 0x7fa74006aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 --2- 172.21.15.57:0/2071802277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa74006a5b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- 172.21.15.57:0/2071802277 >> 172.21.15.57:0/2071802277 conn(0x7fa7400b55c0 msgr2=0x7fa7400b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- 172.21.15.57:0/2071802277 shutdown_connections 2023-11-24T08:05:24.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- 172.21.15.57:0/2071802277 wait complete. 2023-11-24T08:05:24.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 Processor -- start 2023-11-24T08:05:24.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- start start 2023-11-24T08:05:24.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa740159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7400b30a0 0x7fa74015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa740146a70 0x7fa74015fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:24.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740144670 con 0x7fa7400b0a00 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740144950 con 0x7fa7400b30a0 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa7485f5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa740158e20 con 0x7fa740146a70 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa746391640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa740159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa746391640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa740159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34948/0 (socket says 172.21.15.57:34948) 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa746391640 1 -- 172.21.15.57:0/3656968471 learned_addr learned my addr 172.21.15.57:0/3656968471 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa745b90640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7400b30a0 0x7fa74015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.989+0000 7fa746b92640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa740146a70 0x7fa74015fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:24.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa746391640 1 -- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa740146a70 msgr2=0x7fa74015fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa746391640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa740146a70 0x7fa74015fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa746391640 1 -- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7400b30a0 msgr2=0x7fa74015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa746391640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7400b30a0 0x7fa74015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa746391640 1 -- 172.21.15.57:0/3656968471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0094d0 con 0x7fa7400b0a00 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa746391640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa740159620 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ae040 tx=0x7fa73c01aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa736ffd640 1 -- 172.21.15.57:0/3656968471 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0b6620 con 0x7fa7400b0a00 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa736ffd640 1 -- 172.21.15.57:0/3656968471 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0b6780 con 0x7fa7400b0a00 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa740159100 con 0x7fa7400b0a00 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa736ffd640 1 -- 172.21.15.57:0/3656968471 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0b6b10 con 0x7fa7400b0a00 2023-11-24T08:05:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa740144c30 con 0x7fa7400b0a00 2023-11-24T08:05:25.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa740144ee0 con 0x7fa7400b0a00 2023-11-24T08:05:25.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa736ffd640 1 -- 172.21.15.57:0/3656968471 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fa73c0b2040 con 0x7fa7400b0a00 2023-11-24T08:05:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa736ffd640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa724066620 0x7fa724068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.993+0000 7fa736ffd640 1 -- 172.21.15.57:0/3656968471 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73c11e540 con 0x7fa7400b0a00 2023-11-24T08:05:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.997+0000 7fa745b90640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa724066620 0x7fa724068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:24.997+0000 7fa745b90640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa724066620 0x7fa724068ae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa74006dcd0 tx=0x7fa730008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.001+0000 7fa736ffd640 1 -- 172.21.15.57:0/3656968471 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa73c0eb8a0 con 0x7fa7400b0a00 2023-11-24T08:05:25.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.157+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa740067520 con 0x7fa7400b0a00 2023-11-24T08:05:25.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa736ffd640 1 -- 172.21.15.57:0/3656968471 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16466 (secure 0 0 0) 0x7fa73c0eeec0 con 0x7fa7400b0a00 2023-11-24T08:05:25.165 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:25.166 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:24.159935+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa724066620 msgr2=0x7fa724068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa724066620 0x7fa724068ae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa74006dcd0 tx=0x7fa730008040 comp rx=0 tx=0).stop 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 msgr2=0x7fa740159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa740159620 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ae040 tx=0x7fa73c01aa80 comp rx=0 tx=0).stop 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 shutdown_connections 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa724066620 0x7fa724068ae0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa740146a70 0x7fa74015fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7400b30a0 0x7fa74015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 --2- 172.21.15.57:0/3656968471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7400b0a00 0x7fa740159620 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 >> 172.21.15.57:0/3656968471 conn(0x7fa7400b55c0 msgr2=0x7fa74006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 shutdown_connections 2023-11-24T08:05:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.161+0000 7fa7485f5640 1 -- 172.21.15.57:0/3656968471 wait complete. 2023-11-24T08:05:25.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7b4afe640 1 Processor -- start 2023-11-24T08:05:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7b4afe640 1 -- start start 2023-11-24T08:05:25.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7b4afe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7b0144030 0x7fe7b006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7b4afe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7b00709c0 0x7fe7b0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7b4afe640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b006d8b0 con 0x7fe7b009cc20 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7b4afe640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b0145020 con 0x7fe7b00709c0 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7b4afe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b009d0a0 con 0x7fe7b0144030 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7aed9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7b00709c0 0x7fe7b0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7a7fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe7b009cc20 0x7fe7b006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55674/0 (socket says 172.21.15.57:55674) 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7a7fff640 1 -- 172.21.15.57:0/2534638391 learned_addr learned my addr 172.21.15.57:0/2534638391 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7ae59c640 1 --2- 172.21.15.57:0/2534638391 >> v2:172.21.15.132:3300/0 conn(0x7fe7b0144030 0x7fe7b006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7aed9d640 1 -- 172.21.15.57:0/2534638391 >> v2:172.21.15.132:3300/0 conn(0x7fe7b0144030 msgr2=0x7fe7b006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:25.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7aed9d640 1 --2- 172.21.15.57:0/2534638391 >> v2:172.21.15.132:3300/0 conn(0x7fe7b0144030 0x7fe7b006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7aed9d640 1 -- 172.21.15.57:0/2534638391 >> v1:172.21.15.57:6789/0 conn(0x7fe7b009cc20 legacy=0x7fe7b006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7add9b640 1 -- 172.21.15.57:0/2534638391 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509422969 0 0) 0x7fe7b006d8b0 con 0x7fe7b009cc20 2023-11-24T08:05:25.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.325+0000 7fe7aed9d640 1 -- 172.21.15.57:0/2534638391 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0071370 con 0x7fe7b00709c0 2023-11-24T08:05:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7aed9d640 1 --2- 172.21.15.57:0/2534638391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b00709c0 0x7fe7b0070e30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7b006c2f0 tx=0x7fe7a801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb2cf9869ebd038 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7add9b640 1 -- 172.21.15.57:0/2534638391 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80a59a0 con 0x7fe7b00709c0 2023-11-24T08:05:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7add9b640 1 -- 172.21.15.57:0/2534638391 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a80a5b00 con 0x7fe7b00709c0 2023-11-24T08:05:25.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7add9b640 1 -- 172.21.15.57:0/2534638391 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80a5e90 con 0x7fe7b00709c0 2023-11-24T08:05:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 -- 172.21.15.57:0/2534638391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b00709c0 msgr2=0x7fe7b0070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/2534638391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b00709c0 0x7fe7b0070e30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7b006c2f0 tx=0x7fe7a801c8e0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 -- 172.21.15.57:0/2534638391 shutdown_connections 2023-11-24T08:05:25.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/2534638391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b00709c0 0x7fe7b0070e30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/2534638391 >> v2:172.21.15.132:3300/0 conn(0x7fe7b0144030 0x7fe7b006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 -- 172.21.15.57:0/2534638391 >> 172.21.15.57:0/2534638391 conn(0x7fe7b00b0bf0 msgr2=0x7fe7b00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 -- 172.21.15.57:0/2534638391 shutdown_connections 2023-11-24T08:05:25.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.329+0000 7fe7b4afe640 1 -- 172.21.15.57:0/2534638391 wait complete. 2023-11-24T08:05:25.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 Processor -- start 2023-11-24T08:05:25.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 -- start start 2023-11-24T08:05:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b00709c0 0x7fe7b0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b009cc20 0x7fe7b01294d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b0144030 0x7fe7b0129a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0129040 con 0x7fe7b009cc20 2023-11-24T08:05:25.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0128430 con 0x7fe7b00709c0 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0128710 con 0x7fe7b0144030 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b009cc20 0x7fe7b01294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b009cc20 0x7fe7b01294d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34964/0 (socket says 172.21.15.57:34964) 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 -- 172.21.15.57:0/3844464639 learned_addr learned my addr 172.21.15.57:0/3844464639 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7ae59c640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b00709c0 0x7fe7b0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7aed9d640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b0144030 0x7fe7b0129a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 -- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b0144030 msgr2=0x7fe7b0129a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b0144030 0x7fe7b0129a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 -- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b00709c0 msgr2=0x7fe7b0158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b00709c0 0x7fe7b0158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 -- 172.21.15.57:0/3844464639 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009a70 con 0x7fe7b009cc20 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7ae59c640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b00709c0 0x7fe7b0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a7fff640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b009cc20 0x7fe7b01294d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe7980011f0 tx=0x7fe79800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a6ffd640 1 -- 172.21.15.57:0/3844464639 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980074e0 con 0x7fe7b009cc20 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a6ffd640 1 -- 172.21.15.57:0/3844464639 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798007640 con 0x7fe7b009cc20 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b01289f0 con 0x7fe7b009cc20 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7a6ffd640 1 -- 172.21.15.57:0/3844464639 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798004a10 con 0x7fe7b009cc20 2023-11-24T08:05:25.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b0127fc0 con 0x7fe7b009cc20 2023-11-24T08:05:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.333+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b0067520 con 0x7fe7b009cc20 2023-11-24T08:05:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.337+0000 7fe7a6ffd640 1 -- 172.21.15.57:0/3844464639 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe798004b70 con 0x7fe7b009cc20 2023-11-24T08:05:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.337+0000 7fe7a6ffd640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe790066620 0x7fe790068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.337+0000 7fe7a6ffd640 1 -- 172.21.15.57:0/3844464639 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe798083490 con 0x7fe7b009cc20 2023-11-24T08:05:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.337+0000 7fe7ae59c640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe790066620 0x7fe790068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.337+0000 7fe7ae59c640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe790066620 0x7fe790068ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009bb0 tx=0x7fe7a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.341+0000 7fe7a6ffd640 1 -- 172.21.15.57:0/3844464639 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe798050680 con 0x7fe7b009cc20 2023-11-24T08:05:25.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7b013f320 con 0x7fe7b009cc20 2023-11-24T08:05:25.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7a6ffd640 1 -- 172.21.15.57:0/3844464639 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16466 (secure 0 0 0) 0x7fe798018090 con 0x7fe7b009cc20 2023-11-24T08:05:25.507 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:25.507 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":47,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:24.159935+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe790066620 msgr2=0x7fe790068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe790066620 0x7fe790068ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009bb0 tx=0x7fe7a0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b009cc20 msgr2=0x7fe7b01294d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b009cc20 0x7fe7b01294d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe7980011f0 tx=0x7fe79800c9b0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 shutdown_connections 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe790066620 0x7fe790068ae0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b0144030 0x7fe7b0129a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b009cc20 0x7fe7b01294d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 --2- 172.21.15.57:0/3844464639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b00709c0 0x7fe7b0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 >> 172.21.15.57:0/3844464639 conn(0x7fe7b00b0bf0 msgr2=0x7fe7b00723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 shutdown_connections 2023-11-24T08:05:25.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.501+0000 7fe7b4afe640 1 -- 172.21.15.57:0/3844464639 wait complete. 2023-11-24T08:05:25.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:05:25.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.669+0000 7fa249585640 1 Processor -- start 2023-11-24T08:05:25.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.669+0000 7fa249585640 1 -- start start 2023-11-24T08:05:25.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa249585640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa244160970 0x7fa2440d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa249585640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2440cdc60 0x7fa2440d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa249585640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa2440d1c10 0x7fa2440b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa249585640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440d2060 con 0x7fa2440d1c10 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa249585640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440cf0a0 con 0x7fa2440cdc60 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa249585640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440ce490 con 0x7fa244160970 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa2440d1c10 0x7fa2440b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa2440d1c10 0x7fa2440b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34970/0 (socket says 172.21.15.57:34970) 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 -- 172.21.15.57:0/4114868620 learned_addr learned my addr 172.21.15.57:0/4114868620 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa2437fe640 1 --2- 172.21.15.57:0/4114868620 >> v2:172.21.15.132:3300/0 conn(0x7fa2440cdc60 0x7fa2440d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa243fff640 1 --2- 172.21.15.57:0/4114868620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa244160970 0x7fa2440d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 -- 172.21.15.57:0/4114868620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa244160970 msgr2=0x7fa2440d3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:25.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 --2- 172.21.15.57:0/4114868620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa244160970 0x7fa2440d3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 -- 172.21.15.57:0/4114868620 >> v2:172.21.15.132:3300/0 conn(0x7fa2440cdc60 msgr2=0x7fa2440d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:25.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 --2- 172.21.15.57:0/4114868620 >> v2:172.21.15.132:3300/0 conn(0x7fa2440cdc60 0x7fa2440d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.673+0000 7fa248d84640 1 -- 172.21.15.57:0/4114868620 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440ce770 con 0x7fa2440d1c10 2023-11-24T08:05:25.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa248d84640 1 --2- 172.21.15.57:0/4114868620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2440d1c10 0x7fa2440b2be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa24408bbd0 tx=0x7fa23c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c934d9383471d110 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa242ffd640 1 -- 172.21.15.57:0/4114868620 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0a5560 con 0x7fa2440d1c10 2023-11-24T08:05:25.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa242ffd640 1 -- 172.21.15.57:0/4114868620 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0a56c0 con 0x7fa2440d1c10 2023-11-24T08:05:25.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa242ffd640 1 -- 172.21.15.57:0/4114868620 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0a5a50 con 0x7fa2440d1c10 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 -- 172.21.15.57:0/4114868620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2440d1c10 msgr2=0x7fa2440b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 --2- 172.21.15.57:0/4114868620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2440d1c10 0x7fa2440b2be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa24408bbd0 tx=0x7fa23c01c6e0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 -- 172.21.15.57:0/4114868620 shutdown_connections 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 --2- 172.21.15.57:0/4114868620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2440d1c10 0x7fa2440b2be0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 --2- 172.21.15.57:0/4114868620 >> v2:172.21.15.132:3300/0 conn(0x7fa2440cdc60 0x7fa2440d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 --2- 172.21.15.57:0/4114868620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa244160970 0x7fa2440d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 -- 172.21.15.57:0/4114868620 >> 172.21.15.57:0/4114868620 conn(0x7fa24409c5c0 msgr2=0x7fa2440d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 -- 172.21.15.57:0/4114868620 shutdown_connections 2023-11-24T08:05:25.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 -- 172.21.15.57:0/4114868620 wait complete. 2023-11-24T08:05:25.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 Processor -- start 2023-11-24T08:05:25.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 -- start start 2023-11-24T08:05:25.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2440cdc60 0x7fa2441500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440d1c10 0x7fa24415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.677+0000 7fa249585640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa244160970 0x7fa24415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa249585640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244150620 con 0x7fa244160970 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa249585640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415c690 con 0x7fa2440d1c10 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa249585640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415ba80 con 0x7fa2440cdc60 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa244160970 0x7fa24415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa244160970 0x7fa24415b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34984/0 (socket says 172.21.15.57:34984) 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 -- 172.21.15.57:0/3432147642 learned_addr learned my addr 172.21.15.57:0/3432147642 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:25.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa2437fe640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440d1c10 0x7fa24415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa243fff640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2440cdc60 0x7fa2441500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 -- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2440cdc60 msgr2=0x7fa2441500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2440cdc60 0x7fa2441500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 -- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440d1c10 msgr2=0x7fa24415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440d1c10 0x7fa24415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 -- 172.21.15.57:0/3432147642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009b30 con 0x7fa244160970 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa248d84640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa244160970 0x7fa24415b450 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0af040 tx=0x7fa23c019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa240ff9640 1 -- 172.21.15.57:0/3432147642 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0a5560 con 0x7fa244160970 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa240ff9640 1 -- 172.21.15.57:0/3432147642 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0b8690 con 0x7fa244160970 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24415bd60 con 0x7fa244160970 2023-11-24T08:05:25.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa240ff9640 1 -- 172.21.15.57:0/3432147642 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0b8a40 con 0x7fa244160970 2023-11-24T08:05:25.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24415c320 con 0x7fa244160970 2023-11-24T08:05:25.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24415c840 con 0x7fa244160970 2023-11-24T08:05:25.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.681+0000 7fa240ff9640 1 -- 172.21.15.57:0/3432147642 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fa23c0b8ba0 con 0x7fa244160970 2023-11-24T08:05:25.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.685+0000 7fa240ff9640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa230066650 0x7fa230068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:25.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.685+0000 7fa240ff9640 1 -- 172.21.15.57:0/3432147642 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa23c11f300 con 0x7fa244160970 2023-11-24T08:05:25.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.685+0000 7fa243fff640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa230066650 0x7fa230068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:25.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.685+0000 7fa243fff640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa230066650 0x7fa230068b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2340079c0 tx=0x7fa234008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:25.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.689+0000 7fa240ff9640 1 -- 172.21.15.57:0/3432147642 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa24415c840 con 0x7fa244160970 2023-11-24T08:05:25.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:25.881+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa24415c840 con 0x7fa244160970 2023-11-24T08:05:26.747 INFO:tasks.ceph.mds.d.smithi132.stderr:2023-11-24T08:05:26.741+0000 7f3b2e577640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:05:26.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa240ff9640 1 -- 172.21.15.57:0/3432147642 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa24415c840 con 0x7fa244160970 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa230066650 msgr2=0x7fa230068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa230066650 0x7fa230068b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2340079c0 tx=0x7fa234008040 comp rx=0 tx=0).stop 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa244160970 msgr2=0x7fa24415b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa244160970 0x7fa24415b450 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0af040 tx=0x7fa23c019480 comp rx=0 tx=0).stop 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 shutdown_connections 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa230066650 0x7fa230068b10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa244160970 0x7fa24415b450 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440d1c10 0x7fa24415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 --2- 172.21.15.57:0/3432147642 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2440cdc60 0x7fa2441500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 >> 172.21.15.57:0/3432147642 conn(0x7fa24409c5c0 msgr2=0x7fa24406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 shutdown_connections 2023-11-24T08:05:26.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.813+0000 7fa249585640 1 -- 172.21.15.57:0/3432147642 wait complete. 2023-11-24T08:05:26.845 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:05:26.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:05:26.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f337dbc1640 1 Processor -- start 2023-11-24T08:05:26.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f337dbc1640 1 -- start start 2023-11-24T08:05:26.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f337dbc1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33780cd850 0x7f337815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f337dbc1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33780b3510 con 0x7f33780ae4a0 2023-11-24T08:05:26.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f337dbc1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33780b37f0 con 0x7f33780ce420 2023-11-24T08:05:26.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f337dbc1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33780b3ad0 con 0x7f33780cd850 2023-11-24T08:05:26.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f33777fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f33780ae4a0 0x7f33780cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37928/0 (socket says 172.21.15.57:37928) 2023-11-24T08:05:26.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.989+0000 7f33777fe640 1 -- 172.21.15.57:0/4236040456 learned_addr learned my addr 172.21.15.57:0/4236040456 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f3377fff640 1 --2- 172.21.15.57:0/4236040456 >> v2:172.21.15.132:3300/0 conn(0x7f33780cd850 0x7f337815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f33767fc640 1 -- 172.21.15.57:0/4236040456 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040818155 0 0) 0x7f33780b3510 con 0x7f33780ae4a0 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f33767fc640 1 -- 172.21.15.57:0/4236040456 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3360003530 con 0x7f33780ae4a0 2023-11-24T08:05:26.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f33767fc640 1 -- 172.21.15.57:0/4236040456 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524055159 0 0) 0x7f33780b37f0 con 0x7f33780ce420 2023-11-24T08:05:26.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f33767fc640 1 -- 172.21.15.57:0/4236040456 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33780b3510 con 0x7f33780ce420 2023-11-24T08:05:26.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f3377fff640 1 -- 172.21.15.57:0/4236040456 >> v1:172.21.15.132:6789/0 conn(0x7f33780ce420 legacy=0x7f337806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f3377fff640 1 -- 172.21.15.57:0/4236040456 >> v1:172.21.15.57:6789/0 conn(0x7f33780ae4a0 legacy=0x7f33780cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f3377fff640 1 -- 172.21.15.57:0/4236040456 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33780b3db0 con 0x7f33780cd850 2023-11-24T08:05:27.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f3377fff640 1 --2- 172.21.15.57:0/4236040456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337815ba00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3370009d90 tx=0x7f337001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5701d54316d2d2b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f33767fc640 1 -- 172.21.15.57:0/4236040456 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33700a5a00 con 0x7f33780cd850 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f33767fc640 1 -- 172.21.15.57:0/4236040456 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33700a5b60 con 0x7f33780cd850 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.993+0000 7f33767fc640 1 -- 172.21.15.57:0/4236040456 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33700ad440 con 0x7f33780cd850 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- 172.21.15.57:0/4236040456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 msgr2=0x7f337815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 --2- 172.21.15.57:0/4236040456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337815ba00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3370009d90 tx=0x7f337001c920 comp rx=0 tx=0).stop 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- 172.21.15.57:0/4236040456 shutdown_connections 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 --2- 172.21.15.57:0/4236040456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337815ba00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- 172.21.15.57:0/4236040456 >> 172.21.15.57:0/4236040456 conn(0x7f33780b0c80 msgr2=0x7f33780b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- 172.21.15.57:0/4236040456 shutdown_connections 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- 172.21.15.57:0/4236040456 wait complete. 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 Processor -- start 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- start start 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33780ae4a0 0x7f337815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33780ce420 0x7f33780cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3378153200 con 0x7f33780ae4a0 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33781534e0 con 0x7f33780cd850 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f337dbc1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33781537c0 con 0x7f33780ce420 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33780ae4a0 0x7f337815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33780ae4a0 0x7f337815d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35568/0 (socket says 172.21.15.57:35568) 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 -- 172.21.15.57:0/1164436276 learned_addr learned my addr 172.21.15.57:0/1164436276 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f3376ffd640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f3377fff640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33780ce420 0x7f33780cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 -- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33780ce420 msgr2=0x7f33780cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33780ce420 0x7f33780cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 -- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 msgr2=0x7f337814d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337814d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f33777fe640 1 -- 172.21.15.57:0/1164436276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370009a70 con 0x7f33780ae4a0 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f3377fff640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33780ce420 0x7f33780cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:26.997+0000 7f3376ffd640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f33777fe640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33780ae4a0 0x7f337815d8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f336800c4f0 tx=0x7f336800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f335ffff640 1 -- 172.21.15.57:0/1164436276 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368005cf0 con 0x7f33780ae4a0 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f335ffff640 1 -- 172.21.15.57:0/1164436276 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368005e50 con 0x7f33780ae4a0 2023-11-24T08:05:27.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f335ffff640 1 -- 172.21.15.57:0/1164436276 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368007270 con 0x7f33780ae4a0 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337815d0f0 con 0x7f33780ae4a0 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337814d980 con 0x7f33780ae4a0 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337804e8c0 con 0x7f33780ae4a0 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f335ffff640 1 -- 172.21.15.57:0/1164436276 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f33680073d0 con 0x7f33780ae4a0 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f335ffff640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3364066620 0x7f3364068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f335ffff640 1 -- 172.21.15.57:0/1164436276 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33680836f0 con 0x7f33780ae4a0 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.001+0000 7f3376ffd640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3364066620 0x7f3364068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.005+0000 7f3376ffd640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3364066620 0x7f3364068ae0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f33780cbf00 tx=0x7f336c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.005+0000 7f335ffff640 1 -- 172.21.15.57:0/1164436276 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3368050900 con 0x7f33780ae4a0 2023-11-24T08:05:27.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.201+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f337806c900 con 0x7f33780ae4a0 2023-11-24T08:05:27.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.813+0000 7f335ffff640 1 -- 172.21.15.57:0/1164436276 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3368053f20 con 0x7f33780ae4a0 2023-11-24T08:05:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3364066620 msgr2=0x7f3364068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3364066620 0x7f3364068ae0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f33780cbf00 tx=0x7f336c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33780ae4a0 msgr2=0x7f337815d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33780ae4a0 0x7f337815d8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f336800c4f0 tx=0x7f336800c9b0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 shutdown_connections 2023-11-24T08:05:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3364066620 0x7f3364068ae0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33780ce420 0x7f33780cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33780cd850 0x7f337814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 --2- 172.21.15.57:0/1164436276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33780ae4a0 0x7f337815d8f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 >> 172.21.15.57:0/1164436276 conn(0x7f33780b0c80 msgr2=0x7f33780b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 shutdown_connections 2023-11-24T08:05:27.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.817+0000 7f337dbc1640 1 -- 172.21.15.57:0/1164436276 wait complete. 2023-11-24T08:05:27.847 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:05:27.847 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:27.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.989+0000 7fc35bae4640 1 Processor -- start 2023-11-24T08:05:27.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.989+0000 7fc35bae4640 1 -- start start 2023-11-24T08:05:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.989+0000 7fc35bae4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 0x7fc35406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.989+0000 7fc35bae4640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35406dc20 con 0x7fc35406e340 2023-11-24T08:05:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.989+0000 7fc35bae4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3540b3620 con 0x7fc35406cb90 2023-11-24T08:05:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.989+0000 7fc35bae4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35406e0b0 con 0x7fc354158a50 2023-11-24T08:05:27.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc35406e340 0x7fc3540707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37942/0 (socket says 172.21.15.57:37942) 2023-11-24T08:05:27.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 -- 172.21.15.57:0/3771216712 learned_addr learned my addr 172.21.15.57:0/3771216712 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:27.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc359880640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 0x7fc35406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697114385 0 0) 0x7fc35406dc20 con 0x7fc35406e340 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc340003530 con 0x7fc35406e340 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 324330612 0 0) 0x7fc340003530 con 0x7fc35406e340 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 msgr2=0x7fc35406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 0x7fc35406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 >> v1:172.21.15.132:6789/0 conn(0x7fc35406cb90 legacy=0x7fc3540b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354158e30 con 0x7fc35406e340 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fc344001680 con 0x7fc35406e340 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 >> v1:172.21.15.57:6789/0 conn(0x7fc35406e340 legacy=0x7fc3540707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 0x7fc3400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc340003ef0 0x7fc3400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340004d10 0x7fc340005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34000ba40 con 0x7fc340003ef0 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34000bb80 con 0x7fc340004d10 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34000bd40 con 0x7fc354158a50 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc340003ef0 0x7fc3400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35a081640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340004d10 0x7fc340005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc359880640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 0x7fc3400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 -- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 msgr2=0x7fc3400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354158a50 0x7fc3400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 -- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340004d10 msgr2=0x7fc340005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340004d10 0x7fc340005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.993+0000 7fc35907f640 1 -- 172.21.15.57:0/3771216712 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340003530 con 0x7fc340003ef0 2023-11-24T08:05:28.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35907f640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc340003ef0 0x7fc3400047d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c110 tx=0x7fc34401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdfb4cf0833a2dc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344005ae0 con 0x7fc340003ef0 2023-11-24T08:05:28.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344005c40 con 0x7fc340003ef0 2023-11-24T08:05:28.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35887e640 1 -- 172.21.15.57:0/3771216712 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440a57b0 con 0x7fc340003ef0 2023-11-24T08:05:28.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 -- 172.21.15.57:0/3771216712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc340003ef0 msgr2=0x7fc3400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 --2- 172.21.15.57:0/3771216712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc340003ef0 0x7fc3400047d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c110 tx=0x7fc34401cb30 comp rx=0 tx=0).stop 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35a081640 1 -- 172.21.15.57:0/3771216712 reap_dead start 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 -- 172.21.15.57:0/3771216712 shutdown_connections 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 -- 172.21.15.57:0/3771216712 >> 172.21.15.57:0/3771216712 conn(0x7fc3540b0bf0 msgr2=0x7fc3540b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 -- 172.21.15.57:0/3771216712 shutdown_connections 2023-11-24T08:05:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 -- 172.21.15.57:0/3771216712 wait complete. 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 Processor -- start 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:27.997+0000 7fc35bae4640 1 -- start start 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340003ef0 0x7fc354144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354164040 0x7fc354153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3541644c0 0x7fc354153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35409a680 con 0x7fc3541644c0 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc354162fa0 con 0x7fc340003ef0 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc354163280 con 0x7fc354164040 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3541644c0 0x7fc354153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3541644c0 0x7fc354153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35576/0 (socket says 172.21.15.57:35576) 2023-11-24T08:05:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 -- 172.21.15.57:0/1536809181 learned_addr learned my addr 172.21.15.57:0/1536809181 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35907f640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354164040 0x7fc354153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc359880640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340003ef0 0x7fc354144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 -- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354164040 msgr2=0x7fc354153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354164040 0x7fc354153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 -- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340003ef0 msgr2=0x7fc354144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340003ef0 0x7fc354144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 -- 172.21.15.57:0/1536809181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354163560 con 0x7fc3541644c0 2023-11-24T08:05:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35907f640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354164040 0x7fc354153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc359880640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340003ef0 0x7fc354144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35a081640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3541644c0 0x7fc354153770 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc34c007fd0 tx=0x7fc34c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc34a7fc640 1 -- 172.21.15.57:0/1536809181 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c006e30 con 0x7fc3541644c0 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc34a7fc640 1 -- 172.21.15.57:0/1536809181 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c003980 con 0x7fc3541644c0 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc34a7fc640 1 -- 172.21.15.57:0/1536809181 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c003d30 con 0x7fc3541644c0 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc354163840 con 0x7fc3541644c0 2023-11-24T08:05:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc354144690 con 0x7fc3541644c0 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc354163d60 con 0x7fc3541644c0 2023-11-24T08:05:28.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.001+0000 7fc34a7fc640 1 -- 172.21.15.57:0/1536809181 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc34c00d740 con 0x7fc3541644c0 2023-11-24T08:05:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.005+0000 7fc34a7fc640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.005+0000 7fc34a7fc640 1 -- 172.21.15.57:0/1536809181 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc34c083530 con 0x7fc3541644c0 2023-11-24T08:05:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.005+0000 7fc359880640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.005+0000 7fc359880640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc350009ad0 tx=0x7fc350008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.009+0000 7fc34a7fc640 1 -- 172.21.15.57:0/1536809181 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc354163d60 con 0x7fc3541644c0 2023-11-24T08:05:28.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.193+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc354163d60 con 0x7fc3541644c0 2023-11-24T08:05:28.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc34a7fc640 1 -- 172.21.15.57:0/1536809181 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fc354163d60 con 0x7fc3541644c0 2023-11-24T08:05:28.202 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:28.202 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:28.202 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 msgr2=0x7fc338068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc350009ad0 tx=0x7fc350008040 comp rx=0 tx=0).stop 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3541644c0 msgr2=0x7fc354153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3541644c0 0x7fc354153770 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc34c007fd0 tx=0x7fc34c00ff70 comp rx=0 tx=0).stop 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 shutdown_connections 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc338066620 0x7fc338068ae0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3541644c0 0x7fc354153770 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc354164040 0x7fc354153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 --2- 172.21.15.57:0/1536809181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc340003ef0 0x7fc354144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 >> 172.21.15.57:0/1536809181 conn(0x7fc3540b0bf0 msgr2=0x7fc3540ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 shutdown_connections 2023-11-24T08:05:28.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.197+0000 7fc35bae4640 1 -- 172.21.15.57:0/1536809181 wait complete. 2023-11-24T08:05:28.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:28.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.357+0000 7f25fb891640 1 Processor -- start 2023-11-24T08:05:28.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.357+0000 7f25fb891640 1 -- start start 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25fb891640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25fb891640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25f40709c0 0x7f25f4070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25fb891640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f406d8b0 con 0x7f25f409cc20 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25fb891640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4145020 con 0x7f25f40709c0 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25fb891640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f409d0a0 con 0x7f25f4144030 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f9e2e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f25f40709c0 0x7f25f4070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f8e2c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f25f409cc20 0x7f25f406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37954/0 (socket says 172.21.15.57:37954) 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f8e2c640 1 -- 172.21.15.57:0/3882110 learned_addr learned my addr 172.21.15.57:0/3882110 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f962d640 1 --2- 172.21.15.57:0/3882110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f9e2e640 1 -- 172.21.15.57:0/3882110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 msgr2=0x7f25f406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f9e2e640 1 --2- 172.21.15.57:0/3882110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f9e2e640 1 -- 172.21.15.57:0/3882110 >> v1:172.21.15.57:6789/0 conn(0x7f25f409cc20 legacy=0x7f25f406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f9e2e640 1 -- 172.21.15.57:0/3882110 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4071390 con 0x7f25f40709c0 2023-11-24T08:05:28.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25ebfff640 1 -- 172.21.15.57:0/3882110 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658678263 0 0) 0x7f25f406d8b0 con 0x7f25f409cc20 2023-11-24T08:05:28.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.361+0000 7f25f962d640 1 --2- 172.21.15.57:0/3882110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:28.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25f9e2e640 1 --2- 172.21.15.57:0/3882110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f40709c0 0x7f25f4070e50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009d90 tx=0x7f25ec01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96886c7f52f7014f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25ebfff640 1 -- 172.21.15.57:0/3882110 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0a59e0 con 0x7f25f40709c0 2023-11-24T08:05:28.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25ebfff640 1 -- 172.21.15.57:0/3882110 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec0a5b40 con 0x7f25f40709c0 2023-11-24T08:05:28.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25ebfff640 1 -- 172.21.15.57:0/3882110 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0ad440 con 0x7f25f40709c0 2023-11-24T08:05:28.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 -- 172.21.15.57:0/3882110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f40709c0 msgr2=0x7f25f4070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 --2- 172.21.15.57:0/3882110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f40709c0 0x7f25f4070e50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009d90 tx=0x7f25ec01c920 comp rx=0 tx=0).stop 2023-11-24T08:05:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 -- 172.21.15.57:0/3882110 shutdown_connections 2023-11-24T08:05:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 --2- 172.21.15.57:0/3882110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f40709c0 0x7f25f4070e50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 --2- 172.21.15.57:0/3882110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 -- 172.21.15.57:0/3882110 >> 172.21.15.57:0/3882110 conn(0x7f25f40b0bf0 msgr2=0x7f25f40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 -- 172.21.15.57:0/3882110 shutdown_connections 2023-11-24T08:05:28.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 -- 172.21.15.57:0/3882110 wait complete. 2023-11-24T08:05:28.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 Processor -- start 2023-11-24T08:05:28.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.365+0000 7f25fb891640 1 -- start start 2023-11-24T08:05:28.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25f40709c0 0x7f25f40c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f409cc20 0x7f25f4141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f4142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4141870 con 0x7f25f409cc20 2023-11-24T08:05:28.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4141aa0 con 0x7f25f40709c0 2023-11-24T08:05:28.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4141d80 con 0x7f25f4144030 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f409cc20 0x7f25f4141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f409cc20 0x7f25f4141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35594/0 (socket says 172.21.15.57:35594) 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 -- 172.21.15.57:0/3100353569 learned_addr learned my addr 172.21.15.57:0/3100353569 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f962d640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25f40709c0 0x7f25f40c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f9e2e640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f4142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 -- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 msgr2=0x7f25f4142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f4142ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 -- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25f40709c0 msgr2=0x7f25f40c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25f40709c0 0x7f25f40c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 -- 172.21.15.57:0/3100353569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec009a70 con 0x7f25f409cc20 2023-11-24T08:05:28.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25f8e2c640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f409cc20 0x7f25f4141330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f25e40011f0 tx=0x7f25e400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25e9ffb640 1 -- 172.21.15.57:0/3100353569 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e40074e0 con 0x7f25f409cc20 2023-11-24T08:05:28.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25e9ffb640 1 -- 172.21.15.57:0/3100353569 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4007640 con 0x7f25f409cc20 2023-11-24T08:05:28.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25e9ffb640 1 -- 172.21.15.57:0/3100353569 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4004a10 con 0x7f25f409cc20 2023-11-24T08:05:28.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f4142060 con 0x7f25f409cc20 2023-11-24T08:05:28.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4142620 con 0x7f25f409cc20 2023-11-24T08:05:28.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.369+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4067520 con 0x7f25f409cc20 2023-11-24T08:05:28.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.373+0000 7f25e9ffb640 1 -- 172.21.15.57:0/3100353569 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f25e4004b70 con 0x7f25f409cc20 2023-11-24T08:05:28.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.373+0000 7f25e9ffb640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f25d8066620 0x7f25d8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.373+0000 7f25e9ffb640 1 -- 172.21.15.57:0/3100353569 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25e4083350 con 0x7f25f409cc20 2023-11-24T08:05:28.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.373+0000 7f25f962d640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f25d8066620 0x7f25d8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.373+0000 7f25f962d640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f25d8066620 0x7f25d8068ae0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25f0006e90 tx=0x7f25f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.377+0000 7f25e9ffb640 1 -- 172.21.15.57:0/3100353569 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25e40506a0 con 0x7f25f409cc20 2023-11-24T08:05:28.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.533+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25f40b2ad0 con 0x7f25f409cc20 2023-11-24T08:05:28.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.533+0000 7f25e9ffb640 1 -- 172.21.15.57:0/3100353569 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16453 (secure 0 0 0) 0x7f25e4018090 con 0x7f25f409cc20 2023-11-24T08:05:28.541 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:28.541 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":48,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:25.775565+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:28.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f25d8066620 msgr2=0x7f25d8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f25d8066620 0x7f25d8068ae0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25f0006e90 tx=0x7f25f0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f409cc20 msgr2=0x7f25f4141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f409cc20 0x7f25f4141330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f25e40011f0 tx=0x7f25e400c9b0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 shutdown_connections 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f25d8066620 0x7f25d8068ae0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25f4144030 0x7f25f4142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25f409cc20 0x7f25f4141330 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 --2- 172.21.15.57:0/3100353569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25f40709c0 0x7f25f40c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 >> 172.21.15.57:0/3100353569 conn(0x7f25f40b0bf0 msgr2=0x7f25f40b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 shutdown_connections 2023-11-24T08:05:28.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.537+0000 7f25fb891640 1 -- 172.21.15.57:0/3100353569 wait complete. 2023-11-24T08:05:28.563 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:05:28.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:28.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a8557640 1 Processor -- start 2023-11-24T08:05:28.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a8557640 1 -- start start 2023-11-24T08:05:28.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a8557640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0a00ce8b0 0x7fc0a00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a8557640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a006c0e0 con 0x7fc0a015d570 2023-11-24T08:05:28.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a8557640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a00d1cc0 con 0x7fc0a00d3020 2023-11-24T08:05:28.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a8557640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00d1fa0 con 0x7fc0a00ce8b0 2023-11-24T08:05:28.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a62f3640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc0a015d570 0x7fc0a006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37968/0 (socket says 172.21.15.57:37968) 2023-11-24T08:05:28.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a62f3640 1 -- 172.21.15.57:0/1364298518 learned_addr learned my addr 172.21.15.57:0/1364298518 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a6af4640 1 --2- 172.21.15.57:0/1364298518 >> v2:172.21.15.132:3300/0 conn(0x7fc0a00ce8b0 0x7fc0a00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a52f1640 1 -- 172.21.15.57:0/1364298518 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926046177 0 0) 0x7fc0a006c0e0 con 0x7fc0a015d570 2023-11-24T08:05:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a52f1640 1 -- 172.21.15.57:0/1364298518 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc08c003530 con 0x7fc0a015d570 2023-11-24T08:05:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a6af4640 1 -- 172.21.15.57:0/1364298518 >> v1:172.21.15.132:6789/0 conn(0x7fc0a00d3020 legacy=0x7fc0a00d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a52f1640 1 -- 172.21.15.57:0/1364298518 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895242375 0 0) 0x7fc08c003530 con 0x7fc0a015d570 2023-11-24T08:05:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a6af4640 1 -- 172.21.15.57:0/1364298518 >> v1:172.21.15.57:6789/0 conn(0x7fc0a015d570 legacy=0x7fc0a006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.701+0000 7fc0a6af4640 1 -- 172.21.15.57:0/1364298518 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00ce0b0 con 0x7fc0a00ce8b0 2023-11-24T08:05:28.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a6af4640 1 --2- 172.21.15.57:0/1364298518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a00ce8b0 0x7fc0a00ced60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc098009d90 tx=0x7fc09801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ee8da7e571ea7e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a52f1640 1 -- 172.21.15.57:0/1364298518 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c001680 con 0x7fc0a00ce8b0 2023-11-24T08:05:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a52f1640 1 -- 172.21.15.57:0/1364298518 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980a5680 con 0x7fc0a00ce8b0 2023-11-24T08:05:28.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a52f1640 1 -- 172.21.15.57:0/1364298518 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980a5a10 con 0x7fc0a00ce8b0 2023-11-24T08:05:28.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a8557640 1 -- 172.21.15.57:0/1364298518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a00ce8b0 msgr2=0x7fc0a00ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a8557640 1 --2- 172.21.15.57:0/1364298518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a00ce8b0 0x7fc0a00ced60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc098009d90 tx=0x7fc09801c840 comp rx=0 tx=0).stop 2023-11-24T08:05:28.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a8557640 1 -- 172.21.15.57:0/1364298518 shutdown_connections 2023-11-24T08:05:28.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a8557640 1 --2- 172.21.15.57:0/1364298518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a00ce8b0 0x7fc0a00ced60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a8557640 1 -- 172.21.15.57:0/1364298518 >> 172.21.15.57:0/1364298518 conn(0x7fc0a008ceb0 msgr2=0x7fc0a009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a8557640 1 -- 172.21.15.57:0/1364298518 shutdown_connections 2023-11-24T08:05:28.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.705+0000 7fc0a8557640 1 -- 172.21.15.57:0/1364298518 wait complete. 2023-11-24T08:05:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 Processor -- start 2023-11-24T08:05:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 -- start start 2023-11-24T08:05:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0a00ce8b0 0x7fc0a0154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0a00d3020 0x7fc0a00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a015d570 0x7fc0a00cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00b92c0 con 0x7fc0a00d3020 2023-11-24T08:05:28.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00cd640 con 0x7fc0a015d570 2023-11-24T08:05:28.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00c8090 con 0x7fc0a00ce8b0 2023-11-24T08:05:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0a00d3020 0x7fc0a00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0a00d3020 0x7fc0a00ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35600/0 (socket says 172.21.15.57:35600) 2023-11-24T08:05:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 -- 172.21.15.57:0/3618771575 learned_addr learned my addr 172.21.15.57:0/3618771575 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:28.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a6af4640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a015d570 0x7fc0a00cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a62f3640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0a00ce8b0 0x7fc0a0154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 -- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0a00ce8b0 msgr2=0x7fc0a0154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0a00ce8b0 0x7fc0a0154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 -- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a015d570 msgr2=0x7fc0a00cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a015d570 0x7fc0a00cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 -- 172.21.15.57:0/3618771575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009a70 con 0x7fc0a00d3020 2023-11-24T08:05:28.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a62f3640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0a00ce8b0 0x7fc0a0154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:28.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a5af2640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0a00d3020 0x7fc0a00ccbc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c500 tx=0x7fc09000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc096ffd640 1 -- 172.21.15.57:0/3618771575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900052d0 con 0x7fc0a00d3020 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc096ffd640 1 -- 172.21.15.57:0/3618771575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090005430 con 0x7fc0a00d3020 2023-11-24T08:05:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a0160170 con 0x7fc0a00d3020 2023-11-24T08:05:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc096ffd640 1 -- 172.21.15.57:0/3618771575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090012830 con 0x7fc0a00d3020 2023-11-24T08:05:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.709+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a00c83e0 con 0x7fc0a00d3020 2023-11-24T08:05:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.713+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a00c8810 con 0x7fc0a00d3020 2023-11-24T08:05:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.713+0000 7fc096ffd640 1 -- 172.21.15.57:0/3618771575 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc090012990 con 0x7fc0a00d3020 2023-11-24T08:05:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.713+0000 7fc096ffd640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc084066620 0x7fc084068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.713+0000 7fc096ffd640 1 -- 172.21.15.57:0/3618771575 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc090083ca0 con 0x7fc0a00d3020 2023-11-24T08:05:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.713+0000 7fc0a62f3640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc084066620 0x7fc084068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.713+0000 7fc0a62f3640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc084066620 0x7fc084068ae0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000f70 tx=0x7fc09c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.717+0000 7fc096ffd640 1 -- 172.21.15.57:0/3618771575 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc090050e10 con 0x7fc0a00d3020 2023-11-24T08:05:28.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.873+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0a01595f0 con 0x7fc084066620 2023-11-24T08:05:28.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.885+0000 7fc096ffd640 1 -- 172.21.15.57:0/3618771575 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287825 (secure 0 0 0) 0x7fc0a01595f0 con 0x7fc084066620 2023-11-24T08:05:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:05:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc084066620 msgr2=0x7fc084068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc084066620 0x7fc084068ae0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000f70 tx=0x7fc09c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0a00d3020 msgr2=0x7fc0a00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0a00d3020 0x7fc0a00ccbc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c500 tx=0x7fc09000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 shutdown_connections 2023-11-24T08:05:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc084066620 0x7fc084068ae0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a015d570 0x7fc0a00cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0a00d3020 0x7fc0a00ccbc0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 --2- 172.21.15.57:0/3618771575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0a00ce8b0 0x7fc0a0154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 >> 172.21.15.57:0/3618771575 conn(0x7fc0a008ceb0 msgr2=0x7fc0a00cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 shutdown_connections 2023-11-24T08:05:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:28.889+0000 7fc0a8557640 1 -- 172.21.15.57:0/3618771575 wait complete. 2023-11-24T08:05:28.915 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-11-24T08:05:28.700664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238264,"kb_used_data":5440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736456,"statfs":{"total":773094113280,"available":772850130944,"internally_reserved":0,"allocated":5570560,"data_stored":2920856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.946177"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808493+0000","last_change":"2023-11-24T08:05:24.803503+0000","last_active":"2023-11-24T08:05:24.808493+0000","last_peered":"2023-11-24T08:05:24.808493+0000","last_clean":"2023-11-24T08:05:24.808493+0000","last_became_active":"2023-11-24T08:05:24.802762+0000","last_became_peered":"2023-11-24T08:05:24.802762+0000","last_unstale":"2023-11-24T08:05:24.808493+0000","last_undegraded":"2023-11-24T08:05:24.808493+0000","last_fullsized":"2023-11-24T08:05:24.808493+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808522+0000","last_change":"2023-11-24T08:05:24.805589+0000","last_active":"2023-11-24T08:05:24.808522+0000","last_peered":"2023-11-24T08:05:24.808522+0000","last_clean":"2023-11-24T08:05:24.808522+0000","last_became_active":"2023-11-24T08:05:24.805266+0000","last_became_peered":"2023-11-24T08:05:24.805266+0000","last_unstale":"2023-11-24T08:05:24.808522+0000","last_undegraded":"2023-11-24T08:05:24.808522+0000","last_fullsized":"2023-11-24T08:05:24.808522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806879+0000","last_change":"2023-11-24T08:05:24.802338+0000","last_active":"2023-11-24T08:05:24.806879+0000","last_peered":"2023-11-24T08:05:24.806879+0000","last_clean":"2023-11-24T08:05:24.806879+0000","last_became_active":"2023-11-24T08:05:24.802083+0000","last_became_peered":"2023-11-24T08:05:24.802083+0000","last_unstale":"2023-11-24T08:05:24.806879+0000","last_undegraded":"2023-11-24T08:05:24.806879+0000","last_fullsized":"2023-11-24T08:05:24.806879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767162+0000","last_change":"2023-11-24T08:05:23.767162+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767162+0000","last_undegraded":"2023-11-24T08:05:23.767162+0000","last_fullsized":"2023-11-24T08:05:23.767162+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801154+0000","last_change":"2023-11-24T08:05:24.795185+0000","last_active":"2023-11-24T08:05:24.801154+0000","last_peered":"2023-11-24T08:05:24.801154+0000","last_clean":"2023-11-24T08:05:24.801154+0000","last_became_active":"2023-11-24T08:05:24.794908+0000","last_became_peered":"2023-11-24T08:05:24.794908+0000","last_unstale":"2023-11-24T08:05:24.801154+0000","last_undegraded":"2023-11-24T08:05:24.801154+0000","last_fullsized":"2023-11-24T08:05:24.801154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.814811+0000","last_change":"2023-11-24T08:05:24.808518+0000","last_active":"2023-11-24T08:05:24.814811+0000","last_peered":"2023-11-24T08:05:24.814811+0000","last_clean":"2023-11-24T08:05:24.814811+0000","last_became_active":"2023-11-24T08:05:24.807671+0000","last_became_peered":"2023-11-24T08:05:24.807671+0000","last_unstale":"2023-11-24T08:05:24.814811+0000","last_undegraded":"2023-11-24T08:05:24.814811+0000","last_fullsized":"2023-11-24T08:05:24.814811+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:47.196156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818290+0000","last_change":"2023-11-24T08:05:24.816324+0000","last_active":"2023-11-24T08:05:24.818290+0000","last_peered":"2023-11-24T08:05:24.818290+0000","last_clean":"2023-11-24T08:05:24.818290+0000","last_became_active":"2023-11-24T08:05:24.816070+0000","last_became_peered":"2023-11-24T08:05:24.816070+0000","last_unstale":"2023-11-24T08:05:24.818290+0000","last_undegraded":"2023-11-24T08:05:24.818290+0000","last_fullsized":"2023-11-24T08:05:24.818290+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766245+0000","last_change":"2023-11-24T08:05:23.766245+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766245+0000","last_undegraded":"2023-11-24T08:05:23.766245+0000","last_fullsized":"2023-11-24T08:05:23.766245+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764857+0000","last_change":"2023-11-24T08:05:23.764857+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764857+0000","last_undegraded":"2023-11-24T08:05:23.764857+0000","last_fullsized":"2023-11-24T08:05:23.764857+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764046+0000","last_change":"2023-11-24T08:05:23.764046+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764046+0000","last_undegraded":"2023-11-24T08:05:23.764046+0000","last_fullsized":"2023-11-24T08:05:23.764046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767662+0000","last_change":"2023-11-24T08:05:23.767662+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767662+0000","last_undegraded":"2023-11-24T08:05:23.767662+0000","last_fullsized":"2023-11-24T08:05:23.767662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.804986+0000","last_change":"2023-11-24T08:05:24.797897+0000","last_active":"2023-11-24T08:05:24.804986+0000","last_peered":"2023-11-24T08:05:24.804986+0000","last_clean":"2023-11-24T08:05:24.804986+0000","last_became_active":"2023-11-24T08:05:24.797199+0000","last_became_peered":"2023-11-24T08:05:24.797199+0000","last_unstale":"2023-11-24T08:05:24.804986+0000","last_undegraded":"2023-11-24T08:05:24.804986+0000","last_fullsized":"2023-11-24T08:05:24.804986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809144+0000","last_change":"2023-11-24T08:05:24.798153+0000","last_active":"2023-11-24T08:05:24.809144+0000","last_peered":"2023-11-24T08:05:24.809144+0000","last_clean":"2023-11-24T08:05:24.809144+0000","last_became_active":"2023-11-24T08:05:24.797691+0000","last_became_peered":"2023-11-24T08:05:24.797691+0000","last_unstale":"2023-11-24T08:05:24.809144+0000","last_undegraded":"2023-11-24T08:05:24.809144+0000","last_fullsized":"2023-11-24T08:05:24.809144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:43.983089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765738+0000","last_change":"2023-11-24T08:05:23.765738+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765738+0000","last_undegraded":"2023-11-24T08:05:23.765738+0000","last_fullsized":"2023-11-24T08:05:23.765738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802771+0000","last_change":"2023-11-24T08:05:24.795053+0000","last_active":"2023-11-24T08:05:24.802771+0000","last_peered":"2023-11-24T08:05:24.802771+0000","last_clean":"2023-11-24T08:05:24.802771+0000","last_became_active":"2023-11-24T08:05:24.794617+0000","last_became_peered":"2023-11-24T08:05:24.794617+0000","last_unstale":"2023-11-24T08:05:24.802771+0000","last_undegraded":"2023-11-24T08:05:24.802771+0000","last_fullsized":"2023-11-24T08:05:24.802771+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800911+0000","last_change":"2023-11-24T08:05:24.795258+0000","last_active":"2023-11-24T08:05:24.800911+0000","last_peered":"2023-11-24T08:05:24.800911+0000","last_clean":"2023-11-24T08:05:24.800911+0000","last_became_active":"2023-11-24T08:05:24.794956+0000","last_became_peered":"2023-11-24T08:05:24.794956+0000","last_unstale":"2023-11-24T08:05:24.800911+0000","last_undegraded":"2023-11-24T08:05:24.800911+0000","last_fullsized":"2023-11-24T08:05:24.800911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:56.270806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799550+0000","last_change":"2023-11-24T08:05:24.794729+0000","last_active":"2023-11-24T08:05:24.799550+0000","last_peered":"2023-11-24T08:05:24.799550+0000","last_clean":"2023-11-24T08:05:24.799550+0000","last_became_active":"2023-11-24T08:05:24.794319+0000","last_became_peered":"2023-11-24T08:05:24.794319+0000","last_unstale":"2023-11-24T08:05:24.799550+0000","last_undegraded":"2023-11-24T08:05:24.799550+0000","last_fullsized":"2023-11-24T08:05:24.799550+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818901+0000","last_change":"2023-11-24T08:05:24.811835+0000","last_active":"2023-11-24T08:05:24.818901+0000","last_peered":"2023-11-24T08:05:24.818901+0000","last_clean":"2023-11-24T08:05:24.818901+0000","last_became_active":"2023-11-24T08:05:24.811546+0000","last_became_peered":"2023-11-24T08:05:24.811546+0000","last_unstale":"2023-11-24T08:05:24.818901+0000","last_undegraded":"2023-11-24T08:05:24.818901+0000","last_fullsized":"2023-11-24T08:05:24.818901+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820552+0000","last_change":"2023-11-24T08:05:24.807853+0000","last_active":"2023-11-24T08:05:24.820552+0000","last_peered":"2023-11-24T08:05:24.820552+0000","last_clean":"2023-11-24T08:05:24.820552+0000","last_became_active":"2023-11-24T08:05:24.804890+0000","last_became_peered":"2023-11-24T08:05:24.804890+0000","last_unstale":"2023-11-24T08:05:24.820552+0000","last_undegraded":"2023-11-24T08:05:24.820552+0000","last_fullsized":"2023-11-24T08:05:24.820552+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:35.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812853+0000","last_change":"2023-11-24T08:05:24.804875+0000","last_active":"2023-11-24T08:05:24.812853+0000","last_peered":"2023-11-24T08:05:24.812853+0000","last_clean":"2023-11-24T08:05:24.812853+0000","last_became_active":"2023-11-24T08:05:24.804578+0000","last_became_peered":"2023-11-24T08:05:24.804578+0000","last_unstale":"2023-11-24T08:05:24.812853+0000","last_undegraded":"2023-11-24T08:05:24.812853+0000","last_fullsized":"2023-11-24T08:05:24.812853+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:42:06.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803024+0000","last_change":"2023-11-24T08:05:24.794384+0000","last_active":"2023-11-24T08:05:24.803024+0000","last_peered":"2023-11-24T08:05:24.803024+0000","last_clean":"2023-11-24T08:05:24.803024+0000","last_became_active":"2023-11-24T08:05:24.794053+0000","last_became_peered":"2023-11-24T08:05:24.794053+0000","last_unstale":"2023-11-24T08:05:24.803024+0000","last_undegraded":"2023-11-24T08:05:24.803024+0000","last_fullsized":"2023-11-24T08:05:24.803024+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762443+0000","last_change":"2023-11-24T08:05:23.762443+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762443+0000","last_undegraded":"2023-11-24T08:05:23.762443+0000","last_fullsized":"2023-11-24T08:05:23.762443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820819+0000","last_change":"2023-11-24T08:05:24.809693+0000","last_active":"2023-11-24T08:05:24.820819+0000","last_peered":"2023-11-24T08:05:24.820819+0000","last_clean":"2023-11-24T08:05:24.820819+0000","last_became_active":"2023-11-24T08:05:24.809223+0000","last_became_peered":"2023-11-24T08:05:24.809223+0000","last_unstale":"2023-11-24T08:05:24.820819+0000","last_undegraded":"2023-11-24T08:05:24.820819+0000","last_fullsized":"2023-11-24T08:05:24.820819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:57.419189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823105+0000","last_change":"2023-11-24T08:05:24.811467+0000","last_active":"2023-11-24T08:05:24.823105+0000","last_peered":"2023-11-24T08:05:24.823105+0000","last_clean":"2023-11-24T08:05:24.823105+0000","last_became_active":"2023-11-24T08:05:24.811225+0000","last_became_peered":"2023-11-24T08:05:24.811225+0000","last_unstale":"2023-11-24T08:05:24.823105+0000","last_undegraded":"2023-11-24T08:05:24.823105+0000","last_fullsized":"2023-11-24T08:05:24.823105+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:57.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820706+0000","last_change":"2023-11-24T08:05:24.808178+0000","last_active":"2023-11-24T08:05:24.820706+0000","last_peered":"2023-11-24T08:05:24.820706+0000","last_clean":"2023-11-24T08:05:24.820706+0000","last_became_active":"2023-11-24T08:05:24.807918+0000","last_became_peered":"2023-11-24T08:05:24.807918+0000","last_unstale":"2023-11-24T08:05:24.820706+0000","last_undegraded":"2023-11-24T08:05:24.820706+0000","last_fullsized":"2023-11-24T08:05:24.820706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:42.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812129+0000","last_change":"2023-11-24T08:05:24.804744+0000","last_active":"2023-11-24T08:05:24.812129+0000","last_peered":"2023-11-24T08:05:24.812129+0000","last_clean":"2023-11-24T08:05:24.812129+0000","last_became_active":"2023-11-24T08:05:24.804339+0000","last_became_peered":"2023-11-24T08:05:24.804339+0000","last_unstale":"2023-11-24T08:05:24.812129+0000","last_undegraded":"2023-11-24T08:05:24.812129+0000","last_fullsized":"2023-11-24T08:05:24.812129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:08.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801293+0000","last_change":"2023-11-24T08:05:24.795287+0000","last_active":"2023-11-24T08:05:24.801293+0000","last_peered":"2023-11-24T08:05:24.801293+0000","last_clean":"2023-11-24T08:05:24.801293+0000","last_became_active":"2023-11-24T08:05:24.795029+0000","last_became_peered":"2023-11-24T08:05:24.795029+0000","last_unstale":"2023-11-24T08:05:24.801293+0000","last_undegraded":"2023-11-24T08:05:24.801293+0000","last_fullsized":"2023-11-24T08:05:24.801293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807716+0000","last_change":"2023-11-24T08:05:24.801769+0000","last_active":"2023-11-24T08:05:24.807716+0000","last_peered":"2023-11-24T08:05:24.807716+0000","last_clean":"2023-11-24T08:05:24.807716+0000","last_became_active":"2023-11-24T08:05:24.801503+0000","last_became_peered":"2023-11-24T08:05:24.801503+0000","last_unstale":"2023-11-24T08:05:24.807716+0000","last_undegraded":"2023-11-24T08:05:24.807716+0000","last_fullsized":"2023-11-24T08:05:24.807716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:23.875555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823087+0000","last_change":"2023-11-24T08:05:24.808950+0000","last_active":"2023-11-24T08:05:24.823087+0000","last_peered":"2023-11-24T08:05:24.823087+0000","last_clean":"2023-11-24T08:05:24.823087+0000","last_became_active":"2023-11-24T08:05:24.808294+0000","last_became_peered":"2023-11-24T08:05:24.808294+0000","last_unstale":"2023-11-24T08:05:24.823087+0000","last_undegraded":"2023-11-24T08:05:24.823087+0000","last_fullsized":"2023-11-24T08:05:24.823087+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:39.471914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806647+0000","last_change":"2023-11-24T08:05:24.801554+0000","last_active":"2023-11-24T08:05:24.806647+0000","last_peered":"2023-11-24T08:05:24.806647+0000","last_clean":"2023-11-24T08:05:24.806647+0000","last_became_active":"2023-11-24T08:05:24.801207+0000","last_became_peered":"2023-11-24T08:05:24.801207+0000","last_unstale":"2023-11-24T08:05:24.806647+0000","last_undegraded":"2023-11-24T08:05:24.806647+0000","last_fullsized":"2023-11-24T08:05:24.806647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802739+0000","last_change":"2023-11-24T08:05:24.792493+0000","last_active":"2023-11-24T08:05:24.802739+0000","last_peered":"2023-11-24T08:05:24.802739+0000","last_clean":"2023-11-24T08:05:24.802739+0000","last_became_active":"2023-11-24T08:05:24.789895+0000","last_became_peered":"2023-11-24T08:05:24.789895+0000","last_unstale":"2023-11-24T08:05:24.802739+0000","last_undegraded":"2023-11-24T08:05:24.802739+0000","last_fullsized":"2023-11-24T08:05:24.802739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:01.420207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811890+0000","last_change":"2023-11-24T08:05:24.804224+0000","last_active":"2023-11-24T08:05:24.811890+0000","last_peered":"2023-11-24T08:05:24.811890+0000","last_clean":"2023-11-24T08:05:24.811890+0000","last_became_active":"2023-11-24T08:05:24.803814+0000","last_became_peered":"2023-11-24T08:05:24.803814+0000","last_unstale":"2023-11-24T08:05:24.811890+0000","last_undegraded":"2023-11-24T08:05:24.811890+0000","last_fullsized":"2023-11-24T08:05:24.811890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:13.625275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.810842+0000","last_change":"2023-11-24T08:05:24.807630+0000","last_active":"2023-11-24T08:05:24.810842+0000","last_peered":"2023-11-24T08:05:24.810842+0000","last_clean":"2023-11-24T08:05:24.810842+0000","last_became_active":"2023-11-24T08:05:24.807158+0000","last_became_peered":"2023-11-24T08:05:24.807158+0000","last_unstale":"2023-11-24T08:05:24.810842+0000","last_undegraded":"2023-11-24T08:05:24.810842+0000","last_fullsized":"2023-11-24T08:05:24.810842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:01.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824282+0000","last_change":"2023-11-24T08:05:23.789734+0000","last_active":"2023-11-24T08:05:24.824282+0000","last_peered":"2023-11-24T08:05:24.824282+0000","last_clean":"2023-11-24T08:05:24.824282+0000","last_became_active":"2023-11-24T08:05:23.789448+0000","last_became_peered":"2023-11-24T08:05:23.789448+0000","last_unstale":"2023-11-24T08:05:24.824282+0000","last_undegraded":"2023-11-24T08:05:24.824282+0000","last_fullsized":"2023-11-24T08:05:24.824282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:15.341563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797818+0000","last_change":"2023-11-24T08:05:24.793485+0000","last_active":"2023-11-24T08:05:24.797818+0000","last_peered":"2023-11-24T08:05:24.797818+0000","last_clean":"2023-11-24T08:05:24.797818+0000","last_became_active":"2023-11-24T08:05:24.793195+0000","last_became_peered":"2023-11-24T08:05:24.793195+0000","last_unstale":"2023-11-24T08:05:24.797818+0000","last_undegraded":"2023-11-24T08:05:24.797818+0000","last_fullsized":"2023-11-24T08:05:24.797818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:58.250762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823411+0000","last_change":"2023-11-24T08:05:23.781005+0000","last_active":"2023-11-24T08:05:24.823411+0000","last_peered":"2023-11-24T08:05:24.823411+0000","last_clean":"2023-11-24T08:05:24.823411+0000","last_became_active":"2023-11-24T08:05:23.780655+0000","last_became_peered":"2023-11-24T08:05:23.780655+0000","last_unstale":"2023-11-24T08:05:24.823411+0000","last_undegraded":"2023-11-24T08:05:24.823411+0000","last_fullsized":"2023-11-24T08:05:24.823411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:05.273157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801982+0000","last_change":"2023-11-24T08:05:24.796295+0000","last_active":"2023-11-24T08:05:24.801982+0000","last_peered":"2023-11-24T08:05:24.801982+0000","last_clean":"2023-11-24T08:05:24.801982+0000","last_became_active":"2023-11-24T08:05:24.796051+0000","last_became_peered":"2023-11-24T08:05:24.796051+0000","last_unstale":"2023-11-24T08:05:24.801982+0000","last_undegraded":"2023-11-24T08:05:24.801982+0000","last_fullsized":"2023-11-24T08:05:24.801982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819751+0000","last_change":"2023-11-24T08:05:23.785930+0000","last_active":"2023-11-24T08:05:24.819751+0000","last_peered":"2023-11-24T08:05:24.819751+0000","last_clean":"2023-11-24T08:05:24.819751+0000","last_became_active":"2023-11-24T08:05:23.785575+0000","last_became_peered":"2023-11-24T08:05:23.785575+0000","last_unstale":"2023-11-24T08:05:24.819751+0000","last_undegraded":"2023-11-24T08:05:24.819751+0000","last_fullsized":"2023-11-24T08:05:24.819751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:45.042279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807153+0000","last_change":"2023-11-24T08:05:24.801199+0000","last_active":"2023-11-24T08:05:24.807153+0000","last_peered":"2023-11-24T08:05:24.807153+0000","last_clean":"2023-11-24T08:05:24.807153+0000","last_became_active":"2023-11-24T08:05:24.799824+0000","last_became_peered":"2023-11-24T08:05:24.799824+0000","last_unstale":"2023-11-24T08:05:24.807153+0000","last_undegraded":"2023-11-24T08:05:24.807153+0000","last_fullsized":"2023-11-24T08:05:24.807153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819780+0000","last_change":"2023-11-24T08:05:23.786066+0000","last_active":"2023-11-24T08:05:24.819780+0000","last_peered":"2023-11-24T08:05:24.819780+0000","last_clean":"2023-11-24T08:05:24.819780+0000","last_became_active":"2023-11-24T08:05:23.785789+0000","last_became_peered":"2023-11-24T08:05:23.785789+0000","last_unstale":"2023-11-24T08:05:24.819780+0000","last_undegraded":"2023-11-24T08:05:24.819780+0000","last_fullsized":"2023-11-24T08:05:24.819780+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799134+0000","last_change":"2023-11-24T08:05:24.793986+0000","last_active":"2023-11-24T08:05:24.799134+0000","last_peered":"2023-11-24T08:05:24.799134+0000","last_clean":"2023-11-24T08:05:24.799134+0000","last_became_active":"2023-11-24T08:05:24.793719+0000","last_became_peered":"2023-11-24T08:05:24.793719+0000","last_unstale":"2023-11-24T08:05:24.799134+0000","last_undegraded":"2023-11-24T08:05:24.799134+0000","last_fullsized":"2023-11-24T08:05:24.799134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:04.586739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822481+0000","last_change":"2023-11-24T08:05:23.786132+0000","last_active":"2023-11-24T08:05:24.822481+0000","last_peered":"2023-11-24T08:05:24.822481+0000","last_clean":"2023-11-24T08:05:24.822481+0000","last_became_active":"2023-11-24T08:05:23.785846+0000","last_became_peered":"2023-11-24T08:05:23.785846+0000","last_unstale":"2023-11-24T08:05:24.822481+0000","last_undegraded":"2023-11-24T08:05:24.822481+0000","last_fullsized":"2023-11-24T08:05:24.822481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765224+0000","last_change":"2023-11-24T08:05:23.765224+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765224+0000","last_undegraded":"2023-11-24T08:05:23.765224+0000","last_fullsized":"2023-11-24T08:05:23.765224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822483+0000","last_change":"2023-11-24T08:05:23.782383+0000","last_active":"2023-11-24T08:05:24.822483+0000","last_peered":"2023-11-24T08:05:24.822483+0000","last_clean":"2023-11-24T08:05:24.822483+0000","last_became_active":"2023-11-24T08:05:23.782077+0000","last_became_peered":"2023-11-24T08:05:23.782077+0000","last_unstale":"2023-11-24T08:05:24.822483+0000","last_undegraded":"2023-11-24T08:05:24.822483+0000","last_fullsized":"2023-11-24T08:05:24.822483+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:00.714376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765712+0000","last_change":"2023-11-24T08:05:23.765712+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765712+0000","last_undegraded":"2023-11-24T08:05:23.765712+0000","last_fullsized":"2023-11-24T08:05:23.765712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783972+0000","last_change":"2023-11-24T08:05:23.786361+0000","last_active":"2023-11-24T08:05:24.783972+0000","last_peered":"2023-11-24T08:05:24.783972+0000","last_clean":"2023-11-24T08:05:24.783972+0000","last_became_active":"2023-11-24T08:05:23.786102+0000","last_became_peered":"2023-11-24T08:05:23.786102+0000","last_unstale":"2023-11-24T08:05:24.783972+0000","last_undegraded":"2023-11-24T08:05:24.783972+0000","last_fullsized":"2023-11-24T08:05:24.783972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:48.278067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820800+0000","last_change":"2023-11-24T08:05:24.809467+0000","last_active":"2023-11-24T08:05:24.820800+0000","last_peered":"2023-11-24T08:05:24.820800+0000","last_clean":"2023-11-24T08:05:24.820800+0000","last_became_active":"2023-11-24T08:05:24.808871+0000","last_became_peered":"2023-11-24T08:05:24.808871+0000","last_unstale":"2023-11-24T08:05:24.820800+0000","last_undegraded":"2023-11-24T08:05:24.820800+0000","last_fullsized":"2023-11-24T08:05:24.820800+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:55.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.784982+0000","last_change":"2023-11-24T08:05:23.779563+0000","last_active":"2023-11-24T08:05:23.784982+0000","last_peered":"2023-11-24T08:05:23.784982+0000","last_clean":"2023-11-24T08:05:23.784982+0000","last_became_active":"2023-11-24T08:05:23.779281+0000","last_became_peered":"2023-11-24T08:05:23.779281+0000","last_unstale":"2023-11-24T08:05:23.784982+0000","last_undegraded":"2023-11-24T08:05:23.784982+0000","last_fullsized":"2023-11-24T08:05:23.784982+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:44.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811731+0000","last_change":"2023-11-24T08:05:24.807194+0000","last_active":"2023-11-24T08:05:24.811731+0000","last_peered":"2023-11-24T08:05:24.811731+0000","last_clean":"2023-11-24T08:05:24.811731+0000","last_became_active":"2023-11-24T08:05:24.806869+0000","last_became_peered":"2023-11-24T08:05:24.806869+0000","last_unstale":"2023-11-24T08:05:24.811731+0000","last_undegraded":"2023-11-24T08:05:24.811731+0000","last_fullsized":"2023-11-24T08:05:24.811731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.789214+0000","last_change":"2023-11-24T08:05:23.778824+0000","last_active":"2023-11-24T08:05:24.789214+0000","last_peered":"2023-11-24T08:05:24.789214+0000","last_clean":"2023-11-24T08:05:24.789214+0000","last_became_active":"2023-11-24T08:05:23.778462+0000","last_became_peered":"2023-11-24T08:05:23.778462+0000","last_unstale":"2023-11-24T08:05:24.789214+0000","last_undegraded":"2023-11-24T08:05:24.789214+0000","last_fullsized":"2023-11-24T08:05:24.789214+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809998+0000","last_change":"2023-11-24T08:05:24.806424+0000","last_active":"2023-11-24T08:05:24.809998+0000","last_peered":"2023-11-24T08:05:24.809998+0000","last_clean":"2023-11-24T08:05:24.809998+0000","last_became_active":"2023-11-24T08:05:24.806143+0000","last_became_peered":"2023-11-24T08:05:24.806143+0000","last_unstale":"2023-11-24T08:05:24.809998+0000","last_undegraded":"2023-11-24T08:05:24.809998+0000","last_fullsized":"2023-11-24T08:05:24.809998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.781431+0000","last_change":"2023-11-24T08:05:23.777987+0000","last_active":"2023-11-24T08:05:23.781431+0000","last_peered":"2023-11-24T08:05:23.781431+0000","last_clean":"2023-11-24T08:05:23.781431+0000","last_became_active":"2023-11-24T08:05:23.777197+0000","last_became_peered":"2023-11-24T08:05:23.777197+0000","last_unstale":"2023-11-24T08:05:23.781431+0000","last_undegraded":"2023-11-24T08:05:23.781431+0000","last_fullsized":"2023-11-24T08:05:23.781431+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:49.045196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809312+0000","last_change":"2023-11-24T08:05:24.803406+0000","last_active":"2023-11-24T08:05:24.809312+0000","last_peered":"2023-11-24T08:05:24.809312+0000","last_clean":"2023-11-24T08:05:24.809312+0000","last_became_active":"2023-11-24T08:05:24.803027+0000","last_became_peered":"2023-11-24T08:05:24.803027+0000","last_unstale":"2023-11-24T08:05:24.809312+0000","last_undegraded":"2023-11-24T08:05:24.809312+0000","last_fullsized":"2023-11-24T08:05:24.809312+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:21:44.439548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824118+0000","last_change":"2023-11-24T08:05:23.793340+0000","last_active":"2023-11-24T08:05:24.824118+0000","last_peered":"2023-11-24T08:05:24.824118+0000","last_clean":"2023-11-24T08:05:24.824118+0000","last_became_active":"2023-11-24T08:05:23.792687+0000","last_became_peered":"2023-11-24T08:05:23.792687+0000","last_unstale":"2023-11-24T08:05:24.824118+0000","last_undegraded":"2023-11-24T08:05:24.824118+0000","last_fullsized":"2023-11-24T08:05:24.824118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:48.296413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819192+0000","last_change":"2023-11-24T08:05:24.816525+0000","last_active":"2023-11-24T08:05:24.819192+0000","last_peered":"2023-11-24T08:05:24.819192+0000","last_clean":"2023-11-24T08:05:24.819192+0000","last_became_active":"2023-11-24T08:05:24.816253+0000","last_became_peered":"2023-11-24T08:05:24.816253+0000","last_unstale":"2023-11-24T08:05:24.819192+0000","last_undegraded":"2023-11-24T08:05:24.819192+0000","last_fullsized":"2023-11-24T08:05:24.819192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824951+0000","last_change":"2023-11-24T08:05:23.780472+0000","last_active":"2023-11-24T08:05:24.824951+0000","last_peered":"2023-11-24T08:05:24.824951+0000","last_clean":"2023-11-24T08:05:24.824951+0000","last_became_active":"2023-11-24T08:05:23.780179+0000","last_became_peered":"2023-11-24T08:05:23.780179+0000","last_unstale":"2023-11-24T08:05:24.824951+0000","last_undegraded":"2023-11-24T08:05:24.824951+0000","last_fullsized":"2023-11-24T08:05:24.824951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:34.866637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820534+0000","last_change":"2023-11-24T08:05:24.807288+0000","last_active":"2023-11-24T08:05:24.820534+0000","last_peered":"2023-11-24T08:05:24.820534+0000","last_clean":"2023-11-24T08:05:24.820534+0000","last_became_active":"2023-11-24T08:05:24.807002+0000","last_became_peered":"2023-11-24T08:05:24.807002+0000","last_unstale":"2023-11-24T08:05:24.820534+0000","last_undegraded":"2023-11-24T08:05:24.820534+0000","last_fullsized":"2023-11-24T08:05:24.820534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:21.670193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823116+0000","last_change":"2023-11-24T08:05:23.785359+0000","last_active":"2023-11-24T08:05:24.823116+0000","last_peered":"2023-11-24T08:05:24.823116+0000","last_clean":"2023-11-24T08:05:24.823116+0000","last_became_active":"2023-11-24T08:05:23.784845+0000","last_became_peered":"2023-11-24T08:05:23.784845+0000","last_unstale":"2023-11-24T08:05:24.823116+0000","last_undegraded":"2023-11-24T08:05:24.823116+0000","last_fullsized":"2023-11-24T08:05:24.823116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:45.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762666+0000","last_change":"2023-11-24T08:05:23.762666+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762666+0000","last_undegraded":"2023-11-24T08:05:23.762666+0000","last_fullsized":"2023-11-24T08:05:23.762666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795412+0000","last_change":"2023-11-24T08:05:23.785562+0000","last_active":"2023-11-24T08:05:24.795412+0000","last_peered":"2023-11-24T08:05:24.795412+0000","last_clean":"2023-11-24T08:05:24.795412+0000","last_became_active":"2023-11-24T08:05:23.785261+0000","last_became_peered":"2023-11-24T08:05:23.785261+0000","last_unstale":"2023-11-24T08:05:24.795412+0000","last_undegraded":"2023-11-24T08:05:24.795412+0000","last_fullsized":"2023-11-24T08:05:24.795412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802791+0000","last_change":"2023-11-24T08:05:24.797229+0000","last_active":"2023-11-24T08:05:24.802791+0000","last_peered":"2023-11-24T08:05:24.802791+0000","last_clean":"2023-11-24T08:05:24.802791+0000","last_became_active":"2023-11-24T08:05:24.796863+0000","last_became_peered":"2023-11-24T08:05:24.796863+0000","last_unstale":"2023-11-24T08:05:24.802791+0000","last_undegraded":"2023-11-24T08:05:24.802791+0000","last_fullsized":"2023-11-24T08:05:24.802791+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782427+0000","last_change":"2023-11-24T08:05:23.783807+0000","last_active":"2023-11-24T08:05:24.782427+0000","last_peered":"2023-11-24T08:05:24.782427+0000","last_clean":"2023-11-24T08:05:24.782427+0000","last_became_active":"2023-11-24T08:05:23.783504+0000","last_became_peered":"2023-11-24T08:05:23.783504+0000","last_unstale":"2023-11-24T08:05:24.782427+0000","last_undegraded":"2023-11-24T08:05:24.782427+0000","last_fullsized":"2023-11-24T08:05:24.782427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:07.077115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.816629+0000","last_change":"2023-11-24T08:05:24.813482+0000","last_active":"2023-11-24T08:05:24.816629+0000","last_peered":"2023-11-24T08:05:24.816629+0000","last_clean":"2023-11-24T08:05:24.816629+0000","last_became_active":"2023-11-24T08:05:24.813159+0000","last_became_peered":"2023-11-24T08:05:24.813159+0000","last_unstale":"2023-11-24T08:05:24.816629+0000","last_undegraded":"2023-11-24T08:05:24.816629+0000","last_fullsized":"2023-11-24T08:05:24.816629+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.789417+0000","last_change":"2023-11-24T08:05:23.782857+0000","last_active":"2023-11-24T08:05:23.789417+0000","last_peered":"2023-11-24T08:05:23.789417+0000","last_clean":"2023-11-24T08:05:23.789417+0000","last_became_active":"2023-11-24T08:05:23.782637+0000","last_became_peered":"2023-11-24T08:05:23.782637+0000","last_unstale":"2023-11-24T08:05:23.789417+0000","last_undegraded":"2023-11-24T08:05:23.789417+0000","last_fullsized":"2023-11-24T08:05:23.789417+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:17:44.634959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800348+0000","last_change":"2023-11-24T08:05:24.793310+0000","last_active":"2023-11-24T08:05:24.800348+0000","last_peered":"2023-11-24T08:05:24.800348+0000","last_clean":"2023-11-24T08:05:24.800348+0000","last_became_active":"2023-11-24T08:05:24.792934+0000","last_became_peered":"2023-11-24T08:05:24.792934+0000","last_unstale":"2023-11-24T08:05:24.800348+0000","last_undegraded":"2023-11-24T08:05:24.800348+0000","last_fullsized":"2023-11-24T08:05:24.800348+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:46.235186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822139+0000","last_change":"2023-11-24T08:05:23.791769+0000","last_active":"2023-11-24T08:05:24.822139+0000","last_peered":"2023-11-24T08:05:24.822139+0000","last_clean":"2023-11-24T08:05:24.822139+0000","last_became_active":"2023-11-24T08:05:23.790624+0000","last_became_peered":"2023-11-24T08:05:23.790624+0000","last_unstale":"2023-11-24T08:05:24.822139+0000","last_undegraded":"2023-11-24T08:05:24.822139+0000","last_fullsized":"2023-11-24T08:05:24.822139+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:02.701487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764281+0000","last_change":"2023-11-24T08:05:23.764281+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764281+0000","last_undegraded":"2023-11-24T08:05:23.764281+0000","last_fullsized":"2023-11-24T08:05:23.764281+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.821859+0000","last_change":"2023-11-24T08:05:23.785405+0000","last_active":"2023-11-24T08:05:24.821859+0000","last_peered":"2023-11-24T08:05:24.821859+0000","last_clean":"2023-11-24T08:05:24.821859+0000","last_became_active":"2023-11-24T08:05:23.785104+0000","last_became_peered":"2023-11-24T08:05:23.785104+0000","last_unstale":"2023-11-24T08:05:24.821859+0000","last_undegraded":"2023-11-24T08:05:24.821859+0000","last_fullsized":"2023-11-24T08:05:24.821859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820164+0000","last_change":"2023-11-24T08:05:24.803826+0000","last_active":"2023-11-24T08:05:24.820164+0000","last_peered":"2023-11-24T08:05:24.820164+0000","last_clean":"2023-11-24T08:05:24.820164+0000","last_became_active":"2023-11-24T08:05:24.803535+0000","last_became_peered":"2023-11-24T08:05:24.803535+0000","last_unstale":"2023-11-24T08:05:24.820164+0000","last_undegraded":"2023-11-24T08:05:24.820164+0000","last_fullsized":"2023-11-24T08:05:24.820164+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:47.403645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820963+0000","last_change":"2023-11-24T08:05:23.790238+0000","last_active":"2023-11-24T08:05:24.820963+0000","last_peered":"2023-11-24T08:05:24.820963+0000","last_clean":"2023-11-24T08:05:24.820963+0000","last_became_active":"2023-11-24T08:05:23.789980+0000","last_became_peered":"2023-11-24T08:05:23.789980+0000","last_unstale":"2023-11-24T08:05:24.820963+0000","last_undegraded":"2023-11-24T08:05:24.820963+0000","last_fullsized":"2023-11-24T08:05:24.820963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:35.217727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812014+0000","last_change":"2023-11-24T08:05:24.800737+0000","last_active":"2023-11-24T08:05:24.812014+0000","last_peered":"2023-11-24T08:05:24.812014+0000","last_clean":"2023-11-24T08:05:24.812014+0000","last_became_active":"2023-11-24T08:05:24.800410+0000","last_became_peered":"2023-11-24T08:05:24.800410+0000","last_unstale":"2023-11-24T08:05:24.812014+0000","last_undegraded":"2023-11-24T08:05:24.812014+0000","last_fullsized":"2023-11-24T08:05:24.812014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:08:20.963516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782262+0000","last_change":"2023-11-24T08:05:23.787803+0000","last_active":"2023-11-24T08:05:24.782262+0000","last_peered":"2023-11-24T08:05:24.782262+0000","last_clean":"2023-11-24T08:05:24.782262+0000","last_became_active":"2023-11-24T08:05:23.787536+0000","last_became_peered":"2023-11-24T08:05:23.787536+0000","last_unstale":"2023-11-24T08:05:24.782262+0000","last_undegraded":"2023-11-24T08:05:24.782262+0000","last_fullsized":"2023-11-24T08:05:24.782262+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:47.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803376+0000","last_change":"2023-11-24T08:05:24.797504+0000","last_active":"2023-11-24T08:05:24.803376+0000","last_peered":"2023-11-24T08:05:24.803376+0000","last_clean":"2023-11-24T08:05:24.803376+0000","last_became_active":"2023-11-24T08:05:24.797158+0000","last_became_peered":"2023-11-24T08:05:24.797158+0000","last_unstale":"2023-11-24T08:05:24.803376+0000","last_undegraded":"2023-11-24T08:05:24.803376+0000","last_fullsized":"2023-11-24T08:05:24.803376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:04.593709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822567+0000","last_change":"2023-11-24T08:05:23.786254+0000","last_active":"2023-11-24T08:05:24.822567+0000","last_peered":"2023-11-24T08:05:24.822567+0000","last_clean":"2023-11-24T08:05:24.822567+0000","last_became_active":"2023-11-24T08:05:23.786045+0000","last_became_peered":"2023-11-24T08:05:23.786045+0000","last_unstale":"2023-11-24T08:05:24.822567+0000","last_undegraded":"2023-11-24T08:05:24.822567+0000","last_fullsized":"2023-11-24T08:05:24.822567+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:18.255758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807370+0000","last_change":"2023-11-24T08:05:24.797939+0000","last_active":"2023-11-24T08:05:24.807370+0000","last_peered":"2023-11-24T08:05:24.807370+0000","last_clean":"2023-11-24T08:05:24.807370+0000","last_became_active":"2023-11-24T08:05:24.797670+0000","last_became_peered":"2023-11-24T08:05:24.797670+0000","last_unstale":"2023-11-24T08:05:24.807370+0000","last_undegraded":"2023-11-24T08:05:24.807370+0000","last_fullsized":"2023-11-24T08:05:24.807370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783878+0000","last_change":"2023-11-24T08:05:23.787871+0000","last_active":"2023-11-24T08:05:24.783878+0000","last_peered":"2023-11-24T08:05:24.783878+0000","last_clean":"2023-11-24T08:05:24.783878+0000","last_became_active":"2023-11-24T08:05:23.787606+0000","last_became_peered":"2023-11-24T08:05:23.787606+0000","last_unstale":"2023-11-24T08:05:24.783878+0000","last_undegraded":"2023-11-24T08:05:24.783878+0000","last_fullsized":"2023-11-24T08:05:24.783878+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811879+0000","last_change":"2023-11-24T08:05:24.801445+0000","last_active":"2023-11-24T08:05:24.811879+0000","last_peered":"2023-11-24T08:05:24.811879+0000","last_clean":"2023-11-24T08:05:24.811879+0000","last_became_active":"2023-11-24T08:05:24.801146+0000","last_became_peered":"2023-11-24T08:05:24.801146+0000","last_unstale":"2023-11-24T08:05:24.811879+0000","last_undegraded":"2023-11-24T08:05:24.811879+0000","last_fullsized":"2023-11-24T08:05:24.811879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:14.569562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.782532+0000","last_change":"2023-11-24T08:05:23.775594+0000","last_active":"2023-11-24T08:05:23.782532+0000","last_peered":"2023-11-24T08:05:23.782532+0000","last_clean":"2023-11-24T08:05:23.782532+0000","last_became_active":"2023-11-24T08:05:23.775204+0000","last_became_peered":"2023-11-24T08:05:23.775204+0000","last_unstale":"2023-11-24T08:05:23.782532+0000","last_undegraded":"2023-11-24T08:05:23.782532+0000","last_fullsized":"2023-11-24T08:05:23.782532+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:44.667325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762471+0000","last_change":"2023-11-24T08:05:23.762471+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762471+0000","last_undegraded":"2023-11-24T08:05:23.762471+0000","last_fullsized":"2023-11-24T08:05:23.762471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795167+0000","last_change":"2023-11-24T08:05:23.788392+0000","last_active":"2023-11-24T08:05:24.795167+0000","last_peered":"2023-11-24T08:05:24.795167+0000","last_clean":"2023-11-24T08:05:24.795167+0000","last_became_active":"2023-11-24T08:05:23.788108+0000","last_became_peered":"2023-11-24T08:05:23.788108+0000","last_unstale":"2023-11-24T08:05:24.795167+0000","last_undegraded":"2023-11-24T08:05:24.795167+0000","last_fullsized":"2023-11-24T08:05:24.795167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:32.971004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820405+0000","last_change":"2023-11-24T08:05:24.807026+0000","last_active":"2023-11-24T08:05:24.820405+0000","last_peered":"2023-11-24T08:05:24.820405+0000","last_clean":"2023-11-24T08:05:24.820405+0000","last_became_active":"2023-11-24T08:05:24.806282+0000","last_became_peered":"2023-11-24T08:05:24.806282+0000","last_unstale":"2023-11-24T08:05:24.820405+0000","last_undegraded":"2023-11-24T08:05:24.820405+0000","last_fullsized":"2023-11-24T08:05:24.820405+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:13:48.606704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.780151+0000","last_change":"2023-11-24T08:05:23.784376+0000","last_active":"2023-11-24T08:05:24.780151+0000","last_peered":"2023-11-24T08:05:24.780151+0000","last_clean":"2023-11-24T08:05:24.780151+0000","last_became_active":"2023-11-24T08:05:23.784088+0000","last_became_peered":"2023-11-24T08:05:23.784088+0000","last_unstale":"2023-11-24T08:05:24.780151+0000","last_undegraded":"2023-11-24T08:05:24.780151+0000","last_fullsized":"2023-11-24T08:05:24.780151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766717+0000","last_change":"2023-11-24T08:05:23.766717+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766717+0000","last_undegraded":"2023-11-24T08:05:23.766717+0000","last_fullsized":"2023-11-24T08:05:23.766717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797184+0000","last_change":"2023-11-24T08:05:23.793529+0000","last_active":"2023-11-24T08:05:24.797184+0000","last_peered":"2023-11-24T08:05:24.797184+0000","last_clean":"2023-11-24T08:05:24.797184+0000","last_became_active":"2023-11-24T08:05:23.793045+0000","last_became_peered":"2023-11-24T08:05:23.793045+0000","last_unstale":"2023-11-24T08:05:24.797184+0000","last_undegraded":"2023-11-24T08:05:24.797184+0000","last_fullsized":"2023-11-24T08:05:24.797184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813740+0000","last_change":"2023-11-24T08:05:24.810946+0000","last_active":"2023-11-24T08:05:24.813740+0000","last_peered":"2023-11-24T08:05:24.813740+0000","last_clean":"2023-11-24T08:05:24.813740+0000","last_became_active":"2023-11-24T08:05:24.810545+0000","last_became_peered":"2023-11-24T08:05:24.810545+0000","last_unstale":"2023-11-24T08:05:24.813740+0000","last_undegraded":"2023-11-24T08:05:24.813740+0000","last_fullsized":"2023-11-24T08:05:24.813740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:16.355430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.790977+0000","last_change":"2023-11-24T08:05:23.786068+0000","last_active":"2023-11-24T08:05:24.790977+0000","last_peered":"2023-11-24T08:05:24.790977+0000","last_clean":"2023-11-24T08:05:24.790977+0000","last_became_active":"2023-11-24T08:05:23.785722+0000","last_became_peered":"2023-11-24T08:05:23.785722+0000","last_unstale":"2023-11-24T08:05:24.790977+0000","last_undegraded":"2023-11-24T08:05:24.790977+0000","last_fullsized":"2023-11-24T08:05:24.790977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:06.084171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.805738+0000","last_change":"2023-11-24T08:05:24.802279+0000","last_active":"2023-11-24T08:05:24.805738+0000","last_peered":"2023-11-24T08:05:24.805738+0000","last_clean":"2023-11-24T08:05:24.805738+0000","last_became_active":"2023-11-24T08:05:24.801966+0000","last_became_peered":"2023-11-24T08:05:24.801966+0000","last_unstale":"2023-11-24T08:05:24.805738+0000","last_undegraded":"2023-11-24T08:05:24.805738+0000","last_fullsized":"2023-11-24T08:05:24.805738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:29.448203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.796812+0000","last_change":"2023-11-24T08:05:23.792778+0000","last_active":"2023-11-24T08:05:24.796812+0000","last_peered":"2023-11-24T08:05:24.796812+0000","last_clean":"2023-11-24T08:05:24.796812+0000","last_became_active":"2023-11-24T08:05:23.792486+0000","last_became_peered":"2023-11-24T08:05:23.792486+0000","last_unstale":"2023-11-24T08:05:24.796812+0000","last_undegraded":"2023-11-24T08:05:24.796812+0000","last_fullsized":"2023-11-24T08:05:24.796812+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:00.406340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803044+0000","last_change":"2023-11-24T08:05:24.797345+0000","last_active":"2023-11-24T08:05:24.803044+0000","last_peered":"2023-11-24T08:05:24.803044+0000","last_clean":"2023-11-24T08:05:24.803044+0000","last_became_active":"2023-11-24T08:05:24.797025+0000","last_became_peered":"2023-11-24T08:05:24.797025+0000","last_unstale":"2023-11-24T08:05:24.803044+0000","last_undegraded":"2023-11-24T08:05:24.803044+0000","last_fullsized":"2023-11-24T08:05:24.803044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:49.310280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788382+0000","last_change":"2023-11-24T08:05:23.782246+0000","last_active":"2023-11-24T08:05:24.788382+0000","last_peered":"2023-11-24T08:05:24.788382+0000","last_clean":"2023-11-24T08:05:24.788382+0000","last_became_active":"2023-11-24T08:05:23.781813+0000","last_became_peered":"2023-11-24T08:05:23.781813+0000","last_unstale":"2023-11-24T08:05:24.788382+0000","last_undegraded":"2023-11-24T08:05:24.788382+0000","last_fullsized":"2023-11-24T08:05:24.788382+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809841+0000","last_change":"2023-11-24T08:05:24.799932+0000","last_active":"2023-11-24T08:05:24.809841+0000","last_peered":"2023-11-24T08:05:24.809841+0000","last_clean":"2023-11-24T08:05:24.809841+0000","last_became_active":"2023-11-24T08:05:24.799665+0000","last_became_peered":"2023-11-24T08:05:24.799665+0000","last_unstale":"2023-11-24T08:05:24.809841+0000","last_undegraded":"2023-11-24T08:05:24.809841+0000","last_fullsized":"2023-11-24T08:05:24.809841+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788765+0000","last_change":"2023-11-24T08:05:23.788270+0000","last_active":"2023-11-24T08:05:24.788765+0000","last_peered":"2023-11-24T08:05:24.788765+0000","last_clean":"2023-11-24T08:05:24.788765+0000","last_became_active":"2023-11-24T08:05:23.788012+0000","last_became_peered":"2023-11-24T08:05:23.788012+0000","last_unstale":"2023-11-24T08:05:24.788765+0000","last_undegraded":"2023-11-24T08:05:24.788765+0000","last_fullsized":"2023-11-24T08:05:24.788765+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813337+0000","last_change":"2023-11-24T08:05:24.808501+0000","last_active":"2023-11-24T08:05:24.813337+0000","last_peered":"2023-11-24T08:05:24.813337+0000","last_clean":"2023-11-24T08:05:24.813337+0000","last_became_active":"2023-11-24T08:05:24.808234+0000","last_became_peered":"2023-11-24T08:05:24.808234+0000","last_unstale":"2023-11-24T08:05:24.813337+0000","last_undegraded":"2023-11-24T08:05:24.813337+0000","last_fullsized":"2023-11-24T08:05:24.813337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.790894+0000","last_change":"2023-11-24T08:05:23.785853+0000","last_active":"2023-11-24T08:05:23.790894+0000","last_peered":"2023-11-24T08:05:23.790894+0000","last_clean":"2023-11-24T08:05:23.790894+0000","last_became_active":"2023-11-24T08:05:23.785174+0000","last_became_peered":"2023-11-24T08:05:23.785174+0000","last_unstale":"2023-11-24T08:05:23.790894+0000","last_undegraded":"2023-11-24T08:05:23.790894+0000","last_fullsized":"2023-11-24T08:05:23.790894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:14.239227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.763523+0000","last_change":"2023-11-24T08:05:23.763523+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.763523+0000","last_undegraded":"2023-11-24T08:05:23.763523+0000","last_fullsized":"2023-11-24T08:05:23.763523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820451+0000","last_change":"2023-11-24T08:05:23.790128+0000","last_active":"2023-11-24T08:05:24.820451+0000","last_peered":"2023-11-24T08:05:24.820451+0000","last_clean":"2023-11-24T08:05:24.820451+0000","last_became_active":"2023-11-24T08:05:23.789847+0000","last_became_peered":"2023-11-24T08:05:23.789847+0000","last_unstale":"2023-11-24T08:05:24.820451+0000","last_undegraded":"2023-11-24T08:05:24.820451+0000","last_fullsized":"2023-11-24T08:05:24.820451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.773879+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:05:23.773879+0000","last_peered":"2023-11-24T08:05:23.773879+0000","last_clean":"2023-11-24T08:05:23.773879+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:05:23.773879+0000","last_undegraded":"2023-11-24T08:05:23.773879+0000","last_fullsized":"2023-11-24T08:05:23.773879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":809270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.4539999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4260000000000002,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.93999999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71999999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":219484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.754}]},{"osd":2,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.878}]},{"osd":3,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1.006},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0620000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":1.04},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95799999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":219450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.91700000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98099999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":220446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.9139999999999997,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.907,"5min":5.907,"15min":5.907},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.054}]},{"osd":5,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.101},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.143}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.3160000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.6059999999999999,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.434},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9320000000000004,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.94599999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":802405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.880000000000001,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.9800000000000004,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.622}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":12.688000000000001,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.752}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1100000000000003,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":6.6390000000000002,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:28.920 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.093+0000 7ff100a6b640 1 Processor -- start 2023-11-24T08:05:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.093+0000 7ff100a6b640 1 -- start start 2023-11-24T08:05:29.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff100a6b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0fc0cf5b0 0x7ff0fc15b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff100a6b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0fc0ce0a0 0x7ff0fc071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff100a6b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0cc9a0 con 0x7ff0fc071770 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff100a6b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc072160 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff100a6b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc0ce4b0 con 0x7ff0fc0cf5b0 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0fad9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0fc0ce0a0 0x7ff0fc071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0f3fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff0fc071770 0x7ff0fc0cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37980/0 (socket says 172.21.15.57:37980) 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0f3fff640 1 -- 172.21.15.57:0/918536243 learned_addr learned my addr 172.21.15.57:0/918536243 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:29.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0fa59c640 1 --2- 172.21.15.57:0/918536243 >> v2:172.21.15.132:3300/0 conn(0x7ff0fc0cf5b0 0x7ff0fc15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0fad9d640 1 -- 172.21.15.57:0/918536243 >> v2:172.21.15.132:3300/0 conn(0x7ff0fc0cf5b0 msgr2=0x7ff0fc15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0fad9d640 1 --2- 172.21.15.57:0/918536243 >> v2:172.21.15.132:3300/0 conn(0x7ff0fc0cf5b0 0x7ff0fc15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0fad9d640 1 -- 172.21.15.57:0/918536243 >> v1:172.21.15.57:6789/0 conn(0x7ff0fc071770 legacy=0x7ff0fc0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.097+0000 7ff0fad9d640 1 -- 172.21.15.57:0/918536243 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc15b5f0 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff0fad9d640 1 --2- 172.21.15.57:0/918536243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc071c20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc06b590 tx=0x7ff0f401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4013074a44d1df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff0f9d9b640 1 -- 172.21.15.57:0/918536243 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40a79f0 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff0f9d9b640 1 -- 172.21.15.57:0/918536243 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f40a7b50 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff0f9d9b640 1 -- 172.21.15.57:0/918536243 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40af440 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- 172.21.15.57:0/918536243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 msgr2=0x7ff0fc071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 --2- 172.21.15.57:0/918536243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc071c20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc06b590 tx=0x7ff0f401eb20 comp rx=0 tx=0).stop 2023-11-24T08:05:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- 172.21.15.57:0/918536243 shutdown_connections 2023-11-24T08:05:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 --2- 172.21.15.57:0/918536243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc071c20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 --2- 172.21.15.57:0/918536243 >> v2:172.21.15.132:3300/0 conn(0x7ff0fc0cf5b0 0x7ff0fc15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- 172.21.15.57:0/918536243 >> 172.21.15.57:0/918536243 conn(0x7ff0fc06a5b0 msgr2=0x7ff0fc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- 172.21.15.57:0/918536243 shutdown_connections 2023-11-24T08:05:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- 172.21.15.57:0/918536243 wait complete. 2023-11-24T08:05:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 Processor -- start 2023-11-24T08:05:29.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- start start 2023-11-24T08:05:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc071770 0x7ff0fc1495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0fc0cf5b0 0x7ff0fc158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b3e10 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b2d70 con 0x7ff0fc071770 2023-11-24T08:05:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.101+0000 7ff100a6b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b3050 con 0x7ff0fc0cf5b0 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc0b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35618/0 (socket says 172.21.15.57:35618) 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 -- 172.21.15.57:0/965207014 learned_addr learned my addr 172.21.15.57:0/965207014 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0fa59c640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc071770 0x7ff0fc1495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0fad9d640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0fc0cf5b0 0x7ff0fc158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 -- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0fc0cf5b0 msgr2=0x7ff0fc158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0fc0cf5b0 0x7ff0fc158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 -- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc071770 msgr2=0x7ff0fc1495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc071770 0x7ff0fc1495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 -- 172.21.15.57:0/965207014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f4009a70 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0fad9d640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0fc0cf5b0 0x7ff0fc158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f3fff640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc0b22b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400c500 tx=0x7ff0e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f2ffd640 1 -- 172.21.15.57:0/965207014 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4005cf0 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f2ffd640 1 -- 172.21.15.57:0/965207014 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4005e50 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f2ffd640 1 -- 172.21.15.57:0/965207014 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40072f0 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc15bed0 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc0b3610 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc04e850 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f2ffd640 1 -- 172.21.15.57:0/965207014 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ff0e4007450 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.105+0000 7ff0f2ffd640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0dc066620 0x7ff0dc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.109+0000 7ff0f2ffd640 1 -- 172.21.15.57:0/965207014 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0e40835a0 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.109+0000 7ff0fa59c640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0dc066620 0x7ff0dc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.109+0000 7ff0fa59c640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0dc066620 0x7ff0dc068ae0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009ac0 tx=0x7ff0ec009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.109+0000 7ff0f2ffd640 1 -- 172.21.15.57:0/965207014 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0e40508f0 con 0x7ff0fc0ce0a0 2023-11-24T08:05:29.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.273+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0fc15bd50 con 0x7ff0dc066620 2023-11-24T08:05:29.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.281+0000 7ff0f2ffd640 1 -- 172.21.15.57:0/965207014 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287825 (secure 0 0 0) 0x7ff0ec0119e0 con 0x7ff0dc066620 2023-11-24T08:05:29.291 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:29.293 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0dc066620 msgr2=0x7ff0dc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0dc066620 0x7ff0dc068ae0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009ac0 tx=0x7ff0ec009190 comp rx=0 tx=0).stop 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 msgr2=0x7ff0fc0b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc0b22b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400c500 tx=0x7ff0e400c9c0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 shutdown_connections 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0dc066620 0x7ff0dc068ae0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0fc0cf5b0 0x7ff0fc158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0fc0ce0a0 0x7ff0fc0b22b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 --2- 172.21.15.57:0/965207014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc071770 0x7ff0fc1495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 >> 172.21.15.57:0/965207014 conn(0x7ff0fc06a5b0 msgr2=0x7ff0fc15c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 shutdown_connections 2023-11-24T08:05:29.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.285+0000 7ff100a6b640 1 -- 172.21.15.57:0/965207014 wait complete. 2023-11-24T08:05:29.313 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-11-24T08:05:28.700664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238264,"kb_used_data":5440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736456,"statfs":{"total":773094113280,"available":772850130944,"internally_reserved":0,"allocated":5570560,"data_stored":2920856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.946177"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808493+0000","last_change":"2023-11-24T08:05:24.803503+0000","last_active":"2023-11-24T08:05:24.808493+0000","last_peered":"2023-11-24T08:05:24.808493+0000","last_clean":"2023-11-24T08:05:24.808493+0000","last_became_active":"2023-11-24T08:05:24.802762+0000","last_became_peered":"2023-11-24T08:05:24.802762+0000","last_unstale":"2023-11-24T08:05:24.808493+0000","last_undegraded":"2023-11-24T08:05:24.808493+0000","last_fullsized":"2023-11-24T08:05:24.808493+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808522+0000","last_change":"2023-11-24T08:05:24.805589+0000","last_active":"2023-11-24T08:05:24.808522+0000","last_peered":"2023-11-24T08:05:24.808522+0000","last_clean":"2023-11-24T08:05:24.808522+0000","last_became_active":"2023-11-24T08:05:24.805266+0000","last_became_peered":"2023-11-24T08:05:24.805266+0000","last_unstale":"2023-11-24T08:05:24.808522+0000","last_undegraded":"2023-11-24T08:05:24.808522+0000","last_fullsized":"2023-11-24T08:05:24.808522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806879+0000","last_change":"2023-11-24T08:05:24.802338+0000","last_active":"2023-11-24T08:05:24.806879+0000","last_peered":"2023-11-24T08:05:24.806879+0000","last_clean":"2023-11-24T08:05:24.806879+0000","last_became_active":"2023-11-24T08:05:24.802083+0000","last_became_peered":"2023-11-24T08:05:24.802083+0000","last_unstale":"2023-11-24T08:05:24.806879+0000","last_undegraded":"2023-11-24T08:05:24.806879+0000","last_fullsized":"2023-11-24T08:05:24.806879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767162+0000","last_change":"2023-11-24T08:05:23.767162+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767162+0000","last_undegraded":"2023-11-24T08:05:23.767162+0000","last_fullsized":"2023-11-24T08:05:23.767162+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801154+0000","last_change":"2023-11-24T08:05:24.795185+0000","last_active":"2023-11-24T08:05:24.801154+0000","last_peered":"2023-11-24T08:05:24.801154+0000","last_clean":"2023-11-24T08:05:24.801154+0000","last_became_active":"2023-11-24T08:05:24.794908+0000","last_became_peered":"2023-11-24T08:05:24.794908+0000","last_unstale":"2023-11-24T08:05:24.801154+0000","last_undegraded":"2023-11-24T08:05:24.801154+0000","last_fullsized":"2023-11-24T08:05:24.801154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.814811+0000","last_change":"2023-11-24T08:05:24.808518+0000","last_active":"2023-11-24T08:05:24.814811+0000","last_peered":"2023-11-24T08:05:24.814811+0000","last_clean":"2023-11-24T08:05:24.814811+0000","last_became_active":"2023-11-24T08:05:24.807671+0000","last_became_peered":"2023-11-24T08:05:24.807671+0000","last_unstale":"2023-11-24T08:05:24.814811+0000","last_undegraded":"2023-11-24T08:05:24.814811+0000","last_fullsized":"2023-11-24T08:05:24.814811+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:47.196156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818290+0000","last_change":"2023-11-24T08:05:24.816324+0000","last_active":"2023-11-24T08:05:24.818290+0000","last_peered":"2023-11-24T08:05:24.818290+0000","last_clean":"2023-11-24T08:05:24.818290+0000","last_became_active":"2023-11-24T08:05:24.816070+0000","last_became_peered":"2023-11-24T08:05:24.816070+0000","last_unstale":"2023-11-24T08:05:24.818290+0000","last_undegraded":"2023-11-24T08:05:24.818290+0000","last_fullsized":"2023-11-24T08:05:24.818290+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766245+0000","last_change":"2023-11-24T08:05:23.766245+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766245+0000","last_undegraded":"2023-11-24T08:05:23.766245+0000","last_fullsized":"2023-11-24T08:05:23.766245+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764857+0000","last_change":"2023-11-24T08:05:23.764857+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764857+0000","last_undegraded":"2023-11-24T08:05:23.764857+0000","last_fullsized":"2023-11-24T08:05:23.764857+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764046+0000","last_change":"2023-11-24T08:05:23.764046+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764046+0000","last_undegraded":"2023-11-24T08:05:23.764046+0000","last_fullsized":"2023-11-24T08:05:23.764046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767662+0000","last_change":"2023-11-24T08:05:23.767662+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767662+0000","last_undegraded":"2023-11-24T08:05:23.767662+0000","last_fullsized":"2023-11-24T08:05:23.767662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.804986+0000","last_change":"2023-11-24T08:05:24.797897+0000","last_active":"2023-11-24T08:05:24.804986+0000","last_peered":"2023-11-24T08:05:24.804986+0000","last_clean":"2023-11-24T08:05:24.804986+0000","last_became_active":"2023-11-24T08:05:24.797199+0000","last_became_peered":"2023-11-24T08:05:24.797199+0000","last_unstale":"2023-11-24T08:05:24.804986+0000","last_undegraded":"2023-11-24T08:05:24.804986+0000","last_fullsized":"2023-11-24T08:05:24.804986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809144+0000","last_change":"2023-11-24T08:05:24.798153+0000","last_active":"2023-11-24T08:05:24.809144+0000","last_peered":"2023-11-24T08:05:24.809144+0000","last_clean":"2023-11-24T08:05:24.809144+0000","last_became_active":"2023-11-24T08:05:24.797691+0000","last_became_peered":"2023-11-24T08:05:24.797691+0000","last_unstale":"2023-11-24T08:05:24.809144+0000","last_undegraded":"2023-11-24T08:05:24.809144+0000","last_fullsized":"2023-11-24T08:05:24.809144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:43.983089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765738+0000","last_change":"2023-11-24T08:05:23.765738+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765738+0000","last_undegraded":"2023-11-24T08:05:23.765738+0000","last_fullsized":"2023-11-24T08:05:23.765738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802771+0000","last_change":"2023-11-24T08:05:24.795053+0000","last_active":"2023-11-24T08:05:24.802771+0000","last_peered":"2023-11-24T08:05:24.802771+0000","last_clean":"2023-11-24T08:05:24.802771+0000","last_became_active":"2023-11-24T08:05:24.794617+0000","last_became_peered":"2023-11-24T08:05:24.794617+0000","last_unstale":"2023-11-24T08:05:24.802771+0000","last_undegraded":"2023-11-24T08:05:24.802771+0000","last_fullsized":"2023-11-24T08:05:24.802771+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800911+0000","last_change":"2023-11-24T08:05:24.795258+0000","last_active":"2023-11-24T08:05:24.800911+0000","last_peered":"2023-11-24T08:05:24.800911+0000","last_clean":"2023-11-24T08:05:24.800911+0000","last_became_active":"2023-11-24T08:05:24.794956+0000","last_became_peered":"2023-11-24T08:05:24.794956+0000","last_unstale":"2023-11-24T08:05:24.800911+0000","last_undegraded":"2023-11-24T08:05:24.800911+0000","last_fullsized":"2023-11-24T08:05:24.800911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:56.270806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799550+0000","last_change":"2023-11-24T08:05:24.794729+0000","last_active":"2023-11-24T08:05:24.799550+0000","last_peered":"2023-11-24T08:05:24.799550+0000","last_clean":"2023-11-24T08:05:24.799550+0000","last_became_active":"2023-11-24T08:05:24.794319+0000","last_became_peered":"2023-11-24T08:05:24.794319+0000","last_unstale":"2023-11-24T08:05:24.799550+0000","last_undegraded":"2023-11-24T08:05:24.799550+0000","last_fullsized":"2023-11-24T08:05:24.799550+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818901+0000","last_change":"2023-11-24T08:05:24.811835+0000","last_active":"2023-11-24T08:05:24.818901+0000","last_peered":"2023-11-24T08:05:24.818901+0000","last_clean":"2023-11-24T08:05:24.818901+0000","last_became_active":"2023-11-24T08:05:24.811546+0000","last_became_peered":"2023-11-24T08:05:24.811546+0000","last_unstale":"2023-11-24T08:05:24.818901+0000","last_undegraded":"2023-11-24T08:05:24.818901+0000","last_fullsized":"2023-11-24T08:05:24.818901+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820552+0000","last_change":"2023-11-24T08:05:24.807853+0000","last_active":"2023-11-24T08:05:24.820552+0000","last_peered":"2023-11-24T08:05:24.820552+0000","last_clean":"2023-11-24T08:05:24.820552+0000","last_became_active":"2023-11-24T08:05:24.804890+0000","last_became_peered":"2023-11-24T08:05:24.804890+0000","last_unstale":"2023-11-24T08:05:24.820552+0000","last_undegraded":"2023-11-24T08:05:24.820552+0000","last_fullsized":"2023-11-24T08:05:24.820552+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:35.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812853+0000","last_change":"2023-11-24T08:05:24.804875+0000","last_active":"2023-11-24T08:05:24.812853+0000","last_peered":"2023-11-24T08:05:24.812853+0000","last_clean":"2023-11-24T08:05:24.812853+0000","last_became_active":"2023-11-24T08:05:24.804578+0000","last_became_peered":"2023-11-24T08:05:24.804578+0000","last_unstale":"2023-11-24T08:05:24.812853+0000","last_undegraded":"2023-11-24T08:05:24.812853+0000","last_fullsized":"2023-11-24T08:05:24.812853+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:42:06.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803024+0000","last_change":"2023-11-24T08:05:24.794384+0000","last_active":"2023-11-24T08:05:24.803024+0000","last_peered":"2023-11-24T08:05:24.803024+0000","last_clean":"2023-11-24T08:05:24.803024+0000","last_became_active":"2023-11-24T08:05:24.794053+0000","last_became_peered":"2023-11-24T08:05:24.794053+0000","last_unstale":"2023-11-24T08:05:24.803024+0000","last_undegraded":"2023-11-24T08:05:24.803024+0000","last_fullsized":"2023-11-24T08:05:24.803024+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762443+0000","last_change":"2023-11-24T08:05:23.762443+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762443+0000","last_undegraded":"2023-11-24T08:05:23.762443+0000","last_fullsized":"2023-11-24T08:05:23.762443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820819+0000","last_change":"2023-11-24T08:05:24.809693+0000","last_active":"2023-11-24T08:05:24.820819+0000","last_peered":"2023-11-24T08:05:24.820819+0000","last_clean":"2023-11-24T08:05:24.820819+0000","last_became_active":"2023-11-24T08:05:24.809223+0000","last_became_peered":"2023-11-24T08:05:24.809223+0000","last_unstale":"2023-11-24T08:05:24.820819+0000","last_undegraded":"2023-11-24T08:05:24.820819+0000","last_fullsized":"2023-11-24T08:05:24.820819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:57.419189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823105+0000","last_change":"2023-11-24T08:05:24.811467+0000","last_active":"2023-11-24T08:05:24.823105+0000","last_peered":"2023-11-24T08:05:24.823105+0000","last_clean":"2023-11-24T08:05:24.823105+0000","last_became_active":"2023-11-24T08:05:24.811225+0000","last_became_peered":"2023-11-24T08:05:24.811225+0000","last_unstale":"2023-11-24T08:05:24.823105+0000","last_undegraded":"2023-11-24T08:05:24.823105+0000","last_fullsized":"2023-11-24T08:05:24.823105+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:57.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820706+0000","last_change":"2023-11-24T08:05:24.808178+0000","last_active":"2023-11-24T08:05:24.820706+0000","last_peered":"2023-11-24T08:05:24.820706+0000","last_clean":"2023-11-24T08:05:24.820706+0000","last_became_active":"2023-11-24T08:05:24.807918+0000","last_became_peered":"2023-11-24T08:05:24.807918+0000","last_unstale":"2023-11-24T08:05:24.820706+0000","last_undegraded":"2023-11-24T08:05:24.820706+0000","last_fullsized":"2023-11-24T08:05:24.820706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:42.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812129+0000","last_change":"2023-11-24T08:05:24.804744+0000","last_active":"2023-11-24T08:05:24.812129+0000","last_peered":"2023-11-24T08:05:24.812129+0000","last_clean":"2023-11-24T08:05:24.812129+0000","last_became_active":"2023-11-24T08:05:24.804339+0000","last_became_peered":"2023-11-24T08:05:24.804339+0000","last_unstale":"2023-11-24T08:05:24.812129+0000","last_undegraded":"2023-11-24T08:05:24.812129+0000","last_fullsized":"2023-11-24T08:05:24.812129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:08.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801293+0000","last_change":"2023-11-24T08:05:24.795287+0000","last_active":"2023-11-24T08:05:24.801293+0000","last_peered":"2023-11-24T08:05:24.801293+0000","last_clean":"2023-11-24T08:05:24.801293+0000","last_became_active":"2023-11-24T08:05:24.795029+0000","last_became_peered":"2023-11-24T08:05:24.795029+0000","last_unstale":"2023-11-24T08:05:24.801293+0000","last_undegraded":"2023-11-24T08:05:24.801293+0000","last_fullsized":"2023-11-24T08:05:24.801293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807716+0000","last_change":"2023-11-24T08:05:24.801769+0000","last_active":"2023-11-24T08:05:24.807716+0000","last_peered":"2023-11-24T08:05:24.807716+0000","last_clean":"2023-11-24T08:05:24.807716+0000","last_became_active":"2023-11-24T08:05:24.801503+0000","last_became_peered":"2023-11-24T08:05:24.801503+0000","last_unstale":"2023-11-24T08:05:24.807716+0000","last_undegraded":"2023-11-24T08:05:24.807716+0000","last_fullsized":"2023-11-24T08:05:24.807716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:23.875555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823087+0000","last_change":"2023-11-24T08:05:24.808950+0000","last_active":"2023-11-24T08:05:24.823087+0000","last_peered":"2023-11-24T08:05:24.823087+0000","last_clean":"2023-11-24T08:05:24.823087+0000","last_became_active":"2023-11-24T08:05:24.808294+0000","last_became_peered":"2023-11-24T08:05:24.808294+0000","last_unstale":"2023-11-24T08:05:24.823087+0000","last_undegraded":"2023-11-24T08:05:24.823087+0000","last_fullsized":"2023-11-24T08:05:24.823087+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:39.471914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806647+0000","last_change":"2023-11-24T08:05:24.801554+0000","last_active":"2023-11-24T08:05:24.806647+0000","last_peered":"2023-11-24T08:05:24.806647+0000","last_clean":"2023-11-24T08:05:24.806647+0000","last_became_active":"2023-11-24T08:05:24.801207+0000","last_became_peered":"2023-11-24T08:05:24.801207+0000","last_unstale":"2023-11-24T08:05:24.806647+0000","last_undegraded":"2023-11-24T08:05:24.806647+0000","last_fullsized":"2023-11-24T08:05:24.806647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802739+0000","last_change":"2023-11-24T08:05:24.792493+0000","last_active":"2023-11-24T08:05:24.802739+0000","last_peered":"2023-11-24T08:05:24.802739+0000","last_clean":"2023-11-24T08:05:24.802739+0000","last_became_active":"2023-11-24T08:05:24.789895+0000","last_became_peered":"2023-11-24T08:05:24.789895+0000","last_unstale":"2023-11-24T08:05:24.802739+0000","last_undegraded":"2023-11-24T08:05:24.802739+0000","last_fullsized":"2023-11-24T08:05:24.802739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:01.420207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811890+0000","last_change":"2023-11-24T08:05:24.804224+0000","last_active":"2023-11-24T08:05:24.811890+0000","last_peered":"2023-11-24T08:05:24.811890+0000","last_clean":"2023-11-24T08:05:24.811890+0000","last_became_active":"2023-11-24T08:05:24.803814+0000","last_became_peered":"2023-11-24T08:05:24.803814+0000","last_unstale":"2023-11-24T08:05:24.811890+0000","last_undegraded":"2023-11-24T08:05:24.811890+0000","last_fullsized":"2023-11-24T08:05:24.811890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:13.625275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.810842+0000","last_change":"2023-11-24T08:05:24.807630+0000","last_active":"2023-11-24T08:05:24.810842+0000","last_peered":"2023-11-24T08:05:24.810842+0000","last_clean":"2023-11-24T08:05:24.810842+0000","last_became_active":"2023-11-24T08:05:24.807158+0000","last_became_peered":"2023-11-24T08:05:24.807158+0000","last_unstale":"2023-11-24T08:05:24.810842+0000","last_undegraded":"2023-11-24T08:05:24.810842+0000","last_fullsized":"2023-11-24T08:05:24.810842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:01.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824282+0000","last_change":"2023-11-24T08:05:23.789734+0000","last_active":"2023-11-24T08:05:24.824282+0000","last_peered":"2023-11-24T08:05:24.824282+0000","last_clean":"2023-11-24T08:05:24.824282+0000","last_became_active":"2023-11-24T08:05:23.789448+0000","last_became_peered":"2023-11-24T08:05:23.789448+0000","last_unstale":"2023-11-24T08:05:24.824282+0000","last_undegraded":"2023-11-24T08:05:24.824282+0000","last_fullsized":"2023-11-24T08:05:24.824282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:15.341563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797818+0000","last_change":"2023-11-24T08:05:24.793485+0000","last_active":"2023-11-24T08:05:24.797818+0000","last_peered":"2023-11-24T08:05:24.797818+0000","last_clean":"2023-11-24T08:05:24.797818+0000","last_became_active":"2023-11-24T08:05:24.793195+0000","last_became_peered":"2023-11-24T08:05:24.793195+0000","last_unstale":"2023-11-24T08:05:24.797818+0000","last_undegraded":"2023-11-24T08:05:24.797818+0000","last_fullsized":"2023-11-24T08:05:24.797818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:58.250762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823411+0000","last_change":"2023-11-24T08:05:23.781005+0000","last_active":"2023-11-24T08:05:24.823411+0000","last_peered":"2023-11-24T08:05:24.823411+0000","last_clean":"2023-11-24T08:05:24.823411+0000","last_became_active":"2023-11-24T08:05:23.780655+0000","last_became_peered":"2023-11-24T08:05:23.780655+0000","last_unstale":"2023-11-24T08:05:24.823411+0000","last_undegraded":"2023-11-24T08:05:24.823411+0000","last_fullsized":"2023-11-24T08:05:24.823411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:05.273157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801982+0000","last_change":"2023-11-24T08:05:24.796295+0000","last_active":"2023-11-24T08:05:24.801982+0000","last_peered":"2023-11-24T08:05:24.801982+0000","last_clean":"2023-11-24T08:05:24.801982+0000","last_became_active":"2023-11-24T08:05:24.796051+0000","last_became_peered":"2023-11-24T08:05:24.796051+0000","last_unstale":"2023-11-24T08:05:24.801982+0000","last_undegraded":"2023-11-24T08:05:24.801982+0000","last_fullsized":"2023-11-24T08:05:24.801982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819751+0000","last_change":"2023-11-24T08:05:23.785930+0000","last_active":"2023-11-24T08:05:24.819751+0000","last_peered":"2023-11-24T08:05:24.819751+0000","last_clean":"2023-11-24T08:05:24.819751+0000","last_became_active":"2023-11-24T08:05:23.785575+0000","last_became_peered":"2023-11-24T08:05:23.785575+0000","last_unstale":"2023-11-24T08:05:24.819751+0000","last_undegraded":"2023-11-24T08:05:24.819751+0000","last_fullsized":"2023-11-24T08:05:24.819751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:45.042279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807153+0000","last_change":"2023-11-24T08:05:24.801199+0000","last_active":"2023-11-24T08:05:24.807153+0000","last_peered":"2023-11-24T08:05:24.807153+0000","last_clean":"2023-11-24T08:05:24.807153+0000","last_became_active":"2023-11-24T08:05:24.799824+0000","last_became_peered":"2023-11-24T08:05:24.799824+0000","last_unstale":"2023-11-24T08:05:24.807153+0000","last_undegraded":"2023-11-24T08:05:24.807153+0000","last_fullsized":"2023-11-24T08:05:24.807153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819780+0000","last_change":"2023-11-24T08:05:23.786066+0000","last_active":"2023-11-24T08:05:24.819780+0000","last_peered":"2023-11-24T08:05:24.819780+0000","last_clean":"2023-11-24T08:05:24.819780+0000","last_became_active":"2023-11-24T08:05:23.785789+0000","last_became_peered":"2023-11-24T08:05:23.785789+0000","last_unstale":"2023-11-24T08:05:24.819780+0000","last_undegraded":"2023-11-24T08:05:24.819780+0000","last_fullsized":"2023-11-24T08:05:24.819780+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799134+0000","last_change":"2023-11-24T08:05:24.793986+0000","last_active":"2023-11-24T08:05:24.799134+0000","last_peered":"2023-11-24T08:05:24.799134+0000","last_clean":"2023-11-24T08:05:24.799134+0000","last_became_active":"2023-11-24T08:05:24.793719+0000","last_became_peered":"2023-11-24T08:05:24.793719+0000","last_unstale":"2023-11-24T08:05:24.799134+0000","last_undegraded":"2023-11-24T08:05:24.799134+0000","last_fullsized":"2023-11-24T08:05:24.799134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:04.586739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822481+0000","last_change":"2023-11-24T08:05:23.786132+0000","last_active":"2023-11-24T08:05:24.822481+0000","last_peered":"2023-11-24T08:05:24.822481+0000","last_clean":"2023-11-24T08:05:24.822481+0000","last_became_active":"2023-11-24T08:05:23.785846+0000","last_became_peered":"2023-11-24T08:05:23.785846+0000","last_unstale":"2023-11-24T08:05:24.822481+0000","last_undegraded":"2023-11-24T08:05:24.822481+0000","last_fullsized":"2023-11-24T08:05:24.822481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765224+0000","last_change":"2023-11-24T08:05:23.765224+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765224+0000","last_undegraded":"2023-11-24T08:05:23.765224+0000","last_fullsized":"2023-11-24T08:05:23.765224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822483+0000","last_change":"2023-11-24T08:05:23.782383+0000","last_active":"2023-11-24T08:05:24.822483+0000","last_peered":"2023-11-24T08:05:24.822483+0000","last_clean":"2023-11-24T08:05:24.822483+0000","last_became_active":"2023-11-24T08:05:23.782077+0000","last_became_peered":"2023-11-24T08:05:23.782077+0000","last_unstale":"2023-11-24T08:05:24.822483+0000","last_undegraded":"2023-11-24T08:05:24.822483+0000","last_fullsized":"2023-11-24T08:05:24.822483+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:00.714376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765712+0000","last_change":"2023-11-24T08:05:23.765712+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765712+0000","last_undegraded":"2023-11-24T08:05:23.765712+0000","last_fullsized":"2023-11-24T08:05:23.765712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783972+0000","last_change":"2023-11-24T08:05:23.786361+0000","last_active":"2023-11-24T08:05:24.783972+0000","last_peered":"2023-11-24T08:05:24.783972+0000","last_clean":"2023-11-24T08:05:24.783972+0000","last_became_active":"2023-11-24T08:05:23.786102+0000","last_became_peered":"2023-11-24T08:05:23.786102+0000","last_unstale":"2023-11-24T08:05:24.783972+0000","last_undegraded":"2023-11-24T08:05:24.783972+0000","last_fullsized":"2023-11-24T08:05:24.783972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:48.278067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820800+0000","last_change":"2023-11-24T08:05:24.809467+0000","last_active":"2023-11-24T08:05:24.820800+0000","last_peered":"2023-11-24T08:05:24.820800+0000","last_clean":"2023-11-24T08:05:24.820800+0000","last_became_active":"2023-11-24T08:05:24.808871+0000","last_became_peered":"2023-11-24T08:05:24.808871+0000","last_unstale":"2023-11-24T08:05:24.820800+0000","last_undegraded":"2023-11-24T08:05:24.820800+0000","last_fullsized":"2023-11-24T08:05:24.820800+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:55.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.784982+0000","last_change":"2023-11-24T08:05:23.779563+0000","last_active":"2023-11-24T08:05:23.784982+0000","last_peered":"2023-11-24T08:05:23.784982+0000","last_clean":"2023-11-24T08:05:23.784982+0000","last_became_active":"2023-11-24T08:05:23.779281+0000","last_became_peered":"2023-11-24T08:05:23.779281+0000","last_unstale":"2023-11-24T08:05:23.784982+0000","last_undegraded":"2023-11-24T08:05:23.784982+0000","last_fullsized":"2023-11-24T08:05:23.784982+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:44.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811731+0000","last_change":"2023-11-24T08:05:24.807194+0000","last_active":"2023-11-24T08:05:24.811731+0000","last_peered":"2023-11-24T08:05:24.811731+0000","last_clean":"2023-11-24T08:05:24.811731+0000","last_became_active":"2023-11-24T08:05:24.806869+0000","last_became_peered":"2023-11-24T08:05:24.806869+0000","last_unstale":"2023-11-24T08:05:24.811731+0000","last_undegraded":"2023-11-24T08:05:24.811731+0000","last_fullsized":"2023-11-24T08:05:24.811731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.789214+0000","last_change":"2023-11-24T08:05:23.778824+0000","last_active":"2023-11-24T08:05:24.789214+0000","last_peered":"2023-11-24T08:05:24.789214+0000","last_clean":"2023-11-24T08:05:24.789214+0000","last_became_active":"2023-11-24T08:05:23.778462+0000","last_became_peered":"2023-11-24T08:05:23.778462+0000","last_unstale":"2023-11-24T08:05:24.789214+0000","last_undegraded":"2023-11-24T08:05:24.789214+0000","last_fullsized":"2023-11-24T08:05:24.789214+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809998+0000","last_change":"2023-11-24T08:05:24.806424+0000","last_active":"2023-11-24T08:05:24.809998+0000","last_peered":"2023-11-24T08:05:24.809998+0000","last_clean":"2023-11-24T08:05:24.809998+0000","last_became_active":"2023-11-24T08:05:24.806143+0000","last_became_peered":"2023-11-24T08:05:24.806143+0000","last_unstale":"2023-11-24T08:05:24.809998+0000","last_undegraded":"2023-11-24T08:05:24.809998+0000","last_fullsized":"2023-11-24T08:05:24.809998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.781431+0000","last_change":"2023-11-24T08:05:23.777987+0000","last_active":"2023-11-24T08:05:23.781431+0000","last_peered":"2023-11-24T08:05:23.781431+0000","last_clean":"2023-11-24T08:05:23.781431+0000","last_became_active":"2023-11-24T08:05:23.777197+0000","last_became_peered":"2023-11-24T08:05:23.777197+0000","last_unstale":"2023-11-24T08:05:23.781431+0000","last_undegraded":"2023-11-24T08:05:23.781431+0000","last_fullsized":"2023-11-24T08:05:23.781431+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:49.045196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809312+0000","last_change":"2023-11-24T08:05:24.803406+0000","last_active":"2023-11-24T08:05:24.809312+0000","last_peered":"2023-11-24T08:05:24.809312+0000","last_clean":"2023-11-24T08:05:24.809312+0000","last_became_active":"2023-11-24T08:05:24.803027+0000","last_became_peered":"2023-11-24T08:05:24.803027+0000","last_unstale":"2023-11-24T08:05:24.809312+0000","last_undegraded":"2023-11-24T08:05:24.809312+0000","last_fullsized":"2023-11-24T08:05:24.809312+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:21:44.439548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824118+0000","last_change":"2023-11-24T08:05:23.793340+0000","last_active":"2023-11-24T08:05:24.824118+0000","last_peered":"2023-11-24T08:05:24.824118+0000","last_clean":"2023-11-24T08:05:24.824118+0000","last_became_active":"2023-11-24T08:05:23.792687+0000","last_became_peered":"2023-11-24T08:05:23.792687+0000","last_unstale":"2023-11-24T08:05:24.824118+0000","last_undegraded":"2023-11-24T08:05:24.824118+0000","last_fullsized":"2023-11-24T08:05:24.824118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:48.296413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819192+0000","last_change":"2023-11-24T08:05:24.816525+0000","last_active":"2023-11-24T08:05:24.819192+0000","last_peered":"2023-11-24T08:05:24.819192+0000","last_clean":"2023-11-24T08:05:24.819192+0000","last_became_active":"2023-11-24T08:05:24.816253+0000","last_became_peered":"2023-11-24T08:05:24.816253+0000","last_unstale":"2023-11-24T08:05:24.819192+0000","last_undegraded":"2023-11-24T08:05:24.819192+0000","last_fullsized":"2023-11-24T08:05:24.819192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824951+0000","last_change":"2023-11-24T08:05:23.780472+0000","last_active":"2023-11-24T08:05:24.824951+0000","last_peered":"2023-11-24T08:05:24.824951+0000","last_clean":"2023-11-24T08:05:24.824951+0000","last_became_active":"2023-11-24T08:05:23.780179+0000","last_became_peered":"2023-11-24T08:05:23.780179+0000","last_unstale":"2023-11-24T08:05:24.824951+0000","last_undegraded":"2023-11-24T08:05:24.824951+0000","last_fullsized":"2023-11-24T08:05:24.824951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:34.866637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820534+0000","last_change":"2023-11-24T08:05:24.807288+0000","last_active":"2023-11-24T08:05:24.820534+0000","last_peered":"2023-11-24T08:05:24.820534+0000","last_clean":"2023-11-24T08:05:24.820534+0000","last_became_active":"2023-11-24T08:05:24.807002+0000","last_became_peered":"2023-11-24T08:05:24.807002+0000","last_unstale":"2023-11-24T08:05:24.820534+0000","last_undegraded":"2023-11-24T08:05:24.820534+0000","last_fullsized":"2023-11-24T08:05:24.820534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:21.670193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823116+0000","last_change":"2023-11-24T08:05:23.785359+0000","last_active":"2023-11-24T08:05:24.823116+0000","last_peered":"2023-11-24T08:05:24.823116+0000","last_clean":"2023-11-24T08:05:24.823116+0000","last_became_active":"2023-11-24T08:05:23.784845+0000","last_became_peered":"2023-11-24T08:05:23.784845+0000","last_unstale":"2023-11-24T08:05:24.823116+0000","last_undegraded":"2023-11-24T08:05:24.823116+0000","last_fullsized":"2023-11-24T08:05:24.823116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:45.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762666+0000","last_change":"2023-11-24T08:05:23.762666+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762666+0000","last_undegraded":"2023-11-24T08:05:23.762666+0000","last_fullsized":"2023-11-24T08:05:23.762666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795412+0000","last_change":"2023-11-24T08:05:23.785562+0000","last_active":"2023-11-24T08:05:24.795412+0000","last_peered":"2023-11-24T08:05:24.795412+0000","last_clean":"2023-11-24T08:05:24.795412+0000","last_became_active":"2023-11-24T08:05:23.785261+0000","last_became_peered":"2023-11-24T08:05:23.785261+0000","last_unstale":"2023-11-24T08:05:24.795412+0000","last_undegraded":"2023-11-24T08:05:24.795412+0000","last_fullsized":"2023-11-24T08:05:24.795412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802791+0000","last_change":"2023-11-24T08:05:24.797229+0000","last_active":"2023-11-24T08:05:24.802791+0000","last_peered":"2023-11-24T08:05:24.802791+0000","last_clean":"2023-11-24T08:05:24.802791+0000","last_became_active":"2023-11-24T08:05:24.796863+0000","last_became_peered":"2023-11-24T08:05:24.796863+0000","last_unstale":"2023-11-24T08:05:24.802791+0000","last_undegraded":"2023-11-24T08:05:24.802791+0000","last_fullsized":"2023-11-24T08:05:24.802791+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782427+0000","last_change":"2023-11-24T08:05:23.783807+0000","last_active":"2023-11-24T08:05:24.782427+0000","last_peered":"2023-11-24T08:05:24.782427+0000","last_clean":"2023-11-24T08:05:24.782427+0000","last_became_active":"2023-11-24T08:05:23.783504+0000","last_became_peered":"2023-11-24T08:05:23.783504+0000","last_unstale":"2023-11-24T08:05:24.782427+0000","last_undegraded":"2023-11-24T08:05:24.782427+0000","last_fullsized":"2023-11-24T08:05:24.782427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:07.077115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.816629+0000","last_change":"2023-11-24T08:05:24.813482+0000","last_active":"2023-11-24T08:05:24.816629+0000","last_peered":"2023-11-24T08:05:24.816629+0000","last_clean":"2023-11-24T08:05:24.816629+0000","last_became_active":"2023-11-24T08:05:24.813159+0000","last_became_peered":"2023-11-24T08:05:24.813159+0000","last_unstale":"2023-11-24T08:05:24.816629+0000","last_undegraded":"2023-11-24T08:05:24.816629+0000","last_fullsized":"2023-11-24T08:05:24.816629+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.789417+0000","last_change":"2023-11-24T08:05:23.782857+0000","last_active":"2023-11-24T08:05:23.789417+0000","last_peered":"2023-11-24T08:05:23.789417+0000","last_clean":"2023-11-24T08:05:23.789417+0000","last_became_active":"2023-11-24T08:05:23.782637+0000","last_became_peered":"2023-11-24T08:05:23.782637+0000","last_unstale":"2023-11-24T08:05:23.789417+0000","last_undegraded":"2023-11-24T08:05:23.789417+0000","last_fullsized":"2023-11-24T08:05:23.789417+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:17:44.634959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800348+0000","last_change":"2023-11-24T08:05:24.793310+0000","last_active":"2023-11-24T08:05:24.800348+0000","last_peered":"2023-11-24T08:05:24.800348+0000","last_clean":"2023-11-24T08:05:24.800348+0000","last_became_active":"2023-11-24T08:05:24.792934+0000","last_became_peered":"2023-11-24T08:05:24.792934+0000","last_unstale":"2023-11-24T08:05:24.800348+0000","last_undegraded":"2023-11-24T08:05:24.800348+0000","last_fullsized":"2023-11-24T08:05:24.800348+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:46.235186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822139+0000","last_change":"2023-11-24T08:05:23.791769+0000","last_active":"2023-11-24T08:05:24.822139+0000","last_peered":"2023-11-24T08:05:24.822139+0000","last_clean":"2023-11-24T08:05:24.822139+0000","last_became_active":"2023-11-24T08:05:23.790624+0000","last_became_peered":"2023-11-24T08:05:23.790624+0000","last_unstale":"2023-11-24T08:05:24.822139+0000","last_undegraded":"2023-11-24T08:05:24.822139+0000","last_fullsized":"2023-11-24T08:05:24.822139+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:02.701487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764281+0000","last_change":"2023-11-24T08:05:23.764281+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764281+0000","last_undegraded":"2023-11-24T08:05:23.764281+0000","last_fullsized":"2023-11-24T08:05:23.764281+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.821859+0000","last_change":"2023-11-24T08:05:23.785405+0000","last_active":"2023-11-24T08:05:24.821859+0000","last_peered":"2023-11-24T08:05:24.821859+0000","last_clean":"2023-11-24T08:05:24.821859+0000","last_became_active":"2023-11-24T08:05:23.785104+0000","last_became_peered":"2023-11-24T08:05:23.785104+0000","last_unstale":"2023-11-24T08:05:24.821859+0000","last_undegraded":"2023-11-24T08:05:24.821859+0000","last_fullsized":"2023-11-24T08:05:24.821859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820164+0000","last_change":"2023-11-24T08:05:24.803826+0000","last_active":"2023-11-24T08:05:24.820164+0000","last_peered":"2023-11-24T08:05:24.820164+0000","last_clean":"2023-11-24T08:05:24.820164+0000","last_became_active":"2023-11-24T08:05:24.803535+0000","last_became_peered":"2023-11-24T08:05:24.803535+0000","last_unstale":"2023-11-24T08:05:24.820164+0000","last_undegraded":"2023-11-24T08:05:24.820164+0000","last_fullsized":"2023-11-24T08:05:24.820164+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:47.403645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820963+0000","last_change":"2023-11-24T08:05:23.790238+0000","last_active":"2023-11-24T08:05:24.820963+0000","last_peered":"2023-11-24T08:05:24.820963+0000","last_clean":"2023-11-24T08:05:24.820963+0000","last_became_active":"2023-11-24T08:05:23.789980+0000","last_became_peered":"2023-11-24T08:05:23.789980+0000","last_unstale":"2023-11-24T08:05:24.820963+0000","last_undegraded":"2023-11-24T08:05:24.820963+0000","last_fullsized":"2023-11-24T08:05:24.820963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:35.217727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812014+0000","last_change":"2023-11-24T08:05:24.800737+0000","last_active":"2023-11-24T08:05:24.812014+0000","last_peered":"2023-11-24T08:05:24.812014+0000","last_clean":"2023-11-24T08:05:24.812014+0000","last_became_active":"2023-11-24T08:05:24.800410+0000","last_became_peered":"2023-11-24T08:05:24.800410+0000","last_unstale":"2023-11-24T08:05:24.812014+0000","last_undegraded":"2023-11-24T08:05:24.812014+0000","last_fullsized":"2023-11-24T08:05:24.812014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:08:20.963516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782262+0000","last_change":"2023-11-24T08:05:23.787803+0000","last_active":"2023-11-24T08:05:24.782262+0000","last_peered":"2023-11-24T08:05:24.782262+0000","last_clean":"2023-11-24T08:05:24.782262+0000","last_became_active":"2023-11-24T08:05:23.787536+0000","last_became_peered":"2023-11-24T08:05:23.787536+0000","last_unstale":"2023-11-24T08:05:24.782262+0000","last_undegraded":"2023-11-24T08:05:24.782262+0000","last_fullsized":"2023-11-24T08:05:24.782262+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:47.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803376+0000","last_change":"2023-11-24T08:05:24.797504+0000","last_active":"2023-11-24T08:05:24.803376+0000","last_peered":"2023-11-24T08:05:24.803376+0000","last_clean":"2023-11-24T08:05:24.803376+0000","last_became_active":"2023-11-24T08:05:24.797158+0000","last_became_peered":"2023-11-24T08:05:24.797158+0000","last_unstale":"2023-11-24T08:05:24.803376+0000","last_undegraded":"2023-11-24T08:05:24.803376+0000","last_fullsized":"2023-11-24T08:05:24.803376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:04.593709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822567+0000","last_change":"2023-11-24T08:05:23.786254+0000","last_active":"2023-11-24T08:05:24.822567+0000","last_peered":"2023-11-24T08:05:24.822567+0000","last_clean":"2023-11-24T08:05:24.822567+0000","last_became_active":"2023-11-24T08:05:23.786045+0000","last_became_peered":"2023-11-24T08:05:23.786045+0000","last_unstale":"2023-11-24T08:05:24.822567+0000","last_undegraded":"2023-11-24T08:05:24.822567+0000","last_fullsized":"2023-11-24T08:05:24.822567+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:18.255758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807370+0000","last_change":"2023-11-24T08:05:24.797939+0000","last_active":"2023-11-24T08:05:24.807370+0000","last_peered":"2023-11-24T08:05:24.807370+0000","last_clean":"2023-11-24T08:05:24.807370+0000","last_became_active":"2023-11-24T08:05:24.797670+0000","last_became_peered":"2023-11-24T08:05:24.797670+0000","last_unstale":"2023-11-24T08:05:24.807370+0000","last_undegraded":"2023-11-24T08:05:24.807370+0000","last_fullsized":"2023-11-24T08:05:24.807370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783878+0000","last_change":"2023-11-24T08:05:23.787871+0000","last_active":"2023-11-24T08:05:24.783878+0000","last_peered":"2023-11-24T08:05:24.783878+0000","last_clean":"2023-11-24T08:05:24.783878+0000","last_became_active":"2023-11-24T08:05:23.787606+0000","last_became_peered":"2023-11-24T08:05:23.787606+0000","last_unstale":"2023-11-24T08:05:24.783878+0000","last_undegraded":"2023-11-24T08:05:24.783878+0000","last_fullsized":"2023-11-24T08:05:24.783878+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811879+0000","last_change":"2023-11-24T08:05:24.801445+0000","last_active":"2023-11-24T08:05:24.811879+0000","last_peered":"2023-11-24T08:05:24.811879+0000","last_clean":"2023-11-24T08:05:24.811879+0000","last_became_active":"2023-11-24T08:05:24.801146+0000","last_became_peered":"2023-11-24T08:05:24.801146+0000","last_unstale":"2023-11-24T08:05:24.811879+0000","last_undegraded":"2023-11-24T08:05:24.811879+0000","last_fullsized":"2023-11-24T08:05:24.811879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:14.569562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.782532+0000","last_change":"2023-11-24T08:05:23.775594+0000","last_active":"2023-11-24T08:05:23.782532+0000","last_peered":"2023-11-24T08:05:23.782532+0000","last_clean":"2023-11-24T08:05:23.782532+0000","last_became_active":"2023-11-24T08:05:23.775204+0000","last_became_peered":"2023-11-24T08:05:23.775204+0000","last_unstale":"2023-11-24T08:05:23.782532+0000","last_undegraded":"2023-11-24T08:05:23.782532+0000","last_fullsized":"2023-11-24T08:05:23.782532+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:44.667325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762471+0000","last_change":"2023-11-24T08:05:23.762471+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762471+0000","last_undegraded":"2023-11-24T08:05:23.762471+0000","last_fullsized":"2023-11-24T08:05:23.762471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795167+0000","last_change":"2023-11-24T08:05:23.788392+0000","last_active":"2023-11-24T08:05:24.795167+0000","last_peered":"2023-11-24T08:05:24.795167+0000","last_clean":"2023-11-24T08:05:24.795167+0000","last_became_active":"2023-11-24T08:05:23.788108+0000","last_became_peered":"2023-11-24T08:05:23.788108+0000","last_unstale":"2023-11-24T08:05:24.795167+0000","last_undegraded":"2023-11-24T08:05:24.795167+0000","last_fullsized":"2023-11-24T08:05:24.795167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:32.971004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820405+0000","last_change":"2023-11-24T08:05:24.807026+0000","last_active":"2023-11-24T08:05:24.820405+0000","last_peered":"2023-11-24T08:05:24.820405+0000","last_clean":"2023-11-24T08:05:24.820405+0000","last_became_active":"2023-11-24T08:05:24.806282+0000","last_became_peered":"2023-11-24T08:05:24.806282+0000","last_unstale":"2023-11-24T08:05:24.820405+0000","last_undegraded":"2023-11-24T08:05:24.820405+0000","last_fullsized":"2023-11-24T08:05:24.820405+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:13:48.606704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.780151+0000","last_change":"2023-11-24T08:05:23.784376+0000","last_active":"2023-11-24T08:05:24.780151+0000","last_peered":"2023-11-24T08:05:24.780151+0000","last_clean":"2023-11-24T08:05:24.780151+0000","last_became_active":"2023-11-24T08:05:23.784088+0000","last_became_peered":"2023-11-24T08:05:23.784088+0000","last_unstale":"2023-11-24T08:05:24.780151+0000","last_undegraded":"2023-11-24T08:05:24.780151+0000","last_fullsized":"2023-11-24T08:05:24.780151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766717+0000","last_change":"2023-11-24T08:05:23.766717+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766717+0000","last_undegraded":"2023-11-24T08:05:23.766717+0000","last_fullsized":"2023-11-24T08:05:23.766717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797184+0000","last_change":"2023-11-24T08:05:23.793529+0000","last_active":"2023-11-24T08:05:24.797184+0000","last_peered":"2023-11-24T08:05:24.797184+0000","last_clean":"2023-11-24T08:05:24.797184+0000","last_became_active":"2023-11-24T08:05:23.793045+0000","last_became_peered":"2023-11-24T08:05:23.793045+0000","last_unstale":"2023-11-24T08:05:24.797184+0000","last_undegraded":"2023-11-24T08:05:24.797184+0000","last_fullsized":"2023-11-24T08:05:24.797184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813740+0000","last_change":"2023-11-24T08:05:24.810946+0000","last_active":"2023-11-24T08:05:24.813740+0000","last_peered":"2023-11-24T08:05:24.813740+0000","last_clean":"2023-11-24T08:05:24.813740+0000","last_became_active":"2023-11-24T08:05:24.810545+0000","last_became_peered":"2023-11-24T08:05:24.810545+0000","last_unstale":"2023-11-24T08:05:24.813740+0000","last_undegraded":"2023-11-24T08:05:24.813740+0000","last_fullsized":"2023-11-24T08:05:24.813740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:16.355430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.790977+0000","last_change":"2023-11-24T08:05:23.786068+0000","last_active":"2023-11-24T08:05:24.790977+0000","last_peered":"2023-11-24T08:05:24.790977+0000","last_clean":"2023-11-24T08:05:24.790977+0000","last_became_active":"2023-11-24T08:05:23.785722+0000","last_became_peered":"2023-11-24T08:05:23.785722+0000","last_unstale":"2023-11-24T08:05:24.790977+0000","last_undegraded":"2023-11-24T08:05:24.790977+0000","last_fullsized":"2023-11-24T08:05:24.790977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:06.084171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.805738+0000","last_change":"2023-11-24T08:05:24.802279+0000","last_active":"2023-11-24T08:05:24.805738+0000","last_peered":"2023-11-24T08:05:24.805738+0000","last_clean":"2023-11-24T08:05:24.805738+0000","last_became_active":"2023-11-24T08:05:24.801966+0000","last_became_peered":"2023-11-24T08:05:24.801966+0000","last_unstale":"2023-11-24T08:05:24.805738+0000","last_undegraded":"2023-11-24T08:05:24.805738+0000","last_fullsized":"2023-11-24T08:05:24.805738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:29.448203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.796812+0000","last_change":"2023-11-24T08:05:23.792778+0000","last_active":"2023-11-24T08:05:24.796812+0000","last_peered":"2023-11-24T08:05:24.796812+0000","last_clean":"2023-11-24T08:05:24.796812+0000","last_became_active":"2023-11-24T08:05:23.792486+0000","last_became_peered":"2023-11-24T08:05:23.792486+0000","last_unstale":"2023-11-24T08:05:24.796812+0000","last_undegraded":"2023-11-24T08:05:24.796812+0000","last_fullsized":"2023-11-24T08:05:24.796812+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:00.406340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803044+0000","last_change":"2023-11-24T08:05:24.797345+0000","last_active":"2023-11-24T08:05:24.803044+0000","last_peered":"2023-11-24T08:05:24.803044+0000","last_clean":"2023-11-24T08:05:24.803044+0000","last_became_active":"2023-11-24T08:05:24.797025+0000","last_became_peered":"2023-11-24T08:05:24.797025+0000","last_unstale":"2023-11-24T08:05:24.803044+0000","last_undegraded":"2023-11-24T08:05:24.803044+0000","last_fullsized":"2023-11-24T08:05:24.803044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:49.310280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788382+0000","last_change":"2023-11-24T08:05:23.782246+0000","last_active":"2023-11-24T08:05:24.788382+0000","last_peered":"2023-11-24T08:05:24.788382+0000","last_clean":"2023-11-24T08:05:24.788382+0000","last_became_active":"2023-11-24T08:05:23.781813+0000","last_became_peered":"2023-11-24T08:05:23.781813+0000","last_unstale":"2023-11-24T08:05:24.788382+0000","last_undegraded":"2023-11-24T08:05:24.788382+0000","last_fullsized":"2023-11-24T08:05:24.788382+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809841+0000","last_change":"2023-11-24T08:05:24.799932+0000","last_active":"2023-11-24T08:05:24.809841+0000","last_peered":"2023-11-24T08:05:24.809841+0000","last_clean":"2023-11-24T08:05:24.809841+0000","last_became_active":"2023-11-24T08:05:24.799665+0000","last_became_peered":"2023-11-24T08:05:24.799665+0000","last_unstale":"2023-11-24T08:05:24.809841+0000","last_undegraded":"2023-11-24T08:05:24.809841+0000","last_fullsized":"2023-11-24T08:05:24.809841+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788765+0000","last_change":"2023-11-24T08:05:23.788270+0000","last_active":"2023-11-24T08:05:24.788765+0000","last_peered":"2023-11-24T08:05:24.788765+0000","last_clean":"2023-11-24T08:05:24.788765+0000","last_became_active":"2023-11-24T08:05:23.788012+0000","last_became_peered":"2023-11-24T08:05:23.788012+0000","last_unstale":"2023-11-24T08:05:24.788765+0000","last_undegraded":"2023-11-24T08:05:24.788765+0000","last_fullsized":"2023-11-24T08:05:24.788765+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813337+0000","last_change":"2023-11-24T08:05:24.808501+0000","last_active":"2023-11-24T08:05:24.813337+0000","last_peered":"2023-11-24T08:05:24.813337+0000","last_clean":"2023-11-24T08:05:24.813337+0000","last_became_active":"2023-11-24T08:05:24.808234+0000","last_became_peered":"2023-11-24T08:05:24.808234+0000","last_unstale":"2023-11-24T08:05:24.813337+0000","last_undegraded":"2023-11-24T08:05:24.813337+0000","last_fullsized":"2023-11-24T08:05:24.813337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.790894+0000","last_change":"2023-11-24T08:05:23.785853+0000","last_active":"2023-11-24T08:05:23.790894+0000","last_peered":"2023-11-24T08:05:23.790894+0000","last_clean":"2023-11-24T08:05:23.790894+0000","last_became_active":"2023-11-24T08:05:23.785174+0000","last_became_peered":"2023-11-24T08:05:23.785174+0000","last_unstale":"2023-11-24T08:05:23.790894+0000","last_undegraded":"2023-11-24T08:05:23.790894+0000","last_fullsized":"2023-11-24T08:05:23.790894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:14.239227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.763523+0000","last_change":"2023-11-24T08:05:23.763523+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.763523+0000","last_undegraded":"2023-11-24T08:05:23.763523+0000","last_fullsized":"2023-11-24T08:05:23.763523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820451+0000","last_change":"2023-11-24T08:05:23.790128+0000","last_active":"2023-11-24T08:05:24.820451+0000","last_peered":"2023-11-24T08:05:24.820451+0000","last_clean":"2023-11-24T08:05:24.820451+0000","last_became_active":"2023-11-24T08:05:23.789847+0000","last_became_peered":"2023-11-24T08:05:23.789847+0000","last_unstale":"2023-11-24T08:05:24.820451+0000","last_undegraded":"2023-11-24T08:05:24.820451+0000","last_fullsized":"2023-11-24T08:05:24.820451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.773879+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:05:23.773879+0000","last_peered":"2023-11-24T08:05:23.773879+0000","last_clean":"2023-11-24T08:05:23.773879+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:05:23.773879+0000","last_undegraded":"2023-11-24T08:05:23.773879+0000","last_fullsized":"2023-11-24T08:05:23.773879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":809270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.4539999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4260000000000002,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.93999999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71999999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":219484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.754}]},{"osd":2,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.878}]},{"osd":3,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1.006},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0620000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":1.04},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95799999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":219450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.91700000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98099999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":220446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.9139999999999997,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.907,"5min":5.907,"15min":5.907},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.054}]},{"osd":5,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.101},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.143}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.3160000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.6059999999999999,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.434},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9320000000000004,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.94599999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":802405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.880000000000001,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.9800000000000004,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.622}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":12.688000000000001,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.752}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1100000000000003,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":6.6390000000000002,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:29.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:29.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d987c1640 1 Processor -- start 2023-11-24T08:05:29.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d987c1640 1 -- start start 2023-11-24T08:05:29.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d987c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d9015a320 0x7f9d900b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d987c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9d90070da0 0x7f9d9015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d987c1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9015a700 con 0x7f9d900b36c0 2023-11-24T08:05:29.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d987c1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900b2430 con 0x7f9d90070da0 2023-11-24T08:05:29.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d987c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d900b2620 con 0x7f9d9015a320 2023-11-24T08:05:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d95d5c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9d900b36c0 0x7f9d90070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37988/0 (socket says 172.21.15.57:37988) 2023-11-24T08:05:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d95d5c640 1 -- 172.21.15.57:0/3947086006 learned_addr learned my addr 172.21.15.57:0/3947086006 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d96d5e640 1 --2- 172.21.15.57:0/3947086006 >> v2:172.21.15.57:3300/0 conn(0x7f9d90070da0 0x7f9d9015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.489+0000 7f9d9655d640 1 --2- 172.21.15.57:0/3947086006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d9015a320 0x7f9d900b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9555b640 1 -- 172.21.15.57:0/3947086006 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920844975 0 0) 0x7f9d9015a700 con 0x7f9d900b36c0 2023-11-24T08:05:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9555b640 1 -- 172.21.15.57:0/3947086006 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d7c003530 con 0x7f9d900b36c0 2023-11-24T08:05:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9655d640 1 -- 172.21.15.57:0/3947086006 >> v2:172.21.15.57:3300/0 conn(0x7f9d90070da0 msgr2=0x7f9d9015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9655d640 1 --2- 172.21.15.57:0/3947086006 >> v2:172.21.15.57:3300/0 conn(0x7f9d90070da0 0x7f9d9015ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9655d640 1 -- 172.21.15.57:0/3947086006 >> v1:172.21.15.57:6789/0 conn(0x7f9d900b36c0 legacy=0x7f9d90070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9655d640 1 -- 172.21.15.57:0/3947086006 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900b2900 con 0x7f9d9015a320 2023-11-24T08:05:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d96d5e640 1 --2- 172.21.15.57:0/3947086006 >> v2:172.21.15.57:3300/0 conn(0x7f9d90070da0 0x7f9d9015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:29.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9655d640 1 --2- 172.21.15.57:0/3947086006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d9015a320 0x7f9d900b1ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0097c0 tx=0x7f9d8c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc6b07de7c13745 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9555b640 1 -- 172.21.15.57:0/3947086006 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0ad660 con 0x7f9d9015a320 2023-11-24T08:05:29.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9555b640 1 -- 172.21.15.57:0/3947086006 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0ad7c0 con 0x7f9d9015a320 2023-11-24T08:05:29.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.493+0000 7f9d9555b640 1 -- 172.21.15.57:0/3947086006 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0adb50 con 0x7f9d9015a320 2023-11-24T08:05:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- 172.21.15.57:0/3947086006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d9015a320 msgr2=0x7f9d900b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 --2- 172.21.15.57:0/3947086006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d9015a320 0x7f9d900b1ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0097c0 tx=0x7f9d8c01c450 comp rx=0 tx=0).stop 2023-11-24T08:05:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- 172.21.15.57:0/3947086006 shutdown_connections 2023-11-24T08:05:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 --2- 172.21.15.57:0/3947086006 >> v2:172.21.15.57:3300/0 conn(0x7f9d90070da0 0x7f9d9015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 --2- 172.21.15.57:0/3947086006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d9015a320 0x7f9d900b1ef0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- 172.21.15.57:0/3947086006 >> 172.21.15.57:0/3947086006 conn(0x7f9d900b0bf0 msgr2=0x7f9d900b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- 172.21.15.57:0/3947086006 shutdown_connections 2023-11-24T08:05:29.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- 172.21.15.57:0/3947086006 wait complete. 2023-11-24T08:05:29.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 Processor -- start 2023-11-24T08:05:29.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- start start 2023-11-24T08:05:29.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d90070da0 0x7f9d9014bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d900b36c0 0x7f9d9015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9015a320 0x7f9d9015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9014fdf0 con 0x7f9d90070da0 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90153fd0 con 0x7f9d9015a320 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d987c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d901583c0 con 0x7f9d900b36c0 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d90070da0 0x7f9d9014bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d90070da0 0x7f9d9014bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35638/0 (socket says 172.21.15.57:35638) 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 -- 172.21.15.57:0/2112003602 learned_addr learned my addr 172.21.15.57:0/2112003602 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d96d5e640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9015a320 0x7f9d9015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d95d5c640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d900b36c0 0x7f9d9015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 -- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d900b36c0 msgr2=0x7f9d9015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d900b36c0 0x7f9d9015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 -- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9015a320 msgr2=0x7f9d9015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9015a320 0x7f9d9015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.497+0000 7f9d9655d640 1 -- 172.21.15.57:0/2112003602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009a70 con 0x7f9d90070da0 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d9655d640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d90070da0 0x7f9d9014bad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c01ab00 tx=0x7f9d8c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d86ffd640 1 -- 172.21.15.57:0/2112003602 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0b7670 con 0x7f9d90070da0 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d86ffd640 1 -- 172.21.15.57:0/2112003602 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0b77f0 con 0x7f9d90070da0 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d86ffd640 1 -- 172.21.15.57:0/2112003602 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0b7ba0 con 0x7f9d90070da0 2023-11-24T08:05:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c009420 con 0x7f9d90070da0 2023-11-24T08:05:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d90153980 con 0x7f9d90070da0 2023-11-24T08:05:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d90067520 con 0x7f9d90070da0 2023-11-24T08:05:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d86ffd640 1 -- 172.21.15.57:0/2112003602 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f9d8c0b4040 con 0x7f9d90070da0 2023-11-24T08:05:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d86ffd640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d74066620 0x7f9d74068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d86ffd640 1 -- 172.21.15.57:0/2112003602 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d8c11e820 con 0x7f9d90070da0 2023-11-24T08:05:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.501+0000 7f9d95d5c640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d74066620 0x7f9d74068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.505+0000 7f9d95d5c640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d74066620 0x7f9d74068ae0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9d901f9ca0 tx=0x7f9d80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.505+0000 7f9d86ffd640 1 -- 172.21.15.57:0/2112003602 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d8c0eb910 con 0x7f9d90070da0 2023-11-24T08:05:29.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.661+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d90154110 con 0x7f9d74066620 2023-11-24T08:05:29.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.669+0000 7f9d86ffd640 1 -- 172.21.15.57:0/2112003602 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287825 (secure 0 0 0) 0x7f9d80001cf0 con 0x7f9d74066620 2023-11-24T08:05:29.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:29.681 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:05:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d74066620 msgr2=0x7f9d74068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d74066620 0x7f9d74068ae0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9d901f9ca0 tx=0x7f9d80009040 comp rx=0 tx=0).stop 2023-11-24T08:05:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d90070da0 msgr2=0x7f9d9014bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d90070da0 0x7f9d9014bad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c01ab00 tx=0x7f9d8c0191f0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 shutdown_connections 2023-11-24T08:05:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d74066620 0x7f9d74068ae0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9015a320 0x7f9d9015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d900b36c0 0x7f9d9015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 --2- 172.21.15.57:0/2112003602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d90070da0 0x7f9d9014bad0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 >> 172.21.15.57:0/2112003602 conn(0x7f9d900b0bf0 msgr2=0x7f9d9006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 shutdown_connections 2023-11-24T08:05:29.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.673+0000 7f9d987c1640 1 -- 172.21.15.57:0/2112003602 wait complete. 2023-11-24T08:05:29.699 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-11-24T08:05:28.700664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238264,"kb_used_data":5440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736456,"statfs":{"total":773094113280,"available":772850130944,"internally_reserved":0,"allocated":5570560,"data_stored":2920856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.946177"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808493+0000","last_change":"2023-11-24T08:05:24.803503+0000","last_active":"2023-11-24T08:05:24.808493+0000","last_peered":"2023-11-24T08:05:24.808493+0000","last_clean":"2023-11-24T08:05:24.808493+0000","last_became_active":"2023-11-24T08:05:24.802762+0000","last_became_peered":"2023-11-24T08:05:24.802762+0000","last_unstale":"2023-11-24T08:05:24.808493+0000","last_undegraded":"2023-11-24T08:05:24.808493+0000","last_fullsized":"2023-11-24T08:05:24.808493+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808522+0000","last_change":"2023-11-24T08:05:24.805589+0000","last_active":"2023-11-24T08:05:24.808522+0000","last_peered":"2023-11-24T08:05:24.808522+0000","last_clean":"2023-11-24T08:05:24.808522+0000","last_became_active":"2023-11-24T08:05:24.805266+0000","last_became_peered":"2023-11-24T08:05:24.805266+0000","last_unstale":"2023-11-24T08:05:24.808522+0000","last_undegraded":"2023-11-24T08:05:24.808522+0000","last_fullsized":"2023-11-24T08:05:24.808522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806879+0000","last_change":"2023-11-24T08:05:24.802338+0000","last_active":"2023-11-24T08:05:24.806879+0000","last_peered":"2023-11-24T08:05:24.806879+0000","last_clean":"2023-11-24T08:05:24.806879+0000","last_became_active":"2023-11-24T08:05:24.802083+0000","last_became_peered":"2023-11-24T08:05:24.802083+0000","last_unstale":"2023-11-24T08:05:24.806879+0000","last_undegraded":"2023-11-24T08:05:24.806879+0000","last_fullsized":"2023-11-24T08:05:24.806879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767162+0000","last_change":"2023-11-24T08:05:23.767162+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767162+0000","last_undegraded":"2023-11-24T08:05:23.767162+0000","last_fullsized":"2023-11-24T08:05:23.767162+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801154+0000","last_change":"2023-11-24T08:05:24.795185+0000","last_active":"2023-11-24T08:05:24.801154+0000","last_peered":"2023-11-24T08:05:24.801154+0000","last_clean":"2023-11-24T08:05:24.801154+0000","last_became_active":"2023-11-24T08:05:24.794908+0000","last_became_peered":"2023-11-24T08:05:24.794908+0000","last_unstale":"2023-11-24T08:05:24.801154+0000","last_undegraded":"2023-11-24T08:05:24.801154+0000","last_fullsized":"2023-11-24T08:05:24.801154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.814811+0000","last_change":"2023-11-24T08:05:24.808518+0000","last_active":"2023-11-24T08:05:24.814811+0000","last_peered":"2023-11-24T08:05:24.814811+0000","last_clean":"2023-11-24T08:05:24.814811+0000","last_became_active":"2023-11-24T08:05:24.807671+0000","last_became_peered":"2023-11-24T08:05:24.807671+0000","last_unstale":"2023-11-24T08:05:24.814811+0000","last_undegraded":"2023-11-24T08:05:24.814811+0000","last_fullsized":"2023-11-24T08:05:24.814811+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:47.196156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818290+0000","last_change":"2023-11-24T08:05:24.816324+0000","last_active":"2023-11-24T08:05:24.818290+0000","last_peered":"2023-11-24T08:05:24.818290+0000","last_clean":"2023-11-24T08:05:24.818290+0000","last_became_active":"2023-11-24T08:05:24.816070+0000","last_became_peered":"2023-11-24T08:05:24.816070+0000","last_unstale":"2023-11-24T08:05:24.818290+0000","last_undegraded":"2023-11-24T08:05:24.818290+0000","last_fullsized":"2023-11-24T08:05:24.818290+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766245+0000","last_change":"2023-11-24T08:05:23.766245+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766245+0000","last_undegraded":"2023-11-24T08:05:23.766245+0000","last_fullsized":"2023-11-24T08:05:23.766245+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764857+0000","last_change":"2023-11-24T08:05:23.764857+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764857+0000","last_undegraded":"2023-11-24T08:05:23.764857+0000","last_fullsized":"2023-11-24T08:05:23.764857+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764046+0000","last_change":"2023-11-24T08:05:23.764046+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764046+0000","last_undegraded":"2023-11-24T08:05:23.764046+0000","last_fullsized":"2023-11-24T08:05:23.764046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767662+0000","last_change":"2023-11-24T08:05:23.767662+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767662+0000","last_undegraded":"2023-11-24T08:05:23.767662+0000","last_fullsized":"2023-11-24T08:05:23.767662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.804986+0000","last_change":"2023-11-24T08:05:24.797897+0000","last_active":"2023-11-24T08:05:24.804986+0000","last_peered":"2023-11-24T08:05:24.804986+0000","last_clean":"2023-11-24T08:05:24.804986+0000","last_became_active":"2023-11-24T08:05:24.797199+0000","last_became_peered":"2023-11-24T08:05:24.797199+0000","last_unstale":"2023-11-24T08:05:24.804986+0000","last_undegraded":"2023-11-24T08:05:24.804986+0000","last_fullsized":"2023-11-24T08:05:24.804986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809144+0000","last_change":"2023-11-24T08:05:24.798153+0000","last_active":"2023-11-24T08:05:24.809144+0000","last_peered":"2023-11-24T08:05:24.809144+0000","last_clean":"2023-11-24T08:05:24.809144+0000","last_became_active":"2023-11-24T08:05:24.797691+0000","last_became_peered":"2023-11-24T08:05:24.797691+0000","last_unstale":"2023-11-24T08:05:24.809144+0000","last_undegraded":"2023-11-24T08:05:24.809144+0000","last_fullsized":"2023-11-24T08:05:24.809144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:43.983089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765738+0000","last_change":"2023-11-24T08:05:23.765738+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765738+0000","last_undegraded":"2023-11-24T08:05:23.765738+0000","last_fullsized":"2023-11-24T08:05:23.765738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802771+0000","last_change":"2023-11-24T08:05:24.795053+0000","last_active":"2023-11-24T08:05:24.802771+0000","last_peered":"2023-11-24T08:05:24.802771+0000","last_clean":"2023-11-24T08:05:24.802771+0000","last_became_active":"2023-11-24T08:05:24.794617+0000","last_became_peered":"2023-11-24T08:05:24.794617+0000","last_unstale":"2023-11-24T08:05:24.802771+0000","last_undegraded":"2023-11-24T08:05:24.802771+0000","last_fullsized":"2023-11-24T08:05:24.802771+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800911+0000","last_change":"2023-11-24T08:05:24.795258+0000","last_active":"2023-11-24T08:05:24.800911+0000","last_peered":"2023-11-24T08:05:24.800911+0000","last_clean":"2023-11-24T08:05:24.800911+0000","last_became_active":"2023-11-24T08:05:24.794956+0000","last_became_peered":"2023-11-24T08:05:24.794956+0000","last_unstale":"2023-11-24T08:05:24.800911+0000","last_undegraded":"2023-11-24T08:05:24.800911+0000","last_fullsized":"2023-11-24T08:05:24.800911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:56.270806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799550+0000","last_change":"2023-11-24T08:05:24.794729+0000","last_active":"2023-11-24T08:05:24.799550+0000","last_peered":"2023-11-24T08:05:24.799550+0000","last_clean":"2023-11-24T08:05:24.799550+0000","last_became_active":"2023-11-24T08:05:24.794319+0000","last_became_peered":"2023-11-24T08:05:24.794319+0000","last_unstale":"2023-11-24T08:05:24.799550+0000","last_undegraded":"2023-11-24T08:05:24.799550+0000","last_fullsized":"2023-11-24T08:05:24.799550+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818901+0000","last_change":"2023-11-24T08:05:24.811835+0000","last_active":"2023-11-24T08:05:24.818901+0000","last_peered":"2023-11-24T08:05:24.818901+0000","last_clean":"2023-11-24T08:05:24.818901+0000","last_became_active":"2023-11-24T08:05:24.811546+0000","last_became_peered":"2023-11-24T08:05:24.811546+0000","last_unstale":"2023-11-24T08:05:24.818901+0000","last_undegraded":"2023-11-24T08:05:24.818901+0000","last_fullsized":"2023-11-24T08:05:24.818901+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820552+0000","last_change":"2023-11-24T08:05:24.807853+0000","last_active":"2023-11-24T08:05:24.820552+0000","last_peered":"2023-11-24T08:05:24.820552+0000","last_clean":"2023-11-24T08:05:24.820552+0000","last_became_active":"2023-11-24T08:05:24.804890+0000","last_became_peered":"2023-11-24T08:05:24.804890+0000","last_unstale":"2023-11-24T08:05:24.820552+0000","last_undegraded":"2023-11-24T08:05:24.820552+0000","last_fullsized":"2023-11-24T08:05:24.820552+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:35.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812853+0000","last_change":"2023-11-24T08:05:24.804875+0000","last_active":"2023-11-24T08:05:24.812853+0000","last_peered":"2023-11-24T08:05:24.812853+0000","last_clean":"2023-11-24T08:05:24.812853+0000","last_became_active":"2023-11-24T08:05:24.804578+0000","last_became_peered":"2023-11-24T08:05:24.804578+0000","last_unstale":"2023-11-24T08:05:24.812853+0000","last_undegraded":"2023-11-24T08:05:24.812853+0000","last_fullsized":"2023-11-24T08:05:24.812853+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:42:06.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803024+0000","last_change":"2023-11-24T08:05:24.794384+0000","last_active":"2023-11-24T08:05:24.803024+0000","last_peered":"2023-11-24T08:05:24.803024+0000","last_clean":"2023-11-24T08:05:24.803024+0000","last_became_active":"2023-11-24T08:05:24.794053+0000","last_became_peered":"2023-11-24T08:05:24.794053+0000","last_unstale":"2023-11-24T08:05:24.803024+0000","last_undegraded":"2023-11-24T08:05:24.803024+0000","last_fullsized":"2023-11-24T08:05:24.803024+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762443+0000","last_change":"2023-11-24T08:05:23.762443+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762443+0000","last_undegraded":"2023-11-24T08:05:23.762443+0000","last_fullsized":"2023-11-24T08:05:23.762443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820819+0000","last_change":"2023-11-24T08:05:24.809693+0000","last_active":"2023-11-24T08:05:24.820819+0000","last_peered":"2023-11-24T08:05:24.820819+0000","last_clean":"2023-11-24T08:05:24.820819+0000","last_became_active":"2023-11-24T08:05:24.809223+0000","last_became_peered":"2023-11-24T08:05:24.809223+0000","last_unstale":"2023-11-24T08:05:24.820819+0000","last_undegraded":"2023-11-24T08:05:24.820819+0000","last_fullsized":"2023-11-24T08:05:24.820819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:57.419189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823105+0000","last_change":"2023-11-24T08:05:24.811467+0000","last_active":"2023-11-24T08:05:24.823105+0000","last_peered":"2023-11-24T08:05:24.823105+0000","last_clean":"2023-11-24T08:05:24.823105+0000","last_became_active":"2023-11-24T08:05:24.811225+0000","last_became_peered":"2023-11-24T08:05:24.811225+0000","last_unstale":"2023-11-24T08:05:24.823105+0000","last_undegraded":"2023-11-24T08:05:24.823105+0000","last_fullsized":"2023-11-24T08:05:24.823105+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:57.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820706+0000","last_change":"2023-11-24T08:05:24.808178+0000","last_active":"2023-11-24T08:05:24.820706+0000","last_peered":"2023-11-24T08:05:24.820706+0000","last_clean":"2023-11-24T08:05:24.820706+0000","last_became_active":"2023-11-24T08:05:24.807918+0000","last_became_peered":"2023-11-24T08:05:24.807918+0000","last_unstale":"2023-11-24T08:05:24.820706+0000","last_undegraded":"2023-11-24T08:05:24.820706+0000","last_fullsized":"2023-11-24T08:05:24.820706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:42.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812129+0000","last_change":"2023-11-24T08:05:24.804744+0000","last_active":"2023-11-24T08:05:24.812129+0000","last_peered":"2023-11-24T08:05:24.812129+0000","last_clean":"2023-11-24T08:05:24.812129+0000","last_became_active":"2023-11-24T08:05:24.804339+0000","last_became_peered":"2023-11-24T08:05:24.804339+0000","last_unstale":"2023-11-24T08:05:24.812129+0000","last_undegraded":"2023-11-24T08:05:24.812129+0000","last_fullsized":"2023-11-24T08:05:24.812129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:08.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801293+0000","last_change":"2023-11-24T08:05:24.795287+0000","last_active":"2023-11-24T08:05:24.801293+0000","last_peered":"2023-11-24T08:05:24.801293+0000","last_clean":"2023-11-24T08:05:24.801293+0000","last_became_active":"2023-11-24T08:05:24.795029+0000","last_became_peered":"2023-11-24T08:05:24.795029+0000","last_unstale":"2023-11-24T08:05:24.801293+0000","last_undegraded":"2023-11-24T08:05:24.801293+0000","last_fullsized":"2023-11-24T08:05:24.801293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807716+0000","last_change":"2023-11-24T08:05:24.801769+0000","last_active":"2023-11-24T08:05:24.807716+0000","last_peered":"2023-11-24T08:05:24.807716+0000","last_clean":"2023-11-24T08:05:24.807716+0000","last_became_active":"2023-11-24T08:05:24.801503+0000","last_became_peered":"2023-11-24T08:05:24.801503+0000","last_unstale":"2023-11-24T08:05:24.807716+0000","last_undegraded":"2023-11-24T08:05:24.807716+0000","last_fullsized":"2023-11-24T08:05:24.807716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:23.875555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823087+0000","last_change":"2023-11-24T08:05:24.808950+0000","last_active":"2023-11-24T08:05:24.823087+0000","last_peered":"2023-11-24T08:05:24.823087+0000","last_clean":"2023-11-24T08:05:24.823087+0000","last_became_active":"2023-11-24T08:05:24.808294+0000","last_became_peered":"2023-11-24T08:05:24.808294+0000","last_unstale":"2023-11-24T08:05:24.823087+0000","last_undegraded":"2023-11-24T08:05:24.823087+0000","last_fullsized":"2023-11-24T08:05:24.823087+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:39.471914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806647+0000","last_change":"2023-11-24T08:05:24.801554+0000","last_active":"2023-11-24T08:05:24.806647+0000","last_peered":"2023-11-24T08:05:24.806647+0000","last_clean":"2023-11-24T08:05:24.806647+0000","last_became_active":"2023-11-24T08:05:24.801207+0000","last_became_peered":"2023-11-24T08:05:24.801207+0000","last_unstale":"2023-11-24T08:05:24.806647+0000","last_undegraded":"2023-11-24T08:05:24.806647+0000","last_fullsized":"2023-11-24T08:05:24.806647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802739+0000","last_change":"2023-11-24T08:05:24.792493+0000","last_active":"2023-11-24T08:05:24.802739+0000","last_peered":"2023-11-24T08:05:24.802739+0000","last_clean":"2023-11-24T08:05:24.802739+0000","last_became_active":"2023-11-24T08:05:24.789895+0000","last_became_peered":"2023-11-24T08:05:24.789895+0000","last_unstale":"2023-11-24T08:05:24.802739+0000","last_undegraded":"2023-11-24T08:05:24.802739+0000","last_fullsized":"2023-11-24T08:05:24.802739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:01.420207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811890+0000","last_change":"2023-11-24T08:05:24.804224+0000","last_active":"2023-11-24T08:05:24.811890+0000","last_peered":"2023-11-24T08:05:24.811890+0000","last_clean":"2023-11-24T08:05:24.811890+0000","last_became_active":"2023-11-24T08:05:24.803814+0000","last_became_peered":"2023-11-24T08:05:24.803814+0000","last_unstale":"2023-11-24T08:05:24.811890+0000","last_undegraded":"2023-11-24T08:05:24.811890+0000","last_fullsized":"2023-11-24T08:05:24.811890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:13.625275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.810842+0000","last_change":"2023-11-24T08:05:24.807630+0000","last_active":"2023-11-24T08:05:24.810842+0000","last_peered":"2023-11-24T08:05:24.810842+0000","last_clean":"2023-11-24T08:05:24.810842+0000","last_became_active":"2023-11-24T08:05:24.807158+0000","last_became_peered":"2023-11-24T08:05:24.807158+0000","last_unstale":"2023-11-24T08:05:24.810842+0000","last_undegraded":"2023-11-24T08:05:24.810842+0000","last_fullsized":"2023-11-24T08:05:24.810842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:01.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824282+0000","last_change":"2023-11-24T08:05:23.789734+0000","last_active":"2023-11-24T08:05:24.824282+0000","last_peered":"2023-11-24T08:05:24.824282+0000","last_clean":"2023-11-24T08:05:24.824282+0000","last_became_active":"2023-11-24T08:05:23.789448+0000","last_became_peered":"2023-11-24T08:05:23.789448+0000","last_unstale":"2023-11-24T08:05:24.824282+0000","last_undegraded":"2023-11-24T08:05:24.824282+0000","last_fullsized":"2023-11-24T08:05:24.824282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:15.341563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797818+0000","last_change":"2023-11-24T08:05:24.793485+0000","last_active":"2023-11-24T08:05:24.797818+0000","last_peered":"2023-11-24T08:05:24.797818+0000","last_clean":"2023-11-24T08:05:24.797818+0000","last_became_active":"2023-11-24T08:05:24.793195+0000","last_became_peered":"2023-11-24T08:05:24.793195+0000","last_unstale":"2023-11-24T08:05:24.797818+0000","last_undegraded":"2023-11-24T08:05:24.797818+0000","last_fullsized":"2023-11-24T08:05:24.797818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:58.250762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823411+0000","last_change":"2023-11-24T08:05:23.781005+0000","last_active":"2023-11-24T08:05:24.823411+0000","last_peered":"2023-11-24T08:05:24.823411+0000","last_clean":"2023-11-24T08:05:24.823411+0000","last_became_active":"2023-11-24T08:05:23.780655+0000","last_became_peered":"2023-11-24T08:05:23.780655+0000","last_unstale":"2023-11-24T08:05:24.823411+0000","last_undegraded":"2023-11-24T08:05:24.823411+0000","last_fullsized":"2023-11-24T08:05:24.823411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:05.273157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801982+0000","last_change":"2023-11-24T08:05:24.796295+0000","last_active":"2023-11-24T08:05:24.801982+0000","last_peered":"2023-11-24T08:05:24.801982+0000","last_clean":"2023-11-24T08:05:24.801982+0000","last_became_active":"2023-11-24T08:05:24.796051+0000","last_became_peered":"2023-11-24T08:05:24.796051+0000","last_unstale":"2023-11-24T08:05:24.801982+0000","last_undegraded":"2023-11-24T08:05:24.801982+0000","last_fullsized":"2023-11-24T08:05:24.801982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819751+0000","last_change":"2023-11-24T08:05:23.785930+0000","last_active":"2023-11-24T08:05:24.819751+0000","last_peered":"2023-11-24T08:05:24.819751+0000","last_clean":"2023-11-24T08:05:24.819751+0000","last_became_active":"2023-11-24T08:05:23.785575+0000","last_became_peered":"2023-11-24T08:05:23.785575+0000","last_unstale":"2023-11-24T08:05:24.819751+0000","last_undegraded":"2023-11-24T08:05:24.819751+0000","last_fullsized":"2023-11-24T08:05:24.819751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:45.042279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807153+0000","last_change":"2023-11-24T08:05:24.801199+0000","last_active":"2023-11-24T08:05:24.807153+0000","last_peered":"2023-11-24T08:05:24.807153+0000","last_clean":"2023-11-24T08:05:24.807153+0000","last_became_active":"2023-11-24T08:05:24.799824+0000","last_became_peered":"2023-11-24T08:05:24.799824+0000","last_unstale":"2023-11-24T08:05:24.807153+0000","last_undegraded":"2023-11-24T08:05:24.807153+0000","last_fullsized":"2023-11-24T08:05:24.807153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819780+0000","last_change":"2023-11-24T08:05:23.786066+0000","last_active":"2023-11-24T08:05:24.819780+0000","last_peered":"2023-11-24T08:05:24.819780+0000","last_clean":"2023-11-24T08:05:24.819780+0000","last_became_active":"2023-11-24T08:05:23.785789+0000","last_became_peered":"2023-11-24T08:05:23.785789+0000","last_unstale":"2023-11-24T08:05:24.819780+0000","last_undegraded":"2023-11-24T08:05:24.819780+0000","last_fullsized":"2023-11-24T08:05:24.819780+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799134+0000","last_change":"2023-11-24T08:05:24.793986+0000","last_active":"2023-11-24T08:05:24.799134+0000","last_peered":"2023-11-24T08:05:24.799134+0000","last_clean":"2023-11-24T08:05:24.799134+0000","last_became_active":"2023-11-24T08:05:24.793719+0000","last_became_peered":"2023-11-24T08:05:24.793719+0000","last_unstale":"2023-11-24T08:05:24.799134+0000","last_undegraded":"2023-11-24T08:05:24.799134+0000","last_fullsized":"2023-11-24T08:05:24.799134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:04.586739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822481+0000","last_change":"2023-11-24T08:05:23.786132+0000","last_active":"2023-11-24T08:05:24.822481+0000","last_peered":"2023-11-24T08:05:24.822481+0000","last_clean":"2023-11-24T08:05:24.822481+0000","last_became_active":"2023-11-24T08:05:23.785846+0000","last_became_peered":"2023-11-24T08:05:23.785846+0000","last_unstale":"2023-11-24T08:05:24.822481+0000","last_undegraded":"2023-11-24T08:05:24.822481+0000","last_fullsized":"2023-11-24T08:05:24.822481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765224+0000","last_change":"2023-11-24T08:05:23.765224+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765224+0000","last_undegraded":"2023-11-24T08:05:23.765224+0000","last_fullsized":"2023-11-24T08:05:23.765224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822483+0000","last_change":"2023-11-24T08:05:23.782383+0000","last_active":"2023-11-24T08:05:24.822483+0000","last_peered":"2023-11-24T08:05:24.822483+0000","last_clean":"2023-11-24T08:05:24.822483+0000","last_became_active":"2023-11-24T08:05:23.782077+0000","last_became_peered":"2023-11-24T08:05:23.782077+0000","last_unstale":"2023-11-24T08:05:24.822483+0000","last_undegraded":"2023-11-24T08:05:24.822483+0000","last_fullsized":"2023-11-24T08:05:24.822483+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:00.714376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765712+0000","last_change":"2023-11-24T08:05:23.765712+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765712+0000","last_undegraded":"2023-11-24T08:05:23.765712+0000","last_fullsized":"2023-11-24T08:05:23.765712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783972+0000","last_change":"2023-11-24T08:05:23.786361+0000","last_active":"2023-11-24T08:05:24.783972+0000","last_peered":"2023-11-24T08:05:24.783972+0000","last_clean":"2023-11-24T08:05:24.783972+0000","last_became_active":"2023-11-24T08:05:23.786102+0000","last_became_peered":"2023-11-24T08:05:23.786102+0000","last_unstale":"2023-11-24T08:05:24.783972+0000","last_undegraded":"2023-11-24T08:05:24.783972+0000","last_fullsized":"2023-11-24T08:05:24.783972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:48.278067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820800+0000","last_change":"2023-11-24T08:05:24.809467+0000","last_active":"2023-11-24T08:05:24.820800+0000","last_peered":"2023-11-24T08:05:24.820800+0000","last_clean":"2023-11-24T08:05:24.820800+0000","last_became_active":"2023-11-24T08:05:24.808871+0000","last_became_peered":"2023-11-24T08:05:24.808871+0000","last_unstale":"2023-11-24T08:05:24.820800+0000","last_undegraded":"2023-11-24T08:05:24.820800+0000","last_fullsized":"2023-11-24T08:05:24.820800+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:55.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.784982+0000","last_change":"2023-11-24T08:05:23.779563+0000","last_active":"2023-11-24T08:05:23.784982+0000","last_peered":"2023-11-24T08:05:23.784982+0000","last_clean":"2023-11-24T08:05:23.784982+0000","last_became_active":"2023-11-24T08:05:23.779281+0000","last_became_peered":"2023-11-24T08:05:23.779281+0000","last_unstale":"2023-11-24T08:05:23.784982+0000","last_undegraded":"2023-11-24T08:05:23.784982+0000","last_fullsized":"2023-11-24T08:05:23.784982+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:44.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811731+0000","last_change":"2023-11-24T08:05:24.807194+0000","last_active":"2023-11-24T08:05:24.811731+0000","last_peered":"2023-11-24T08:05:24.811731+0000","last_clean":"2023-11-24T08:05:24.811731+0000","last_became_active":"2023-11-24T08:05:24.806869+0000","last_became_peered":"2023-11-24T08:05:24.806869+0000","last_unstale":"2023-11-24T08:05:24.811731+0000","last_undegraded":"2023-11-24T08:05:24.811731+0000","last_fullsized":"2023-11-24T08:05:24.811731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.789214+0000","last_change":"2023-11-24T08:05:23.778824+0000","last_active":"2023-11-24T08:05:24.789214+0000","last_peered":"2023-11-24T08:05:24.789214+0000","last_clean":"2023-11-24T08:05:24.789214+0000","last_became_active":"2023-11-24T08:05:23.778462+0000","last_became_peered":"2023-11-24T08:05:23.778462+0000","last_unstale":"2023-11-24T08:05:24.789214+0000","last_undegraded":"2023-11-24T08:05:24.789214+0000","last_fullsized":"2023-11-24T08:05:24.789214+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809998+0000","last_change":"2023-11-24T08:05:24.806424+0000","last_active":"2023-11-24T08:05:24.809998+0000","last_peered":"2023-11-24T08:05:24.809998+0000","last_clean":"2023-11-24T08:05:24.809998+0000","last_became_active":"2023-11-24T08:05:24.806143+0000","last_became_peered":"2023-11-24T08:05:24.806143+0000","last_unstale":"2023-11-24T08:05:24.809998+0000","last_undegraded":"2023-11-24T08:05:24.809998+0000","last_fullsized":"2023-11-24T08:05:24.809998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.781431+0000","last_change":"2023-11-24T08:05:23.777987+0000","last_active":"2023-11-24T08:05:23.781431+0000","last_peered":"2023-11-24T08:05:23.781431+0000","last_clean":"2023-11-24T08:05:23.781431+0000","last_became_active":"2023-11-24T08:05:23.777197+0000","last_became_peered":"2023-11-24T08:05:23.777197+0000","last_unstale":"2023-11-24T08:05:23.781431+0000","last_undegraded":"2023-11-24T08:05:23.781431+0000","last_fullsized":"2023-11-24T08:05:23.781431+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:49.045196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809312+0000","last_change":"2023-11-24T08:05:24.803406+0000","last_active":"2023-11-24T08:05:24.809312+0000","last_peered":"2023-11-24T08:05:24.809312+0000","last_clean":"2023-11-24T08:05:24.809312+0000","last_became_active":"2023-11-24T08:05:24.803027+0000","last_became_peered":"2023-11-24T08:05:24.803027+0000","last_unstale":"2023-11-24T08:05:24.809312+0000","last_undegraded":"2023-11-24T08:05:24.809312+0000","last_fullsized":"2023-11-24T08:05:24.809312+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:21:44.439548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824118+0000","last_change":"2023-11-24T08:05:23.793340+0000","last_active":"2023-11-24T08:05:24.824118+0000","last_peered":"2023-11-24T08:05:24.824118+0000","last_clean":"2023-11-24T08:05:24.824118+0000","last_became_active":"2023-11-24T08:05:23.792687+0000","last_became_peered":"2023-11-24T08:05:23.792687+0000","last_unstale":"2023-11-24T08:05:24.824118+0000","last_undegraded":"2023-11-24T08:05:24.824118+0000","last_fullsized":"2023-11-24T08:05:24.824118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:48.296413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819192+0000","last_change":"2023-11-24T08:05:24.816525+0000","last_active":"2023-11-24T08:05:24.819192+0000","last_peered":"2023-11-24T08:05:24.819192+0000","last_clean":"2023-11-24T08:05:24.819192+0000","last_became_active":"2023-11-24T08:05:24.816253+0000","last_became_peered":"2023-11-24T08:05:24.816253+0000","last_unstale":"2023-11-24T08:05:24.819192+0000","last_undegraded":"2023-11-24T08:05:24.819192+0000","last_fullsized":"2023-11-24T08:05:24.819192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824951+0000","last_change":"2023-11-24T08:05:23.780472+0000","last_active":"2023-11-24T08:05:24.824951+0000","last_peered":"2023-11-24T08:05:24.824951+0000","last_clean":"2023-11-24T08:05:24.824951+0000","last_became_active":"2023-11-24T08:05:23.780179+0000","last_became_peered":"2023-11-24T08:05:23.780179+0000","last_unstale":"2023-11-24T08:05:24.824951+0000","last_undegraded":"2023-11-24T08:05:24.824951+0000","last_fullsized":"2023-11-24T08:05:24.824951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:34.866637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820534+0000","last_change":"2023-11-24T08:05:24.807288+0000","last_active":"2023-11-24T08:05:24.820534+0000","last_peered":"2023-11-24T08:05:24.820534+0000","last_clean":"2023-11-24T08:05:24.820534+0000","last_became_active":"2023-11-24T08:05:24.807002+0000","last_became_peered":"2023-11-24T08:05:24.807002+0000","last_unstale":"2023-11-24T08:05:24.820534+0000","last_undegraded":"2023-11-24T08:05:24.820534+0000","last_fullsized":"2023-11-24T08:05:24.820534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:21.670193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823116+0000","last_change":"2023-11-24T08:05:23.785359+0000","last_active":"2023-11-24T08:05:24.823116+0000","last_peered":"2023-11-24T08:05:24.823116+0000","last_clean":"2023-11-24T08:05:24.823116+0000","last_became_active":"2023-11-24T08:05:23.784845+0000","last_became_peered":"2023-11-24T08:05:23.784845+0000","last_unstale":"2023-11-24T08:05:24.823116+0000","last_undegraded":"2023-11-24T08:05:24.823116+0000","last_fullsized":"2023-11-24T08:05:24.823116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:45.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762666+0000","last_change":"2023-11-24T08:05:23.762666+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762666+0000","last_undegraded":"2023-11-24T08:05:23.762666+0000","last_fullsized":"2023-11-24T08:05:23.762666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795412+0000","last_change":"2023-11-24T08:05:23.785562+0000","last_active":"2023-11-24T08:05:24.795412+0000","last_peered":"2023-11-24T08:05:24.795412+0000","last_clean":"2023-11-24T08:05:24.795412+0000","last_became_active":"2023-11-24T08:05:23.785261+0000","last_became_peered":"2023-11-24T08:05:23.785261+0000","last_unstale":"2023-11-24T08:05:24.795412+0000","last_undegraded":"2023-11-24T08:05:24.795412+0000","last_fullsized":"2023-11-24T08:05:24.795412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802791+0000","last_change":"2023-11-24T08:05:24.797229+0000","last_active":"2023-11-24T08:05:24.802791+0000","last_peered":"2023-11-24T08:05:24.802791+0000","last_clean":"2023-11-24T08:05:24.802791+0000","last_became_active":"2023-11-24T08:05:24.796863+0000","last_became_peered":"2023-11-24T08:05:24.796863+0000","last_unstale":"2023-11-24T08:05:24.802791+0000","last_undegraded":"2023-11-24T08:05:24.802791+0000","last_fullsized":"2023-11-24T08:05:24.802791+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782427+0000","last_change":"2023-11-24T08:05:23.783807+0000","last_active":"2023-11-24T08:05:24.782427+0000","last_peered":"2023-11-24T08:05:24.782427+0000","last_clean":"2023-11-24T08:05:24.782427+0000","last_became_active":"2023-11-24T08:05:23.783504+0000","last_became_peered":"2023-11-24T08:05:23.783504+0000","last_unstale":"2023-11-24T08:05:24.782427+0000","last_undegraded":"2023-11-24T08:05:24.782427+0000","last_fullsized":"2023-11-24T08:05:24.782427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:07.077115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.816629+0000","last_change":"2023-11-24T08:05:24.813482+0000","last_active":"2023-11-24T08:05:24.816629+0000","last_peered":"2023-11-24T08:05:24.816629+0000","last_clean":"2023-11-24T08:05:24.816629+0000","last_became_active":"2023-11-24T08:05:24.813159+0000","last_became_peered":"2023-11-24T08:05:24.813159+0000","last_unstale":"2023-11-24T08:05:24.816629+0000","last_undegraded":"2023-11-24T08:05:24.816629+0000","last_fullsized":"2023-11-24T08:05:24.816629+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.789417+0000","last_change":"2023-11-24T08:05:23.782857+0000","last_active":"2023-11-24T08:05:23.789417+0000","last_peered":"2023-11-24T08:05:23.789417+0000","last_clean":"2023-11-24T08:05:23.789417+0000","last_became_active":"2023-11-24T08:05:23.782637+0000","last_became_peered":"2023-11-24T08:05:23.782637+0000","last_unstale":"2023-11-24T08:05:23.789417+0000","last_undegraded":"2023-11-24T08:05:23.789417+0000","last_fullsized":"2023-11-24T08:05:23.789417+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:17:44.634959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800348+0000","last_change":"2023-11-24T08:05:24.793310+0000","last_active":"2023-11-24T08:05:24.800348+0000","last_peered":"2023-11-24T08:05:24.800348+0000","last_clean":"2023-11-24T08:05:24.800348+0000","last_became_active":"2023-11-24T08:05:24.792934+0000","last_became_peered":"2023-11-24T08:05:24.792934+0000","last_unstale":"2023-11-24T08:05:24.800348+0000","last_undegraded":"2023-11-24T08:05:24.800348+0000","last_fullsized":"2023-11-24T08:05:24.800348+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:46.235186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822139+0000","last_change":"2023-11-24T08:05:23.791769+0000","last_active":"2023-11-24T08:05:24.822139+0000","last_peered":"2023-11-24T08:05:24.822139+0000","last_clean":"2023-11-24T08:05:24.822139+0000","last_became_active":"2023-11-24T08:05:23.790624+0000","last_became_peered":"2023-11-24T08:05:23.790624+0000","last_unstale":"2023-11-24T08:05:24.822139+0000","last_undegraded":"2023-11-24T08:05:24.822139+0000","last_fullsized":"2023-11-24T08:05:24.822139+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:02.701487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764281+0000","last_change":"2023-11-24T08:05:23.764281+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764281+0000","last_undegraded":"2023-11-24T08:05:23.764281+0000","last_fullsized":"2023-11-24T08:05:23.764281+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.821859+0000","last_change":"2023-11-24T08:05:23.785405+0000","last_active":"2023-11-24T08:05:24.821859+0000","last_peered":"2023-11-24T08:05:24.821859+0000","last_clean":"2023-11-24T08:05:24.821859+0000","last_became_active":"2023-11-24T08:05:23.785104+0000","last_became_peered":"2023-11-24T08:05:23.785104+0000","last_unstale":"2023-11-24T08:05:24.821859+0000","last_undegraded":"2023-11-24T08:05:24.821859+0000","last_fullsized":"2023-11-24T08:05:24.821859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820164+0000","last_change":"2023-11-24T08:05:24.803826+0000","last_active":"2023-11-24T08:05:24.820164+0000","last_peered":"2023-11-24T08:05:24.820164+0000","last_clean":"2023-11-24T08:05:24.820164+0000","last_became_active":"2023-11-24T08:05:24.803535+0000","last_became_peered":"2023-11-24T08:05:24.803535+0000","last_unstale":"2023-11-24T08:05:24.820164+0000","last_undegraded":"2023-11-24T08:05:24.820164+0000","last_fullsized":"2023-11-24T08:05:24.820164+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:47.403645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820963+0000","last_change":"2023-11-24T08:05:23.790238+0000","last_active":"2023-11-24T08:05:24.820963+0000","last_peered":"2023-11-24T08:05:24.820963+0000","last_clean":"2023-11-24T08:05:24.820963+0000","last_became_active":"2023-11-24T08:05:23.789980+0000","last_became_peered":"2023-11-24T08:05:23.789980+0000","last_unstale":"2023-11-24T08:05:24.820963+0000","last_undegraded":"2023-11-24T08:05:24.820963+0000","last_fullsized":"2023-11-24T08:05:24.820963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:35.217727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812014+0000","last_change":"2023-11-24T08:05:24.800737+0000","last_active":"2023-11-24T08:05:24.812014+0000","last_peered":"2023-11-24T08:05:24.812014+0000","last_clean":"2023-11-24T08:05:24.812014+0000","last_became_active":"2023-11-24T08:05:24.800410+0000","last_became_peered":"2023-11-24T08:05:24.800410+0000","last_unstale":"2023-11-24T08:05:24.812014+0000","last_undegraded":"2023-11-24T08:05:24.812014+0000","last_fullsized":"2023-11-24T08:05:24.812014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:08:20.963516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782262+0000","last_change":"2023-11-24T08:05:23.787803+0000","last_active":"2023-11-24T08:05:24.782262+0000","last_peered":"2023-11-24T08:05:24.782262+0000","last_clean":"2023-11-24T08:05:24.782262+0000","last_became_active":"2023-11-24T08:05:23.787536+0000","last_became_peered":"2023-11-24T08:05:23.787536+0000","last_unstale":"2023-11-24T08:05:24.782262+0000","last_undegraded":"2023-11-24T08:05:24.782262+0000","last_fullsized":"2023-11-24T08:05:24.782262+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:47.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803376+0000","last_change":"2023-11-24T08:05:24.797504+0000","last_active":"2023-11-24T08:05:24.803376+0000","last_peered":"2023-11-24T08:05:24.803376+0000","last_clean":"2023-11-24T08:05:24.803376+0000","last_became_active":"2023-11-24T08:05:24.797158+0000","last_became_peered":"2023-11-24T08:05:24.797158+0000","last_unstale":"2023-11-24T08:05:24.803376+0000","last_undegraded":"2023-11-24T08:05:24.803376+0000","last_fullsized":"2023-11-24T08:05:24.803376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:04.593709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822567+0000","last_change":"2023-11-24T08:05:23.786254+0000","last_active":"2023-11-24T08:05:24.822567+0000","last_peered":"2023-11-24T08:05:24.822567+0000","last_clean":"2023-11-24T08:05:24.822567+0000","last_became_active":"2023-11-24T08:05:23.786045+0000","last_became_peered":"2023-11-24T08:05:23.786045+0000","last_unstale":"2023-11-24T08:05:24.822567+0000","last_undegraded":"2023-11-24T08:05:24.822567+0000","last_fullsized":"2023-11-24T08:05:24.822567+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:18.255758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807370+0000","last_change":"2023-11-24T08:05:24.797939+0000","last_active":"2023-11-24T08:05:24.807370+0000","last_peered":"2023-11-24T08:05:24.807370+0000","last_clean":"2023-11-24T08:05:24.807370+0000","last_became_active":"2023-11-24T08:05:24.797670+0000","last_became_peered":"2023-11-24T08:05:24.797670+0000","last_unstale":"2023-11-24T08:05:24.807370+0000","last_undegraded":"2023-11-24T08:05:24.807370+0000","last_fullsized":"2023-11-24T08:05:24.807370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783878+0000","last_change":"2023-11-24T08:05:23.787871+0000","last_active":"2023-11-24T08:05:24.783878+0000","last_peered":"2023-11-24T08:05:24.783878+0000","last_clean":"2023-11-24T08:05:24.783878+0000","last_became_active":"2023-11-24T08:05:23.787606+0000","last_became_peered":"2023-11-24T08:05:23.787606+0000","last_unstale":"2023-11-24T08:05:24.783878+0000","last_undegraded":"2023-11-24T08:05:24.783878+0000","last_fullsized":"2023-11-24T08:05:24.783878+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811879+0000","last_change":"2023-11-24T08:05:24.801445+0000","last_active":"2023-11-24T08:05:24.811879+0000","last_peered":"2023-11-24T08:05:24.811879+0000","last_clean":"2023-11-24T08:05:24.811879+0000","last_became_active":"2023-11-24T08:05:24.801146+0000","last_became_peered":"2023-11-24T08:05:24.801146+0000","last_unstale":"2023-11-24T08:05:24.811879+0000","last_undegraded":"2023-11-24T08:05:24.811879+0000","last_fullsized":"2023-11-24T08:05:24.811879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:14.569562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.782532+0000","last_change":"2023-11-24T08:05:23.775594+0000","last_active":"2023-11-24T08:05:23.782532+0000","last_peered":"2023-11-24T08:05:23.782532+0000","last_clean":"2023-11-24T08:05:23.782532+0000","last_became_active":"2023-11-24T08:05:23.775204+0000","last_became_peered":"2023-11-24T08:05:23.775204+0000","last_unstale":"2023-11-24T08:05:23.782532+0000","last_undegraded":"2023-11-24T08:05:23.782532+0000","last_fullsized":"2023-11-24T08:05:23.782532+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:44.667325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762471+0000","last_change":"2023-11-24T08:05:23.762471+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762471+0000","last_undegraded":"2023-11-24T08:05:23.762471+0000","last_fullsized":"2023-11-24T08:05:23.762471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795167+0000","last_change":"2023-11-24T08:05:23.788392+0000","last_active":"2023-11-24T08:05:24.795167+0000","last_peered":"2023-11-24T08:05:24.795167+0000","last_clean":"2023-11-24T08:05:24.795167+0000","last_became_active":"2023-11-24T08:05:23.788108+0000","last_became_peered":"2023-11-24T08:05:23.788108+0000","last_unstale":"2023-11-24T08:05:24.795167+0000","last_undegraded":"2023-11-24T08:05:24.795167+0000","last_fullsized":"2023-11-24T08:05:24.795167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:32.971004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820405+0000","last_change":"2023-11-24T08:05:24.807026+0000","last_active":"2023-11-24T08:05:24.820405+0000","last_peered":"2023-11-24T08:05:24.820405+0000","last_clean":"2023-11-24T08:05:24.820405+0000","last_became_active":"2023-11-24T08:05:24.806282+0000","last_became_peered":"2023-11-24T08:05:24.806282+0000","last_unstale":"2023-11-24T08:05:24.820405+0000","last_undegraded":"2023-11-24T08:05:24.820405+0000","last_fullsized":"2023-11-24T08:05:24.820405+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:13:48.606704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.780151+0000","last_change":"2023-11-24T08:05:23.784376+0000","last_active":"2023-11-24T08:05:24.780151+0000","last_peered":"2023-11-24T08:05:24.780151+0000","last_clean":"2023-11-24T08:05:24.780151+0000","last_became_active":"2023-11-24T08:05:23.784088+0000","last_became_peered":"2023-11-24T08:05:23.784088+0000","last_unstale":"2023-11-24T08:05:24.780151+0000","last_undegraded":"2023-11-24T08:05:24.780151+0000","last_fullsized":"2023-11-24T08:05:24.780151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766717+0000","last_change":"2023-11-24T08:05:23.766717+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766717+0000","last_undegraded":"2023-11-24T08:05:23.766717+0000","last_fullsized":"2023-11-24T08:05:23.766717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797184+0000","last_change":"2023-11-24T08:05:23.793529+0000","last_active":"2023-11-24T08:05:24.797184+0000","last_peered":"2023-11-24T08:05:24.797184+0000","last_clean":"2023-11-24T08:05:24.797184+0000","last_became_active":"2023-11-24T08:05:23.793045+0000","last_became_peered":"2023-11-24T08:05:23.793045+0000","last_unstale":"2023-11-24T08:05:24.797184+0000","last_undegraded":"2023-11-24T08:05:24.797184+0000","last_fullsized":"2023-11-24T08:05:24.797184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813740+0000","last_change":"2023-11-24T08:05:24.810946+0000","last_active":"2023-11-24T08:05:24.813740+0000","last_peered":"2023-11-24T08:05:24.813740+0000","last_clean":"2023-11-24T08:05:24.813740+0000","last_became_active":"2023-11-24T08:05:24.810545+0000","last_became_peered":"2023-11-24T08:05:24.810545+0000","last_unstale":"2023-11-24T08:05:24.813740+0000","last_undegraded":"2023-11-24T08:05:24.813740+0000","last_fullsized":"2023-11-24T08:05:24.813740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:16.355430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.790977+0000","last_change":"2023-11-24T08:05:23.786068+0000","last_active":"2023-11-24T08:05:24.790977+0000","last_peered":"2023-11-24T08:05:24.790977+0000","last_clean":"2023-11-24T08:05:24.790977+0000","last_became_active":"2023-11-24T08:05:23.785722+0000","last_became_peered":"2023-11-24T08:05:23.785722+0000","last_unstale":"2023-11-24T08:05:24.790977+0000","last_undegraded":"2023-11-24T08:05:24.790977+0000","last_fullsized":"2023-11-24T08:05:24.790977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:06.084171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.805738+0000","last_change":"2023-11-24T08:05:24.802279+0000","last_active":"2023-11-24T08:05:24.805738+0000","last_peered":"2023-11-24T08:05:24.805738+0000","last_clean":"2023-11-24T08:05:24.805738+0000","last_became_active":"2023-11-24T08:05:24.801966+0000","last_became_peered":"2023-11-24T08:05:24.801966+0000","last_unstale":"2023-11-24T08:05:24.805738+0000","last_undegraded":"2023-11-24T08:05:24.805738+0000","last_fullsized":"2023-11-24T08:05:24.805738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:29.448203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.796812+0000","last_change":"2023-11-24T08:05:23.792778+0000","last_active":"2023-11-24T08:05:24.796812+0000","last_peered":"2023-11-24T08:05:24.796812+0000","last_clean":"2023-11-24T08:05:24.796812+0000","last_became_active":"2023-11-24T08:05:23.792486+0000","last_became_peered":"2023-11-24T08:05:23.792486+0000","last_unstale":"2023-11-24T08:05:24.796812+0000","last_undegraded":"2023-11-24T08:05:24.796812+0000","last_fullsized":"2023-11-24T08:05:24.796812+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:00.406340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803044+0000","last_change":"2023-11-24T08:05:24.797345+0000","last_active":"2023-11-24T08:05:24.803044+0000","last_peered":"2023-11-24T08:05:24.803044+0000","last_clean":"2023-11-24T08:05:24.803044+0000","last_became_active":"2023-11-24T08:05:24.797025+0000","last_became_peered":"2023-11-24T08:05:24.797025+0000","last_unstale":"2023-11-24T08:05:24.803044+0000","last_undegraded":"2023-11-24T08:05:24.803044+0000","last_fullsized":"2023-11-24T08:05:24.803044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:49.310280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788382+0000","last_change":"2023-11-24T08:05:23.782246+0000","last_active":"2023-11-24T08:05:24.788382+0000","last_peered":"2023-11-24T08:05:24.788382+0000","last_clean":"2023-11-24T08:05:24.788382+0000","last_became_active":"2023-11-24T08:05:23.781813+0000","last_became_peered":"2023-11-24T08:05:23.781813+0000","last_unstale":"2023-11-24T08:05:24.788382+0000","last_undegraded":"2023-11-24T08:05:24.788382+0000","last_fullsized":"2023-11-24T08:05:24.788382+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809841+0000","last_change":"2023-11-24T08:05:24.799932+0000","last_active":"2023-11-24T08:05:24.809841+0000","last_peered":"2023-11-24T08:05:24.809841+0000","last_clean":"2023-11-24T08:05:24.809841+0000","last_became_active":"2023-11-24T08:05:24.799665+0000","last_became_peered":"2023-11-24T08:05:24.799665+0000","last_unstale":"2023-11-24T08:05:24.809841+0000","last_undegraded":"2023-11-24T08:05:24.809841+0000","last_fullsized":"2023-11-24T08:05:24.809841+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788765+0000","last_change":"2023-11-24T08:05:23.788270+0000","last_active":"2023-11-24T08:05:24.788765+0000","last_peered":"2023-11-24T08:05:24.788765+0000","last_clean":"2023-11-24T08:05:24.788765+0000","last_became_active":"2023-11-24T08:05:23.788012+0000","last_became_peered":"2023-11-24T08:05:23.788012+0000","last_unstale":"2023-11-24T08:05:24.788765+0000","last_undegraded":"2023-11-24T08:05:24.788765+0000","last_fullsized":"2023-11-24T08:05:24.788765+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813337+0000","last_change":"2023-11-24T08:05:24.808501+0000","last_active":"2023-11-24T08:05:24.813337+0000","last_peered":"2023-11-24T08:05:24.813337+0000","last_clean":"2023-11-24T08:05:24.813337+0000","last_became_active":"2023-11-24T08:05:24.808234+0000","last_became_peered":"2023-11-24T08:05:24.808234+0000","last_unstale":"2023-11-24T08:05:24.813337+0000","last_undegraded":"2023-11-24T08:05:24.813337+0000","last_fullsized":"2023-11-24T08:05:24.813337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.790894+0000","last_change":"2023-11-24T08:05:23.785853+0000","last_active":"2023-11-24T08:05:23.790894+0000","last_peered":"2023-11-24T08:05:23.790894+0000","last_clean":"2023-11-24T08:05:23.790894+0000","last_became_active":"2023-11-24T08:05:23.785174+0000","last_became_peered":"2023-11-24T08:05:23.785174+0000","last_unstale":"2023-11-24T08:05:23.790894+0000","last_undegraded":"2023-11-24T08:05:23.790894+0000","last_fullsized":"2023-11-24T08:05:23.790894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:14.239227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.763523+0000","last_change":"2023-11-24T08:05:23.763523+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.763523+0000","last_undegraded":"2023-11-24T08:05:23.763523+0000","last_fullsized":"2023-11-24T08:05:23.763523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820451+0000","last_change":"2023-11-24T08:05:23.790128+0000","last_active":"2023-11-24T08:05:24.820451+0000","last_peered":"2023-11-24T08:05:24.820451+0000","last_clean":"2023-11-24T08:05:24.820451+0000","last_became_active":"2023-11-24T08:05:23.789847+0000","last_became_peered":"2023-11-24T08:05:23.789847+0000","last_unstale":"2023-11-24T08:05:24.820451+0000","last_undegraded":"2023-11-24T08:05:24.820451+0000","last_fullsized":"2023-11-24T08:05:24.820451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.773879+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:05:23.773879+0000","last_peered":"2023-11-24T08:05:23.773879+0000","last_clean":"2023-11-24T08:05:23.773879+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:05:23.773879+0000","last_undegraded":"2023-11-24T08:05:23.773879+0000","last_fullsized":"2023-11-24T08:05:23.773879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":809270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.4539999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4260000000000002,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.93999999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71999999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":219484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.754}]},{"osd":2,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.878}]},{"osd":3,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1.006},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0620000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":1.04},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95799999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":219450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.91700000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98099999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":220446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.9139999999999997,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.907,"5min":5.907,"15min":5.907},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.054}]},{"osd":5,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.101},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.143}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.3160000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.6059999999999999,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.434},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9320000000000004,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.94599999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":802405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.880000000000001,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.9800000000000004,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.622}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":12.688000000000001,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.752}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1100000000000003,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":6.6390000000000002,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:29.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.767162+0000', 'last_change': '2023-11-24T08:05:23.767162+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.767162+0000', 'last_undegraded': '2023-11-24T08:05:23.767162+0000', 'last_fullsized': '2023-11-24T08:05:23.767162+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.766245+0000', 'last_change': '2023-11-24T08:05:23.766245+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.766245+0000', 'last_undegraded': '2023-11-24T08:05:23.766245+0000', 'last_fullsized': '2023-11-24T08:05:23.766245+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.764857+0000', 'last_change': '2023-11-24T08:05:23.764857+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.764857+0000', 'last_undegraded': '2023-11-24T08:05:23.764857+0000', 'last_fullsized': '2023-11-24T08:05:23.764857+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.764046+0000', 'last_change': '2023-11-24T08:05:23.764046+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.764046+0000', 'last_undegraded': '2023-11-24T08:05:23.764046+0000', 'last_fullsized': '2023-11-24T08:05:23.764046+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-11-24T08:05:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.767662+0000', 'last_change': '2023-11-24T08:05:23.767662+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.767662+0000', 'last_undegraded': '2023-11-24T08:05:23.767662+0000', 'last_fullsized': '2023-11-24T08:05:23.767662+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-11-24T08:05:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.765738+0000', 'last_change': '2023-11-24T08:05:23.765738+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.765738+0000', 'last_undegraded': '2023-11-24T08:05:23.765738+0000', 'last_fullsized': '2023-11-24T08:05:23.765738+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-11-24T08:05:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.762443+0000', 'last_change': '2023-11-24T08:05:23.762443+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.762443+0000', 'last_undegraded': '2023-11-24T08:05:23.762443+0000', 'last_fullsized': '2023-11-24T08:05:23.762443+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.765224+0000', 'last_change': '2023-11-24T08:05:23.765224+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.765224+0000', 'last_undegraded': '2023-11-24T08:05:23.765224+0000', 'last_fullsized': '2023-11-24T08:05:23.765224+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.765712+0000', 'last_change': '2023-11-24T08:05:23.765712+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.765712+0000', 'last_undegraded': '2023-11-24T08:05:23.765712+0000', 'last_fullsized': '2023-11-24T08:05:23.765712+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.762666+0000', 'last_change': '2023-11-24T08:05:23.762666+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.762666+0000', 'last_undegraded': '2023-11-24T08:05:23.762666+0000', 'last_fullsized': '2023-11-24T08:05:23.762666+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.764281+0000', 'last_change': '2023-11-24T08:05:23.764281+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.764281+0000', 'last_undegraded': '2023-11-24T08:05:23.764281+0000', 'last_fullsized': '2023-11-24T08:05:23.764281+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-11-24T08:05:29.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.762471+0000', 'last_change': '2023-11-24T08:05:23.762471+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.762471+0000', 'last_undegraded': '2023-11-24T08:05:23.762471+0000', 'last_fullsized': '2023-11-24T08:05:23.762471+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-11-24T08:05:29.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.766717+0000', 'last_change': '2023-11-24T08:05:23.766717+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.766717+0000', 'last_undegraded': '2023-11-24T08:05:23.766717+0000', 'last_fullsized': '2023-11-24T08:05:23.766717+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-11-24T08:05:29.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:05:23.763523+0000', 'last_change': '2023-11-24T08:05:23.763523+0000', 'last_active': '2023-11-24T08:05:23.752211+0000', 'last_peered': '2023-11-24T08:05:23.752211+0000', 'last_clean': '2023-11-24T08:05:23.752211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:05:23.763523+0000', 'last_undegraded': '2023-11-24T08:05:23.763523+0000', 'last_fullsized': '2023-11-24T08:05:23.763523+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'last_clean_scrub_stamp': '2023-11-24T08:05:23.752211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:05:29.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T08:05:29.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97fc9a1640 1 Processor -- start 2023-11-24T08:05:29.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97fc9a1640 1 -- start start 2023-11-24T08:05:29.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97fc9a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 0x7f97f806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97fc9a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97f80ce8b0 0x7f97f80ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97fc9a1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f80d1cc0 con 0x7f97f80d3020 2023-11-24T08:05:29.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97fc9a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80d1fa0 con 0x7f97f80ce8b0 2023-11-24T08:05:29.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97fc9a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80ce0b0 con 0x7f97f815d570 2023-11-24T08:05:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97effff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f97f80d3020 0x7f97f80d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38004/0 (socket says 172.21.15.57:38004) 2023-11-24T08:05:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97effff640 1 -- 172.21.15.57:0/2999376475 learned_addr learned my addr 172.21.15.57:0/2999376475 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f659c640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 0x7f97f806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f6d9d640 1 --2- 172.21.15.57:0/2999376475 >> v2:172.21.15.132:3300/0 conn(0x7f97f80ce8b0 0x7f97f80ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946168441 0 0) 0x7f97f80d1cc0 con 0x7f97f80d3020 2023-11-24T08:05:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4003530 con 0x7f97f80d3020 2023-11-24T08:05:29.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 366299137 0 0) 0x7f97e4003530 con 0x7f97f80d3020 2023-11-24T08:05:29.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 msgr2=0x7f97f806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 0x7f97f806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 >> v2:172.21.15.132:3300/0 conn(0x7f97f80ce8b0 msgr2=0x7f97f80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 --2- 172.21.15.57:0/2999376475 >> v2:172.21.15.132:3300/0 conn(0x7f97f80ce8b0 0x7f97f80ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80ce390 con 0x7f97f80d3020 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f97e0001680 con 0x7f97f80d3020 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 >> v1:172.21.15.57:6789/0 conn(0x7f97f80d3020 legacy=0x7f97f80d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 0x7f97e4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4003f00 0x7f97e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97e4004d10 0x7f97e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80d1fa0 con 0x7f97e4004d10 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80ce0b0 con 0x7f97e4003f00 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e400b990 con 0x7f97f815d570 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f659c640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 0x7f97e4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97effff640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4003f00 0x7f97e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.877+0000 7f97f6d9d640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97e4004d10 0x7f97e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f6d9d640 1 -- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 msgr2=0x7f97e4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f6d9d640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 0x7f97e4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f6d9d640 1 -- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4003f00 msgr2=0x7f97e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f6d9d640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4003f00 0x7f97e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f6d9d640 1 -- 172.21.15.57:0/2999376475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4003530 con 0x7f97e4004d10 2023-11-24T08:05:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f659c640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815d570 0x7f97e4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:29.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f6d9d640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97e4004d10 0x7f97e4005190 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009fc0 tx=0x7f97f001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b67a492f54064f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00a5cb0 con 0x7f97e4004d10 2023-11-24T08:05:29.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f000f040 con 0x7f97e4004d10 2023-11-24T08:05:29.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f5d9b640 1 -- 172.21.15.57:0/2999376475 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00ad680 con 0x7f97e4004d10 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97fc9a1640 1 -- 172.21.15.57:0/2999376475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97e4004d10 msgr2=0x7f97e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97fc9a1640 1 --2- 172.21.15.57:0/2999376475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97e4004d10 0x7f97e4005190 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009fc0 tx=0x7f97f001cc40 comp rx=0 tx=0).stop 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97f6d9d640 1 -- 172.21.15.57:0/2999376475 reap_dead start 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97fc9a1640 1 -- 172.21.15.57:0/2999376475 shutdown_connections 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97fc9a1640 1 -- 172.21.15.57:0/2999376475 >> 172.21.15.57:0/2999376475 conn(0x7f97f808ceb0 msgr2=0x7f97f809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.881+0000 7f97fc9a1640 1 -- 172.21.15.57:0/2999376475 shutdown_connections 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 -- 172.21.15.57:0/2999376475 wait complete. 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 Processor -- start 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 -- start start 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4004d10 0x7f97f8152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f815f730 0x7f97f80cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815b620 0x7f97f815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8152ec0 con 0x7f97f815f730 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f815bfe0 con 0x7f97e4004d10 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97fc9a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f815fcf0 con 0x7f97f815b620 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f815f730 0x7f97f80cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f815f730 0x7f97f80cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35646/0 (socket says 172.21.15.57:35646) 2023-11-24T08:05:29.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 -- 172.21.15.57:0/1571389914 learned_addr learned my addr 172.21.15.57:0/1571389914 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:29.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97f659c640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4004d10 0x7f97f8152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97f6d9d640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815b620 0x7f97f815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 -- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815b620 msgr2=0x7f97f815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815b620 0x7f97f815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 -- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4004d10 msgr2=0x7f97f8152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4004d10 0x7f97f8152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 -- 172.21.15.57:0/1571389914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f815ffd0 con 0x7f97f815f730 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97f659c640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4004d10 0x7f97f8152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97effff640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f815f730 0x7f97f80cc590 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f97e0007310 tx=0x7f97e00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.885+0000 7f97eeffd640 1 -- 172.21.15.57:0/1571389914 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000f9c0 con 0x7f97f815f730 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97eeffd640 1 -- 172.21.15.57:0/1571389914 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e000fb20 con 0x7f97f815f730 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f81602b0 con 0x7f97f815f730 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97eeffd640 1 -- 172.21.15.57:0/1571389914 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000fed0 con 0x7f97f815f730 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f8160870 con 0x7f97f815f730 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f8067520 con 0x7f97f815f730 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97eeffd640 1 -- 172.21.15.57:0/1571389914 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f97e001d460 con 0x7f97f815f730 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97eeffd640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f97d8066650 0x7f97d8068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97eeffd640 1 -- 172.21.15.57:0/1571389914 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97e0084510 con 0x7f97f815f730 2023-11-24T08:05:29.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97f659c640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f97d8066650 0x7f97d8068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.889+0000 7f97f659c640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f97d8066650 0x7f97d8068b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009d80 tx=0x7f97e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:29.893+0000 7f97eeffd640 1 -- 172.21.15.57:0/1571389914 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97e0051670 con 0x7f97f815f730 2023-11-24T08:05:30.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f97f806b7b0 con 0x7f97f815f730 2023-11-24T08:05:30.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97eeffd640 1 -- 172.21.15.57:0/1571389914 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1518 (secure 0 0 0) 0x7f97e0054c90 con 0x7f97f815f730 2023-11-24T08:05:30.112 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:30.112 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":115,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1700813025,"num_in_osds":8,"osd_in_since":1700813016,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"creating+peering","count":14}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592778,"bytes_used":243982336,"bytes_avail":772850130944,"bytes_total":773094113280,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":2410,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":55016}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-24T08:05:12.697626+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-24T08:05:30.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f97d8066650 msgr2=0x7f97d8068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f97d8066650 0x7f97d8068b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009d80 tx=0x7f97e8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:30.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f815f730 msgr2=0x7f97f80cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f815f730 0x7f97f80cc590 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f97e0007310 tx=0x7f97e00077d0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 shutdown_connections 2023-11-24T08:05:30.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f97d8066650 0x7f97d8068b10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f97f815b620 0x7f97f815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97f815f730 0x7f97f80cc590 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 --2- 172.21.15.57:0/1571389914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e4004d10 0x7f97f8152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 >> 172.21.15.57:0/1571389914 conn(0x7f97f808ceb0 msgr2=0x7f97f80735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 shutdown_connections 2023-11-24T08:05:30.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.105+0000 7f97fc9a1640 1 -- 172.21.15.57:0/1571389914 wait complete. 2023-11-24T08:05:30.133 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T08:05:30.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0857606640 1 Processor -- start 2023-11-24T08:05:30.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0857606640 1 -- start start 2023-11-24T08:05:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0857606640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08500715b0 0x7f0850168130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0857606640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085006acc0 con 0x7f085015d4f0 2023-11-24T08:05:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0857606640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085006af20 con 0x7f08500ce710 2023-11-24T08:05:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0857606640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085006bba0 con 0x7f08500715b0 2023-11-24T08:05:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f08553a2640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f085015d4f0 0x7f085006a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38018/0 (socket says 172.21.15.57:38018) 2023-11-24T08:05:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f08553a2640 1 -- 172.21.15.57:0/3942149824 learned_addr learned my addr 172.21.15.57:0/3942149824 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:30.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0855ba3640 1 --2- 172.21.15.57:0/3942149824 >> v2:172.21.15.57:3300/0 conn(0x7f08500715b0 0x7f0850168130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0847fff640 1 -- 172.21.15.57:0/3942149824 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963964516 0 0) 0x7f085006acc0 con 0x7f085015d4f0 2023-11-24T08:05:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0847fff640 1 -- 172.21.15.57:0/3942149824 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f083c003530 con 0x7f085015d4f0 2023-11-24T08:05:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0855ba3640 1 -- 172.21.15.57:0/3942149824 >> v1:172.21.15.132:6789/0 conn(0x7f08500ce710 legacy=0x7f0850070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0855ba3640 1 -- 172.21.15.57:0/3942149824 >> v1:172.21.15.57:6789/0 conn(0x7f085015d4f0 legacy=0x7f085006a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.269+0000 7f0855ba3640 1 -- 172.21.15.57:0/3942149824 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085006b200 con 0x7f08500715b0 2023-11-24T08:05:30.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0855ba3640 1 --2- 172.21.15.57:0/3942149824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08500715b0 0x7f0850168130 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0848009d90 tx=0x7f084801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d676240c72bc4bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0847fff640 1 -- 172.21.15.57:0/3942149824 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480a59e0 con 0x7f08500715b0 2023-11-24T08:05:30.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0847fff640 1 -- 172.21.15.57:0/3942149824 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480a5b40 con 0x7f08500715b0 2023-11-24T08:05:30.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0847fff640 1 -- 172.21.15.57:0/3942149824 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480ad440 con 0x7f08500715b0 2023-11-24T08:05:30.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0857606640 1 -- 172.21.15.57:0/3942149824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08500715b0 msgr2=0x7f0850168130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0857606640 1 --2- 172.21.15.57:0/3942149824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08500715b0 0x7f0850168130 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0848009d90 tx=0x7f084801c920 comp rx=0 tx=0).stop 2023-11-24T08:05:30.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0857606640 1 -- 172.21.15.57:0/3942149824 shutdown_connections 2023-11-24T08:05:30.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0857606640 1 --2- 172.21.15.57:0/3942149824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08500715b0 0x7f0850168130 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0857606640 1 -- 172.21.15.57:0/3942149824 >> 172.21.15.57:0/3942149824 conn(0x7f08500cc330 msgr2=0x7f08500cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0857606640 1 -- 172.21.15.57:0/3942149824 shutdown_connections 2023-11-24T08:05:30.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.273+0000 7f0857606640 1 -- 172.21.15.57:0/3942149824 wait complete. 2023-11-24T08:05:30.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 Processor -- start 2023-11-24T08:05:30.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 -- start start 2023-11-24T08:05:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08500715b0 0x7f0850159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08500ce710 0x7f08501486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085015d4f0 0x7f08501603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085015dd40 con 0x7f085015d4f0 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085015bc80 con 0x7f08500ce710 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085015bf20 con 0x7f08500715b0 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085015d4f0 0x7f08501603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085015d4f0 0x7f08501603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35674/0 (socket says 172.21.15.57:35674) 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 -- 172.21.15.57:0/2992309926 learned_addr learned my addr 172.21.15.57:0/2992309926 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f08553a2640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08500715b0 0x7f0850159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0854ba1640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08500ce710 0x7f08501486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 -- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08500715b0 msgr2=0x7f0850159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08500715b0 0x7f0850159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 -- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08500ce710 msgr2=0x7f08501486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08500ce710 0x7f08501486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 -- 172.21.15.57:0/2992309926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009a70 con 0x7f085015d4f0 2023-11-24T08:05:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0855ba3640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085015d4f0 0x7f08501603d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f08480b0040 tx=0x7f08480196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0845ffb640 1 -- 172.21.15.57:0/2992309926 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480add90 con 0x7f085015d4f0 2023-11-24T08:05:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0845ffb640 1 -- 172.21.15.57:0/2992309926 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848009450 con 0x7f085015d4f0 2023-11-24T08:05:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0845ffb640 1 -- 172.21.15.57:0/2992309926 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480b9690 con 0x7f085015d4f0 2023-11-24T08:05:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085015c200 con 0x7f085015d4f0 2023-11-24T08:05:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.277+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0850160910 con 0x7f085015d4f0 2023-11-24T08:05:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.281+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085015deb0 con 0x7f085015d4f0 2023-11-24T08:05:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.281+0000 7f0845ffb640 1 -- 172.21.15.57:0/2992309926 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f08480b97f0 con 0x7f085015d4f0 2023-11-24T08:05:30.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.281+0000 7f0845ffb640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0834066620 0x7f0834068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.281+0000 7f0845ffb640 1 -- 172.21.15.57:0/2992309926 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f084811f970 con 0x7f085015d4f0 2023-11-24T08:05:30.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.281+0000 7f08553a2640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0834066620 0x7f0834068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.285+0000 7f08553a2640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0834066620 0x7f0834068ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f084c0011f0 tx=0x7f084c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.285+0000 7f0845ffb640 1 -- 172.21.15.57:0/2992309926 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08480ecc10 con 0x7f085015d4f0 2023-11-24T08:05:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.441+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0850067520 con 0x7f0834066620 2023-11-24T08:05:30.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.449+0000 7f0845ffb640 1 -- 172.21.15.57:0/2992309926 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287825 (secure 0 0 0) 0x7f0850067520 con 0x7f0834066620 2023-11-24T08:05:30.459 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:30.461 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:05:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0834066620 msgr2=0x7f0834068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0834066620 0x7f0834068ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f084c0011f0 tx=0x7f084c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085015d4f0 msgr2=0x7f08501603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085015d4f0 0x7f08501603d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f08480b0040 tx=0x7f08480196c0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 shutdown_connections 2023-11-24T08:05:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0834066620 0x7f0834068ae0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085015d4f0 0x7f08501603d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08500ce710 0x7f08501486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 --2- 172.21.15.57:0/2992309926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08500715b0 0x7f0850159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 >> 172.21.15.57:0/2992309926 conn(0x7f08500cc330 msgr2=0x7f0850154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 shutdown_connections 2023-11-24T08:05:30.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:30.453+0000 7f0857606640 1 -- 172.21.15.57:0/2992309926 wait complete. 2023-11-24T08:05:30.482 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-11-24T08:05:28.700664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238264,"kb_used_data":5440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736456,"statfs":{"total":773094113280,"available":772850130944,"internally_reserved":0,"allocated":5570560,"data_stored":2920856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.946177"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808493+0000","last_change":"2023-11-24T08:05:24.803503+0000","last_active":"2023-11-24T08:05:24.808493+0000","last_peered":"2023-11-24T08:05:24.808493+0000","last_clean":"2023-11-24T08:05:24.808493+0000","last_became_active":"2023-11-24T08:05:24.802762+0000","last_became_peered":"2023-11-24T08:05:24.802762+0000","last_unstale":"2023-11-24T08:05:24.808493+0000","last_undegraded":"2023-11-24T08:05:24.808493+0000","last_fullsized":"2023-11-24T08:05:24.808493+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.808522+0000","last_change":"2023-11-24T08:05:24.805589+0000","last_active":"2023-11-24T08:05:24.808522+0000","last_peered":"2023-11-24T08:05:24.808522+0000","last_clean":"2023-11-24T08:05:24.808522+0000","last_became_active":"2023-11-24T08:05:24.805266+0000","last_became_peered":"2023-11-24T08:05:24.805266+0000","last_unstale":"2023-11-24T08:05:24.808522+0000","last_undegraded":"2023-11-24T08:05:24.808522+0000","last_fullsized":"2023-11-24T08:05:24.808522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806879+0000","last_change":"2023-11-24T08:05:24.802338+0000","last_active":"2023-11-24T08:05:24.806879+0000","last_peered":"2023-11-24T08:05:24.806879+0000","last_clean":"2023-11-24T08:05:24.806879+0000","last_became_active":"2023-11-24T08:05:24.802083+0000","last_became_peered":"2023-11-24T08:05:24.802083+0000","last_unstale":"2023-11-24T08:05:24.806879+0000","last_undegraded":"2023-11-24T08:05:24.806879+0000","last_fullsized":"2023-11-24T08:05:24.806879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767162+0000","last_change":"2023-11-24T08:05:23.767162+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767162+0000","last_undegraded":"2023-11-24T08:05:23.767162+0000","last_fullsized":"2023-11-24T08:05:23.767162+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801154+0000","last_change":"2023-11-24T08:05:24.795185+0000","last_active":"2023-11-24T08:05:24.801154+0000","last_peered":"2023-11-24T08:05:24.801154+0000","last_clean":"2023-11-24T08:05:24.801154+0000","last_became_active":"2023-11-24T08:05:24.794908+0000","last_became_peered":"2023-11-24T08:05:24.794908+0000","last_unstale":"2023-11-24T08:05:24.801154+0000","last_undegraded":"2023-11-24T08:05:24.801154+0000","last_fullsized":"2023-11-24T08:05:24.801154+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.814811+0000","last_change":"2023-11-24T08:05:24.808518+0000","last_active":"2023-11-24T08:05:24.814811+0000","last_peered":"2023-11-24T08:05:24.814811+0000","last_clean":"2023-11-24T08:05:24.814811+0000","last_became_active":"2023-11-24T08:05:24.807671+0000","last_became_peered":"2023-11-24T08:05:24.807671+0000","last_unstale":"2023-11-24T08:05:24.814811+0000","last_undegraded":"2023-11-24T08:05:24.814811+0000","last_fullsized":"2023-11-24T08:05:24.814811+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:47.196156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818290+0000","last_change":"2023-11-24T08:05:24.816324+0000","last_active":"2023-11-24T08:05:24.818290+0000","last_peered":"2023-11-24T08:05:24.818290+0000","last_clean":"2023-11-24T08:05:24.818290+0000","last_became_active":"2023-11-24T08:05:24.816070+0000","last_became_peered":"2023-11-24T08:05:24.816070+0000","last_unstale":"2023-11-24T08:05:24.818290+0000","last_undegraded":"2023-11-24T08:05:24.818290+0000","last_fullsized":"2023-11-24T08:05:24.818290+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766245+0000","last_change":"2023-11-24T08:05:23.766245+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766245+0000","last_undegraded":"2023-11-24T08:05:23.766245+0000","last_fullsized":"2023-11-24T08:05:23.766245+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764857+0000","last_change":"2023-11-24T08:05:23.764857+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764857+0000","last_undegraded":"2023-11-24T08:05:23.764857+0000","last_fullsized":"2023-11-24T08:05:23.764857+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764046+0000","last_change":"2023-11-24T08:05:23.764046+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764046+0000","last_undegraded":"2023-11-24T08:05:23.764046+0000","last_fullsized":"2023-11-24T08:05:23.764046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.767662+0000","last_change":"2023-11-24T08:05:23.767662+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.767662+0000","last_undegraded":"2023-11-24T08:05:23.767662+0000","last_fullsized":"2023-11-24T08:05:23.767662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.804986+0000","last_change":"2023-11-24T08:05:24.797897+0000","last_active":"2023-11-24T08:05:24.804986+0000","last_peered":"2023-11-24T08:05:24.804986+0000","last_clean":"2023-11-24T08:05:24.804986+0000","last_became_active":"2023-11-24T08:05:24.797199+0000","last_became_peered":"2023-11-24T08:05:24.797199+0000","last_unstale":"2023-11-24T08:05:24.804986+0000","last_undegraded":"2023-11-24T08:05:24.804986+0000","last_fullsized":"2023-11-24T08:05:24.804986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809144+0000","last_change":"2023-11-24T08:05:24.798153+0000","last_active":"2023-11-24T08:05:24.809144+0000","last_peered":"2023-11-24T08:05:24.809144+0000","last_clean":"2023-11-24T08:05:24.809144+0000","last_became_active":"2023-11-24T08:05:24.797691+0000","last_became_peered":"2023-11-24T08:05:24.797691+0000","last_unstale":"2023-11-24T08:05:24.809144+0000","last_undegraded":"2023-11-24T08:05:24.809144+0000","last_fullsized":"2023-11-24T08:05:24.809144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:43.983089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765738+0000","last_change":"2023-11-24T08:05:23.765738+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765738+0000","last_undegraded":"2023-11-24T08:05:23.765738+0000","last_fullsized":"2023-11-24T08:05:23.765738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802771+0000","last_change":"2023-11-24T08:05:24.795053+0000","last_active":"2023-11-24T08:05:24.802771+0000","last_peered":"2023-11-24T08:05:24.802771+0000","last_clean":"2023-11-24T08:05:24.802771+0000","last_became_active":"2023-11-24T08:05:24.794617+0000","last_became_peered":"2023-11-24T08:05:24.794617+0000","last_unstale":"2023-11-24T08:05:24.802771+0000","last_undegraded":"2023-11-24T08:05:24.802771+0000","last_fullsized":"2023-11-24T08:05:24.802771+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800911+0000","last_change":"2023-11-24T08:05:24.795258+0000","last_active":"2023-11-24T08:05:24.800911+0000","last_peered":"2023-11-24T08:05:24.800911+0000","last_clean":"2023-11-24T08:05:24.800911+0000","last_became_active":"2023-11-24T08:05:24.794956+0000","last_became_peered":"2023-11-24T08:05:24.794956+0000","last_unstale":"2023-11-24T08:05:24.800911+0000","last_undegraded":"2023-11-24T08:05:24.800911+0000","last_fullsized":"2023-11-24T08:05:24.800911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:56.270806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799550+0000","last_change":"2023-11-24T08:05:24.794729+0000","last_active":"2023-11-24T08:05:24.799550+0000","last_peered":"2023-11-24T08:05:24.799550+0000","last_clean":"2023-11-24T08:05:24.799550+0000","last_became_active":"2023-11-24T08:05:24.794319+0000","last_became_peered":"2023-11-24T08:05:24.794319+0000","last_unstale":"2023-11-24T08:05:24.799550+0000","last_undegraded":"2023-11-24T08:05:24.799550+0000","last_fullsized":"2023-11-24T08:05:24.799550+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.818901+0000","last_change":"2023-11-24T08:05:24.811835+0000","last_active":"2023-11-24T08:05:24.818901+0000","last_peered":"2023-11-24T08:05:24.818901+0000","last_clean":"2023-11-24T08:05:24.818901+0000","last_became_active":"2023-11-24T08:05:24.811546+0000","last_became_peered":"2023-11-24T08:05:24.811546+0000","last_unstale":"2023-11-24T08:05:24.818901+0000","last_undegraded":"2023-11-24T08:05:24.818901+0000","last_fullsized":"2023-11-24T08:05:24.818901+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820552+0000","last_change":"2023-11-24T08:05:24.807853+0000","last_active":"2023-11-24T08:05:24.820552+0000","last_peered":"2023-11-24T08:05:24.820552+0000","last_clean":"2023-11-24T08:05:24.820552+0000","last_became_active":"2023-11-24T08:05:24.804890+0000","last_became_peered":"2023-11-24T08:05:24.804890+0000","last_unstale":"2023-11-24T08:05:24.820552+0000","last_undegraded":"2023-11-24T08:05:24.820552+0000","last_fullsized":"2023-11-24T08:05:24.820552+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:35.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812853+0000","last_change":"2023-11-24T08:05:24.804875+0000","last_active":"2023-11-24T08:05:24.812853+0000","last_peered":"2023-11-24T08:05:24.812853+0000","last_clean":"2023-11-24T08:05:24.812853+0000","last_became_active":"2023-11-24T08:05:24.804578+0000","last_became_peered":"2023-11-24T08:05:24.804578+0000","last_unstale":"2023-11-24T08:05:24.812853+0000","last_undegraded":"2023-11-24T08:05:24.812853+0000","last_fullsized":"2023-11-24T08:05:24.812853+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:42:06.757120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803024+0000","last_change":"2023-11-24T08:05:24.794384+0000","last_active":"2023-11-24T08:05:24.803024+0000","last_peered":"2023-11-24T08:05:24.803024+0000","last_clean":"2023-11-24T08:05:24.803024+0000","last_became_active":"2023-11-24T08:05:24.794053+0000","last_became_peered":"2023-11-24T08:05:24.794053+0000","last_unstale":"2023-11-24T08:05:24.803024+0000","last_undegraded":"2023-11-24T08:05:24.803024+0000","last_fullsized":"2023-11-24T08:05:24.803024+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762443+0000","last_change":"2023-11-24T08:05:23.762443+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762443+0000","last_undegraded":"2023-11-24T08:05:23.762443+0000","last_fullsized":"2023-11-24T08:05:23.762443+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820819+0000","last_change":"2023-11-24T08:05:24.809693+0000","last_active":"2023-11-24T08:05:24.820819+0000","last_peered":"2023-11-24T08:05:24.820819+0000","last_clean":"2023-11-24T08:05:24.820819+0000","last_became_active":"2023-11-24T08:05:24.809223+0000","last_became_peered":"2023-11-24T08:05:24.809223+0000","last_unstale":"2023-11-24T08:05:24.820819+0000","last_undegraded":"2023-11-24T08:05:24.820819+0000","last_fullsized":"2023-11-24T08:05:24.820819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:57.419189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823105+0000","last_change":"2023-11-24T08:05:24.811467+0000","last_active":"2023-11-24T08:05:24.823105+0000","last_peered":"2023-11-24T08:05:24.823105+0000","last_clean":"2023-11-24T08:05:24.823105+0000","last_became_active":"2023-11-24T08:05:24.811225+0000","last_became_peered":"2023-11-24T08:05:24.811225+0000","last_unstale":"2023-11-24T08:05:24.823105+0000","last_undegraded":"2023-11-24T08:05:24.823105+0000","last_fullsized":"2023-11-24T08:05:24.823105+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:57.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820706+0000","last_change":"2023-11-24T08:05:24.808178+0000","last_active":"2023-11-24T08:05:24.820706+0000","last_peered":"2023-11-24T08:05:24.820706+0000","last_clean":"2023-11-24T08:05:24.820706+0000","last_became_active":"2023-11-24T08:05:24.807918+0000","last_became_peered":"2023-11-24T08:05:24.807918+0000","last_unstale":"2023-11-24T08:05:24.820706+0000","last_undegraded":"2023-11-24T08:05:24.820706+0000","last_fullsized":"2023-11-24T08:05:24.820706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:42.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812129+0000","last_change":"2023-11-24T08:05:24.804744+0000","last_active":"2023-11-24T08:05:24.812129+0000","last_peered":"2023-11-24T08:05:24.812129+0000","last_clean":"2023-11-24T08:05:24.812129+0000","last_became_active":"2023-11-24T08:05:24.804339+0000","last_became_peered":"2023-11-24T08:05:24.804339+0000","last_unstale":"2023-11-24T08:05:24.812129+0000","last_undegraded":"2023-11-24T08:05:24.812129+0000","last_fullsized":"2023-11-24T08:05:24.812129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:06:08.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801293+0000","last_change":"2023-11-24T08:05:24.795287+0000","last_active":"2023-11-24T08:05:24.801293+0000","last_peered":"2023-11-24T08:05:24.801293+0000","last_clean":"2023-11-24T08:05:24.801293+0000","last_became_active":"2023-11-24T08:05:24.795029+0000","last_became_peered":"2023-11-24T08:05:24.795029+0000","last_unstale":"2023-11-24T08:05:24.801293+0000","last_undegraded":"2023-11-24T08:05:24.801293+0000","last_fullsized":"2023-11-24T08:05:24.801293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807716+0000","last_change":"2023-11-24T08:05:24.801769+0000","last_active":"2023-11-24T08:05:24.807716+0000","last_peered":"2023-11-24T08:05:24.807716+0000","last_clean":"2023-11-24T08:05:24.807716+0000","last_became_active":"2023-11-24T08:05:24.801503+0000","last_became_peered":"2023-11-24T08:05:24.801503+0000","last_unstale":"2023-11-24T08:05:24.807716+0000","last_undegraded":"2023-11-24T08:05:24.807716+0000","last_fullsized":"2023-11-24T08:05:24.807716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:23.875555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823087+0000","last_change":"2023-11-24T08:05:24.808950+0000","last_active":"2023-11-24T08:05:24.823087+0000","last_peered":"2023-11-24T08:05:24.823087+0000","last_clean":"2023-11-24T08:05:24.823087+0000","last_became_active":"2023-11-24T08:05:24.808294+0000","last_became_peered":"2023-11-24T08:05:24.808294+0000","last_unstale":"2023-11-24T08:05:24.823087+0000","last_undegraded":"2023-11-24T08:05:24.823087+0000","last_fullsized":"2023-11-24T08:05:24.823087+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:39.471914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.806647+0000","last_change":"2023-11-24T08:05:24.801554+0000","last_active":"2023-11-24T08:05:24.806647+0000","last_peered":"2023-11-24T08:05:24.806647+0000","last_clean":"2023-11-24T08:05:24.806647+0000","last_became_active":"2023-11-24T08:05:24.801207+0000","last_became_peered":"2023-11-24T08:05:24.801207+0000","last_unstale":"2023-11-24T08:05:24.806647+0000","last_undegraded":"2023-11-24T08:05:24.806647+0000","last_fullsized":"2023-11-24T08:05:24.806647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802739+0000","last_change":"2023-11-24T08:05:24.792493+0000","last_active":"2023-11-24T08:05:24.802739+0000","last_peered":"2023-11-24T08:05:24.802739+0000","last_clean":"2023-11-24T08:05:24.802739+0000","last_became_active":"2023-11-24T08:05:24.789895+0000","last_became_peered":"2023-11-24T08:05:24.789895+0000","last_unstale":"2023-11-24T08:05:24.802739+0000","last_undegraded":"2023-11-24T08:05:24.802739+0000","last_fullsized":"2023-11-24T08:05:24.802739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:01.420207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811890+0000","last_change":"2023-11-24T08:05:24.804224+0000","last_active":"2023-11-24T08:05:24.811890+0000","last_peered":"2023-11-24T08:05:24.811890+0000","last_clean":"2023-11-24T08:05:24.811890+0000","last_became_active":"2023-11-24T08:05:24.803814+0000","last_became_peered":"2023-11-24T08:05:24.803814+0000","last_unstale":"2023-11-24T08:05:24.811890+0000","last_undegraded":"2023-11-24T08:05:24.811890+0000","last_fullsized":"2023-11-24T08:05:24.811890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:13.625275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.810842+0000","last_change":"2023-11-24T08:05:24.807630+0000","last_active":"2023-11-24T08:05:24.810842+0000","last_peered":"2023-11-24T08:05:24.810842+0000","last_clean":"2023-11-24T08:05:24.810842+0000","last_became_active":"2023-11-24T08:05:24.807158+0000","last_became_peered":"2023-11-24T08:05:24.807158+0000","last_unstale":"2023-11-24T08:05:24.810842+0000","last_undegraded":"2023-11-24T08:05:24.810842+0000","last_fullsized":"2023-11-24T08:05:24.810842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:01.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824282+0000","last_change":"2023-11-24T08:05:23.789734+0000","last_active":"2023-11-24T08:05:24.824282+0000","last_peered":"2023-11-24T08:05:24.824282+0000","last_clean":"2023-11-24T08:05:24.824282+0000","last_became_active":"2023-11-24T08:05:23.789448+0000","last_became_peered":"2023-11-24T08:05:23.789448+0000","last_unstale":"2023-11-24T08:05:24.824282+0000","last_undegraded":"2023-11-24T08:05:24.824282+0000","last_fullsized":"2023-11-24T08:05:24.824282+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:15.341563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797818+0000","last_change":"2023-11-24T08:05:24.793485+0000","last_active":"2023-11-24T08:05:24.797818+0000","last_peered":"2023-11-24T08:05:24.797818+0000","last_clean":"2023-11-24T08:05:24.797818+0000","last_became_active":"2023-11-24T08:05:24.793195+0000","last_became_peered":"2023-11-24T08:05:24.793195+0000","last_unstale":"2023-11-24T08:05:24.797818+0000","last_undegraded":"2023-11-24T08:05:24.797818+0000","last_fullsized":"2023-11-24T08:05:24.797818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:58.250762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823411+0000","last_change":"2023-11-24T08:05:23.781005+0000","last_active":"2023-11-24T08:05:24.823411+0000","last_peered":"2023-11-24T08:05:24.823411+0000","last_clean":"2023-11-24T08:05:24.823411+0000","last_became_active":"2023-11-24T08:05:23.780655+0000","last_became_peered":"2023-11-24T08:05:23.780655+0000","last_unstale":"2023-11-24T08:05:24.823411+0000","last_undegraded":"2023-11-24T08:05:24.823411+0000","last_fullsized":"2023-11-24T08:05:24.823411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:05.273157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.801982+0000","last_change":"2023-11-24T08:05:24.796295+0000","last_active":"2023-11-24T08:05:24.801982+0000","last_peered":"2023-11-24T08:05:24.801982+0000","last_clean":"2023-11-24T08:05:24.801982+0000","last_became_active":"2023-11-24T08:05:24.796051+0000","last_became_peered":"2023-11-24T08:05:24.796051+0000","last_unstale":"2023-11-24T08:05:24.801982+0000","last_undegraded":"2023-11-24T08:05:24.801982+0000","last_fullsized":"2023-11-24T08:05:24.801982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819751+0000","last_change":"2023-11-24T08:05:23.785930+0000","last_active":"2023-11-24T08:05:24.819751+0000","last_peered":"2023-11-24T08:05:24.819751+0000","last_clean":"2023-11-24T08:05:24.819751+0000","last_became_active":"2023-11-24T08:05:23.785575+0000","last_became_peered":"2023-11-24T08:05:23.785575+0000","last_unstale":"2023-11-24T08:05:24.819751+0000","last_undegraded":"2023-11-24T08:05:24.819751+0000","last_fullsized":"2023-11-24T08:05:24.819751+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:45.042279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807153+0000","last_change":"2023-11-24T08:05:24.801199+0000","last_active":"2023-11-24T08:05:24.807153+0000","last_peered":"2023-11-24T08:05:24.807153+0000","last_clean":"2023-11-24T08:05:24.807153+0000","last_became_active":"2023-11-24T08:05:24.799824+0000","last_became_peered":"2023-11-24T08:05:24.799824+0000","last_unstale":"2023-11-24T08:05:24.807153+0000","last_undegraded":"2023-11-24T08:05:24.807153+0000","last_fullsized":"2023-11-24T08:05:24.807153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819780+0000","last_change":"2023-11-24T08:05:23.786066+0000","last_active":"2023-11-24T08:05:24.819780+0000","last_peered":"2023-11-24T08:05:24.819780+0000","last_clean":"2023-11-24T08:05:24.819780+0000","last_became_active":"2023-11-24T08:05:23.785789+0000","last_became_peered":"2023-11-24T08:05:23.785789+0000","last_unstale":"2023-11-24T08:05:24.819780+0000","last_undegraded":"2023-11-24T08:05:24.819780+0000","last_fullsized":"2023-11-24T08:05:24.819780+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.799134+0000","last_change":"2023-11-24T08:05:24.793986+0000","last_active":"2023-11-24T08:05:24.799134+0000","last_peered":"2023-11-24T08:05:24.799134+0000","last_clean":"2023-11-24T08:05:24.799134+0000","last_became_active":"2023-11-24T08:05:24.793719+0000","last_became_peered":"2023-11-24T08:05:24.793719+0000","last_unstale":"2023-11-24T08:05:24.799134+0000","last_undegraded":"2023-11-24T08:05:24.799134+0000","last_fullsized":"2023-11-24T08:05:24.799134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:04.586739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822481+0000","last_change":"2023-11-24T08:05:23.786132+0000","last_active":"2023-11-24T08:05:24.822481+0000","last_peered":"2023-11-24T08:05:24.822481+0000","last_clean":"2023-11-24T08:05:24.822481+0000","last_became_active":"2023-11-24T08:05:23.785846+0000","last_became_peered":"2023-11-24T08:05:23.785846+0000","last_unstale":"2023-11-24T08:05:24.822481+0000","last_undegraded":"2023-11-24T08:05:24.822481+0000","last_fullsized":"2023-11-24T08:05:24.822481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765224+0000","last_change":"2023-11-24T08:05:23.765224+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765224+0000","last_undegraded":"2023-11-24T08:05:23.765224+0000","last_fullsized":"2023-11-24T08:05:23.765224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822483+0000","last_change":"2023-11-24T08:05:23.782383+0000","last_active":"2023-11-24T08:05:24.822483+0000","last_peered":"2023-11-24T08:05:24.822483+0000","last_clean":"2023-11-24T08:05:24.822483+0000","last_became_active":"2023-11-24T08:05:23.782077+0000","last_became_peered":"2023-11-24T08:05:23.782077+0000","last_unstale":"2023-11-24T08:05:24.822483+0000","last_undegraded":"2023-11-24T08:05:24.822483+0000","last_fullsized":"2023-11-24T08:05:24.822483+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:00.714376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.765712+0000","last_change":"2023-11-24T08:05:23.765712+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.765712+0000","last_undegraded":"2023-11-24T08:05:23.765712+0000","last_fullsized":"2023-11-24T08:05:23.765712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783972+0000","last_change":"2023-11-24T08:05:23.786361+0000","last_active":"2023-11-24T08:05:24.783972+0000","last_peered":"2023-11-24T08:05:24.783972+0000","last_clean":"2023-11-24T08:05:24.783972+0000","last_became_active":"2023-11-24T08:05:23.786102+0000","last_became_peered":"2023-11-24T08:05:23.786102+0000","last_unstale":"2023-11-24T08:05:24.783972+0000","last_undegraded":"2023-11-24T08:05:24.783972+0000","last_fullsized":"2023-11-24T08:05:24.783972+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:48.278067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820800+0000","last_change":"2023-11-24T08:05:24.809467+0000","last_active":"2023-11-24T08:05:24.820800+0000","last_peered":"2023-11-24T08:05:24.820800+0000","last_clean":"2023-11-24T08:05:24.820800+0000","last_became_active":"2023-11-24T08:05:24.808871+0000","last_became_peered":"2023-11-24T08:05:24.808871+0000","last_unstale":"2023-11-24T08:05:24.820800+0000","last_undegraded":"2023-11-24T08:05:24.820800+0000","last_fullsized":"2023-11-24T08:05:24.820800+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:33:55.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.784982+0000","last_change":"2023-11-24T08:05:23.779563+0000","last_active":"2023-11-24T08:05:23.784982+0000","last_peered":"2023-11-24T08:05:23.784982+0000","last_clean":"2023-11-24T08:05:23.784982+0000","last_became_active":"2023-11-24T08:05:23.779281+0000","last_became_peered":"2023-11-24T08:05:23.779281+0000","last_unstale":"2023-11-24T08:05:23.784982+0000","last_undegraded":"2023-11-24T08:05:23.784982+0000","last_fullsized":"2023-11-24T08:05:23.784982+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:44.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811731+0000","last_change":"2023-11-24T08:05:24.807194+0000","last_active":"2023-11-24T08:05:24.811731+0000","last_peered":"2023-11-24T08:05:24.811731+0000","last_clean":"2023-11-24T08:05:24.811731+0000","last_became_active":"2023-11-24T08:05:24.806869+0000","last_became_peered":"2023-11-24T08:05:24.806869+0000","last_unstale":"2023-11-24T08:05:24.811731+0000","last_undegraded":"2023-11-24T08:05:24.811731+0000","last_fullsized":"2023-11-24T08:05:24.811731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.789214+0000","last_change":"2023-11-24T08:05:23.778824+0000","last_active":"2023-11-24T08:05:24.789214+0000","last_peered":"2023-11-24T08:05:24.789214+0000","last_clean":"2023-11-24T08:05:24.789214+0000","last_became_active":"2023-11-24T08:05:23.778462+0000","last_became_peered":"2023-11-24T08:05:23.778462+0000","last_unstale":"2023-11-24T08:05:24.789214+0000","last_undegraded":"2023-11-24T08:05:24.789214+0000","last_fullsized":"2023-11-24T08:05:24.789214+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809998+0000","last_change":"2023-11-24T08:05:24.806424+0000","last_active":"2023-11-24T08:05:24.809998+0000","last_peered":"2023-11-24T08:05:24.809998+0000","last_clean":"2023-11-24T08:05:24.809998+0000","last_became_active":"2023-11-24T08:05:24.806143+0000","last_became_peered":"2023-11-24T08:05:24.806143+0000","last_unstale":"2023-11-24T08:05:24.809998+0000","last_undegraded":"2023-11-24T08:05:24.809998+0000","last_fullsized":"2023-11-24T08:05:24.809998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:49.291934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.781431+0000","last_change":"2023-11-24T08:05:23.777987+0000","last_active":"2023-11-24T08:05:23.781431+0000","last_peered":"2023-11-24T08:05:23.781431+0000","last_clean":"2023-11-24T08:05:23.781431+0000","last_became_active":"2023-11-24T08:05:23.777197+0000","last_became_peered":"2023-11-24T08:05:23.777197+0000","last_unstale":"2023-11-24T08:05:23.781431+0000","last_undegraded":"2023-11-24T08:05:23.781431+0000","last_fullsized":"2023-11-24T08:05:23.781431+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:17:49.045196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809312+0000","last_change":"2023-11-24T08:05:24.803406+0000","last_active":"2023-11-24T08:05:24.809312+0000","last_peered":"2023-11-24T08:05:24.809312+0000","last_clean":"2023-11-24T08:05:24.809312+0000","last_became_active":"2023-11-24T08:05:24.803027+0000","last_became_peered":"2023-11-24T08:05:24.803027+0000","last_unstale":"2023-11-24T08:05:24.809312+0000","last_undegraded":"2023-11-24T08:05:24.809312+0000","last_fullsized":"2023-11-24T08:05:24.809312+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:21:44.439548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824118+0000","last_change":"2023-11-24T08:05:23.793340+0000","last_active":"2023-11-24T08:05:24.824118+0000","last_peered":"2023-11-24T08:05:24.824118+0000","last_clean":"2023-11-24T08:05:24.824118+0000","last_became_active":"2023-11-24T08:05:23.792687+0000","last_became_peered":"2023-11-24T08:05:23.792687+0000","last_unstale":"2023-11-24T08:05:24.824118+0000","last_undegraded":"2023-11-24T08:05:24.824118+0000","last_fullsized":"2023-11-24T08:05:24.824118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:48.296413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.819192+0000","last_change":"2023-11-24T08:05:24.816525+0000","last_active":"2023-11-24T08:05:24.819192+0000","last_peered":"2023-11-24T08:05:24.819192+0000","last_clean":"2023-11-24T08:05:24.819192+0000","last_became_active":"2023-11-24T08:05:24.816253+0000","last_became_peered":"2023-11-24T08:05:24.816253+0000","last_unstale":"2023-11-24T08:05:24.819192+0000","last_undegraded":"2023-11-24T08:05:24.819192+0000","last_fullsized":"2023-11-24T08:05:24.819192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.824951+0000","last_change":"2023-11-24T08:05:23.780472+0000","last_active":"2023-11-24T08:05:24.824951+0000","last_peered":"2023-11-24T08:05:24.824951+0000","last_clean":"2023-11-24T08:05:24.824951+0000","last_became_active":"2023-11-24T08:05:23.780179+0000","last_became_peered":"2023-11-24T08:05:23.780179+0000","last_unstale":"2023-11-24T08:05:24.824951+0000","last_undegraded":"2023-11-24T08:05:24.824951+0000","last_fullsized":"2023-11-24T08:05:24.824951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:34.866637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820534+0000","last_change":"2023-11-24T08:05:24.807288+0000","last_active":"2023-11-24T08:05:24.820534+0000","last_peered":"2023-11-24T08:05:24.820534+0000","last_clean":"2023-11-24T08:05:24.820534+0000","last_became_active":"2023-11-24T08:05:24.807002+0000","last_became_peered":"2023-11-24T08:05:24.807002+0000","last_unstale":"2023-11-24T08:05:24.820534+0000","last_undegraded":"2023-11-24T08:05:24.820534+0000","last_fullsized":"2023-11-24T08:05:24.820534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:21.670193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.823116+0000","last_change":"2023-11-24T08:05:23.785359+0000","last_active":"2023-11-24T08:05:24.823116+0000","last_peered":"2023-11-24T08:05:24.823116+0000","last_clean":"2023-11-24T08:05:24.823116+0000","last_became_active":"2023-11-24T08:05:23.784845+0000","last_became_peered":"2023-11-24T08:05:23.784845+0000","last_unstale":"2023-11-24T08:05:24.823116+0000","last_undegraded":"2023-11-24T08:05:24.823116+0000","last_fullsized":"2023-11-24T08:05:24.823116+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:45.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762666+0000","last_change":"2023-11-24T08:05:23.762666+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762666+0000","last_undegraded":"2023-11-24T08:05:23.762666+0000","last_fullsized":"2023-11-24T08:05:23.762666+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795412+0000","last_change":"2023-11-24T08:05:23.785562+0000","last_active":"2023-11-24T08:05:24.795412+0000","last_peered":"2023-11-24T08:05:24.795412+0000","last_clean":"2023-11-24T08:05:24.795412+0000","last_became_active":"2023-11-24T08:05:23.785261+0000","last_became_peered":"2023-11-24T08:05:23.785261+0000","last_unstale":"2023-11-24T08:05:24.795412+0000","last_undegraded":"2023-11-24T08:05:24.795412+0000","last_fullsized":"2023-11-24T08:05:24.795412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.802791+0000","last_change":"2023-11-24T08:05:24.797229+0000","last_active":"2023-11-24T08:05:24.802791+0000","last_peered":"2023-11-24T08:05:24.802791+0000","last_clean":"2023-11-24T08:05:24.802791+0000","last_became_active":"2023-11-24T08:05:24.796863+0000","last_became_peered":"2023-11-24T08:05:24.796863+0000","last_unstale":"2023-11-24T08:05:24.802791+0000","last_undegraded":"2023-11-24T08:05:24.802791+0000","last_fullsized":"2023-11-24T08:05:24.802791+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782427+0000","last_change":"2023-11-24T08:05:23.783807+0000","last_active":"2023-11-24T08:05:24.782427+0000","last_peered":"2023-11-24T08:05:24.782427+0000","last_clean":"2023-11-24T08:05:24.782427+0000","last_became_active":"2023-11-24T08:05:23.783504+0000","last_became_peered":"2023-11-24T08:05:23.783504+0000","last_unstale":"2023-11-24T08:05:24.782427+0000","last_undegraded":"2023-11-24T08:05:24.782427+0000","last_fullsized":"2023-11-24T08:05:24.782427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:07.077115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.816629+0000","last_change":"2023-11-24T08:05:24.813482+0000","last_active":"2023-11-24T08:05:24.816629+0000","last_peered":"2023-11-24T08:05:24.816629+0000","last_clean":"2023-11-24T08:05:24.816629+0000","last_became_active":"2023-11-24T08:05:24.813159+0000","last_became_peered":"2023-11-24T08:05:24.813159+0000","last_unstale":"2023-11-24T08:05:24.816629+0000","last_undegraded":"2023-11-24T08:05:24.816629+0000","last_fullsized":"2023-11-24T08:05:24.816629+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.789417+0000","last_change":"2023-11-24T08:05:23.782857+0000","last_active":"2023-11-24T08:05:23.789417+0000","last_peered":"2023-11-24T08:05:23.789417+0000","last_clean":"2023-11-24T08:05:23.789417+0000","last_became_active":"2023-11-24T08:05:23.782637+0000","last_became_peered":"2023-11-24T08:05:23.782637+0000","last_unstale":"2023-11-24T08:05:23.789417+0000","last_undegraded":"2023-11-24T08:05:23.789417+0000","last_fullsized":"2023-11-24T08:05:23.789417+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:17:44.634959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.800348+0000","last_change":"2023-11-24T08:05:24.793310+0000","last_active":"2023-11-24T08:05:24.800348+0000","last_peered":"2023-11-24T08:05:24.800348+0000","last_clean":"2023-11-24T08:05:24.800348+0000","last_became_active":"2023-11-24T08:05:24.792934+0000","last_became_peered":"2023-11-24T08:05:24.792934+0000","last_unstale":"2023-11-24T08:05:24.800348+0000","last_undegraded":"2023-11-24T08:05:24.800348+0000","last_fullsized":"2023-11-24T08:05:24.800348+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:57:46.235186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822139+0000","last_change":"2023-11-24T08:05:23.791769+0000","last_active":"2023-11-24T08:05:24.822139+0000","last_peered":"2023-11-24T08:05:24.822139+0000","last_clean":"2023-11-24T08:05:24.822139+0000","last_became_active":"2023-11-24T08:05:23.790624+0000","last_became_peered":"2023-11-24T08:05:23.790624+0000","last_unstale":"2023-11-24T08:05:24.822139+0000","last_undegraded":"2023-11-24T08:05:24.822139+0000","last_fullsized":"2023-11-24T08:05:24.822139+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:02.701487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.764281+0000","last_change":"2023-11-24T08:05:23.764281+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.764281+0000","last_undegraded":"2023-11-24T08:05:23.764281+0000","last_fullsized":"2023-11-24T08:05:23.764281+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.821859+0000","last_change":"2023-11-24T08:05:23.785405+0000","last_active":"2023-11-24T08:05:24.821859+0000","last_peered":"2023-11-24T08:05:24.821859+0000","last_clean":"2023-11-24T08:05:24.821859+0000","last_became_active":"2023-11-24T08:05:23.785104+0000","last_became_peered":"2023-11-24T08:05:23.785104+0000","last_unstale":"2023-11-24T08:05:24.821859+0000","last_undegraded":"2023-11-24T08:05:24.821859+0000","last_fullsized":"2023-11-24T08:05:24.821859+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820164+0000","last_change":"2023-11-24T08:05:24.803826+0000","last_active":"2023-11-24T08:05:24.820164+0000","last_peered":"2023-11-24T08:05:24.820164+0000","last_clean":"2023-11-24T08:05:24.820164+0000","last_became_active":"2023-11-24T08:05:24.803535+0000","last_became_peered":"2023-11-24T08:05:24.803535+0000","last_unstale":"2023-11-24T08:05:24.820164+0000","last_undegraded":"2023-11-24T08:05:24.820164+0000","last_fullsized":"2023-11-24T08:05:24.820164+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:47.403645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820963+0000","last_change":"2023-11-24T08:05:23.790238+0000","last_active":"2023-11-24T08:05:24.820963+0000","last_peered":"2023-11-24T08:05:24.820963+0000","last_clean":"2023-11-24T08:05:24.820963+0000","last_became_active":"2023-11-24T08:05:23.789980+0000","last_became_peered":"2023-11-24T08:05:23.789980+0000","last_unstale":"2023-11-24T08:05:24.820963+0000","last_undegraded":"2023-11-24T08:05:24.820963+0000","last_fullsized":"2023-11-24T08:05:24.820963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:35.217727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.812014+0000","last_change":"2023-11-24T08:05:24.800737+0000","last_active":"2023-11-24T08:05:24.812014+0000","last_peered":"2023-11-24T08:05:24.812014+0000","last_clean":"2023-11-24T08:05:24.812014+0000","last_became_active":"2023-11-24T08:05:24.800410+0000","last_became_peered":"2023-11-24T08:05:24.800410+0000","last_unstale":"2023-11-24T08:05:24.812014+0000","last_undegraded":"2023-11-24T08:05:24.812014+0000","last_fullsized":"2023-11-24T08:05:24.812014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:08:20.963516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.782262+0000","last_change":"2023-11-24T08:05:23.787803+0000","last_active":"2023-11-24T08:05:24.782262+0000","last_peered":"2023-11-24T08:05:24.782262+0000","last_clean":"2023-11-24T08:05:24.782262+0000","last_became_active":"2023-11-24T08:05:23.787536+0000","last_became_peered":"2023-11-24T08:05:23.787536+0000","last_unstale":"2023-11-24T08:05:24.782262+0000","last_undegraded":"2023-11-24T08:05:24.782262+0000","last_fullsized":"2023-11-24T08:05:24.782262+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:47.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803376+0000","last_change":"2023-11-24T08:05:24.797504+0000","last_active":"2023-11-24T08:05:24.803376+0000","last_peered":"2023-11-24T08:05:24.803376+0000","last_clean":"2023-11-24T08:05:24.803376+0000","last_became_active":"2023-11-24T08:05:24.797158+0000","last_became_peered":"2023-11-24T08:05:24.797158+0000","last_unstale":"2023-11-24T08:05:24.803376+0000","last_undegraded":"2023-11-24T08:05:24.803376+0000","last_fullsized":"2023-11-24T08:05:24.803376+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:04.593709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.822567+0000","last_change":"2023-11-24T08:05:23.786254+0000","last_active":"2023-11-24T08:05:24.822567+0000","last_peered":"2023-11-24T08:05:24.822567+0000","last_clean":"2023-11-24T08:05:24.822567+0000","last_became_active":"2023-11-24T08:05:23.786045+0000","last_became_peered":"2023-11-24T08:05:23.786045+0000","last_unstale":"2023-11-24T08:05:24.822567+0000","last_undegraded":"2023-11-24T08:05:24.822567+0000","last_fullsized":"2023-11-24T08:05:24.822567+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:18.255758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.807370+0000","last_change":"2023-11-24T08:05:24.797939+0000","last_active":"2023-11-24T08:05:24.807370+0000","last_peered":"2023-11-24T08:05:24.807370+0000","last_clean":"2023-11-24T08:05:24.807370+0000","last_became_active":"2023-11-24T08:05:24.797670+0000","last_became_peered":"2023-11-24T08:05:24.797670+0000","last_unstale":"2023-11-24T08:05:24.807370+0000","last_undegraded":"2023-11-24T08:05:24.807370+0000","last_fullsized":"2023-11-24T08:05:24.807370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.783878+0000","last_change":"2023-11-24T08:05:23.787871+0000","last_active":"2023-11-24T08:05:24.783878+0000","last_peered":"2023-11-24T08:05:24.783878+0000","last_clean":"2023-11-24T08:05:24.783878+0000","last_became_active":"2023-11-24T08:05:23.787606+0000","last_became_peered":"2023-11-24T08:05:23.787606+0000","last_unstale":"2023-11-24T08:05:24.783878+0000","last_undegraded":"2023-11-24T08:05:24.783878+0000","last_fullsized":"2023-11-24T08:05:24.783878+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.811879+0000","last_change":"2023-11-24T08:05:24.801445+0000","last_active":"2023-11-24T08:05:24.811879+0000","last_peered":"2023-11-24T08:05:24.811879+0000","last_clean":"2023-11-24T08:05:24.811879+0000","last_became_active":"2023-11-24T08:05:24.801146+0000","last_became_peered":"2023-11-24T08:05:24.801146+0000","last_unstale":"2023-11-24T08:05:24.811879+0000","last_undegraded":"2023-11-24T08:05:24.811879+0000","last_fullsized":"2023-11-24T08:05:24.811879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:14.569562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.782532+0000","last_change":"2023-11-24T08:05:23.775594+0000","last_active":"2023-11-24T08:05:23.782532+0000","last_peered":"2023-11-24T08:05:23.782532+0000","last_clean":"2023-11-24T08:05:23.782532+0000","last_became_active":"2023-11-24T08:05:23.775204+0000","last_became_peered":"2023-11-24T08:05:23.775204+0000","last_unstale":"2023-11-24T08:05:23.782532+0000","last_undegraded":"2023-11-24T08:05:23.782532+0000","last_fullsized":"2023-11-24T08:05:23.782532+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:44.667325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.762471+0000","last_change":"2023-11-24T08:05:23.762471+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.762471+0000","last_undegraded":"2023-11-24T08:05:23.762471+0000","last_fullsized":"2023-11-24T08:05:23.762471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795167+0000","last_change":"2023-11-24T08:05:23.788392+0000","last_active":"2023-11-24T08:05:24.795167+0000","last_peered":"2023-11-24T08:05:24.795167+0000","last_clean":"2023-11-24T08:05:24.795167+0000","last_became_active":"2023-11-24T08:05:23.788108+0000","last_became_peered":"2023-11-24T08:05:23.788108+0000","last_unstale":"2023-11-24T08:05:24.795167+0000","last_undegraded":"2023-11-24T08:05:24.795167+0000","last_fullsized":"2023-11-24T08:05:24.795167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:32.971004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820405+0000","last_change":"2023-11-24T08:05:24.807026+0000","last_active":"2023-11-24T08:05:24.820405+0000","last_peered":"2023-11-24T08:05:24.820405+0000","last_clean":"2023-11-24T08:05:24.820405+0000","last_became_active":"2023-11-24T08:05:24.806282+0000","last_became_peered":"2023-11-24T08:05:24.806282+0000","last_unstale":"2023-11-24T08:05:24.820405+0000","last_undegraded":"2023-11-24T08:05:24.820405+0000","last_fullsized":"2023-11-24T08:05:24.820405+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:13:48.606704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.780151+0000","last_change":"2023-11-24T08:05:23.784376+0000","last_active":"2023-11-24T08:05:24.780151+0000","last_peered":"2023-11-24T08:05:24.780151+0000","last_clean":"2023-11-24T08:05:24.780151+0000","last_became_active":"2023-11-24T08:05:23.784088+0000","last_became_peered":"2023-11-24T08:05:23.784088+0000","last_unstale":"2023-11-24T08:05:24.780151+0000","last_undegraded":"2023-11-24T08:05:24.780151+0000","last_fullsized":"2023-11-24T08:05:24.780151+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.766717+0000","last_change":"2023-11-24T08:05:23.766717+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.766717+0000","last_undegraded":"2023-11-24T08:05:23.766717+0000","last_fullsized":"2023-11-24T08:05:23.766717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.797184+0000","last_change":"2023-11-24T08:05:23.793529+0000","last_active":"2023-11-24T08:05:24.797184+0000","last_peered":"2023-11-24T08:05:24.797184+0000","last_clean":"2023-11-24T08:05:24.797184+0000","last_became_active":"2023-11-24T08:05:23.793045+0000","last_became_peered":"2023-11-24T08:05:23.793045+0000","last_unstale":"2023-11-24T08:05:24.797184+0000","last_undegraded":"2023-11-24T08:05:24.797184+0000","last_fullsized":"2023-11-24T08:05:24.797184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813740+0000","last_change":"2023-11-24T08:05:24.810946+0000","last_active":"2023-11-24T08:05:24.813740+0000","last_peered":"2023-11-24T08:05:24.813740+0000","last_clean":"2023-11-24T08:05:24.813740+0000","last_became_active":"2023-11-24T08:05:24.810545+0000","last_became_peered":"2023-11-24T08:05:24.810545+0000","last_unstale":"2023-11-24T08:05:24.813740+0000","last_undegraded":"2023-11-24T08:05:24.813740+0000","last_fullsized":"2023-11-24T08:05:24.813740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:16.355430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.790977+0000","last_change":"2023-11-24T08:05:23.786068+0000","last_active":"2023-11-24T08:05:24.790977+0000","last_peered":"2023-11-24T08:05:24.790977+0000","last_clean":"2023-11-24T08:05:24.790977+0000","last_became_active":"2023-11-24T08:05:23.785722+0000","last_became_peered":"2023-11-24T08:05:23.785722+0000","last_unstale":"2023-11-24T08:05:24.790977+0000","last_undegraded":"2023-11-24T08:05:24.790977+0000","last_fullsized":"2023-11-24T08:05:24.790977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:06.084171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.805738+0000","last_change":"2023-11-24T08:05:24.802279+0000","last_active":"2023-11-24T08:05:24.805738+0000","last_peered":"2023-11-24T08:05:24.805738+0000","last_clean":"2023-11-24T08:05:24.805738+0000","last_became_active":"2023-11-24T08:05:24.801966+0000","last_became_peered":"2023-11-24T08:05:24.801966+0000","last_unstale":"2023-11-24T08:05:24.805738+0000","last_undegraded":"2023-11-24T08:05:24.805738+0000","last_fullsized":"2023-11-24T08:05:24.805738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:52:29.448203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.796812+0000","last_change":"2023-11-24T08:05:23.792778+0000","last_active":"2023-11-24T08:05:24.796812+0000","last_peered":"2023-11-24T08:05:24.796812+0000","last_clean":"2023-11-24T08:05:24.796812+0000","last_became_active":"2023-11-24T08:05:23.792486+0000","last_became_peered":"2023-11-24T08:05:23.792486+0000","last_unstale":"2023-11-24T08:05:24.796812+0000","last_undegraded":"2023-11-24T08:05:24.796812+0000","last_fullsized":"2023-11-24T08:05:24.796812+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:00.406340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.803044+0000","last_change":"2023-11-24T08:05:24.797345+0000","last_active":"2023-11-24T08:05:24.803044+0000","last_peered":"2023-11-24T08:05:24.803044+0000","last_clean":"2023-11-24T08:05:24.803044+0000","last_became_active":"2023-11-24T08:05:24.797025+0000","last_became_peered":"2023-11-24T08:05:24.797025+0000","last_unstale":"2023-11-24T08:05:24.803044+0000","last_undegraded":"2023-11-24T08:05:24.803044+0000","last_fullsized":"2023-11-24T08:05:24.803044+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:49.310280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788382+0000","last_change":"2023-11-24T08:05:23.782246+0000","last_active":"2023-11-24T08:05:24.788382+0000","last_peered":"2023-11-24T08:05:24.788382+0000","last_clean":"2023-11-24T08:05:24.788382+0000","last_became_active":"2023-11-24T08:05:23.781813+0000","last_became_peered":"2023-11-24T08:05:23.781813+0000","last_unstale":"2023-11-24T08:05:24.788382+0000","last_undegraded":"2023-11-24T08:05:24.788382+0000","last_fullsized":"2023-11-24T08:05:24.788382+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.809841+0000","last_change":"2023-11-24T08:05:24.799932+0000","last_active":"2023-11-24T08:05:24.809841+0000","last_peered":"2023-11-24T08:05:24.809841+0000","last_clean":"2023-11-24T08:05:24.809841+0000","last_became_active":"2023-11-24T08:05:24.799665+0000","last_became_peered":"2023-11-24T08:05:24.799665+0000","last_unstale":"2023-11-24T08:05:24.809841+0000","last_undegraded":"2023-11-24T08:05:24.809841+0000","last_fullsized":"2023-11-24T08:05:24.809841+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.788765+0000","last_change":"2023-11-24T08:05:23.788270+0000","last_active":"2023-11-24T08:05:24.788765+0000","last_peered":"2023-11-24T08:05:24.788765+0000","last_clean":"2023-11-24T08:05:24.788765+0000","last_became_active":"2023-11-24T08:05:23.788012+0000","last_became_peered":"2023-11-24T08:05:23.788012+0000","last_unstale":"2023-11-24T08:05:24.788765+0000","last_undegraded":"2023-11-24T08:05:24.788765+0000","last_fullsized":"2023-11-24T08:05:24.788765+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.813337+0000","last_change":"2023-11-24T08:05:24.808501+0000","last_active":"2023-11-24T08:05:24.813337+0000","last_peered":"2023-11-24T08:05:24.813337+0000","last_clean":"2023-11-24T08:05:24.813337+0000","last_became_active":"2023-11-24T08:05:24.808234+0000","last_became_peered":"2023-11-24T08:05:24.808234+0000","last_unstale":"2023-11-24T08:05:24.813337+0000","last_undegraded":"2023-11-24T08:05:24.813337+0000","last_fullsized":"2023-11-24T08:05:24.813337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.790894+0000","last_change":"2023-11-24T08:05:23.785853+0000","last_active":"2023-11-24T08:05:23.790894+0000","last_peered":"2023-11-24T08:05:23.790894+0000","last_clean":"2023-11-24T08:05:23.790894+0000","last_became_active":"2023-11-24T08:05:23.785174+0000","last_became_peered":"2023-11-24T08:05:23.785174+0000","last_unstale":"2023-11-24T08:05:23.790894+0000","last_undegraded":"2023-11-24T08:05:23.790894+0000","last_fullsized":"2023-11-24T08:05:23.790894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:43:14.239227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2023-11-24T08:05:23.763523+0000","last_change":"2023-11-24T08:05:23.763523+0000","last_active":"2023-11-24T08:05:23.752211+0000","last_peered":"2023-11-24T08:05:23.752211+0000","last_clean":"2023-11-24T08:05:23.752211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:05:23.763523+0000","last_undegraded":"2023-11-24T08:05:23.763523+0000","last_fullsized":"2023-11-24T08:05:23.763523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.820451+0000","last_change":"2023-11-24T08:05:23.790128+0000","last_active":"2023-11-24T08:05:24.820451+0000","last_peered":"2023-11-24T08:05:24.820451+0000","last_clean":"2023-11-24T08:05:24.820451+0000","last_became_active":"2023-11-24T08:05:23.789847+0000","last_became_peered":"2023-11-24T08:05:23.789847+0000","last_unstale":"2023-11-24T08:05:24.820451+0000","last_undegraded":"2023-11-24T08:05:24.820451+0000","last_fullsized":"2023-11-24T08:05:24.820451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:05:23.773879+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:05:23.773879+0000","last_peered":"2023-11-24T08:05:23.773879+0000","last_clean":"2023-11-24T08:05:23.773879+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:05:23.773879+0000","last_undegraded":"2023-11-24T08:05:23.773879+0000","last_fullsized":"2023-11-24T08:05:23.773879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":809270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.4539999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4260000000000002,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.98399999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.93999999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71999999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":219484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.754}]},{"osd":2,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.878}]},{"osd":3,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":1.006},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0620000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":1.04},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.95799999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":219450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.91700000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98099999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":561152,"data_stored":220446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.9139999999999997,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.907,"5min":5.907,"15min":5.907},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.054}]},{"osd":5,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.101},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.143}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.3160000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":548864,"data_stored":218882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.6059999999999999,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.434},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9320000000000004,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.94599999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":802405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.880000000000001,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.9800000000000004,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.622}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":12.688000000000001,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.752}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1100000000000003,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":6.6390000000000002,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:33.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:33.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc427df5640 1 Processor -- start 2023-11-24T08:05:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc427df5640 1 -- start start 2023-11-24T08:05:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc427df5640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc42006e340 0x7fc4200707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc427df5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc4200b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc427df5640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42006dc20 con 0x7fc420158a50 2023-11-24T08:05:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc427df5640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42006e0b0 con 0x7fc42006e340 2023-11-24T08:05:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc427df5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc420071140 con 0x7fc420070cf0 2023-11-24T08:05:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc425b91640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc420158a50 0x7fc42006c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38020/0 (socket says 172.21.15.57:38020) 2023-11-24T08:05:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc425b91640 1 -- 172.21.15.57:0/2646064298 learned_addr learned my addr 172.21.15.57:0/2646064298 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc425390640 1 --2- 172.21.15.57:0/2646064298 >> v2:172.21.15.57:3300/0 conn(0x7fc42006e340 0x7fc4200707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc426392640 1 --2- 172.21.15.57:0/2646064298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc4200b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc424b8f640 1 -- 172.21.15.57:0/2646064298 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995493729 0 0) 0x7fc42006dc20 con 0x7fc420158a50 2023-11-24T08:05:33.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc425390640 1 -- 172.21.15.57:0/2646064298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 msgr2=0x7fc4200b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc425390640 1 --2- 172.21.15.57:0/2646064298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc4200b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc425390640 1 -- 172.21.15.57:0/2646064298 >> v1:172.21.15.57:6789/0 conn(0x7fc420158a50 legacy=0x7fc42006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc425390640 1 -- 172.21.15.57:0/2646064298 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42006cd60 con 0x7fc42006e340 2023-11-24T08:05:33.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.637+0000 7fc426392640 1 --2- 172.21.15.57:0/2646064298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc4200b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc425390640 1 --2- 172.21.15.57:0/2646064298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc4200707b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc4100097c0 tx=0x7fc41001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3309a5d0b22f84 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc424b8f640 1 -- 172.21.15.57:0/2646064298 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100ab680 con 0x7fc42006e340 2023-11-24T08:05:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc424b8f640 1 -- 172.21.15.57:0/2646064298 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4100ab7e0 con 0x7fc42006e340 2023-11-24T08:05:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc424b8f640 1 -- 172.21.15.57:0/2646064298 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100abb70 con 0x7fc42006e340 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 -- 172.21.15.57:0/2646064298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 msgr2=0x7fc4200707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 --2- 172.21.15.57:0/2646064298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc4200707b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc4100097c0 tx=0x7fc41001c480 comp rx=0 tx=0).stop 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 -- 172.21.15.57:0/2646064298 shutdown_connections 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 --2- 172.21.15.57:0/2646064298 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc4200b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 --2- 172.21.15.57:0/2646064298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc4200707b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 -- 172.21.15.57:0/2646064298 >> 172.21.15.57:0/2646064298 conn(0x7fc4200b0bf0 msgr2=0x7fc4200b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 -- 172.21.15.57:0/2646064298 shutdown_connections 2023-11-24T08:05:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.641+0000 7fc427df5640 1 -- 172.21.15.57:0/2646064298 wait complete. 2023-11-24T08:05:33.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 Processor -- start 2023-11-24T08:05:33.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 -- start start 2023-11-24T08:05:33.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc420164760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc420155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc420158a50 0x7fc42014ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc420150e50 con 0x7fc42006e340 2023-11-24T08:05:33.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc420164ca0 con 0x7fc420158a50 2023-11-24T08:05:33.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc420150890 con 0x7fc420070cf0 2023-11-24T08:05:33.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc420164760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc420164760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35688/0 (socket says 172.21.15.57:35688) 2023-11-24T08:05:33.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 -- 172.21.15.57:0/2421085686 learned_addr learned my addr 172.21.15.57:0/2421085686 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:33.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425390640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc420155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc426392640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc420158a50 0x7fc42014ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 -- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 msgr2=0x7fc420155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc420155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 -- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc420158a50 msgr2=0x7fc42014ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc420158a50 0x7fc42014ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 -- 172.21.15.57:0/2421085686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410009420 con 0x7fc42006e340 2023-11-24T08:05:33.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc426392640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc420158a50 0x7fc42014ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:33.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc425b91640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc420164760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0011f0 tx=0x7fc41c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc4167fc640 1 -- 172.21.15.57:0/2421085686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0074e0 con 0x7fc42006e340 2023-11-24T08:05:33.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc4167fc640 1 -- 172.21.15.57:0/2421085686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c007640 con 0x7fc42006e340 2023-11-24T08:05:33.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc4167fc640 1 -- 172.21.15.57:0/2421085686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c004a10 con 0x7fc42006e340 2023-11-24T08:05:33.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc420150b70 con 0x7fc42006e340 2023-11-24T08:05:33.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.645+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc420162bc0 con 0x7fc42006e340 2023-11-24T08:05:33.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.649+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc420162720 con 0x7fc42006e340 2023-11-24T08:05:33.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.649+0000 7fc4167fc640 1 -- 172.21.15.57:0/2421085686 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc41c004b70 con 0x7fc42006e340 2023-11-24T08:05:33.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.649+0000 7fc4167fc640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc404066620 0x7fc404068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.649+0000 7fc4167fc640 1 -- 172.21.15.57:0/2421085686 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc41c0834b0 con 0x7fc42006e340 2023-11-24T08:05:33.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.649+0000 7fc425390640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc404066620 0x7fc404068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.649+0000 7fc425390640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc404066620 0x7fc404068ae0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc4100af000 tx=0x7fc4100a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.653+0000 7fc4167fc640 1 -- 172.21.15.57:0/2421085686 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc41c0506a0 con 0x7fc42006e340 2023-11-24T08:05:33.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.809+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc42006d5d0 con 0x7fc404066620 2023-11-24T08:05:33.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.817+0000 7fc4167fc640 1 -- 172.21.15.57:0/2421085686 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289050 (secure 0 0 0) 0x7fc4100ab950 con 0x7fc404066620 2023-11-24T08:05:33.828 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:33.830 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc404066620 msgr2=0x7fc404068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc404066620 0x7fc404068ae0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc4100af000 tx=0x7fc4100a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 msgr2=0x7fc420164760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc420164760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0011f0 tx=0x7fc41c00c9b0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 shutdown_connections 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc404066620 0x7fc404068ae0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc420158a50 0x7fc42014ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc420070cf0 0x7fc420155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 --2- 172.21.15.57:0/2421085686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc42006e340 0x7fc420164760 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 >> 172.21.15.57:0/2421085686 conn(0x7fc4200b0bf0 msgr2=0x7fc42006c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 shutdown_connections 2023-11-24T08:05:33.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:33.821+0000 7fc427df5640 1 -- 172.21.15.57:0/2421085686 wait complete. 2023-11-24T08:05:33.848 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-11-24T08:05:32.701461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238400,"kb_used_data":5576,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736320,"statfs":{"total":773094113280,"available":772849991680,"internally_reserved":0,"allocated":5709824,"data_stored":2986452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001687"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.783242+0000","last_change":"2023-11-24T08:05:24.803503+0000","last_active":"2023-11-24T08:05:25.783242+0000","last_peered":"2023-11-24T08:05:25.783242+0000","last_clean":"2023-11-24T08:05:25.783242+0000","last_became_active":"2023-11-24T08:05:24.802762+0000","last_became_peered":"2023-11-24T08:05:24.802762+0000","last_unstale":"2023-11-24T08:05:25.783242+0000","last_undegraded":"2023-11-24T08:05:25.783242+0000","last_fullsized":"2023-11-24T08:05:25.783242+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:19.269625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.078659+0000","last_change":"2023-11-24T08:05:24.805589+0000","last_active":"2023-11-24T08:05:26.078659+0000","last_peered":"2023-11-24T08:05:26.078659+0000","last_clean":"2023-11-24T08:05:26.078659+0000","last_became_active":"2023-11-24T08:05:24.805266+0000","last_became_peered":"2023-11-24T08:05:24.805266+0000","last_unstale":"2023-11-24T08:05:26.078659+0000","last_undegraded":"2023-11-24T08:05:26.078659+0000","last_fullsized":"2023-11-24T08:05:26.078659+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:35.592590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.407087+0000","last_change":"2023-11-24T08:05:24.802338+0000","last_active":"2023-11-24T08:05:27.407087+0000","last_peered":"2023-11-24T08:05:27.407087+0000","last_clean":"2023-11-24T08:05:27.407087+0000","last_became_active":"2023-11-24T08:05:24.802083+0000","last_became_peered":"2023-11-24T08:05:24.802083+0000","last_unstale":"2023-11-24T08:05:27.407087+0000","last_undegraded":"2023-11-24T08:05:27.407087+0000","last_fullsized":"2023-11-24T08:05:27.407087+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:49.310280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782904+0000","last_change":"2023-11-24T08:05:24.801278+0000","last_active":"2023-11-24T08:05:25.782904+0000","last_peered":"2023-11-24T08:05:25.782904+0000","last_clean":"2023-11-24T08:05:25.782904+0000","last_became_active":"2023-11-24T08:05:24.800873+0000","last_became_peered":"2023-11-24T08:05:24.800873+0000","last_unstale":"2023-11-24T08:05:25.782904+0000","last_undegraded":"2023-11-24T08:05:25.782904+0000","last_fullsized":"2023-11-24T08:05:25.782904+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:41.762813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.078486+0000","last_change":"2023-11-24T08:05:24.795185+0000","last_active":"2023-11-24T08:05:26.078486+0000","last_peered":"2023-11-24T08:05:26.078486+0000","last_clean":"2023-11-24T08:05:26.078486+0000","last_became_active":"2023-11-24T08:05:24.794908+0000","last_became_peered":"2023-11-24T08:05:24.794908+0000","last_unstale":"2023-11-24T08:05:26.078486+0000","last_undegraded":"2023-11-24T08:05:26.078486+0000","last_fullsized":"2023-11-24T08:05:26.078486+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:16.355430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635098+0000","last_change":"2023-11-24T08:05:24.808518+0000","last_active":"2023-11-24T08:05:26.635098+0000","last_peered":"2023-11-24T08:05:26.635098+0000","last_clean":"2023-11-24T08:05:26.635098+0000","last_became_active":"2023-11-24T08:05:24.807671+0000","last_became_peered":"2023-11-24T08:05:24.807671+0000","last_unstale":"2023-11-24T08:05:26.635098+0000","last_undegraded":"2023-11-24T08:05:26.635098+0000","last_fullsized":"2023-11-24T08:05:26.635098+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:31:23.424042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782562+0000","last_change":"2023-11-24T08:05:24.816324+0000","last_active":"2023-11-24T08:05:25.782562+0000","last_peered":"2023-11-24T08:05:25.782562+0000","last_clean":"2023-11-24T08:05:25.782562+0000","last_became_active":"2023-11-24T08:05:24.816070+0000","last_became_peered":"2023-11-24T08:05:24.816070+0000","last_unstale":"2023-11-24T08:05:25.782562+0000","last_undegraded":"2023-11-24T08:05:25.782562+0000","last_fullsized":"2023-11-24T08:05:25.782562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:46.521565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782514+0000","last_change":"2023-11-24T08:05:24.793464+0000","last_active":"2023-11-24T08:05:25.782514+0000","last_peered":"2023-11-24T08:05:25.782514+0000","last_clean":"2023-11-24T08:05:25.782514+0000","last_became_active":"2023-11-24T08:05:24.793075+0000","last_became_peered":"2023-11-24T08:05:24.793075+0000","last_unstale":"2023-11-24T08:05:25.782514+0000","last_undegraded":"2023-11-24T08:05:25.782514+0000","last_fullsized":"2023-11-24T08:05:25.782514+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:10:02.520894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.783293+0000","last_change":"2023-11-24T08:05:24.812288+0000","last_active":"2023-11-24T08:05:25.783293+0000","last_peered":"2023-11-24T08:05:25.783293+0000","last_clean":"2023-11-24T08:05:25.783293+0000","last_became_active":"2023-11-24T08:05:24.809534+0000","last_became_peered":"2023-11-24T08:05:24.809534+0000","last_unstale":"2023-11-24T08:05:25.783293+0000","last_undegraded":"2023-11-24T08:05:25.783293+0000","last_fullsized":"2023-11-24T08:05:25.783293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:01:54.060154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.783160+0000","last_change":"2023-11-24T08:05:24.804441+0000","last_active":"2023-11-24T08:05:25.783160+0000","last_peered":"2023-11-24T08:05:25.783160+0000","last_clean":"2023-11-24T08:05:25.783160+0000","last_became_active":"2023-11-24T08:05:24.804032+0000","last_became_peered":"2023-11-24T08:05:24.804032+0000","last_unstale":"2023-11-24T08:05:25.783160+0000","last_undegraded":"2023-11-24T08:05:25.783160+0000","last_fullsized":"2023-11-24T08:05:25.783160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:59.799830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782972+0000","last_change":"2023-11-24T08:05:24.807034+0000","last_active":"2023-11-24T08:05:25.782972+0000","last_peered":"2023-11-24T08:05:25.782972+0000","last_clean":"2023-11-24T08:05:25.782972+0000","last_became_active":"2023-11-24T08:05:24.806755+0000","last_became_peered":"2023-11-24T08:05:24.806755+0000","last_unstale":"2023-11-24T08:05:25.782972+0000","last_undegraded":"2023-11-24T08:05:25.782972+0000","last_fullsized":"2023-11-24T08:05:25.782972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:33.492998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.078683+0000","last_change":"2023-11-24T08:05:24.797897+0000","last_active":"2023-11-24T08:05:26.078683+0000","last_peered":"2023-11-24T08:05:26.078683+0000","last_clean":"2023-11-24T08:05:26.078683+0000","last_became_active":"2023-11-24T08:05:24.797199+0000","last_became_peered":"2023-11-24T08:05:24.797199+0000","last_unstale":"2023-11-24T08:05:26.078683+0000","last_undegraded":"2023-11-24T08:05:26.078683+0000","last_fullsized":"2023-11-24T08:05:26.078683+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:46.521565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.781882+0000","last_change":"2023-11-24T08:05:24.798153+0000","last_active":"2023-11-24T08:05:25.781882+0000","last_peered":"2023-11-24T08:05:25.781882+0000","last_clean":"2023-11-24T08:05:25.781882+0000","last_became_active":"2023-11-24T08:05:24.797691+0000","last_became_peered":"2023-11-24T08:05:24.797691+0000","last_unstale":"2023-11-24T08:05:25.781882+0000","last_undegraded":"2023-11-24T08:05:25.781882+0000","last_fullsized":"2023-11-24T08:05:25.781882+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:57.924593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782631+0000","last_change":"2023-11-24T08:05:24.808948+0000","last_active":"2023-11-24T08:05:25.782631+0000","last_peered":"2023-11-24T08:05:25.782631+0000","last_clean":"2023-11-24T08:05:25.782631+0000","last_became_active":"2023-11-24T08:05:24.808650+0000","last_became_peered":"2023-11-24T08:05:24.808650+0000","last_unstale":"2023-11-24T08:05:25.782631+0000","last_undegraded":"2023-11-24T08:05:25.782631+0000","last_fullsized":"2023-11-24T08:05:25.782631+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:50.261950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.634988+0000","last_change":"2023-11-24T08:05:24.795053+0000","last_active":"2023-11-24T08:05:26.634988+0000","last_peered":"2023-11-24T08:05:26.634988+0000","last_clean":"2023-11-24T08:05:26.634988+0000","last_became_active":"2023-11-24T08:05:24.794617+0000","last_became_peered":"2023-11-24T08:05:24.794617+0000","last_unstale":"2023-11-24T08:05:26.634988+0000","last_undegraded":"2023-11-24T08:05:26.634988+0000","last_fullsized":"2023-11-24T08:05:26.634988+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:48.216851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.478995+0000","last_change":"2023-11-24T08:05:24.795258+0000","last_active":"2023-11-24T08:05:26.478995+0000","last_peered":"2023-11-24T08:05:26.478995+0000","last_clean":"2023-11-24T08:05:26.478995+0000","last_became_active":"2023-11-24T08:05:24.794956+0000","last_became_peered":"2023-11-24T08:05:24.794956+0000","last_unstale":"2023-11-24T08:05:26.478995+0000","last_undegraded":"2023-11-24T08:05:26.478995+0000","last_fullsized":"2023-11-24T08:05:26.478995+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:32.463157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.407375+0000","last_change":"2023-11-24T08:05:24.794729+0000","last_active":"2023-11-24T08:05:27.407375+0000","last_peered":"2023-11-24T08:05:27.407375+0000","last_clean":"2023-11-24T08:05:27.407375+0000","last_became_active":"2023-11-24T08:05:24.794319+0000","last_became_peered":"2023-11-24T08:05:24.794319+0000","last_unstale":"2023-11-24T08:05:27.407375+0000","last_undegraded":"2023-11-24T08:05:27.407375+0000","last_fullsized":"2023-11-24T08:05:27.407375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:48.874005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.407234+0000","last_change":"2023-11-24T08:05:24.811835+0000","last_active":"2023-11-24T08:05:27.407234+0000","last_peered":"2023-11-24T08:05:27.407234+0000","last_clean":"2023-11-24T08:05:27.407234+0000","last_became_active":"2023-11-24T08:05:24.811546+0000","last_became_peered":"2023-11-24T08:05:24.811546+0000","last_unstale":"2023-11-24T08:05:27.407234+0000","last_undegraded":"2023-11-24T08:05:27.407234+0000","last_fullsized":"2023-11-24T08:05:27.407234+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:35.592590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479421+0000","last_change":"2023-11-24T08:05:24.807853+0000","last_active":"2023-11-24T08:05:26.479421+0000","last_peered":"2023-11-24T08:05:26.479421+0000","last_clean":"2023-11-24T08:05:26.479421+0000","last_became_active":"2023-11-24T08:05:24.804890+0000","last_became_peered":"2023-11-24T08:05:24.804890+0000","last_unstale":"2023-11-24T08:05:26.479421+0000","last_undegraded":"2023-11-24T08:05:26.479421+0000","last_fullsized":"2023-11-24T08:05:26.479421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:33.984871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782083+0000","last_change":"2023-11-24T08:05:24.804875+0000","last_active":"2023-11-24T08:05:25.782083+0000","last_peered":"2023-11-24T08:05:25.782083+0000","last_clean":"2023-11-24T08:05:25.782083+0000","last_became_active":"2023-11-24T08:05:24.804578+0000","last_became_peered":"2023-11-24T08:05:24.804578+0000","last_unstale":"2023-11-24T08:05:25.782083+0000","last_undegraded":"2023-11-24T08:05:25.782083+0000","last_fullsized":"2023-11-24T08:05:25.782083+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:56.270806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635147+0000","last_change":"2023-11-24T08:05:24.794384+0000","last_active":"2023-11-24T08:05:26.635147+0000","last_peered":"2023-11-24T08:05:26.635147+0000","last_clean":"2023-11-24T08:05:26.635147+0000","last_became_active":"2023-11-24T08:05:24.794053+0000","last_became_peered":"2023-11-24T08:05:24.794053+0000","last_unstale":"2023-11-24T08:05:26.635147+0000","last_undegraded":"2023-11-24T08:05:26.635147+0000","last_fullsized":"2023-11-24T08:05:26.635147+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:59.051148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782770+0000","last_change":"2023-11-24T08:05:24.796072+0000","last_active":"2023-11-24T08:05:25.782770+0000","last_peered":"2023-11-24T08:05:25.782770+0000","last_clean":"2023-11-24T08:05:25.782770+0000","last_became_active":"2023-11-24T08:05:24.795732+0000","last_became_peered":"2023-11-24T08:05:24.795732+0000","last_unstale":"2023-11-24T08:05:25.782770+0000","last_undegraded":"2023-11-24T08:05:25.782770+0000","last_fullsized":"2023-11-24T08:05:25.782770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:11.564017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479025+0000","last_change":"2023-11-24T08:05:24.809693+0000","last_active":"2023-11-24T08:05:26.479025+0000","last_peered":"2023-11-24T08:05:26.479025+0000","last_clean":"2023-11-24T08:05:26.479025+0000","last_became_active":"2023-11-24T08:05:24.809223+0000","last_became_peered":"2023-11-24T08:05:24.809223+0000","last_unstale":"2023-11-24T08:05:26.479025+0000","last_undegraded":"2023-11-24T08:05:26.479025+0000","last_fullsized":"2023-11-24T08:05:26.479025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:45:34.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479025+0000","last_change":"2023-11-24T08:05:24.811467+0000","last_active":"2023-11-24T08:05:26.479025+0000","last_peered":"2023-11-24T08:05:26.479025+0000","last_clean":"2023-11-24T08:05:26.479025+0000","last_became_active":"2023-11-24T08:05:24.811225+0000","last_became_peered":"2023-11-24T08:05:24.811225+0000","last_unstale":"2023-11-24T08:05:26.479025+0000","last_undegraded":"2023-11-24T08:05:26.479025+0000","last_fullsized":"2023-11-24T08:05:26.479025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:14:04.586739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479529+0000","last_change":"2023-11-24T08:05:24.808178+0000","last_active":"2023-11-24T08:05:26.479529+0000","last_peered":"2023-11-24T08:05:26.479529+0000","last_clean":"2023-11-24T08:05:26.479529+0000","last_became_active":"2023-11-24T08:05:24.807918+0000","last_became_peered":"2023-11-24T08:05:24.807918+0000","last_unstale":"2023-11-24T08:05:26.479529+0000","last_undegraded":"2023-11-24T08:05:26.479529+0000","last_fullsized":"2023-11-24T08:05:26.479529+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782126+0000","last_change":"2023-11-24T08:05:24.804744+0000","last_active":"2023-11-24T08:05:25.782126+0000","last_peered":"2023-11-24T08:05:25.782126+0000","last_clean":"2023-11-24T08:05:25.782126+0000","last_became_active":"2023-11-24T08:05:24.804339+0000","last_became_peered":"2023-11-24T08:05:24.804339+0000","last_unstale":"2023-11-24T08:05:25.782126+0000","last_undegraded":"2023-11-24T08:05:25.782126+0000","last_fullsized":"2023-11-24T08:05:25.782126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:35.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.407160+0000","last_change":"2023-11-24T08:05:24.795287+0000","last_active":"2023-11-24T08:05:27.407160+0000","last_peered":"2023-11-24T08:05:27.407160+0000","last_clean":"2023-11-24T08:05:27.407160+0000","last_became_active":"2023-11-24T08:05:24.795029+0000","last_became_peered":"2023-11-24T08:05:24.795029+0000","last_unstale":"2023-11-24T08:05:27.407160+0000","last_undegraded":"2023-11-24T08:05:27.407160+0000","last_fullsized":"2023-11-24T08:05:27.407160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:16.355430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.078695+0000","last_change":"2023-11-24T08:05:24.801769+0000","last_active":"2023-11-24T08:05:26.078695+0000","last_peered":"2023-11-24T08:05:26.078695+0000","last_clean":"2023-11-24T08:05:26.078695+0000","last_became_active":"2023-11-24T08:05:24.801503+0000","last_became_peered":"2023-11-24T08:05:24.801503+0000","last_unstale":"2023-11-24T08:05:26.078695+0000","last_undegraded":"2023-11-24T08:05:26.078695+0000","last_fullsized":"2023-11-24T08:05:26.078695+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:48.874005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479223+0000","last_change":"2023-11-24T08:05:24.808950+0000","last_active":"2023-11-24T08:05:26.479223+0000","last_peered":"2023-11-24T08:05:26.479223+0000","last_clean":"2023-11-24T08:05:26.479223+0000","last_became_active":"2023-11-24T08:05:24.808294+0000","last_became_peered":"2023-11-24T08:05:24.808294+0000","last_unstale":"2023-11-24T08:05:26.479223+0000","last_undegraded":"2023-11-24T08:05:26.479223+0000","last_fullsized":"2023-11-24T08:05:26.479223+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:05.991710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.406991+0000","last_change":"2023-11-24T08:05:24.801554+0000","last_active":"2023-11-24T08:05:27.406991+0000","last_peered":"2023-11-24T08:05:27.406991+0000","last_clean":"2023-11-24T08:05:27.406991+0000","last_became_active":"2023-11-24T08:05:24.801207+0000","last_became_peered":"2023-11-24T08:05:24.801207+0000","last_unstale":"2023-11-24T08:05:27.406991+0000","last_undegraded":"2023-11-24T08:05:27.406991+0000","last_fullsized":"2023-11-24T08:05:27.406991+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:36.231594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635030+0000","last_change":"2023-11-24T08:05:24.792493+0000","last_active":"2023-11-24T08:05:26.635030+0000","last_peered":"2023-11-24T08:05:26.635030+0000","last_clean":"2023-11-24T08:05:26.635030+0000","last_became_active":"2023-11-24T08:05:24.789895+0000","last_became_peered":"2023-11-24T08:05:24.789895+0000","last_unstale":"2023-11-24T08:05:26.635030+0000","last_undegraded":"2023-11-24T08:05:26.635030+0000","last_fullsized":"2023-11-24T08:05:26.635030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:20:26.668855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.781944+0000","last_change":"2023-11-24T08:05:24.804224+0000","last_active":"2023-11-24T08:05:25.781944+0000","last_peered":"2023-11-24T08:05:25.781944+0000","last_clean":"2023-11-24T08:05:25.781944+0000","last_became_active":"2023-11-24T08:05:24.803814+0000","last_became_peered":"2023-11-24T08:05:24.803814+0000","last_unstale":"2023-11-24T08:05:25.781944+0000","last_undegraded":"2023-11-24T08:05:25.781944+0000","last_fullsized":"2023-11-24T08:05:25.781944+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:08:20.963516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.936329+0000","last_change":"2023-11-24T08:05:24.807630+0000","last_active":"2023-11-24T08:05:25.936329+0000","last_peered":"2023-11-24T08:05:25.936329+0000","last_clean":"2023-11-24T08:05:25.936329+0000","last_became_active":"2023-11-24T08:05:24.807158+0000","last_became_peered":"2023-11-24T08:05:24.807158+0000","last_unstale":"2023-11-24T08:05:25.936329+0000","last_undegraded":"2023-11-24T08:05:25.936329+0000","last_fullsized":"2023-11-24T08:05:25.936329+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.714063+0000","last_change":"2023-11-24T08:05:23.789734+0000","last_active":"2023-11-24T08:05:25.714063+0000","last_peered":"2023-11-24T08:05:25.714063+0000","last_clean":"2023-11-24T08:05:25.714063+0000","last_became_active":"2023-11-24T08:05:23.789448+0000","last_became_peered":"2023-11-24T08:05:23.789448+0000","last_unstale":"2023-11-24T08:05:25.714063+0000","last_undegraded":"2023-11-24T08:05:25.714063+0000","last_fullsized":"2023-11-24T08:05:25.714063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:42:15.341563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479575+0000","last_change":"2023-11-24T08:05:24.793485+0000","last_active":"2023-11-24T08:05:26.479575+0000","last_peered":"2023-11-24T08:05:26.479575+0000","last_clean":"2023-11-24T08:05:26.479575+0000","last_became_active":"2023-11-24T08:05:24.793195+0000","last_became_peered":"2023-11-24T08:05:24.793195+0000","last_unstale":"2023-11-24T08:05:26.479575+0000","last_undegraded":"2023-11-24T08:05:26.479575+0000","last_fullsized":"2023-11-24T08:05:26.479575+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:24.802223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705263+0000","last_change":"2023-11-24T08:05:23.781005+0000","last_active":"2023-11-24T08:05:25.705263+0000","last_peered":"2023-11-24T08:05:25.705263+0000","last_clean":"2023-11-24T08:05:25.705263+0000","last_became_active":"2023-11-24T08:05:23.780655+0000","last_became_peered":"2023-11-24T08:05:23.780655+0000","last_unstale":"2023-11-24T08:05:25.705263+0000","last_undegraded":"2023-11-24T08:05:25.705263+0000","last_fullsized":"2023-11-24T08:05:25.705263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:05.273157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.078792+0000","last_change":"2023-11-24T08:05:24.796295+0000","last_active":"2023-11-24T08:05:26.078792+0000","last_peered":"2023-11-24T08:05:26.078792+0000","last_clean":"2023-11-24T08:05:26.078792+0000","last_became_active":"2023-11-24T08:05:24.796051+0000","last_became_peered":"2023-11-24T08:05:24.796051+0000","last_unstale":"2023-11-24T08:05:26.078792+0000","last_undegraded":"2023-11-24T08:05:26.078792+0000","last_fullsized":"2023-11-24T08:05:26.078792+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:47.196156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.708171+0000","last_change":"2023-11-24T08:05:23.785930+0000","last_active":"2023-11-24T08:05:25.708171+0000","last_peered":"2023-11-24T08:05:25.708171+0000","last_clean":"2023-11-24T08:05:25.708171+0000","last_became_active":"2023-11-24T08:05:23.785575+0000","last_became_peered":"2023-11-24T08:05:23.785575+0000","last_unstale":"2023-11-24T08:05:25.708171+0000","last_undegraded":"2023-11-24T08:05:25.708171+0000","last_fullsized":"2023-11-24T08:05:25.708171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:45.042279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.936318+0000","last_change":"2023-11-24T08:05:24.801199+0000","last_active":"2023-11-24T08:05:25.936318+0000","last_peered":"2023-11-24T08:05:25.936318+0000","last_clean":"2023-11-24T08:05:25.936318+0000","last_became_active":"2023-11-24T08:05:24.799824+0000","last_became_peered":"2023-11-24T08:05:24.799824+0000","last_unstale":"2023-11-24T08:05:25.936318+0000","last_undegraded":"2023-11-24T08:05:25.936318+0000","last_fullsized":"2023-11-24T08:05:25.936318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:06.287024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705402+0000","last_change":"2023-11-24T08:05:23.786066+0000","last_active":"2023-11-24T08:05:25.705402+0000","last_peered":"2023-11-24T08:05:25.705402+0000","last_clean":"2023-11-24T08:05:25.705402+0000","last_became_active":"2023-11-24T08:05:23.785789+0000","last_became_peered":"2023-11-24T08:05:23.785789+0000","last_unstale":"2023-11-24T08:05:25.705402+0000","last_undegraded":"2023-11-24T08:05:25.705402+0000","last_fullsized":"2023-11-24T08:05:25.705402+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.406999+0000","last_change":"2023-11-24T08:05:24.793986+0000","last_active":"2023-11-24T08:05:27.406999+0000","last_peered":"2023-11-24T08:05:27.406999+0000","last_clean":"2023-11-24T08:05:27.406999+0000","last_became_active":"2023-11-24T08:05:24.793719+0000","last_became_peered":"2023-11-24T08:05:24.793719+0000","last_unstale":"2023-11-24T08:05:27.406999+0000","last_undegraded":"2023-11-24T08:05:27.406999+0000","last_fullsized":"2023-11-24T08:05:27.406999+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:01.420207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.714008+0000","last_change":"2023-11-24T08:05:23.786132+0000","last_active":"2023-11-24T08:05:25.714008+0000","last_peered":"2023-11-24T08:05:25.714008+0000","last_clean":"2023-11-24T08:05:25.714008+0000","last_became_active":"2023-11-24T08:05:23.785846+0000","last_became_peered":"2023-11-24T08:05:23.785846+0000","last_unstale":"2023-11-24T08:05:25.714008+0000","last_undegraded":"2023-11-24T08:05:25.714008+0000","last_fullsized":"2023-11-24T08:05:25.714008+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782804+0000","last_change":"2023-11-24T08:05:24.805092+0000","last_active":"2023-11-24T08:05:25.782804+0000","last_peered":"2023-11-24T08:05:25.782804+0000","last_clean":"2023-11-24T08:05:25.782804+0000","last_became_active":"2023-11-24T08:05:24.804798+0000","last_became_peered":"2023-11-24T08:05:24.804798+0000","last_unstale":"2023-11-24T08:05:25.782804+0000","last_undegraded":"2023-11-24T08:05:25.782804+0000","last_fullsized":"2023-11-24T08:05:25.782804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:05.178406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705165+0000","last_change":"2023-11-24T08:05:23.782383+0000","last_active":"2023-11-24T08:05:25.705165+0000","last_peered":"2023-11-24T08:05:25.705165+0000","last_clean":"2023-11-24T08:05:25.705165+0000","last_became_active":"2023-11-24T08:05:23.782077+0000","last_became_peered":"2023-11-24T08:05:23.782077+0000","last_unstale":"2023-11-24T08:05:25.705165+0000","last_undegraded":"2023-11-24T08:05:25.705165+0000","last_fullsized":"2023-11-24T08:05:25.705165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:00.714376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782520+0000","last_change":"2023-11-24T08:05:24.798868+0000","last_active":"2023-11-24T08:05:25.782520+0000","last_peered":"2023-11-24T08:05:25.782520+0000","last_clean":"2023-11-24T08:05:25.782520+0000","last_became_active":"2023-11-24T08:05:24.798118+0000","last_became_peered":"2023-11-24T08:05:24.798118+0000","last_unstale":"2023-11-24T08:05:25.782520+0000","last_undegraded":"2023-11-24T08:05:25.782520+0000","last_fullsized":"2023-11-24T08:05:25.782520+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:35:57.605765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.709632+0000","last_change":"2023-11-24T08:05:23.786361+0000","last_active":"2023-11-24T08:05:25.709632+0000","last_peered":"2023-11-24T08:05:25.709632+0000","last_clean":"2023-11-24T08:05:25.709632+0000","last_became_active":"2023-11-24T08:05:23.786102+0000","last_became_peered":"2023-11-24T08:05:23.786102+0000","last_unstale":"2023-11-24T08:05:25.709632+0000","last_undegraded":"2023-11-24T08:05:25.709632+0000","last_fullsized":"2023-11-24T08:05:25.709632+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:55:48.278067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479166+0000","last_change":"2023-11-24T08:05:24.809467+0000","last_active":"2023-11-24T08:05:26.479166+0000","last_peered":"2023-11-24T08:05:26.479166+0000","last_clean":"2023-11-24T08:05:26.479166+0000","last_became_active":"2023-11-24T08:05:24.808871+0000","last_became_peered":"2023-11-24T08:05:24.808871+0000","last_unstale":"2023-11-24T08:05:26.479166+0000","last_undegraded":"2023-11-24T08:05:26.479166+0000","last_fullsized":"2023-11-24T08:05:26.479166+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:01.728243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.787206+0000","last_change":"2023-11-24T08:05:23.779563+0000","last_active":"2023-11-24T08:05:24.787206+0000","last_peered":"2023-11-24T08:05:24.787206+0000","last_clean":"2023-11-24T08:05:24.787206+0000","last_became_active":"2023-11-24T08:05:23.779281+0000","last_became_peered":"2023-11-24T08:05:23.779281+0000","last_unstale":"2023-11-24T08:05:24.787206+0000","last_undegraded":"2023-11-24T08:05:24.787206+0000","last_fullsized":"2023-11-24T08:05:24.787206+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:53.236136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.407330+0000","last_change":"2023-11-24T08:05:24.807194+0000","last_active":"2023-11-24T08:05:27.407330+0000","last_peered":"2023-11-24T08:05:27.407330+0000","last_clean":"2023-11-24T08:05:27.407330+0000","last_became_active":"2023-11-24T08:05:24.806869+0000","last_became_peered":"2023-11-24T08:05:24.806869+0000","last_unstale":"2023-11-24T08:05:27.407330+0000","last_undegraded":"2023-11-24T08:05:27.407330+0000","last_fullsized":"2023-11-24T08:05:27.407330+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:46.521565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705303+0000","last_change":"2023-11-24T08:05:23.778824+0000","last_active":"2023-11-24T08:05:25.705303+0000","last_peered":"2023-11-24T08:05:25.705303+0000","last_clean":"2023-11-24T08:05:25.705303+0000","last_became_active":"2023-11-24T08:05:23.778462+0000","last_became_peered":"2023-11-24T08:05:23.778462+0000","last_unstale":"2023-11-24T08:05:25.705303+0000","last_undegraded":"2023-11-24T08:05:25.705303+0000","last_fullsized":"2023-11-24T08:05:25.705303+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782919+0000","last_change":"2023-11-24T08:05:24.806424+0000","last_active":"2023-11-24T08:05:25.782919+0000","last_peered":"2023-11-24T08:05:25.782919+0000","last_clean":"2023-11-24T08:05:25.782919+0000","last_became_active":"2023-11-24T08:05:24.806143+0000","last_became_peered":"2023-11-24T08:05:24.806143+0000","last_unstale":"2023-11-24T08:05:25.782919+0000","last_undegraded":"2023-11-24T08:05:25.782919+0000","last_fullsized":"2023-11-24T08:05:25.782919+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:21:44.439548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.792329+0000","last_change":"2023-11-24T08:05:23.777987+0000","last_active":"2023-11-24T08:05:24.792329+0000","last_peered":"2023-11-24T08:05:24.792329+0000","last_clean":"2023-11-24T08:05:24.792329+0000","last_became_active":"2023-11-24T08:05:23.777197+0000","last_became_peered":"2023-11-24T08:05:23.777197+0000","last_unstale":"2023-11-24T08:05:24.792329+0000","last_undegraded":"2023-11-24T08:05:24.792329+0000","last_fullsized":"2023-11-24T08:05:24.792329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:19:09.684620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635356+0000","last_change":"2023-11-24T08:05:24.803406+0000","last_active":"2023-11-24T08:05:26.635356+0000","last_peered":"2023-11-24T08:05:26.635356+0000","last_clean":"2023-11-24T08:05:26.635356+0000","last_became_active":"2023-11-24T08:05:24.803027+0000","last_became_peered":"2023-11-24T08:05:24.803027+0000","last_unstale":"2023-11-24T08:05:26.635356+0000","last_undegraded":"2023-11-24T08:05:26.635356+0000","last_fullsized":"2023-11-24T08:05:26.635356+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:10.014682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705434+0000","last_change":"2023-11-24T08:05:23.793340+0000","last_active":"2023-11-24T08:05:25.705434+0000","last_peered":"2023-11-24T08:05:25.705434+0000","last_clean":"2023-11-24T08:05:25.705434+0000","last_became_active":"2023-11-24T08:05:23.792687+0000","last_became_peered":"2023-11-24T08:05:23.792687+0000","last_unstale":"2023-11-24T08:05:25.705434+0000","last_undegraded":"2023-11-24T08:05:25.705434+0000","last_fullsized":"2023-11-24T08:05:25.705434+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:48.296413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782873+0000","last_change":"2023-11-24T08:05:24.816525+0000","last_active":"2023-11-24T08:05:25.782873+0000","last_peered":"2023-11-24T08:05:25.782873+0000","last_clean":"2023-11-24T08:05:25.782873+0000","last_became_active":"2023-11-24T08:05:24.816253+0000","last_became_peered":"2023-11-24T08:05:24.816253+0000","last_unstale":"2023-11-24T08:05:25.782873+0000","last_undegraded":"2023-11-24T08:05:25.782873+0000","last_fullsized":"2023-11-24T08:05:25.782873+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:04:47.196156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.707876+0000","last_change":"2023-11-24T08:05:23.780472+0000","last_active":"2023-11-24T08:05:25.707876+0000","last_peered":"2023-11-24T08:05:25.707876+0000","last_clean":"2023-11-24T08:05:25.707876+0000","last_became_active":"2023-11-24T08:05:23.780179+0000","last_became_peered":"2023-11-24T08:05:23.780179+0000","last_unstale":"2023-11-24T08:05:25.707876+0000","last_undegraded":"2023-11-24T08:05:25.707876+0000","last_fullsized":"2023-11-24T08:05:25.707876+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:34.866637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479249+0000","last_change":"2023-11-24T08:05:24.807288+0000","last_active":"2023-11-24T08:05:26.479249+0000","last_peered":"2023-11-24T08:05:26.479249+0000","last_clean":"2023-11-24T08:05:26.479249+0000","last_became_active":"2023-11-24T08:05:24.807002+0000","last_became_peered":"2023-11-24T08:05:24.807002+0000","last_unstale":"2023-11-24T08:05:26.479249+0000","last_undegraded":"2023-11-24T08:05:26.479249+0000","last_fullsized":"2023-11-24T08:05:26.479249+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:07.098038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.714019+0000","last_change":"2023-11-24T08:05:23.785359+0000","last_active":"2023-11-24T08:05:25.714019+0000","last_peered":"2023-11-24T08:05:25.714019+0000","last_clean":"2023-11-24T08:05:25.714019+0000","last_became_active":"2023-11-24T08:05:23.784845+0000","last_became_peered":"2023-11-24T08:05:23.784845+0000","last_unstale":"2023-11-24T08:05:25.714019+0000","last_undegraded":"2023-11-24T08:05:25.714019+0000","last_fullsized":"2023-11-24T08:05:25.714019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:40:45.507698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782985+0000","last_change":"2023-11-24T08:05:24.804919+0000","last_active":"2023-11-24T08:05:25.782985+0000","last_peered":"2023-11-24T08:05:25.782985+0000","last_clean":"2023-11-24T08:05:25.782985+0000","last_became_active":"2023-11-24T08:05:24.804612+0000","last_became_peered":"2023-11-24T08:05:24.804612+0000","last_unstale":"2023-11-24T08:05:25.782985+0000","last_undegraded":"2023-11-24T08:05:25.782985+0000","last_fullsized":"2023-11-24T08:05:25.782985+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:45:27.075000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705377+0000","last_change":"2023-11-24T08:05:23.785562+0000","last_active":"2023-11-24T08:05:25.705377+0000","last_peered":"2023-11-24T08:05:25.705377+0000","last_clean":"2023-11-24T08:05:25.705377+0000","last_became_active":"2023-11-24T08:05:23.785261+0000","last_became_peered":"2023-11-24T08:05:23.785261+0000","last_unstale":"2023-11-24T08:05:25.705377+0000","last_undegraded":"2023-11-24T08:05:25.705377+0000","last_fullsized":"2023-11-24T08:05:25.705377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.634951+0000","last_change":"2023-11-24T08:05:24.797229+0000","last_active":"2023-11-24T08:05:26.634951+0000","last_peered":"2023-11-24T08:05:26.634951+0000","last_clean":"2023-11-24T08:05:26.634951+0000","last_became_active":"2023-11-24T08:05:24.796863+0000","last_became_peered":"2023-11-24T08:05:24.796863+0000","last_unstale":"2023-11-24T08:05:26.634951+0000","last_undegraded":"2023-11-24T08:05:26.634951+0000","last_fullsized":"2023-11-24T08:05:26.634951+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:42.589514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.713956+0000","last_change":"2023-11-24T08:05:23.783807+0000","last_active":"2023-11-24T08:05:25.713956+0000","last_peered":"2023-11-24T08:05:25.713956+0000","last_clean":"2023-11-24T08:05:25.713956+0000","last_became_active":"2023-11-24T08:05:23.783504+0000","last_became_peered":"2023-11-24T08:05:23.783504+0000","last_unstale":"2023-11-24T08:05:25.713956+0000","last_undegraded":"2023-11-24T08:05:25.713956+0000","last_fullsized":"2023-11-24T08:05:25.713956+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:36:07.077115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782804+0000","last_change":"2023-11-24T08:05:24.813482+0000","last_active":"2023-11-24T08:05:25.782804+0000","last_peered":"2023-11-24T08:05:25.782804+0000","last_clean":"2023-11-24T08:05:25.782804+0000","last_became_active":"2023-11-24T08:05:24.813159+0000","last_became_peered":"2023-11-24T08:05:24.813159+0000","last_unstale":"2023-11-24T08:05:25.782804+0000","last_undegraded":"2023-11-24T08:05:25.782804+0000","last_fullsized":"2023-11-24T08:05:25.782804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:48.874005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.826960+0000","last_change":"2023-11-24T08:05:23.782857+0000","last_active":"2023-11-24T08:05:24.826960+0000","last_peered":"2023-11-24T08:05:24.826960+0000","last_clean":"2023-11-24T08:05:24.826960+0000","last_became_active":"2023-11-24T08:05:23.782637+0000","last_became_peered":"2023-11-24T08:05:23.782637+0000","last_unstale":"2023-11-24T08:05:24.826960+0000","last_undegraded":"2023-11-24T08:05:24.826960+0000","last_fullsized":"2023-11-24T08:05:24.826960+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:57:02.135837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782385+0000","last_change":"2023-11-24T08:05:24.793310+0000","last_active":"2023-11-24T08:05:25.782385+0000","last_peered":"2023-11-24T08:05:25.782385+0000","last_clean":"2023-11-24T08:05:25.782385+0000","last_became_active":"2023-11-24T08:05:24.792934+0000","last_became_peered":"2023-11-24T08:05:24.792934+0000","last_unstale":"2023-11-24T08:05:25.782385+0000","last_undegraded":"2023-11-24T08:05:25.782385+0000","last_fullsized":"2023-11-24T08:05:25.782385+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:46:21.670193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.707926+0000","last_change":"2023-11-24T08:05:23.791769+0000","last_active":"2023-11-24T08:05:25.707926+0000","last_peered":"2023-11-24T08:05:25.707926+0000","last_clean":"2023-11-24T08:05:25.707926+0000","last_became_active":"2023-11-24T08:05:23.790624+0000","last_became_peered":"2023-11-24T08:05:23.790624+0000","last_unstale":"2023-11-24T08:05:25.707926+0000","last_undegraded":"2023-11-24T08:05:25.707926+0000","last_fullsized":"2023-11-24T08:05:25.707926+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:43:02.701487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.783265+0000","last_change":"2023-11-24T08:05:24.796149+0000","last_active":"2023-11-24T08:05:25.783265+0000","last_peered":"2023-11-24T08:05:25.783265+0000","last_clean":"2023-11-24T08:05:25.783265+0000","last_became_active":"2023-11-24T08:05:24.794353+0000","last_became_peered":"2023-11-24T08:05:24.794353+0000","last_unstale":"2023-11-24T08:05:25.783265+0000","last_undegraded":"2023-11-24T08:05:25.783265+0000","last_fullsized":"2023-11-24T08:05:25.783265+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:58:34.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705281+0000","last_change":"2023-11-24T08:05:23.785405+0000","last_active":"2023-11-24T08:05:25.705281+0000","last_peered":"2023-11-24T08:05:25.705281+0000","last_clean":"2023-11-24T08:05:25.705281+0000","last_became_active":"2023-11-24T08:05:23.785104+0000","last_became_peered":"2023-11-24T08:05:23.785104+0000","last_unstale":"2023-11-24T08:05:25.705281+0000","last_undegraded":"2023-11-24T08:05:25.705281+0000","last_fullsized":"2023-11-24T08:05:25.705281+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:22.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479295+0000","last_change":"2023-11-24T08:05:24.803826+0000","last_active":"2023-11-24T08:05:26.479295+0000","last_peered":"2023-11-24T08:05:26.479295+0000","last_clean":"2023-11-24T08:05:26.479295+0000","last_became_active":"2023-11-24T08:05:24.803535+0000","last_became_peered":"2023-11-24T08:05:24.803535+0000","last_unstale":"2023-11-24T08:05:26.479295+0000","last_undegraded":"2023-11-24T08:05:26.479295+0000","last_fullsized":"2023-11-24T08:05:26.479295+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:46.056146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.709697+0000","last_change":"2023-11-24T08:05:23.790238+0000","last_active":"2023-11-24T08:05:25.709697+0000","last_peered":"2023-11-24T08:05:25.709697+0000","last_clean":"2023-11-24T08:05:25.709697+0000","last_became_active":"2023-11-24T08:05:23.789980+0000","last_became_peered":"2023-11-24T08:05:23.789980+0000","last_unstale":"2023-11-24T08:05:25.709697+0000","last_undegraded":"2023-11-24T08:05:25.709697+0000","last_fullsized":"2023-11-24T08:05:25.709697+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:29:35.217727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479441+0000","last_change":"2023-11-24T08:05:24.800737+0000","last_active":"2023-11-24T08:05:26.479441+0000","last_peered":"2023-11-24T08:05:26.479441+0000","last_clean":"2023-11-24T08:05:26.479441+0000","last_became_active":"2023-11-24T08:05:24.800410+0000","last_became_peered":"2023-11-24T08:05:24.800410+0000","last_unstale":"2023-11-24T08:05:26.479441+0000","last_undegraded":"2023-11-24T08:05:26.479441+0000","last_fullsized":"2023-11-24T08:05:26.479441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:23.875555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.714046+0000","last_change":"2023-11-24T08:05:23.787803+0000","last_active":"2023-11-24T08:05:25.714046+0000","last_peered":"2023-11-24T08:05:25.714046+0000","last_clean":"2023-11-24T08:05:25.714046+0000","last_became_active":"2023-11-24T08:05:23.787536+0000","last_became_peered":"2023-11-24T08:05:23.787536+0000","last_unstale":"2023-11-24T08:05:25.714046+0000","last_undegraded":"2023-11-24T08:05:25.714046+0000","last_fullsized":"2023-11-24T08:05:25.714046+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:47.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635076+0000","last_change":"2023-11-24T08:05:24.797504+0000","last_active":"2023-11-24T08:05:26.635076+0000","last_peered":"2023-11-24T08:05:26.635076+0000","last_clean":"2023-11-24T08:05:26.635076+0000","last_became_active":"2023-11-24T08:05:24.797158+0000","last_became_peered":"2023-11-24T08:05:24.797158+0000","last_unstale":"2023-11-24T08:05:26.635076+0000","last_undegraded":"2023-11-24T08:05:26.635076+0000","last_fullsized":"2023-11-24T08:05:26.635076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:52:17.957889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.714028+0000","last_change":"2023-11-24T08:05:23.786254+0000","last_active":"2023-11-24T08:05:25.714028+0000","last_peered":"2023-11-24T08:05:25.714028+0000","last_clean":"2023-11-24T08:05:25.714028+0000","last_became_active":"2023-11-24T08:05:23.786045+0000","last_became_peered":"2023-11-24T08:05:23.786045+0000","last_unstale":"2023-11-24T08:05:25.714028+0000","last_undegraded":"2023-11-24T08:05:25.714028+0000","last_fullsized":"2023-11-24T08:05:25.714028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:33:18.255758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.936108+0000","last_change":"2023-11-24T08:05:24.797939+0000","last_active":"2023-11-24T08:05:25.936108+0000","last_peered":"2023-11-24T08:05:25.936108+0000","last_clean":"2023-11-24T08:05:25.936108+0000","last_became_active":"2023-11-24T08:05:24.797670+0000","last_became_peered":"2023-11-24T08:05:24.797670+0000","last_unstale":"2023-11-24T08:05:25.936108+0000","last_undegraded":"2023-11-24T08:05:25.936108+0000","last_fullsized":"2023-11-24T08:05:25.936108+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:25:23.875555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.709643+0000","last_change":"2023-11-24T08:05:23.787871+0000","last_active":"2023-11-24T08:05:25.709643+0000","last_peered":"2023-11-24T08:05:25.709643+0000","last_clean":"2023-11-24T08:05:25.709643+0000","last_became_active":"2023-11-24T08:05:23.787606+0000","last_became_peered":"2023-11-24T08:05:23.787606+0000","last_unstale":"2023-11-24T08:05:25.709643+0000","last_undegraded":"2023-11-24T08:05:25.709643+0000","last_fullsized":"2023-11-24T08:05:25.709643+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:45.344663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.781834+0000","last_change":"2023-11-24T08:05:24.801445+0000","last_active":"2023-11-24T08:05:25.781834+0000","last_peered":"2023-11-24T08:05:25.781834+0000","last_clean":"2023-11-24T08:05:25.781834+0000","last_became_active":"2023-11-24T08:05:24.801146+0000","last_became_peered":"2023-11-24T08:05:24.801146+0000","last_unstale":"2023-11-24T08:05:25.781834+0000","last_undegraded":"2023-11-24T08:05:25.781834+0000","last_fullsized":"2023-11-24T08:05:25.781834+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:18:03.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.796793+0000","last_change":"2023-11-24T08:05:23.775594+0000","last_active":"2023-11-24T08:05:24.796793+0000","last_peered":"2023-11-24T08:05:24.796793+0000","last_clean":"2023-11-24T08:05:24.796793+0000","last_became_active":"2023-11-24T08:05:23.775204+0000","last_became_peered":"2023-11-24T08:05:23.775204+0000","last_unstale":"2023-11-24T08:05:24.796793+0000","last_undegraded":"2023-11-24T08:05:24.796793+0000","last_fullsized":"2023-11-24T08:05:24.796793+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:05:11.901416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.782613+0000","last_change":"2023-11-24T08:05:24.806533+0000","last_active":"2023-11-24T08:05:25.782613+0000","last_peered":"2023-11-24T08:05:25.782613+0000","last_clean":"2023-11-24T08:05:25.782613+0000","last_became_active":"2023-11-24T08:05:24.806251+0000","last_became_peered":"2023-11-24T08:05:24.806251+0000","last_unstale":"2023-11-24T08:05:25.782613+0000","last_undegraded":"2023-11-24T08:05:25.782613+0000","last_fullsized":"2023-11-24T08:05:25.782613+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:15:09.149669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705313+0000","last_change":"2023-11-24T08:05:23.788392+0000","last_active":"2023-11-24T08:05:25.705313+0000","last_peered":"2023-11-24T08:05:25.705313+0000","last_clean":"2023-11-24T08:05:25.705313+0000","last_became_active":"2023-11-24T08:05:23.788108+0000","last_became_peered":"2023-11-24T08:05:23.788108+0000","last_unstale":"2023-11-24T08:05:25.705313+0000","last_undegraded":"2023-11-24T08:05:25.705313+0000","last_fullsized":"2023-11-24T08:05:25.705313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:40:32.971004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.479611+0000","last_change":"2023-11-24T08:05:24.807026+0000","last_active":"2023-11-24T08:05:26.479611+0000","last_peered":"2023-11-24T08:05:26.479611+0000","last_clean":"2023-11-24T08:05:26.479611+0000","last_became_active":"2023-11-24T08:05:24.806282+0000","last_became_peered":"2023-11-24T08:05:24.806282+0000","last_unstale":"2023-11-24T08:05:26.479611+0000","last_undegraded":"2023-11-24T08:05:26.479611+0000","last_fullsized":"2023-11-24T08:05:26.479611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:17:46.358530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635622+0000","last_change":"2023-11-24T08:05:23.784376+0000","last_active":"2023-11-24T08:05:26.635622+0000","last_peered":"2023-11-24T08:05:26.635622+0000","last_clean":"2023-11-24T08:05:26.635622+0000","last_became_active":"2023-11-24T08:05:23.784088+0000","last_became_peered":"2023-11-24T08:05:23.784088+0000","last_unstale":"2023-11-24T08:05:26.635622+0000","last_undegraded":"2023-11-24T08:05:26.635622+0000","last_fullsized":"2023-11-24T08:05:26.635622+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.783045+0000","last_change":"2023-11-24T08:05:24.799624+0000","last_active":"2023-11-24T08:05:25.783045+0000","last_peered":"2023-11-24T08:05:25.783045+0000","last_clean":"2023-11-24T08:05:25.783045+0000","last_became_active":"2023-11-24T08:05:24.798890+0000","last_became_peered":"2023-11-24T08:05:24.798890+0000","last_unstale":"2023-11-24T08:05:25.783045+0000","last_undegraded":"2023-11-24T08:05:25.783045+0000","last_fullsized":"2023-11-24T08:05:25.783045+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:11:03.426431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705444+0000","last_change":"2023-11-24T08:05:23.793529+0000","last_active":"2023-11-24T08:05:25.705444+0000","last_peered":"2023-11-24T08:05:25.705444+0000","last_clean":"2023-11-24T08:05:25.705444+0000","last_became_active":"2023-11-24T08:05:23.793045+0000","last_became_peered":"2023-11-24T08:05:23.793045+0000","last_unstale":"2023-11-24T08:05:25.705444+0000","last_undegraded":"2023-11-24T08:05:25.705444+0000","last_fullsized":"2023-11-24T08:05:25.705444+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:34.578723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.783015+0000","last_change":"2023-11-24T08:05:24.810946+0000","last_active":"2023-11-24T08:05:25.783015+0000","last_peered":"2023-11-24T08:05:25.783015+0000","last_clean":"2023-11-24T08:05:25.783015+0000","last_became_active":"2023-11-24T08:05:24.810545+0000","last_became_peered":"2023-11-24T08:05:24.810545+0000","last_unstale":"2023-11-24T08:05:25.783015+0000","last_undegraded":"2023-11-24T08:05:25.783015+0000","last_fullsized":"2023-11-24T08:05:25.783015+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:44:04.593709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.708153+0000","last_change":"2023-11-24T08:05:23.786068+0000","last_active":"2023-11-24T08:05:25.708153+0000","last_peered":"2023-11-24T08:05:25.708153+0000","last_clean":"2023-11-24T08:05:25.708153+0000","last_became_active":"2023-11-24T08:05:23.785722+0000","last_became_peered":"2023-11-24T08:05:23.785722+0000","last_unstale":"2023-11-24T08:05:25.708153+0000","last_undegraded":"2023-11-24T08:05:25.708153+0000","last_fullsized":"2023-11-24T08:05:25.708153+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:06:06.084171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635318+0000","last_change":"2023-11-24T08:05:24.802279+0000","last_active":"2023-11-24T08:05:26.635318+0000","last_peered":"2023-11-24T08:05:26.635318+0000","last_clean":"2023-11-24T08:05:26.635318+0000","last_became_active":"2023-11-24T08:05:24.801966+0000","last_became_peered":"2023-11-24T08:05:24.801966+0000","last_unstale":"2023-11-24T08:05:26.635318+0000","last_undegraded":"2023-11-24T08:05:26.635318+0000","last_fullsized":"2023-11-24T08:05:26.635318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:49:41.290647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705388+0000","last_change":"2023-11-24T08:05:23.792778+0000","last_active":"2023-11-24T08:05:25.705388+0000","last_peered":"2023-11-24T08:05:25.705388+0000","last_clean":"2023-11-24T08:05:25.705388+0000","last_became_active":"2023-11-24T08:05:23.792486+0000","last_became_peered":"2023-11-24T08:05:23.792486+0000","last_unstale":"2023-11-24T08:05:25.705388+0000","last_undegraded":"2023-11-24T08:05:25.705388+0000","last_fullsized":"2023-11-24T08:05:25.705388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:05:00.406340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.635197+0000","last_change":"2023-11-24T08:05:24.797345+0000","last_active":"2023-11-24T08:05:26.635197+0000","last_peered":"2023-11-24T08:05:26.635197+0000","last_clean":"2023-11-24T08:05:26.635197+0000","last_became_active":"2023-11-24T08:05:24.797025+0000","last_became_peered":"2023-11-24T08:05:24.797025+0000","last_unstale":"2023-11-24T08:05:26.635197+0000","last_undegraded":"2023-11-24T08:05:26.635197+0000","last_fullsized":"2023-11-24T08:05:26.635197+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:44:01.400095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.705175+0000","last_change":"2023-11-24T08:05:23.782246+0000","last_active":"2023-11-24T08:05:25.705175+0000","last_peered":"2023-11-24T08:05:25.705175+0000","last_clean":"2023-11-24T08:05:25.705175+0000","last_became_active":"2023-11-24T08:05:23.781813+0000","last_became_peered":"2023-11-24T08:05:23.781813+0000","last_unstale":"2023-11-24T08:05:25.705175+0000","last_undegraded":"2023-11-24T08:05:25.705175+0000","last_fullsized":"2023-11-24T08:05:25.705175+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:26.078345+0000","last_change":"2023-11-24T08:05:24.799932+0000","last_active":"2023-11-24T08:05:26.078345+0000","last_peered":"2023-11-24T08:05:26.078345+0000","last_clean":"2023-11-24T08:05:26.078345+0000","last_became_active":"2023-11-24T08:05:24.799665+0000","last_became_peered":"2023-11-24T08:05:24.799665+0000","last_unstale":"2023-11-24T08:05:26.078345+0000","last_undegraded":"2023-11-24T08:05:26.078345+0000","last_fullsized":"2023-11-24T08:05:26.078345+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:37:49.310280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.708125+0000","last_change":"2023-11-24T08:05:23.788270+0000","last_active":"2023-11-24T08:05:25.708125+0000","last_peered":"2023-11-24T08:05:25.708125+0000","last_clean":"2023-11-24T08:05:25.708125+0000","last_became_active":"2023-11-24T08:05:23.788012+0000","last_became_peered":"2023-11-24T08:05:23.788012+0000","last_unstale":"2023-11-24T08:05:25.708125+0000","last_undegraded":"2023-11-24T08:05:25.708125+0000","last_fullsized":"2023-11-24T08:05:25.708125+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:04.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:27.406988+0000","last_change":"2023-11-24T08:05:24.808501+0000","last_active":"2023-11-24T08:05:27.406988+0000","last_peered":"2023-11-24T08:05:27.406988+0000","last_clean":"2023-11-24T08:05:27.406988+0000","last_became_active":"2023-11-24T08:05:24.808234+0000","last_became_peered":"2023-11-24T08:05:24.808234+0000","last_unstale":"2023-11-24T08:05:27.406988+0000","last_undegraded":"2023-11-24T08:05:27.406988+0000","last_fullsized":"2023-11-24T08:05:27.406988+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:09.347137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.787086+0000","last_change":"2023-11-24T08:05:23.785853+0000","last_active":"2023-11-24T08:05:24.787086+0000","last_peered":"2023-11-24T08:05:24.787086+0000","last_clean":"2023-11-24T08:05:24.787086+0000","last_became_active":"2023-11-24T08:05:23.785174+0000","last_became_peered":"2023-11-24T08:05:23.785174+0000","last_unstale":"2023-11-24T08:05:24.787086+0000","last_undegraded":"2023-11-24T08:05:24.787086+0000","last_fullsized":"2023-11-24T08:05:24.787086+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:22:44.681046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.783226+0000","last_change":"2023-11-24T08:05:24.803674+0000","last_active":"2023-11-24T08:05:25.783226+0000","last_peered":"2023-11-24T08:05:25.783226+0000","last_clean":"2023-11-24T08:05:25.783226+0000","last_became_active":"2023-11-24T08:05:24.803234+0000","last_became_peered":"2023-11-24T08:05:24.803234+0000","last_unstale":"2023-11-24T08:05:25.783226+0000","last_undegraded":"2023-11-24T08:05:25.783226+0000","last_fullsized":"2023-11-24T08:05:25.783226+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:23.752211+0000","last_clean_scrub_stamp":"2023-11-24T08:05:23.752211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:03:42.588027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:25.709723+0000","last_change":"2023-11-24T08:05:23.790128+0000","last_active":"2023-11-24T08:05:25.709723+0000","last_peered":"2023-11-24T08:05:25.709723+0000","last_clean":"2023-11-24T08:05:25.709723+0000","last_became_active":"2023-11-24T08:05:23.789847+0000","last_became_peered":"2023-11-24T08:05:23.789847+0000","last_unstale":"2023-11-24T08:05:25.709723+0000","last_undegraded":"2023-11-24T08:05:25.709723+0000","last_fullsized":"2023-11-24T08:05:25.709723+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:05:22.738344+0000","last_clean_scrub_stamp":"2023-11-24T08:05:22.738344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T20:00:08.333269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":185,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:05:24.795232+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:05:24.795232+0000","last_peered":"2023-11-24T08:05:24.795232+0000","last_clean":"2023-11-24T08:05:24.795232+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:05:24.795232+0000","last_undegraded":"2023-11-24T08:05:24.795232+0000","last_fullsized":"2023-11-24T08:05:24.795232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1155072,"data_stored":815570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.4539999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.4260000000000002,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":6.1210000000000004,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":6.4569999999999999,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65700000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":225784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.753},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":1.018}]},{"osd":1,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.657,"5min":3.657,"15min":3.657},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.876}]},{"osd":7,"last update":"Fri Nov 24 08:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.93000000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":225182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.752},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.82599999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":569344,"data_stored":226724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70999999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":569344,"data_stored":225750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.497}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.62},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.65300000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":226746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":6.1799999999999997,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":6.9139999999999997,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.907,"5min":5.907,"15min":5.907},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.754}]},{"osd":5,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.84999999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":225182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":3.6059999999999999,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.433},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.502}]},{"osd":3,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.9320000000000004,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":4.1870000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:04:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":4.9699999999999998,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.72199999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":815514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":10.880000000000001,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.434}]},{"osd":3,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":6.5830000000000002,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":8.9800000000000004,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.753},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":12.688000000000001,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":6.7839999999999998,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.1100000000000003,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":6.6390000000000002,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.80800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:33.853 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:05:33.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:05:34.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 Processor -- start 2023-11-24T08:05:34.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 -- start start 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f173415a4d0 0x7f17340c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17340cad20 0x7f173415e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f173406d740 0x7f173406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173406e0d0 con 0x7f173415a4d0 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173415a8b0 con 0x7f173406d740 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1738d65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340c9c30 con 0x7f17340cad20 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f173415a4d0 0x7f17340c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f173415a4d0 0x7f17340c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35694/0 (socket says 172.21.15.57:35694) 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 -- 172.21.15.57:0/4137521050 learned_addr learned my addr 172.21.15.57:0/4137521050 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f172bfff640 1 --2- 172.21.15.57:0/4137521050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17340cad20 0x7f173415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1732d9d640 1 --2- 172.21.15.57:0/4137521050 >> v2:172.21.15.132:3300/0 conn(0x7f173406d740 0x7f173406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 -- 172.21.15.57:0/4137521050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17340cad20 msgr2=0x7f173415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 --2- 172.21.15.57:0/4137521050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17340cad20 0x7f173415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 -- 172.21.15.57:0/4137521050 >> v2:172.21.15.132:3300/0 conn(0x7f173406d740 msgr2=0x7f173406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 --2- 172.21.15.57:0/4137521050 >> v2:172.21.15.132:3300/0 conn(0x7f173406d740 0x7f173406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f173259c640 1 -- 172.21.15.57:0/4137521050 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173415ee80 con 0x7f173415a4d0 2023-11-24T08:05:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.037+0000 7f1732d9d640 1 --2- 172.21.15.57:0/4137521050 >> v2:172.21.15.132:3300/0 conn(0x7f173406d740 0x7f173406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f173259c640 1 --2- 172.21.15.57:0/4137521050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f17340c9650 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f17340729f0 tx=0x7f172401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a3df2d4493279b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1731d9b640 1 -- 172.21.15.57:0/4137521050 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240ab600 con 0x7f173415a4d0 2023-11-24T08:05:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1731d9b640 1 -- 172.21.15.57:0/4137521050 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17240ab760 con 0x7f173415a4d0 2023-11-24T08:05:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1731d9b640 1 -- 172.21.15.57:0/4137521050 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240abaf0 con 0x7f173415a4d0 2023-11-24T08:05:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 -- 172.21.15.57:0/4137521050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 msgr2=0x7f17340c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 --2- 172.21.15.57:0/4137521050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f17340c9650 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f17340729f0 tx=0x7f172401c440 comp rx=0 tx=0).stop 2023-11-24T08:05:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 -- 172.21.15.57:0/4137521050 shutdown_connections 2023-11-24T08:05:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 --2- 172.21.15.57:0/4137521050 >> v2:172.21.15.132:3300/0 conn(0x7f173406d740 0x7f173406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 --2- 172.21.15.57:0/4137521050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17340cad20 0x7f173415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 --2- 172.21.15.57:0/4137521050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f17340c9650 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 -- 172.21.15.57:0/4137521050 >> 172.21.15.57:0/4137521050 conn(0x7f17340b0bf0 msgr2=0x7f17340b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 -- 172.21.15.57:0/4137521050 shutdown_connections 2023-11-24T08:05:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.041+0000 7f1738d65640 1 -- 172.21.15.57:0/4137521050 wait complete. 2023-11-24T08:05:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 Processor -- start 2023-11-24T08:05:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 -- start start 2023-11-24T08:05:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f173406d740 0x7f1734152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17340cad20 0x7f1734153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f1734151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734151550 con 0x7f173415a4d0 2023-11-24T08:05:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734159aa0 con 0x7f17340cad20 2023-11-24T08:05:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1734164cd0 con 0x7f173406d740 2023-11-24T08:05:34.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f1734151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f1734151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35704/0 (socket says 172.21.15.57:35704) 2023-11-24T08:05:34.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 -- 172.21.15.57:0/1637077559 learned_addr learned my addr 172.21.15.57:0/1637077559 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:34.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f173259c640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f173406d740 0x7f1734152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f172bfff640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17340cad20 0x7f1734153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 -- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f173406d740 msgr2=0x7f1734152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f173406d740 0x7f1734152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 -- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17340cad20 msgr2=0x7f1734153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17340cad20 0x7f1734153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 -- 172.21.15.57:0/1637077559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240094d0 con 0x7f173415a4d0 2023-11-24T08:05:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1732d9d640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f1734151970 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f172c007e10 tx=0x7f172c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f172affd640 1 -- 172.21.15.57:0/1637077559 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c003ba0 con 0x7f173415a4d0 2023-11-24T08:05:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f172affd640 1 -- 172.21.15.57:0/1637077559 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c00f040 con 0x7f173415a4d0 2023-11-24T08:05:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f172affd640 1 -- 172.21.15.57:0/1637077559 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c00de80 con 0x7f173415a4d0 2023-11-24T08:05:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1734164fb0 con 0x7f173415a4d0 2023-11-24T08:05:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.045+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1734151170 con 0x7f173415a4d0 2023-11-24T08:05:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.049+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1734151690 con 0x7f173415a4d0 2023-11-24T08:05:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.049+0000 7f172affd640 1 -- 172.21.15.57:0/1637077559 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f172c004030 con 0x7f173415a4d0 2023-11-24T08:05:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.049+0000 7f172affd640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1714066620 0x7f1714068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.049+0000 7f172affd640 1 -- 172.21.15.57:0/1637077559 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f172c084420 con 0x7f173415a4d0 2023-11-24T08:05:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.049+0000 7f173259c640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1714066620 0x7f1714068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.049+0000 7f173259c640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1714066620 0x7f1714068ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f17240af000 tx=0x7f17240b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.053+0000 7f172affd640 1 -- 172.21.15.57:0/1637077559 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1734151690 con 0x7f173415a4d0 2023-11-24T08:05:34.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.261+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1734151690 con 0x7f173415a4d0 2023-11-24T08:05:34.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.265+0000 7f172affd640 1 -- 172.21.15.57:0/1637077559 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1734151690 con 0x7f173415a4d0 2023-11-24T08:05:34.274 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-11-24T08:05:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg== 2023-11-24T08:05:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: caps mds = "allow" 2023-11-24T08:05:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: caps mon = "allow r" 2023-11-24T08:05:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:05:34.274 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2023-11-24T08:05:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1714066620 msgr2=0x7f1714068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1714066620 0x7f1714068ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f17240af000 tx=0x7f17240b6040 comp rx=0 tx=0).stop 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 msgr2=0x7f1734151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f1734151970 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f172c007e10 tx=0x7f172c00d4a0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 shutdown_connections 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1714066620 0x7f1714068ae0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f173415a4d0 0x7f1734151970 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17340cad20 0x7f1734153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 --2- 172.21.15.57:0/1637077559 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f173406d740 0x7f1734152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 >> 172.21.15.57:0/1637077559 conn(0x7f17340b0bf0 msgr2=0x7f17340cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 shutdown_connections 2023-11-24T08:05:34.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.269+0000 7f1738d65640 1 -- 172.21.15.57:0/1637077559 wait complete. 2023-11-24T08:05:34.295 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:34.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 Processor -- start 2023-11-24T08:05:34.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 -- start start 2023-11-24T08:05:34.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11840b2e50 0x7f118413e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11840b3230 0x7f11840cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1184140c40 0x7f11841410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118415ee50 con 0x7f11840b2e50 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118415f060 con 0x7f11840b3230 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1188e79640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118415f340 con 0x7f1184140c40 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11840b2e50 0x7f118413e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11840b2e50 0x7f118413e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35716/0 (socket says 172.21.15.57:35716) 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 -- 172.21.15.57:0/1542320584 learned_addr learned my addr 172.21.15.57:0/1542320584 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f1182d9d640 1 --2- 172.21.15.57:0/1542320584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1184140c40 0x7f11841410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f117bfff640 1 --2- 172.21.15.57:0/1542320584 >> v2:172.21.15.132:3300/0 conn(0x7f11840b3230 0x7f11840cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 -- 172.21.15.57:0/1542320584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1184140c40 msgr2=0x7f11841410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 --2- 172.21.15.57:0/1542320584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1184140c40 0x7f11841410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 -- 172.21.15.57:0/1542320584 >> v2:172.21.15.132:3300/0 conn(0x7f11840b3230 msgr2=0x7f11840cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 --2- 172.21.15.57:0/1542320584 >> v2:172.21.15.132:3300/0 conn(0x7f11840b3230 0x7f11840cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f118259c640 1 -- 172.21.15.57:0/1542320584 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118415f620 con 0x7f11840b2e50 2023-11-24T08:05:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.433+0000 7f117bfff640 1 --2- 172.21.15.57:0/1542320584 >> v2:172.21.15.132:3300/0 conn(0x7f11840b3230 0x7f11840cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:34.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f118259c640 1 --2- 172.21.15.57:0/1542320584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11840b2e50 0x7f118413e970 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f11840d0b30 tx=0x7f117401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fe2afff57b304d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1181d9b640 1 -- 172.21.15.57:0/1542320584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740ac410 con 0x7f11840b2e50 2023-11-24T08:05:34.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1181d9b640 1 -- 172.21.15.57:0/1542320584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740ac570 con 0x7f11840b2e50 2023-11-24T08:05:34.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1181d9b640 1 -- 172.21.15.57:0/1542320584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740ac900 con 0x7f11840b2e50 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 -- 172.21.15.57:0/1542320584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11840b2e50 msgr2=0x7f118413e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 --2- 172.21.15.57:0/1542320584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11840b2e50 0x7f118413e970 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f11840d0b30 tx=0x7f117401c500 comp rx=0 tx=0).stop 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 -- 172.21.15.57:0/1542320584 shutdown_connections 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 --2- 172.21.15.57:0/1542320584 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1184140c40 0x7f11841410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 --2- 172.21.15.57:0/1542320584 >> v2:172.21.15.132:3300/0 conn(0x7f11840b3230 0x7f11840cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 --2- 172.21.15.57:0/1542320584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11840b2e50 0x7f118413e970 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 -- 172.21.15.57:0/1542320584 >> 172.21.15.57:0/1542320584 conn(0x7f1184060fd0 msgr2=0x7f11840613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 -- 172.21.15.57:0/1542320584 shutdown_connections 2023-11-24T08:05:34.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.437+0000 7f1188e79640 1 -- 172.21.15.57:0/1542320584 wait complete. 2023-11-24T08:05:34.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 Processor -- start 2023-11-24T08:05:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 -- start start 2023-11-24T08:05:34.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11840b2e50 0x7f118413d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11840b3230 0x7f11840b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1184140c40 0x7f11840b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11840cb9f0 con 0x7f1184140c40 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118413d5c0 con 0x7f11840b3230 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11840b4bb0 con 0x7f11840b2e50 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1184140c40 0x7f11840b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1184140c40 0x7f11840b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35726/0 (socket says 172.21.15.57:35726) 2023-11-24T08:05:34.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 -- 172.21.15.57:0/478625368 learned_addr learned my addr 172.21.15.57:0/478625368 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:34.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f118259c640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11840b2e50 0x7f118413d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 -- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11840b2e50 msgr2=0x7f118413d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11840b2e50 0x7f118413d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f117bfff640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11840b3230 0x7f11840b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 -- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11840b3230 msgr2=0x7f11840b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11840b3230 0x7f11840b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 -- 172.21.15.57:0/478625368 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740094d0 con 0x7f1184140c40 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f117bfff640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11840b3230 0x7f11840b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1182d9d640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1184140c40 0x7f11840b63a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f117c007e40 tx=0x7f117c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f117affd640 1 -- 172.21.15.57:0/478625368 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c014620 con 0x7f1184140c40 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f117affd640 1 -- 172.21.15.57:0/478625368 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c00ee90 con 0x7f1184140c40 2023-11-24T08:05:34.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f117affd640 1 -- 172.21.15.57:0/478625368 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c0149e0 con 0x7f1184140c40 2023-11-24T08:05:34.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11840cbc90 con 0x7f1184140c40 2023-11-24T08:05:34.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.441+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11840b4e90 con 0x7f1184140c40 2023-11-24T08:05:34.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.445+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1184067520 con 0x7f1184140c40 2023-11-24T08:05:34.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.445+0000 7f117affd640 1 -- 172.21.15.57:0/478625368 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f117c014b40 con 0x7f1184140c40 2023-11-24T08:05:34.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.445+0000 7f117affd640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1164066620 0x7f1164068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.445+0000 7f117affd640 1 -- 172.21.15.57:0/478625368 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f117c084c10 con 0x7f1184140c40 2023-11-24T08:05:34.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.445+0000 7f118259c640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1164066620 0x7f1164068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.445+0000 7f118259c640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1164066620 0x7f1164068ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f11740ae000 tx=0x7f1174008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.449+0000 7f117affd640 1 -- 172.21.15.57:0/478625368 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f117c051d80 con 0x7f1184140c40 2023-11-24T08:05:34.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.637+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11840cc140 con 0x7f1184140c40 2023-11-24T08:05:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f117affd640 1 -- 172.21.15.57:0/478625368 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f117c0553a0 con 0x7f1184140c40 2023-11-24T08:05:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:34.646 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:34.646 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1164066620 msgr2=0x7f1164068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1164066620 0x7f1164068ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f11740ae000 tx=0x7f1174008040 comp rx=0 tx=0).stop 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1184140c40 msgr2=0x7f11840b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1184140c40 0x7f11840b63a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f117c007e40 tx=0x7f117c00e4b0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 shutdown_connections 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1164066620 0x7f1164068ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1184140c40 0x7f11840b63a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11840b3230 0x7f11840b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 --2- 172.21.15.57:0/478625368 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11840b2e50 0x7f118413d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 >> 172.21.15.57:0/478625368 conn(0x7f1184060fd0 msgr2=0x7f11840cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 shutdown_connections 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:34.641+0000 7f1188e79640 1 -- 172.21.15.57:0/478625368 wait complete. 2023-11-24T08:05:35.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:05:24.160281+0000', 'modified': '2023-11-24T08:05:27.205680+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 55016}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_55016': {'gid': 55016, 'name': 'd', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6837/1528560341', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6835', 'nonce': 1528560341}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 1528560341}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:05:35.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:05:35.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T08:05:35.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a3980640 1 Processor -- start 2023-11-24T08:05:35.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a3980640 1 -- start start 2023-11-24T08:05:35.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a3980640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 0x7f339c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a3980640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f339c06d740 0x7f339c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a3980640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c06e0d0 con 0x7f339c0cad20 2023-11-24T08:05:35.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a3980640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c15a8b0 con 0x7f339c06d740 2023-11-24T08:05:35.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a3980640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c9c30 con 0x7f339c15a4d0 2023-11-24T08:05:35.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a0f1b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f339c0cad20 0x7f339c15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38036/0 (socket says 172.21.15.57:38036) 2023-11-24T08:05:35.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a0f1b640 1 -- 172.21.15.57:0/3435021323 learned_addr learned my addr 172.21.15.57:0/3435021323 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:35.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/3435021323 >> v2:172.21.15.132:3300/0 conn(0x7f339c06d740 0x7f339c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a171c640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 0x7f339c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353003776 0 0) 0x7f338c001120 con 0x7f339c0cad20 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3388005740 con 0x7f339c0cad20 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1756621402 0 0) 0x7f3388005740 con 0x7f339c0cad20 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 msgr2=0x7f339c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 0x7f339c0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 >> v2:172.21.15.132:3300/0 conn(0x7f339c06d740 msgr2=0x7f339c06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 --2- 172.21.15.57:0/3435021323 >> v2:172.21.15.132:3300/0 conn(0x7f339c06d740 0x7f339c06db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0c9f60 con 0x7f339c0cad20 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f338c001810 con 0x7f339c0cad20 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 >> v1:172.21.15.57:6789/0 conn(0x7f339c0cad20 legacy=0x7f339c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 0x7f3388005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3388006160 0x7f33880069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f33880073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c15a8b0 con 0x7f3388006f20 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c9c30 con 0x7f3388006160 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338800dc50 con 0x7f339c15a4d0 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f33880073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a171c640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 0x7f3388005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3388006160 0x7f33880069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a1f1d640 1 -- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 msgr2=0x7f3388005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c15a4d0 0x7f3388005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a1f1d640 1 -- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3388006160 msgr2=0x7f33880069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3388006160 0x7f33880069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.213+0000 7f33a1f1d640 1 -- 172.21.15.57:0/3435021323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388005740 con 0x7f3388006f20 2023-11-24T08:05:35.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f33880073a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3394009fc0 tx=0x7f339401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88226fd1f92f1fe3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33940a5cb0 con 0x7f3388006f20 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339400f040 con 0x7f3388006f20 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f3393fff640 1 -- 172.21.15.57:0/3435021323 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33940ad680 con 0x7f3388006f20 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a3980640 1 -- 172.21.15.57:0/3435021323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 msgr2=0x7f33880073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a3980640 1 --2- 172.21.15.57:0/3435021323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f33880073a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3394009fc0 tx=0x7f339401cca0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a1f1d640 1 -- 172.21.15.57:0/3435021323 reap_dead start 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a3980640 1 -- 172.21.15.57:0/3435021323 shutdown_connections 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a3980640 1 -- 172.21.15.57:0/3435021323 >> 172.21.15.57:0/3435021323 conn(0x7f339c0b0bf0 msgr2=0x7f339c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a3980640 1 -- 172.21.15.57:0/3435021323 shutdown_connections 2023-11-24T08:05:35.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.217+0000 7f33a3980640 1 -- 172.21.15.57:0/3435021323 wait complete. 2023-11-24T08:05:35.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 Processor -- start 2023-11-24T08:05:35.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 -- start start 2023-11-24T08:05:35.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f339c0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f339c0c1d40 0x7f339c14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c0ad5e0 0x7f339c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c09ab70 con 0x7f3388006f20 2023-11-24T08:05:35.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c4850 con 0x7f339c0c1d40 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c09a360 con 0x7f339c0ad5e0 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f339c0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f339c0b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35738/0 (socket says 172.21.15.57:35738) 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 -- 172.21.15.57:0/478861045 learned_addr learned my addr 172.21.15.57:0/478861045 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c0ad5e0 0x7f339c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f339c0c1d40 0x7f339c14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 -- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c0ad5e0 msgr2=0x7f339c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c0ad5e0 0x7f339c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 -- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f339c0c1d40 msgr2=0x7f339c14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f339c0c1d40 0x7f339c14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 -- 172.21.15.57:0/478861045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0ad150 con 0x7f3388006f20 2023-11-24T08:05:35.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a171c640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f339c0b4470 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3398011a00 tx=0x7f3398011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f3391ffb640 1 -- 172.21.15.57:0/478861045 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800faf0 con 0x7f3388006f20 2023-11-24T08:05:35.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f3391ffb640 1 -- 172.21.15.57:0/478861045 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339800fc50 con 0x7f3388006f20 2023-11-24T08:05:35.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f3391ffb640 1 -- 172.21.15.57:0/478861045 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398014440 con 0x7f3388006f20 2023-11-24T08:05:35.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c09a5b0 con 0x7f3388006f20 2023-11-24T08:05:35.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.221+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c14e9c0 con 0x7f3388006f20 2023-11-24T08:05:35.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.225+0000 7f3391ffb640 1 -- 172.21.15.57:0/478861045 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f33980145a0 con 0x7f3388006f20 2023-11-24T08:05:35.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.225+0000 7f3391ffb640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3380066620 0x7f3380068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.225+0000 7f3391ffb640 1 -- 172.21.15.57:0/478861045 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33980849a0 con 0x7f3388006f20 2023-11-24T08:05:35.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.225+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3380066620 0x7f3380068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.225+0000 7f33a6cf6000 1 Processor -- start 2023-11-24T08:05:35.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.225+0000 7f33a6cf6000 1 -- start start 2023-11-24T08:05:35.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3380066620 0x7f3380068ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f339c0b5140 tx=0x7f338c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1f8c90 0x55e93c1f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1af320 0x55e93c1af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93c019130 con 0x55e93c1af320 2023-11-24T08:05:35.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93c0069a0 con 0x55e93c1f8c90 2023-11-24T08:05:35.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e93c003ed0 con 0x55e93c1f95b0 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1af320 0x55e93c1af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1af320 0x55e93c1af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35754/0 (socket says 172.21.15.57:35754) 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 -- 172.21.15.57:0/514533141 learned_addr learned my addr 172.21.15.57:0/514533141 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a171c640 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1f8c90 0x55e93c1f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 -- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 msgr2=0x55e93c1aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 -- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1f8c90 msgr2=0x55e93c1f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1f8c90 0x55e93c1f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 -- 172.21.15.57:0/514533141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e93bcf7890 con 0x55e93c1af320 2023-11-24T08:05:35.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:35.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1af320 0x55e93c1af700 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f33940b0040 tx=0x7f339401b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f3008b47879d18 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f337effd640 1 -- 172.21.15.57:0/514533141 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33940a5ab0 con 0x55e93c1af320 2023-11-24T08:05:35.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f337effd640 1 -- 172.21.15.57:0/514533141 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33940a5c30 con 0x55e93c1af320 2023-11-24T08:05:35.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f337effd640 1 -- 172.21.15.57:0/514533141 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33940039a0 con 0x55e93c1af320 2023-11-24T08:05:35.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- 172.21.15.57:0/514533141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1af320 msgr2=0x55e93c1af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1af320 0x55e93c1af700 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f33940b0040 tx=0x7f339401b4e0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- 172.21.15.57:0/514533141 shutdown_connections 2023-11-24T08:05:35.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1af320 0x55e93c1af700 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/514533141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1f8c90 0x55e93c1f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- 172.21.15.57:0/514533141 >> 172.21.15.57:0/514533141 conn(0x55e93c1ab2d0 msgr2=0x55e93c1ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- 172.21.15.57:0/514533141 shutdown_connections 2023-11-24T08:05:35.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- 172.21.15.57:0/514533141 wait complete. 2023-11-24T08:05:35.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 -- start start 2023-11-24T08:05:35.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.229+0000 7f33a6cf6000 1 Processor -- start 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1f8c90 0x55e93c1b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93bfff7c0 con 0x55e93c1f8c90 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93bfb7bf0 con 0x55e93c1af320 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e93bfbda90 con 0x55e93c1f95b0 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 10 client.0 _ll_register_callbacks cb 0x55e93c19a3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1f8c90 0x55e93c1b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a171c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1f8c90 0x55e93c1b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35762/0 (socket says 172.21.15.57:35762) 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 -- 172.21.15.57:0/2066863411 learned_addr learned my addr 172.21.15.57:0/2066863411 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 -- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 msgr2=0x55e93c1c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 -- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 msgr2=0x55e93c1b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 -- 172.21.15.57:0/2066863411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3388005740 con 0x55e93c1f8c90 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1f8c90 0x55e93c1b42b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f338c014be0 tx=0x7f338c001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea05ad268d76d32 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f3377fff640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f3377fff640 1 -- 172.21.15.57:0/2066863411 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c01c040 con 0x55e93c1f8c90 2023-11-24T08:05:35.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f3377fff640 1 -- 172.21.15.57:0/2066863411 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f338c017db0 con 0x55e93c1f8c90 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e93bfc1470 con 0x55e93c1f8c90 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f3377fff640 1 -- 172.21.15.57:0/2066863411 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f338c030460 con 0x55e93c1f8c90 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 10 client.5763 fetch_fsmap learned FSMap version 25 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e93bfc0190 con 0x55e93c1f8c90 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f3377fff640 1 -- 172.21.15.57:0/2066863411 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c034020 con 0x55e93c1f8c90 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f3377fff640 1 -- 172.21.15.57:0/2066863411 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f338c022050 con 0x55e93c1f8c90 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 10 client.5763 fetch_fsmap finished waiting for FSMap version 25 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 10 client.5763 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:05:35.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 20 client.5763 populate_metadata read hostname 'smithi057' 2023-11-24T08:05:35.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1c8320 0x55e93c20af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 4 client.5763 mds_command: new command op to 55016 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:05:35.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 --> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e93bfc4b50 con 0x55e93c1c8320 2023-11-24T08:05:35.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a171c640 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1c8320 0x55e93c20af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f33a171c640 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1c8320 0x55e93c20af50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8297b67de23f4a46 server_cookie=cea950bae1446b87 in_seq=0 out_seq=0 2023-11-24T08:05:35.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.233+0000 7f3377fff640 10 client.5763 ms_handle_connect on v2:172.21.15.132:6835/1528560341 2023-11-24T08:05:35.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f3377fff640 1 -- 172.21.15.57:0/2066863411 <== mds.0 v2:172.21.15.132:6835/1528560341 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e93bfc4b50 con 0x55e93c1c8320 2023-11-24T08:05:35.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f3377fff640 10 client.5763 handle_command_reply: tid=0 2023-11-24T08:05:35.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 client.5763 shutdown 2023-11-24T08:05:35.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1f8c90 msgr2=0x55e93c1b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1f8c90 0x55e93c1b42b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f338c014be0 tx=0x7f338c001ad0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 shutdown_connections 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1c8320 0x55e93c20af50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f95b0 0x55e93c1c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1f8c90 0x55e93c1b42b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2066863411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f3377fff640 0 client.5763 ms_handle_reset on v2:172.21.15.132:6835/1528560341 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 >> 172.21.15.57:0/2066863411 conn(0x55e93c1ab2d0 msgr2=0x55e93c1ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 shutdown_connections 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2066863411 wait complete. 2023-11-24T08:05:35.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.237+0000 7f33a6cf6000 20 client.5763 trim_cache size 0 max 16384 2023-11-24T08:05:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 Processor -- start 2023-11-24T08:05:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- start start 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c1f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1f7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c1af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93bcb8940 con 0x55e93c1ab2d0 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93c0037c0 con 0x55e93c1af320 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e93c1aac70 con 0x55e93c1f8c90 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c1f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c1f6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35772/0 (socket says 172.21.15.57:35772) 2023-11-24T08:05:35.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 -- 172.21.15.57:0/2245681992 learned_addr learned my addr 172.21.15.57:0/2245681992 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:35.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c1af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 -- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 msgr2=0x55e93c1af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c1af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 -- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 msgr2=0x55e93c1f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 -- 172.21.15.57:0/2245681992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e93bfa6490 con 0x55e93c1ab2d0 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c1af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a171c640 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c1f6b30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f33980558a0 tx=0x7f3398058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d776cf701481b3e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f337f7fe640 1 -- 172.21.15.57:0/2245681992 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398053cb0 con 0x55e93c1ab2d0 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f337f7fe640 1 -- 172.21.15.57:0/2245681992 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398052020 con 0x55e93c1ab2d0 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f337f7fe640 1 -- 172.21.15.57:0/2245681992 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398082f90 con 0x55e93c1ab2d0 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2245681992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 msgr2=0x55e93c1f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c1f6b30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f33980558a0 tx=0x7f3398058040 comp rx=0 tx=0).stop 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2245681992 shutdown_connections 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c1af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c1f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/2245681992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c1f6b30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2245681992 >> 172.21.15.57:0/2245681992 conn(0x55e93c1b3f40 msgr2=0x55e93c1ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2245681992 shutdown_connections 2023-11-24T08:05:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.253+0000 7f33a6cf6000 1 -- 172.21.15.57:0/2245681992 wait complete. 2023-11-24T08:05:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 -- start start 2023-11-24T08:05:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 Processor -- start 2023-11-24T08:05:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c20bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c20c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c2169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93bffcbc0 con 0x55e93c1ab2d0 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e93bffefd0 con 0x55e93c1af320 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e93bf86a00 con 0x55e93c1f8c90 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 10 client.0 _ll_register_callbacks cb 0x55e93c04dc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c20bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c20bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35774/0 (socket says 172.21.15.57:35774) 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 -- 172.21.15.57:0/3294818711 learned_addr learned my addr 172.21.15.57:0/3294818711 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c20c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a1f1d640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c2169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 -- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 msgr2=0x55e93c2169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c2169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 -- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 msgr2=0x55e93c20c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c20c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 -- 172.21.15.57:0/3294818711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c14e9c0 con 0x55e93c1ab2d0 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c20c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a171c640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c20bfa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f33980558a0 tx=0x7f339807e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59673c9fabdec88e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f3377fff640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f3377fff640 1 -- 172.21.15.57:0/3294818711 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398055d70 con 0x55e93c1ab2d0 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f3377fff640 1 -- 172.21.15.57:0/3294818711 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3398081040 con 0x55e93c1ab2d0 2023-11-24T08:05:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e93bffe110 con 0x55e93c1ab2d0 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f3377fff640 1 -- 172.21.15.57:0/3294818711 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3398054e00 con 0x55e93c1ab2d0 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 10 client.5769 fetch_fsmap learned FSMap version 25 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e93bcf7cc0 con 0x55e93c1ab2d0 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f3377fff640 1 -- 172.21.15.57:0/3294818711 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339804d020 con 0x55e93c1ab2d0 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f3377fff640 1 -- 172.21.15.57:0/3294818711 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f339801b020 con 0x55e93c1ab2d0 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 10 client.5769 fetch_fsmap finished waiting for FSMap version 25 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 10 client.5769 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 20 client.5769 populate_metadata read hostname 'smithi057' 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1f95b0 0x55e93c216f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 4 client.5769 mds_command: new command op to 55016 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:05:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.257+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 --> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e93c02d9a0 con 0x55e93c1f95b0 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1f95b0 0x55e93c216f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f3377fff640 10 client.5769 ms_handle_connect on v2:172.21.15.132:6835/1528560341 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a0f1b640 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1f95b0 0x55e93c216f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3a04aa8f2c0a25 server_cookie=52dfc74077a9c7f in_seq=0 out_seq=0 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f3377fff640 1 -- 172.21.15.57:0/3294818711 <== mds.0 v2:172.21.15.132:6835/1528560341 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55e93c02d9a0 con 0x55e93c1f95b0 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f3377fff640 10 client.5769 handle_command_reply: tid=0 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 client.5769 shutdown 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 msgr2=0x55e93c20bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c20bfa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f33980558a0 tx=0x7f339807e040 comp rx=0 tx=0).stop 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 shutdown_connections 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:6835/1528560341,v1:172.21.15.132:6837/1528560341] conn(0x55e93c1f95b0 0x55e93c216f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55e93c1f8c90 0x55e93c2169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e93c1af320 0x55e93c20c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f3377fff640 0 client.5769 ms_handle_reset on v2:172.21.15.132:6835/1528560341 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 --2- 172.21.15.57:0/3294818711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e93c1ab2d0 0x55e93c20bfa0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 >> 172.21.15.57:0/3294818711 conn(0x55e93c1b3f40 msgr2=0x55e93c1adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 shutdown_connections 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 1 -- 172.21.15.57:0/3294818711 wait complete. 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a6cf6000 20 client.5769 trim_cache size 0 max 16384 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:05:35.272 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "445cea61-e72c-4da9-979a-02ade002d7d6", 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 55016, 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 10.464700206, 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 25, 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 48, 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 48, 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 15.315990213999999 2023-11-24T08:05:35.273 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:05:35.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3380066620 msgr2=0x7f3380068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3380066620 0x7f3380068ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f339c0b5140 tx=0x7f338c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:35.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 msgr2=0x7f339c0b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f339c0b4470 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3398011a00 tx=0x7f3398011ec0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 shutdown_connections 2023-11-24T08:05:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3380066620 0x7f3380068ae0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f339c0ad5e0 0x7f339c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f339c0c1d40 0x7f339c14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 --2- 172.21.15.57:0/478861045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3388006f20 0x7f339c0b4470 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 >> 172.21.15.57:0/478861045 conn(0x7f339c0b0bf0 msgr2=0x7f339c071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 shutdown_connections 2023-11-24T08:05:35.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.261+0000 7f33a3980640 1 -- 172.21.15.57:0/478861045 wait complete. 2023-11-24T08:05:35.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:35.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 Processor -- start 2023-11-24T08:05:35.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 -- start start 2023-11-24T08:05:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7eff1015d570 0x7eff1006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100d3020 0x7eff100d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff100ce8b0 0x7eff100ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100d39c0 con 0x7eff100ce8b0 2023-11-24T08:05:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100d1cc0 con 0x7eff1015d570 2023-11-24T08:05:35.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff17091640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100d1fa0 con 0x7eff100d3020 2023-11-24T08:05:35.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff100ce8b0 0x7eff100ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff100ce8b0 0x7eff100ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35776/0 (socket says 172.21.15.57:35776) 2023-11-24T08:05:35.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 -- 172.21.15.57:0/267501887 learned_addr learned my addr 172.21.15.57:0/267501887 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:35.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff14e2d640 1 --2- 172.21.15.57:0/267501887 >> v2:172.21.15.132:3300/0 conn(0x7eff1015d570 0x7eff1006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff0ffff640 1 --2- 172.21.15.57:0/267501887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100d3020 0x7eff100d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 -- 172.21.15.57:0/267501887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100d3020 msgr2=0x7eff100d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 --2- 172.21.15.57:0/267501887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100d3020 0x7eff100d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 -- 172.21.15.57:0/267501887 >> v2:172.21.15.132:3300/0 conn(0x7eff1015d570 msgr2=0x7eff1006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:35.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 --2- 172.21.15.57:0/267501887 >> v2:172.21.15.132:3300/0 conn(0x7eff1015d570 0x7eff1006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.425+0000 7eff1562e640 1 -- 172.21.15.57:0/267501887 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100ce0b0 con 0x7eff100ce8b0 2023-11-24T08:05:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff1562e640 1 --2- 172.21.15.57:0/267501887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100ce8b0 0x7eff100ced40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7eff100d0eb0 tx=0x7eff0801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a29c7ef316418b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff0f7fe640 1 -- 172.21.15.57:0/267501887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080a5840 con 0x7eff100ce8b0 2023-11-24T08:05:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff0f7fe640 1 -- 172.21.15.57:0/267501887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff080a59a0 con 0x7eff100ce8b0 2023-11-24T08:05:35.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff0f7fe640 1 -- 172.21.15.57:0/267501887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080a5d30 con 0x7eff100ce8b0 2023-11-24T08:05:35.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 -- 172.21.15.57:0/267501887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100ce8b0 msgr2=0x7eff100ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 --2- 172.21.15.57:0/267501887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100ce8b0 0x7eff100ced40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7eff100d0eb0 tx=0x7eff0801c9a0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 -- 172.21.15.57:0/267501887 shutdown_connections 2023-11-24T08:05:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 --2- 172.21.15.57:0/267501887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100ce8b0 0x7eff100ced40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 --2- 172.21.15.57:0/267501887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100d3020 0x7eff100d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 --2- 172.21.15.57:0/267501887 >> v2:172.21.15.132:3300/0 conn(0x7eff1015d570 0x7eff1006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 -- 172.21.15.57:0/267501887 >> 172.21.15.57:0/267501887 conn(0x7eff1008ceb0 msgr2=0x7eff1009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 -- 172.21.15.57:0/267501887 shutdown_connections 2023-11-24T08:05:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.429+0000 7eff17091640 1 -- 172.21.15.57:0/267501887 wait complete. 2023-11-24T08:05:35.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 Processor -- start 2023-11-24T08:05:35.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 -- start start 2023-11-24T08:05:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100ce8b0 0x7eff100c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100d3020 0x7eff100b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff1015d570 0x7eff10156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c8150 con 0x7eff100d3020 2023-11-24T08:05:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff10157960 con 0x7eff1015d570 2023-11-24T08:05:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100b8440 con 0x7eff100ce8b0 2023-11-24T08:05:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100d3020 0x7eff100b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100d3020 0x7eff100b6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35782/0 (socket says 172.21.15.57:35782) 2023-11-24T08:05:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 -- 172.21.15.57:0/3728864330 learned_addr learned my addr 172.21.15.57:0/3728864330 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff14e2d640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100ce8b0 0x7eff100c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff1562e640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff1015d570 0x7eff10156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 -- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100ce8b0 msgr2=0x7eff100c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100ce8b0 0x7eff100c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 -- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff1015d570 msgr2=0x7eff10156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff1015d570 0x7eff10156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 -- 172.21.15.57:0/3728864330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009b30 con 0x7eff100d3020 2023-11-24T08:05:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0ffff640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100d3020 0x7eff100b6a00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e8e0 tx=0x7efefc00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0d7fa640 1 -- 172.21.15.57:0/3728864330 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00ca00 con 0x7eff100d3020 2023-11-24T08:05:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0d7fa640 1 -- 172.21.15.57:0/3728864330 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00cb60 con 0x7eff100d3020 2023-11-24T08:05:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff100c8330 con 0x7eff100d3020 2023-11-24T08:05:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff0d7fa640 1 -- 172.21.15.57:0/3728864330 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc013470 con 0x7eff100d3020 2023-11-24T08:05:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.433+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff100c88f0 con 0x7eff100d3020 2023-11-24T08:05:35.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.437+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff10067520 con 0x7eff100d3020 2023-11-24T08:05:35.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.437+0000 7eff0d7fa640 1 -- 172.21.15.57:0/3728864330 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7efefc0135d0 con 0x7eff100d3020 2023-11-24T08:05:35.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.437+0000 7eff0d7fa640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efef4066620 0x7efef4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:35.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.437+0000 7eff0d7fa640 1 -- 172.21.15.57:0/3728864330 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efefc0842c0 con 0x7eff100d3020 2023-11-24T08:05:35.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.437+0000 7eff14e2d640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efef4066620 0x7efef4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:35.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.437+0000 7eff14e2d640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efef4066620 0x7efef4068ae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7eff1015cfc0 tx=0x7eff04009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:35.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.441+0000 7eff0d7fa640 1 -- 172.21.15.57:0/3728864330 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efefc051610 con 0x7eff100d3020 2023-11-24T08:05:35.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff1006b7b0 con 0x7eff100d3020 2023-11-24T08:05:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff0d7fa640 1 -- 172.21.15.57:0/3728864330 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7efefc054c30 con 0x7eff100d3020 2023-11-24T08:05:35.640 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:35.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efef4066620 msgr2=0x7efef4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efef4066620 0x7efef4068ae0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7eff1015cfc0 tx=0x7eff04009190 comp rx=0 tx=0).stop 2023-11-24T08:05:35.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100d3020 msgr2=0x7eff100b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:35.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100d3020 0x7eff100b6a00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e8e0 tx=0x7efefc00eda0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 shutdown_connections 2023-11-24T08:05:35.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efef4066620 0x7efef4068ae0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff1015d570 0x7eff10156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff100d3020 0x7eff100b6a00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 --2- 172.21.15.57:0/3728864330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff100ce8b0 0x7eff100c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:35.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 >> 172.21.15.57:0/3728864330 conn(0x7eff1008ceb0 msgr2=0x7eff100b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:35.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 shutdown_connections 2023-11-24T08:05:35.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:35.633+0000 7eff17091640 1 -- 172.21.15.57:0/3728864330 wait complete. 2023-11-24T08:05:35.661 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:05:35.662 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:35.663 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-11-24T08:05:35.664 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:05:35.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:35.664 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:05:35.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:05:35.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:35.664 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:35.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:35.665 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-11-24T08:05:35.676 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.678 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-11-24T08:05:35.678 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-11-24T08:05:35.679 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-11-24T08:05:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T08:05:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42290sec preferred_lft 42290sec 2023-11-24T08:05:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-11-24T08:05:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.680 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-11-24T08:05:35.680 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:05:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:79:99:46:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:05:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.681 INFO:teuthology.orchestra.run.smithi057.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T08:05:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.682 INFO:teuthology.orchestra.run.smithi057.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T08:05:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.682 INFO:teuthology.orchestra.run.smithi057.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T08:05:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:35.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:35.686 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:35.737 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-11-24T08:05:35.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:35.739 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-11-24T08:05:35.792 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-11-24T08:05:35.792 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:35.792 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T08:05:35.792 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:05:35.792 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T08:05:35.793 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:35.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:35.793 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:05:35.794 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:05:35.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T08:05:35.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T08:05:35.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T08:05:35.794 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:05:35.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:35.887 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:05:35.897 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:05:35.897 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:05:35.898 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:35.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:35.898 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-11-24T08:05:35.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:35.963 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:36.018 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:36.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:36.018 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:36.069 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T08:05:36.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:36.164 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:36.165 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:05:36.180 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:36.180 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:05:36.180 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:05:36.180 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with new device syntax: 0@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:05:36.180 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:05:36.185 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:05:36.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:36.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.209 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:05:36.275 INFO:teuthology.orchestra.run.smithi057.stdout:client5551 2023-11-24T08:05:36.275 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:36.275 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:36.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:36.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.505+0000 7fcdd6ac9640 1 Processor -- start 2023-11-24T08:05:36.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.505+0000 7fcdd6ac9640 1 -- start start 2023-11-24T08:05:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdd6ac9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcdd006c650 0x7fcdd009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdd6ac9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd006d8b0 con 0x7fcdd0144030 2023-11-24T08:05:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdd6ac9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd006cca0 con 0x7fcdd00709c0 2023-11-24T08:05:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdd6ac9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd0145020 con 0x7fcdd006c650 2023-11-24T08:05:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcdd006c650 0x7fcdd009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdd4865640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcdd0144030 0x7fcdd006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50966/0 (socket says 172.21.15.57:50966) 2023-11-24T08:05:36.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdd4865640 1 -- 172.21.15.57:0/4294272304 learned_addr learned my addr 172.21.15.57:0/4294272304 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcffff640 1 -- 172.21.15.57:0/4294272304 >> v1:172.21.15.132:6789/0 conn(0x7fcdd00709c0 legacy=0x7fcdd0070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcffff640 1 -- 172.21.15.57:0/4294272304 >> v1:172.21.15.57:6789/0 conn(0x7fcdd0144030 legacy=0x7fcdd006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcffff640 1 -- 172.21.15.57:0/4294272304 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd006cf80 con 0x7fcdd006c650 2023-11-24T08:05:36.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcf7fe640 1 -- 172.21.15.57:0/4294272304 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873397112 0 0) 0x7fcdd006d8b0 con 0x7fcdd0144030 2023-11-24T08:05:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcffff640 1 --2- 172.21.15.57:0/4294272304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd006c650 0x7fcdd009cc20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0097c0 tx=0x7fcdbc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d135139ca6206b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcf7fe640 1 -- 172.21.15.57:0/4294272304 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0ab600 con 0x7fcdd006c650 2023-11-24T08:05:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.509+0000 7fcdcf7fe640 1 -- 172.21.15.57:0/4294272304 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc0a7050 con 0x7fcdd006c650 2023-11-24T08:05:36.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdcf7fe640 1 -- 172.21.15.57:0/4294272304 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0ab980 con 0x7fcdd006c650 2023-11-24T08:05:36.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/4294272304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd006c650 msgr2=0x7fcdd009cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/4294272304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd006c650 0x7fcdd009cc20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0097c0 tx=0x7fcdbc01c480 comp rx=0 tx=0).stop 2023-11-24T08:05:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/4294272304 shutdown_connections 2023-11-24T08:05:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/4294272304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd006c650 0x7fcdd009cc20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/4294272304 >> 172.21.15.57:0/4294272304 conn(0x7fcdd00b0bf0 msgr2=0x7fcdd00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/4294272304 shutdown_connections 2023-11-24T08:05:36.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/4294272304 wait complete. 2023-11-24T08:05:36.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 Processor -- start 2023-11-24T08:05:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- start start 2023-11-24T08:05:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcdd006c650 0x7fcdd0157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd00709c0 0x7fcdd0155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdd0144030 0x7fcdd0154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd01564f0 con 0x7fcdd00709c0 2023-11-24T08:05:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0156940 con 0x7fcdd0144030 2023-11-24T08:05:36.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd6ac9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0156c20 con 0x7fcdd006c650 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd00709c0 0x7fcdd0155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdcffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd00709c0 0x7fcdd0155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52182/0 (socket says 172.21.15.57:52182) 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdcffff640 1 -- 172.21.15.57:0/3795553910 learned_addr learned my addr 172.21.15.57:0/3795553910 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd4865640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcdd006c650 0x7fcdd0157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.513+0000 7fcdd5066640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdd0144030 0x7fcdd0154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcffff640 1 -- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcdd006c650 msgr2=0x7fcdd0157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcffff640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcdd006c650 0x7fcdd0157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcffff640 1 -- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdd0144030 msgr2=0x7fcdd0154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcffff640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdd0144030 0x7fcdd0154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcffff640 1 -- 172.21.15.57:0/3795553910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc009420 con 0x7fcdd00709c0 2023-11-24T08:05:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcffff640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd00709c0 0x7fcdd0155e10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc01a0b0 tx=0x7fcdbc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcd7fa640 1 -- 172.21.15.57:0/3795553910 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc004220 con 0x7fcdd00709c0 2023-11-24T08:05:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcd7fa640 1 -- 172.21.15.57:0/3795553910 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc004380 con 0x7fcdd00709c0 2023-11-24T08:05:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd0156f00 con 0x7fcdd00709c0 2023-11-24T08:05:36.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcd7fa640 1 -- 172.21.15.57:0/3795553910 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc003820 con 0x7fcdd00709c0 2023-11-24T08:05:36.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd0151ad0 con 0x7fcdd00709c0 2023-11-24T08:05:36.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd0156690 con 0x7fcdd00709c0 2023-11-24T08:05:36.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcd7fa640 1 -- 172.21.15.57:0/3795553910 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fcdbc0b2040 con 0x7fcdd00709c0 2023-11-24T08:05:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcd7fa640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcdb4066650 0x7fcdb4068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdcd7fa640 1 -- 172.21.15.57:0/3795553910 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdbc11e250 con 0x7fcdd00709c0 2023-11-24T08:05:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.517+0000 7fcdd4865640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcdb4066650 0x7fcdb4068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.521+0000 7fcdd4865640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcdb4066650 0x7fcdb4068b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4007bc0 tx=0x7fcdc4007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.521+0000 7fcdcd7fa640 1 -- 172.21.15.57:0/3795553910 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcdbc0eb330 con 0x7fcdd00709c0 2023-11-24T08:05:36.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.713+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcdd0067520 con 0x7fcdd00709c0 2023-11-24T08:05:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.713+0000 7fcdcd7fa640 1 -- 172.21.15.57:0/3795553910 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcdbc0b0060 con 0x7fcdd00709c0 2023-11-24T08:05:36.722 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:36.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcdb4066650 msgr2=0x7fcdb4068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcdb4066650 0x7fcdb4068b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4007bc0 tx=0x7fcdc4007b10 comp rx=0 tx=0).stop 2023-11-24T08:05:36.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd00709c0 msgr2=0x7fcdd0155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:36.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd00709c0 0x7fcdd0155e10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc01a0b0 tx=0x7fcdbc019220 comp rx=0 tx=0).stop 2023-11-24T08:05:36.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 shutdown_connections 2023-11-24T08:05:36.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcdb4066650 0x7fcdb4068b10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdd0144030 0x7fcdd0154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdd00709c0 0x7fcdd0155e10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 --2- 172.21.15.57:0/3795553910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcdd006c650 0x7fcdd0157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:36.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 >> 172.21.15.57:0/3795553910 conn(0x7fcdd00b0bf0 msgr2=0x7fcdd009af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:36.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 shutdown_connections 2023-11-24T08:05:36.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:36.717+0000 7fcdd6ac9640 1 -- 172.21.15.57:0/3795553910 wait complete. 2023-11-24T08:05:36.743 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:05:36.744 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:36.744 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-24T08:05:36.744 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:05:36.744 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:36.744 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:05:36.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:05:36.745 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:36.745 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:36.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.745 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-24T08:05:36.756 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-24T08:05:36.757 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42280sec preferred_lft 42280sec 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.758 INFO:teuthology.orchestra.run.smithi132.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 02:42:35:0c:2c:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:36.759 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T08:05:36.760 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.760 INFO:teuthology.orchestra.run.smithi132.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:36.760 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:36.760 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T08:05:36.760 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:36.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.761 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:36.825 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-24T08:05:36.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.828 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-24T08:05:36.884 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-24T08:05:36.884 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:36.884 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T08:05:36.884 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:36.885 INFO:teuthology.orchestra.run.smithi132.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:05:36.885 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:36.885 INFO:teuthology.orchestra.run.smithi132.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:05:36.885 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:05:36.885 INFO:teuthology.orchestra.run.smithi132.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:05:36.885 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:36.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.886 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:05:36.886 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:05:36.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:36.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:36.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:36.886 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:05:36.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.984 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:05:36.993 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:05:36.994 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:05:36.995 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:36.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:36.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-24T08:05:37.062 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:37.062 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:37.113 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:37.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:37.113 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:37.164 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T08:05:37.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:37.164 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:37.259 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:37.260 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:05:37.273 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:05:37.273 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:05:37.273 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:05:37.274 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with new device syntax: 1@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:05:37.274 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:05:37.277 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:05:37.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:37.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:37.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:37.298 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:05:37.351 INFO:teuthology.orchestra.run.smithi132.stdout:client5787 2023-11-24T08:05:37.352 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:37.352 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:37.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:05:37.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.553+0000 7f6de831c640 1 Processor -- start 2023-11-24T08:05:37.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.553+0000 7f6de831c640 1 -- start start 2023-11-24T08:05:37.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de831c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6de015d570 0x7f6de006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de831c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de00d3020 0x7f6de00d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de831c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de00d39d0 con 0x7f6de00d14b0 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de831c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de00d05b0 con 0x7f6de015d570 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de831c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00d0890 con 0x7f6de00d3020 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6de015d570 0x7f6de006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6de015d570 0x7f6de006bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52196/0 (socket says 172.21.15.57:52196) 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 -- 172.21.15.57:0/958119335 learned_addr learned my addr 172.21.15.57:0/958119335 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de68b9640 1 --2- 172.21.15.57:0/958119335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de00d3020 0x7f6de00d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 -- 172.21.15.57:0/958119335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de00d3020 msgr2=0x7f6de00d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 --2- 172.21.15.57:0/958119335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de00d3020 0x7f6de00d3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:37.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 -- 172.21.15.57:0/958119335 >> v1:172.21.15.132:6789/0 conn(0x7f6de00d14b0 legacy=0x7f6de00cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:37.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 -- 172.21.15.57:0/958119335 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de00d0b70 con 0x7f6de015d570 2023-11-24T08:05:37.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de68b9640 1 --2- 172.21.15.57:0/958119335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de00d3020 0x7f6de00d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de60b8640 1 --2- 172.21.15.57:0/958119335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de015d570 0x7f6de006bba0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6de008d720 tx=0x7f6ddc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0556032891779e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de50b6640 1 -- 172.21.15.57:0/958119335 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0ab600 con 0x7f6de015d570 2023-11-24T08:05:37.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de50b6640 1 -- 172.21.15.57:0/958119335 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc0a7050 con 0x7f6de015d570 2023-11-24T08:05:37.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.557+0000 7f6de50b6640 1 -- 172.21.15.57:0/958119335 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0ab980 con 0x7f6de015d570 2023-11-24T08:05:37.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- 172.21.15.57:0/958119335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de015d570 msgr2=0x7f6de006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:37.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 --2- 172.21.15.57:0/958119335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de015d570 0x7f6de006bba0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6de008d720 tx=0x7f6ddc01c3a0 comp rx=0 tx=0).stop 2023-11-24T08:05:37.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- 172.21.15.57:0/958119335 shutdown_connections 2023-11-24T08:05:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 --2- 172.21.15.57:0/958119335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de00d3020 0x7f6de00d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 --2- 172.21.15.57:0/958119335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de015d570 0x7f6de006bba0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- 172.21.15.57:0/958119335 >> 172.21.15.57:0/958119335 conn(0x7f6de008ceb0 msgr2=0x7f6de009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- 172.21.15.57:0/958119335 shutdown_connections 2023-11-24T08:05:37.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- 172.21.15.57:0/958119335 wait complete. 2023-11-24T08:05:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 Processor -- start 2023-11-24T08:05:37.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- start start 2023-11-24T08:05:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6de00d14b0 0x7f6de00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de00d3020 0x7f6de01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:37.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de015d570 0x7f6de00c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de01582f0 con 0x7f6de00d3020 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c96f0 con 0x7f6de00d14b0 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de831c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c99d0 con 0x7f6de015d570 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de58b7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de00d3020 0x7f6de01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de58b7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de00d3020 0x7f6de01578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52202/0 (socket says 172.21.15.57:52202) 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de58b7640 1 -- 172.21.15.57:0/1196470547 learned_addr learned my addr 172.21.15.57:0/1196470547 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de68b9640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de015d570 0x7f6de00c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de60b8640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6de00d14b0 0x7f6de00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de58b7640 1 -- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de015d570 msgr2=0x7f6de00c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de58b7640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de015d570 0x7f6de00c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:37.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de58b7640 1 -- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6de00d14b0 msgr2=0x7f6de00c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.561+0000 7f6de58b7640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6de00d14b0 0x7f6de00c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6de58b7640 1 -- 172.21.15.57:0/1196470547 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0094d0 con 0x7f6de00d3020 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6de60b8640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6de00d14b0 0x7f6de00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6de58b7640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de00d3020 0x7f6de01578d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c450 tx=0x7f6dd000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6dd6ffd640 1 -- 172.21.15.57:0/1196470547 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0012830 con 0x7f6de00d3020 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6dd6ffd640 1 -- 172.21.15.57:0/1196470547 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd00129b0 con 0x7f6de00d3020 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de00c9cb0 con 0x7f6de00d3020 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6dd6ffd640 1 -- 172.21.15.57:0/1196470547 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0012d60 con 0x7f6de00d3020 2023-11-24T08:05:37.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de00c7e20 con 0x7f6de00d3020 2023-11-24T08:05:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de0158430 con 0x7f6de00d3020 2023-11-24T08:05:37.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.565+0000 7f6dd6ffd640 1 -- 172.21.15.57:0/1196470547 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f6dd001c460 con 0x7f6de00d3020 2023-11-24T08:05:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.569+0000 7f6dd6ffd640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6dc4066620 0x7f6dc4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.569+0000 7f6dd6ffd640 1 -- 172.21.15.57:0/1196470547 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dd0083ff0 con 0x7f6de00d3020 2023-11-24T08:05:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.569+0000 7f6de60b8640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6dc4066620 0x7f6dc4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:37.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.569+0000 7f6de60b8640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6dc4066620 0x7f6dc4068ae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0ad000 tx=0x7f6ddc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:37.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.573+0000 7f6dd6ffd640 1 -- 172.21.15.57:0/1196470547 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6dd00b5280 con 0x7f6de00d3020 2023-11-24T08:05:37.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:37.765+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6de0067520 con 0x7f6de00d3020 2023-11-24T08:05:38.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.473+0000 7f6dd6ffd640 1 -- 172.21.15.57:0/1196470547 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6de0158430 con 0x7f6de00d3020 2023-11-24T08:05:38.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6dc4066620 msgr2=0x7f6dc4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6dc4066620 0x7f6dc4068ae0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0ad000 tx=0x7f6ddc0a6000 comp rx=0 tx=0).stop 2023-11-24T08:05:38.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de00d3020 msgr2=0x7f6de01578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de00d3020 0x7f6de01578d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c450 tx=0x7f6dd000c910 comp rx=0 tx=0).stop 2023-11-24T08:05:38.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 shutdown_connections 2023-11-24T08:05:38.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6dc4066620 0x7f6dc4068ae0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6de015d570 0x7f6de00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de00d3020 0x7f6de01578d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 --2- 172.21.15.57:0/1196470547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6de00d14b0 0x7f6de00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 >> 172.21.15.57:0/1196470547 conn(0x7f6de008ceb0 msgr2=0x7f6de00b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:38.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 shutdown_connections 2023-11-24T08:05:38.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.477+0000 7f6de831c640 1 -- 172.21.15.57:0/1196470547 wait complete. 2023-11-24T08:05:38.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:05:38.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b65d1640 1 Processor -- start 2023-11-24T08:05:38.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b65d1640 1 -- start start 2023-11-24T08:05:38.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b65d1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1b00b2550 0x7fa1b006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b65d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00d1000 0x7fa1b00ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b65d1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b00ce060 con 0x7fa1b00cfe40 2023-11-24T08:05:38.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b65d1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b00d1a10 con 0x7fa1b00b2550 2023-11-24T08:05:38.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b65d1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b00cded0 con 0x7fa1b00d1000 2023-11-24T08:05:38.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b4b6e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00d1000 0x7fa1b00ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1af7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1b00b2550 0x7fa1b006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b4b6e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00d1000 0x7fa1b00ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:56814/0 (socket says 172.21.15.57:56814) 2023-11-24T08:05:38.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1937419207 learned_addr learned my addr 172.21.15.57:0/1937419207 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:38.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1affff640 1 --1- 172.21.15.57:0/1937419207 >> v1:172.21.15.132:6789/0 conn(0x7fa1b00cfe40 0x7fa1b00d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:50942/0 (socket says 172.21.15.57:50942) 2023-11-24T08:05:38.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1937419207 >> v2:172.21.15.132:3300/0 conn(0x7fa1b00b2550 msgr2=0x7fa1b006b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:38.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b4b6e640 1 --2- 172.21.15.57:0/1937419207 >> v2:172.21.15.132:3300/0 conn(0x7fa1b00b2550 0x7fa1b006b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1937419207 >> v1:172.21.15.132:6789/0 conn(0x7fa1b00cfe40 legacy=0x7fa1b00d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1937419207 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b00d1c20 con 0x7fa1b00d1000 2023-11-24T08:05:38.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.657+0000 7fa1af7fe640 1 --2- 172.21.15.57:0/1937419207 >> v2:172.21.15.132:3300/0 conn(0x7fa1b00b2550 0x7fa1b006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:38.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b4b6e640 1 --2- 172.21.15.57:0/1937419207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00d1000 0x7fa1b00ce4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009e50 tx=0x7fa1a801c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb6f250c8e1e099 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1aeffd640 1 -- 172.21.15.57:0/1937419207 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80a56a0 con 0x7fa1b00d1000 2023-11-24T08:05:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1aeffd640 1 -- 172.21.15.57:0/1937419207 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a80a5800 con 0x7fa1b00d1000 2023-11-24T08:05:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1aeffd640 1 -- 172.21.15.57:0/1937419207 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80a5b90 con 0x7fa1b00d1000 2023-11-24T08:05:38.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1937419207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00d1000 msgr2=0x7fa1b00ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1937419207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00d1000 0x7fa1b00ce4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009e50 tx=0x7fa1a801c8f0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1937419207 shutdown_connections 2023-11-24T08:05:38.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1937419207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00d1000 0x7fa1b00ce4f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1937419207 >> v2:172.21.15.132:3300/0 conn(0x7fa1b00b2550 0x7fa1b006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1937419207 >> 172.21.15.57:0/1937419207 conn(0x7fa1b009c780 msgr2=0x7fa1b00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:38.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1937419207 shutdown_connections 2023-11-24T08:05:38.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.661+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1937419207 wait complete. 2023-11-24T08:05:38.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 Processor -- start 2023-11-24T08:05:38.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 -- start start 2023-11-24T08:05:38.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00b2550 0x7fa1b01564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00cfe40 0x7fa1b015f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d1000 0x7fa1b014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b015feb0 con 0x7fa1b00d1000 2023-11-24T08:05:38.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0157010 con 0x7fa1b00b2550 2023-11-24T08:05:38.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b65d1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0155a10 con 0x7fa1b00cfe40 2023-11-24T08:05:38.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d1000 0x7fa1b014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1af7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00cfe40 0x7fa1b015f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d1000 0x7fa1b014fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52210/0 (socket says 172.21.15.57:52210) 2023-11-24T08:05:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1285159107 learned_addr learned my addr 172.21.15.57:0/1285159107 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1affff640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00b2550 0x7fa1b01564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00cfe40 msgr2=0x7fa1b015f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00cfe40 0x7fa1b015f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00b2550 msgr2=0x7fa1b01564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00b2550 0x7fa1b01564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 -- 172.21.15.57:0/1285159107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4009420 con 0x7fa1b00d1000 2023-11-24T08:05:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.665+0000 7fa1b4b6e640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d1000 0x7fa1b014fb30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80af040 tx=0x7fa1a8019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1acff9640 1 -- 172.21.15.57:0/1285159107 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80b8640 con 0x7fa1b00d1000 2023-11-24T08:05:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1acff9640 1 -- 172.21.15.57:0/1285159107 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a80b87a0 con 0x7fa1b00d1000 2023-11-24T08:05:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1acff9640 1 -- 172.21.15.57:0/1285159107 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80b8b30 con 0x7fa1b00d1000 2023-11-24T08:05:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a8009b30 con 0x7fa1b00d1000 2023-11-24T08:05:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b0155fd0 con 0x7fa1b00d1000 2023-11-24T08:05:38.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b0155870 con 0x7fa1b00d1000 2023-11-24T08:05:38.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1acff9640 1 -- 172.21.15.57:0/1285159107 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fa1a80b8c90 con 0x7fa1b00d1000 2023-11-24T08:05:38.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1acff9640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa19c066620 0x7fa19c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:38.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1acff9640 1 -- 172.21.15.57:0/1285159107 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1a811f1b0 con 0x7fa1b00d1000 2023-11-24T08:05:38.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.669+0000 7fa1affff640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa19c066620 0x7fa19c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:38.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.673+0000 7fa1affff640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa19c066620 0x7fa19c068ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0000f70 tx=0x7fa1a0007e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:38.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.673+0000 7fa1acff9640 1 -- 172.21.15.57:0/1285159107 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa1b0155870 con 0x7fa1b00d1000 2023-11-24T08:05:38.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.853+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1b0155870 con 0x7fa19c066620 2023-11-24T08:05:38.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.853+0000 7fa1acff9640 1 -- 172.21.15.57:0/1285159107 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa1b0155870 con 0x7fa19c066620 2023-11-24T08:05:38.860 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-11-24T08:05:38.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:05:38.860 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs" 2023-11-24T08:05:38.860 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:05:38.860 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-11-24T08:05:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa19c066620 msgr2=0x7fa19c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa19c066620 0x7fa19c068ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0000f70 tx=0x7fa1a0007e50 comp rx=0 tx=0).stop 2023-11-24T08:05:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d1000 msgr2=0x7fa1b014fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d1000 0x7fa1b014fb30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80af040 tx=0x7fa1a8019690 comp rx=0 tx=0).stop 2023-11-24T08:05:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 shutdown_connections 2023-11-24T08:05:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa19c066620 0x7fa19c068ae0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d1000 0x7fa1b014fb30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1b00cfe40 0x7fa1b015f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 --2- 172.21.15.57:0/1285159107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00b2550 0x7fa1b01564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 >> 172.21.15.57:0/1285159107 conn(0x7fa1b009c780 msgr2=0x7fa1b00b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 shutdown_connections 2023-11-24T08:05:38.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:38.857+0000 7fa1b65d1640 1 -- 172.21.15.57:0/1285159107 wait complete. 2023-11-24T08:05:38.882 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:05:39.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f36a01a1640 1 Processor -- start 2023-11-24T08:05:39.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f36a01a1640 1 -- start start 2023-11-24T08:05:39.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f36a01a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f369815d630 0x7f36980cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f36a01a1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369806c620 con 0x7f36980cf4d0 2023-11-24T08:05:39.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f36a01a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36980cbd80 con 0x7f36980ce200 2023-11-24T08:05:39.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f36a01a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369806ba10 con 0x7f369815d630 2023-11-24T08:05:39.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f369e73e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f36980cf4d0 0x7f369806cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50974/0 (socket says 172.21.15.57:50974) 2023-11-24T08:05:39.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f369e73e640 1 -- 172.21.15.57:0/1195189543 learned_addr learned my addr 172.21.15.57:0/1195189543 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:39.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f369df3d640 1 --2- 172.21.15.57:0/1195189543 >> v2:172.21.15.132:3300/0 conn(0x7f369815d630 0x7f36980cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792780947 0 0) 0x7f369806c620 con 0x7f36980cf4d0 2023-11-24T08:05:39.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.021+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003530 con 0x7f36980cf4d0 2023-11-24T08:05:39.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486415178 0 0) 0x7f36980cbd80 con 0x7f36980ce200 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369806c620 con 0x7f36980ce200 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2640308750 0 0) 0x7f3684003530 con 0x7f36980cf4d0 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 >> v2:172.21.15.132:3300/0 conn(0x7f369815d630 msgr2=0x7f36980cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 --2- 172.21.15.57:0/1195189543 >> v2:172.21.15.132:3300/0 conn(0x7f369815d630 0x7f36980cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 >> v1:172.21.15.132:6789/0 conn(0x7f36980ce200 legacy=0x7f36980cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369806bcf0 con 0x7f36980cf4d0 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f3690001a00 con 0x7f36980cf4d0 2023-11-24T08:05:39.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 >> v1:172.21.15.57:6789/0 conn(0x7f36980cf4d0 legacy=0x7f369806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3684003b10 0x7f3684003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36840047d0 0x7f3684004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3684005190 0x7f368400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369806ba10 con 0x7f36840047d0 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c010 con 0x7f3684003b10 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c1d0 con 0x7f3684005190 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369d73c640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36840047d0 0x7f3684004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369df3d640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3684003b10 0x7f3684003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369e73e640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3684005190 0x7f368400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369d73c640 1 -- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3684005190 msgr2=0x7f368400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:39.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369d73c640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3684005190 0x7f368400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369d73c640 1 -- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3684003b10 msgr2=0x7f3684003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:39.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369d73c640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3684003b10 0x7f3684003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369d73c640 1 -- 172.21.15.57:0/1195189543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684003530 con 0x7f36840047d0 2023-11-24T08:05:39.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369e73e640 1 -- 172.21.15.57:0/1195189543 reap_dead start 2023-11-24T08:05:39.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.025+0000 7f369d73c640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36840047d0 0x7f3684004c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f36880018d0 tx=0x7f368801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815a0952f6ce3992 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880052d0 con 0x7f36840047d0 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688005450 con 0x7f36840047d0 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369cf3b640 1 -- 172.21.15.57:0/1195189543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880a8910 con 0x7f36840047d0 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- 172.21.15.57:0/1195189543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36840047d0 msgr2=0x7f3684004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36840047d0 0x7f3684004c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f36880018d0 tx=0x7f368801ecb0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- 172.21.15.57:0/1195189543 shutdown_connections 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 --2- 172.21.15.57:0/1195189543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36840047d0 0x7f3684004c50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- 172.21.15.57:0/1195189543 >> 172.21.15.57:0/1195189543 conn(0x7f369806e860 msgr2=0x7f369806ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- 172.21.15.57:0/1195189543 shutdown_connections 2023-11-24T08:05:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- 172.21.15.57:0/1195189543 wait complete. 2023-11-24T08:05:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 Processor -- start 2023-11-24T08:05:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- start start 2023-11-24T08:05:39.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36840047d0 0x7f3698153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f369815f5f0 0x7f369815fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36980c8a40 0x7f36980c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36980c9400 con 0x7f36980c8a40 2023-11-24T08:05:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3698153fd0 con 0x7f369815f5f0 2023-11-24T08:05:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f36a01a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3698160160 con 0x7f36840047d0 2023-11-24T08:05:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369e73e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36980c8a40 0x7f36980c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369e73e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36980c8a40 0x7f36980c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52238/0 (socket says 172.21.15.57:52238) 2023-11-24T08:05:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369df3d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36840047d0 0x7f3698153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369e73e640 1 -- 172.21.15.57:0/2601545177 learned_addr learned my addr 172.21.15.57:0/2601545177 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.029+0000 7f369d73c640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f369815f5f0 0x7f369815fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f369e73e640 1 -- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36840047d0 msgr2=0x7f3698153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f369e73e640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36840047d0 0x7f3698153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f369e73e640 1 -- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f369815f5f0 msgr2=0x7f369815fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f369e73e640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f369815f5f0 0x7f369815fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f369e73e640 1 -- 172.21.15.57:0/2601545177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698160440 con 0x7f36980c8a40 2023-11-24T08:05:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f369e73e640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36980c8a40 0x7f36980c8ec0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3690000f90 tx=0x7f3690007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f368e7fc640 1 -- 172.21.15.57:0/2601545177 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690017070 con 0x7f36980c8a40 2023-11-24T08:05:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f368e7fc640 1 -- 172.21.15.57:0/2601545177 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369000ea40 con 0x7f36980c8a40 2023-11-24T08:05:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f368e7fc640 1 -- 172.21.15.57:0/2601545177 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369000ebb0 con 0x7f36980c8a40 2023-11-24T08:05:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3698155090 con 0x7f36980c8a40 2023-11-24T08:05:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3698155650 con 0x7f36980c8a40 2023-11-24T08:05:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3698155840 con 0x7f36980c8a40 2023-11-24T08:05:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f368e7fc640 1 -- 172.21.15.57:0/2601545177 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f369000ed10 con 0x7f36980c8a40 2023-11-24T08:05:39.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f368e7fc640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f367c066620 0x7f367c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.033+0000 7f368e7fc640 1 -- 172.21.15.57:0/2601545177 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3690083d20 con 0x7f36980c8a40 2023-11-24T08:05:39.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.037+0000 7f369df3d640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f367c066620 0x7f367c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.037+0000 7f369df3d640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f367c066620 0x7f367c068ae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3694009b80 tx=0x7f3694009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.037+0000 7f368e7fc640 1 -- 172.21.15.57:0/2601545177 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3690050f10 con 0x7f36980c8a40 2023-11-24T08:05:39.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.197+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f369804e8c0 con 0x7f36980c8a40 2023-11-24T08:05:39.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.197+0000 7f368e7fc640 1 -- 172.21.15.57:0/2601545177 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3690054530 con 0x7f36980c8a40 2023-11-24T08:05:39.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f367c066620 msgr2=0x7f367c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f367c066620 0x7f367c068ae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3694009b80 tx=0x7f3694009190 comp rx=0 tx=0).stop 2023-11-24T08:05:39.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36980c8a40 msgr2=0x7f36980c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36980c8a40 0x7f36980c8ec0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3690000f90 tx=0x7f3690007b00 comp rx=0 tx=0).stop 2023-11-24T08:05:39.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 shutdown_connections 2023-11-24T08:05:39.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f367c066620 0x7f367c068ae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36980c8a40 0x7f36980c8ec0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f369815f5f0 0x7f369815fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 --2- 172.21.15.57:0/2601545177 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36840047d0 0x7f3698153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 >> 172.21.15.57:0/2601545177 conn(0x7f369806e860 msgr2=0x7f369815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:39.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 shutdown_connections 2023-11-24T08:05:39.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.201+0000 7f36a01a1640 1 -- 172.21.15.57:0/2601545177 wait complete. 2023-11-24T08:05:39.226 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:39.227 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:39.236 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:05:39.236 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:39.290 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:39.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0ee66b640 1 Processor -- start 2023-11-24T08:05:39.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0ee66b640 1 -- start start 2023-11-24T08:05:39.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0ee66b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e8147020 0x7fe0e80d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0ee66b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0e80d01e0 0x7fe0e80b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0ee66b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80cee60 con 0x7fe0e80d0640 2023-11-24T08:05:39.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0ee66b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80cf140 con 0x7fe0e80d01e0 2023-11-24T08:05:39.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0ee66b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80cf420 con 0x7fe0e8147020 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0e77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0e80d01e0 0x7fe0e80b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0e77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0e80d01e0 0x7fe0e80b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52246/0 (socket says 172.21.15.57:52246) 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.469+0000 7fe0e77fe640 1 -- 172.21.15.57:0/165551647 learned_addr learned my addr 172.21.15.57:0/165551647 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e7fff640 1 --2- 172.21.15.57:0/165551647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e8147020 0x7fe0e80d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e77fe640 1 -- 172.21.15.57:0/165551647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e8147020 msgr2=0x7fe0e80d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e77fe640 1 --2- 172.21.15.57:0/165551647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e8147020 0x7fe0e80d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e77fe640 1 -- 172.21.15.57:0/165551647 >> v1:172.21.15.132:6789/0 conn(0x7fe0e80d0640 legacy=0x7fe0e806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e77fe640 1 -- 172.21.15.57:0/165551647 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80cf700 con 0x7fe0e80d01e0 2023-11-24T08:05:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e77fe640 1 --2- 172.21.15.57:0/165551647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d01e0 0x7fe0e80b2e50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009870 tx=0x7fe0dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d0f64ad06fecc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e6ffd640 1 -- 172.21.15.57:0/165551647 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0aa670 con 0x7fe0e80d01e0 2023-11-24T08:05:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e6ffd640 1 -- 172.21.15.57:0/165551647 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0aa7d0 con 0x7fe0e80d01e0 2023-11-24T08:05:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0e6ffd640 1 -- 172.21.15.57:0/165551647 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0aab60 con 0x7fe0e80d01e0 2023-11-24T08:05:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0ee66b640 1 -- 172.21.15.57:0/165551647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d01e0 msgr2=0x7fe0e80b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.473+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/165551647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d01e0 0x7fe0e80b2e50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009870 tx=0x7fe0dc01c510 comp rx=0 tx=0).stop 2023-11-24T08:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- 172.21.15.57:0/165551647 shutdown_connections 2023-11-24T08:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/165551647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d01e0 0x7fe0e80b2e50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/165551647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e8147020 0x7fe0e80d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- 172.21.15.57:0/165551647 >> 172.21.15.57:0/165551647 conn(0x7fe0e8060fd0 msgr2=0x7fe0e80613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- 172.21.15.57:0/165551647 shutdown_connections 2023-11-24T08:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- 172.21.15.57:0/165551647 wait complete. 2023-11-24T08:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 Processor -- start 2023-11-24T08:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- start start 2023-11-24T08:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e80d01e0 0x7fe0e8156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d0640 0x7fe0e815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0e8147020 0x7fe0e815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8155d00 con 0x7fe0e80d0640 2023-11-24T08:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e815f140 con 0x7fe0e8147020 2023-11-24T08:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ee66b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e81556b0 con 0x7fe0e80d01e0 2023-11-24T08:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d0640 0x7fe0e815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d0640 0x7fe0e815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52256/0 (socket says 172.21.15.57:52256) 2023-11-24T08:05:39.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 -- 172.21.15.57:0/3851139973 learned_addr learned my addr 172.21.15.57:0/3851139973 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e7fff640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e80d01e0 0x7fe0e8156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ecc08640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0e8147020 0x7fe0e815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 -- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e80d01e0 msgr2=0x7fe0e8156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e80d01e0 0x7fe0e8156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 -- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0e8147020 msgr2=0x7fe0e815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0e8147020 0x7fe0e815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e77fe640 1 -- 172.21.15.57:0/3851139973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0094d0 con 0x7fe0e80d0640 2023-11-24T08:05:39.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0e7fff640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e80d01e0 0x7fe0e8156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.477+0000 7fe0ecc08640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0e8147020 0x7fe0e815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0e77fe640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d0640 0x7fe0e815dbc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc01a140 tx=0x7fe0dc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0e4ff9640 1 -- 172.21.15.57:0/3851139973 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0aa670 con 0x7fe0e80d0640 2023-11-24T08:05:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0e4ff9640 1 -- 172.21.15.57:0/3851139973 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0b3800 con 0x7fe0e80d0640 2023-11-24T08:05:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0e4ff9640 1 -- 172.21.15.57:0/3851139973 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0b3bb0 con 0x7fe0e80d0640 2023-11-24T08:05:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e81566c0 con 0x7fe0e80d0640 2023-11-24T08:05:39.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e81577b0 con 0x7fe0e80d0640 2023-11-24T08:05:39.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e8155e40 con 0x7fe0e80d0640 2023-11-24T08:05:39.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.481+0000 7fe0e4ff9640 1 -- 172.21.15.57:0/3851139973 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe0dc0b3d10 con 0x7fe0e80d0640 2023-11-24T08:05:39.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.485+0000 7fe0e4ff9640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe0d4066620 0x7fe0d4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.485+0000 7fe0e4ff9640 1 -- 172.21.15.57:0/3851139973 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0dc11edb0 con 0x7fe0e80d0640 2023-11-24T08:05:39.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.485+0000 7fe0e7fff640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe0d4066620 0x7fe0d4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.485+0000 7fe0e7fff640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe0d4066620 0x7fe0d4068ae0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80c7eb0 tx=0x7fe0d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.485+0000 7fe0e4ff9640 1 -- 172.21.15.57:0/3851139973 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0dc0ebfc0 con 0x7fe0e80d0640 2023-11-24T08:05:39.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.645+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0e8155e40 con 0x7fe0e80d0640 2023-11-24T08:05:39.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.645+0000 7fe0e4ff9640 1 -- 172.21.15.57:0/3851139973 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16453 (secure 0 0 0) 0x7fe0e8155e40 con 0x7fe0e80d0640 2023-11-24T08:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":48,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:25.775565+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe0d4066620 msgr2=0x7fe0d4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe0d4066620 0x7fe0d4068ae0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80c7eb0 tx=0x7fe0d8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d0640 msgr2=0x7fe0e815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d0640 0x7fe0e815dbc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc01a140 tx=0x7fe0dc01ad50 comp rx=0 tx=0).stop 2023-11-24T08:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 shutdown_connections 2023-11-24T08:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe0d4066620 0x7fe0d4068ae0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0e8147020 0x7fe0e815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0e80d0640 0x7fe0e815dbc0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 --2- 172.21.15.57:0/3851139973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0e80d01e0 0x7fe0e8156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 >> 172.21.15.57:0/3851139973 conn(0x7fe0e8060fd0 msgr2=0x7fe0e80cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 shutdown_connections 2023-11-24T08:05:39.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.649+0000 7fe0ee66b640 1 -- 172.21.15.57:0/3851139973 wait complete. 2023-11-24T08:05:39.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:22.550537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:23.148396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:39.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:39.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.817+0000 7f6c26e9c640 1 Processor -- start 2023-11-24T08:05:39.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.817+0000 7f6c26e9c640 1 -- start start 2023-11-24T08:05:39.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c26e9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6c20160970 0x7f6c200d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c26e9c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200cf0a0 con 0x7f6c200cdc60 2023-11-24T08:05:39.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c26e9c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200ce490 con 0x7f6c200d1de0 2023-11-24T08:05:39.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c26e9c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200ce770 con 0x7f6c20160970 2023-11-24T08:05:39.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c25e9a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6c20160970 0x7f6c200d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c25699640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6c200cdc60 0x7f6c200d16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50976/0 (socket says 172.21.15.57:50976) 2023-11-24T08:05:39.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c25699640 1 -- 172.21.15.57:0/851021543 learned_addr learned my addr 172.21.15.57:0/851021543 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:39.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c25e9a640 1 -- 172.21.15.57:0/851021543 >> v1:172.21.15.132:6789/0 conn(0x7f6c200d1de0 legacy=0x7f6c200cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:39.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c25e9a640 1 -- 172.21.15.57:0/851021543 >> v1:172.21.15.57:6789/0 conn(0x7f6c200cdc60 legacy=0x7f6c200d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.821+0000 7f6c25e9a640 1 -- 172.21.15.57:0/851021543 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200cea50 con 0x7f6c20160970 2023-11-24T08:05:39.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c25e9a640 1 --2- 172.21.15.57:0/851021543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c20160970 0x7f6c200d3d20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0097c0 tx=0x7f6c1c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab398ab3709eaf36 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c24e98640 1 -- 172.21.15.57:0/851021543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0a7070 con 0x7f6c20160970 2023-11-24T08:05:39.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c24e98640 1 -- 172.21.15.57:0/851021543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c0ab430 con 0x7f6c20160970 2023-11-24T08:05:39.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c24e98640 1 -- 172.21.15.57:0/851021543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0ab7c0 con 0x7f6c20160970 2023-11-24T08:05:39.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- 172.21.15.57:0/851021543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c20160970 msgr2=0x7f6c200d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/851021543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c20160970 0x7f6c200d3d20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0097c0 tx=0x7f6c1c01c410 comp rx=0 tx=0).stop 2023-11-24T08:05:39.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- 172.21.15.57:0/851021543 shutdown_connections 2023-11-24T08:05:39.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/851021543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c20160970 0x7f6c200d3d20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- 172.21.15.57:0/851021543 >> 172.21.15.57:0/851021543 conn(0x7f6c2009c5c0 msgr2=0x7f6c200d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:39.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- 172.21.15.57:0/851021543 shutdown_connections 2023-11-24T08:05:39.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- 172.21.15.57:0/851021543 wait complete. 2023-11-24T08:05:39.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 Processor -- start 2023-11-24T08:05:39.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- start start 2023-11-24T08:05:39.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200cdc60 0x7f6c2014eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c200d1de0 0x7f6c2014f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c20160970 0x7f6c2014cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200cad60 con 0x7f6c200d1de0 2023-11-24T08:05:39.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200ccdf0 con 0x7f6c200cdc60 2023-11-24T08:05:39.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c26e9c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200cd0d0 con 0x7f6c20160970 2023-11-24T08:05:39.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.825+0000 7f6c25699640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c200d1de0 0x7f6c2014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c200d1de0 0x7f6c2014f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52280/0 (socket says 172.21.15.57:52280) 2023-11-24T08:05:39.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 -- 172.21.15.57:0/1465053460 learned_addr learned my addr 172.21.15.57:0/1465053460 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:39.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25e9a640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200cdc60 0x7f6c2014eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c2669b640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c20160970 0x7f6c2014cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 -- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c20160970 msgr2=0x7f6c2014cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c20160970 0x7f6c2014cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 -- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200cdc60 msgr2=0x7f6c2014eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200cdc60 0x7f6c2014eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 -- 172.21.15.57:0/1465053460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c009420 con 0x7f6c200d1de0 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c25699640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c200d1de0 0x7f6c2014f060 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000c500 tx=0x7f6c1000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c167fc640 1 -- 172.21.15.57:0/1465053460 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10005cf0 con 0x7f6c200d1de0 2023-11-24T08:05:39.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c167fc640 1 -- 172.21.15.57:0/1465053460 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10005e50 con 0x7f6c200d1de0 2023-11-24T08:05:39.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c167fc640 1 -- 172.21.15.57:0/1465053460 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c100072f0 con 0x7f6c200d1de0 2023-11-24T08:05:39.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c200cd3b0 con 0x7f6c200d1de0 2023-11-24T08:05:39.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2014d310 con 0x7f6c200d1de0 2023-11-24T08:05:39.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2004e850 con 0x7f6c200d1de0 2023-11-24T08:05:39.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c167fc640 1 -- 172.21.15.57:0/1465053460 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f6c10007450 con 0x7f6c200d1de0 2023-11-24T08:05:39.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c167fc640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c04066620 0x7f6c04068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:39.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.829+0000 7f6c167fc640 1 -- 172.21.15.57:0/1465053460 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c10083540 con 0x7f6c200d1de0 2023-11-24T08:05:39.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.833+0000 7f6c25e9a640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c04066620 0x7f6c04068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:39.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.833+0000 7f6c25e9a640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c04066620 0x7f6c04068ae0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:39.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.833+0000 7f6c167fc640 1 -- 172.21.15.57:0/1465053460 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c10050930 con 0x7f6c200d1de0 2023-11-24T08:05:40.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.993+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c200d12a0 con 0x7f6c200d1de0 2023-11-24T08:05:40.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c167fc640 1 -- 172.21.15.57:0/1465053460 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c10017020 con 0x7f6c200d1de0 2023-11-24T08:05:40.002 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:05:40.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c04066620 msgr2=0x7f6c04068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c04066620 0x7f6c04068ae0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:40.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c200d1de0 msgr2=0x7f6c2014f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c200d1de0 0x7f6c2014f060 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000c500 tx=0x7f6c1000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 shutdown_connections 2023-11-24T08:05:40.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6c04066620 0x7f6c04068ae0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c20160970 0x7f6c2014cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c200d1de0 0x7f6c2014f060 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 --2- 172.21.15.57:0/1465053460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200cdc60 0x7f6c2014eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 >> 172.21.15.57:0/1465053460 conn(0x7f6c2009c5c0 msgr2=0x7f6c20158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 shutdown_connections 2023-11-24T08:05:40.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:39.997+0000 7f6c26e9c640 1 -- 172.21.15.57:0/1465053460 wait complete. 2023-11-24T08:05:40.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:40.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f538d632640 1 Processor -- start 2023-11-24T08:05:40.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f538d632640 1 -- start start 2023-11-24T08:05:40.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f538d632640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f538815d630 0x7f53880cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f538d632640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53880ce200 0x7f53880cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f538d632640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538806c620 con 0x7f53880cf300 2023-11-24T08:05:40.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f538d632640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880cf790 con 0x7f538815d630 2023-11-24T08:05:40.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f538d632640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880cbd80 con 0x7f53880ce200 2023-11-24T08:05:40.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f5386ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f538815d630 0x7f53880cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f5386ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f538815d630 0x7f53880cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52290/0 (socket says 172.21.15.57:52290) 2023-11-24T08:05:40.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f5386ffd640 1 -- 172.21.15.57:0/1254879578 learned_addr learned my addr 172.21.15.57:0/1254879578 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:40.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f53867fc640 1 --2- 172.21.15.57:0/1254879578 >> v2:172.21.15.132:3300/0 conn(0x7f53880ce200 0x7f53880cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f5386ffd640 1 -- 172.21.15.57:0/1254879578 >> v2:172.21.15.132:3300/0 conn(0x7f53880ce200 msgr2=0x7f53880cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f5386ffd640 1 --2- 172.21.15.57:0/1254879578 >> v2:172.21.15.132:3300/0 conn(0x7f53880ce200 0x7f53880cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f5386ffd640 1 -- 172.21.15.57:0/1254879578 >> v1:172.21.15.132:6789/0 conn(0x7f53880cf300 legacy=0x7f538806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.169+0000 7f5386ffd640 1 -- 172.21.15.57:0/1254879578 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538806ba10 con 0x7f538815d630 2023-11-24T08:05:40.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f5386ffd640 1 --2- 172.21.15.57:0/1254879578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f538815d630 0x7f53880cb840 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f538806e1d0 tx=0x7f537801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4d97414ed5a0a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f5385ffb640 1 -- 172.21.15.57:0/1254879578 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780aa5f0 con 0x7f538815d630 2023-11-24T08:05:40.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f5385ffb640 1 -- 172.21.15.57:0/1254879578 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53780aa750 con 0x7f538815d630 2023-11-24T08:05:40.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f5385ffb640 1 -- 172.21.15.57:0/1254879578 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780aaae0 con 0x7f538815d630 2023-11-24T08:05:40.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 -- 172.21.15.57:0/1254879578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f538815d630 msgr2=0x7f53880cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 --2- 172.21.15.57:0/1254879578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f538815d630 0x7f53880cb840 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f538806e1d0 tx=0x7f537801c490 comp rx=0 tx=0).stop 2023-11-24T08:05:40.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 -- 172.21.15.57:0/1254879578 shutdown_connections 2023-11-24T08:05:40.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 --2- 172.21.15.57:0/1254879578 >> v2:172.21.15.132:3300/0 conn(0x7f53880ce200 0x7f53880cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 --2- 172.21.15.57:0/1254879578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f538815d630 0x7f53880cb840 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 -- 172.21.15.57:0/1254879578 >> 172.21.15.57:0/1254879578 conn(0x7f538806e860 msgr2=0x7f538806ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 -- 172.21.15.57:0/1254879578 shutdown_connections 2023-11-24T08:05:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.173+0000 7f538d632640 1 -- 172.21.15.57:0/1254879578 wait complete. 2023-11-24T08:05:40.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 Processor -- start 2023-11-24T08:05:40.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 -- start start 2023-11-24T08:05:40.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880ce200 0x7f53880b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53880cf300 0x7f538815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f538815d630 0x7f5388154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881564b0 con 0x7f53880ce200 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388156d50 con 0x7f53880cf300 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53880b6ca0 con 0x7f538815d630 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880ce200 0x7f53880b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880ce200 0x7f53880b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52302/0 (socket says 172.21.15.57:52302) 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 -- 172.21.15.57:0/107823940 learned_addr learned my addr 172.21.15.57:0/107823940 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f53867fc640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53880cf300 0x7f538815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f53877fe640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f538815d630 0x7f5388154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 -- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f538815d630 msgr2=0x7f5388154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f538815d630 0x7f5388154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 -- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53880cf300 msgr2=0x7f538815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53880cf300 0x7f538815ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 -- 172.21.15.57:0/107823940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53780094d0 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f5386ffd640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880ce200 0x7f53880b6620 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f53780ac040 tx=0x7f537801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f536f7fe640 1 -- 172.21.15.57:0/107823940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780b3800 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f536f7fe640 1 -- 172.21.15.57:0/107823940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53780b3980 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f536f7fe640 1 -- 172.21.15.57:0/107823940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780b3d30 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5388156700 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5388157c30 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.177+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53880b2b50 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.181+0000 7f536f7fe640 1 -- 172.21.15.57:0/107823940 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f53780b2380 con 0x7f53880ce200 2023-11-24T08:05:40.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.181+0000 7f536f7fe640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5374066650 0x7f5374068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.181+0000 7f536f7fe640 1 -- 172.21.15.57:0/107823940 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53780a7070 con 0x7f53880ce200 2023-11-24T08:05:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.181+0000 7f53867fc640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5374066650 0x7f5374068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.181+0000 7f53867fc640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5374066650 0x7f5374068b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f538806c970 tx=0x7f537c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.185+0000 7f536f7fe640 1 -- 172.21.15.57:0/107823940 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53780eb570 con 0x7f53880ce200 2023-11-24T08:05:40.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f538804e8a0 con 0x7f53880ce200 2023-11-24T08:05:40.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f536f7fe640 1 -- 172.21.15.57:0/107823940 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53780eeb90 con 0x7f53880ce200 2023-11-24T08:05:40.348 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:05:40.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5374066650 msgr2=0x7f5374068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5374066650 0x7f5374068b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f538806c970 tx=0x7f537c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:40.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880ce200 msgr2=0x7f53880b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880ce200 0x7f53880b6620 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f53780ac040 tx=0x7f537801acd0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 shutdown_connections 2023-11-24T08:05:40.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5374066650 0x7f5374068b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f538815d630 0x7f5388154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53880cf300 0x7f538815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 --2- 172.21.15.57:0/107823940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53880ce200 0x7f53880b6620 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 >> 172.21.15.57:0/107823940 conn(0x7f538806e860 msgr2=0x7f538815c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 shutdown_connections 2023-11-24T08:05:40.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.341+0000 7f538d632640 1 -- 172.21.15.57:0/107823940 wait complete. 2023-11-24T08:05:40.369 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:40.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.509+0000 7fc7158d6640 1 Processor -- start 2023-11-24T08:05:40.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.509+0000 7fc7158d6640 1 -- start start 2023-11-24T08:05:40.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc7158d6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc71015d260 0x7fc7100cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc7158d6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc71015d640 0x7fc7100cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc7158d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc710160ff0 0x7fc71006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc7158d6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7100716f0 con 0x7fc71015d640 2023-11-24T08:05:40.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc7158d6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc710070400 con 0x7fc71015d260 2023-11-24T08:05:40.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc7158d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100b3ce0 con 0x7fc710160ff0 2023-11-24T08:05:40.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc71015d640 0x7fc7100cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc71015d640 0x7fc7100cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52308/0 (socket says 172.21.15.57:52308) 2023-11-24T08:05:40.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 -- 172.21.15.57:0/1290904153 learned_addr learned my addr 172.21.15.57:0/1290904153 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:40.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70effd640 1 --2- 172.21.15.57:0/1290904153 >> v2:172.21.15.132:3300/0 conn(0x7fc71015d260 0x7fc7100cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70f7fe640 1 --2- 172.21.15.57:0/1290904153 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc710160ff0 0x7fc71006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 -- 172.21.15.57:0/1290904153 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc710160ff0 msgr2=0x7fc71006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 --2- 172.21.15.57:0/1290904153 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc710160ff0 0x7fc71006d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 -- 172.21.15.57:0/1290904153 >> v2:172.21.15.132:3300/0 conn(0x7fc71015d260 msgr2=0x7fc7100cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 --2- 172.21.15.57:0/1290904153 >> v2:172.21.15.132:3300/0 conn(0x7fc71015d260 0x7fc7100cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70e7fc640 1 -- 172.21.15.57:0/1290904153 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710070650 con 0x7fc71015d640 2023-11-24T08:05:40.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.513+0000 7fc70f7fe640 1 --2- 172.21.15.57:0/1290904153 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc710160ff0 0x7fc71006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:40.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc70e7fc640 1 --2- 172.21.15.57:0/1290904153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc71015d640 0x7fc7100cf120 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc71006b590 tx=0x7fc70401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67d3475520d1970 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc70dffb640 1 -- 172.21.15.57:0/1290904153 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040aa5f0 con 0x7fc71015d640 2023-11-24T08:05:40.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc70dffb640 1 -- 172.21.15.57:0/1290904153 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7040aa750 con 0x7fc71015d640 2023-11-24T08:05:40.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc70dffb640 1 -- 172.21.15.57:0/1290904153 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040aaae0 con 0x7fc71015d640 2023-11-24T08:05:40.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 -- 172.21.15.57:0/1290904153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc71015d640 msgr2=0x7fc7100cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 --2- 172.21.15.57:0/1290904153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc71015d640 0x7fc7100cf120 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc71006b590 tx=0x7fc70401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 -- 172.21.15.57:0/1290904153 shutdown_connections 2023-11-24T08:05:40.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 --2- 172.21.15.57:0/1290904153 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc710160ff0 0x7fc71006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 --2- 172.21.15.57:0/1290904153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc71015d640 0x7fc7100cf120 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 --2- 172.21.15.57:0/1290904153 >> v2:172.21.15.132:3300/0 conn(0x7fc71015d260 0x7fc7100cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 -- 172.21.15.57:0/1290904153 >> 172.21.15.57:0/1290904153 conn(0x7fc71006ae90 msgr2=0x7fc7100b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 -- 172.21.15.57:0/1290904153 shutdown_connections 2023-11-24T08:05:40.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 -- 172.21.15.57:0/1290904153 wait complete. 2023-11-24T08:05:40.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.517+0000 7fc7158d6640 1 Processor -- start 2023-11-24T08:05:40.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 -- start start 2023-11-24T08:05:40.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71015d260 0x7fc7100cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc71015d640 0x7fc710160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc710160ff0 0x7fc710144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101f9a40 con 0x7fc710160ff0 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101f9c90 con 0x7fc71015d260 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101f9f70 con 0x7fc71015d640 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc710160ff0 0x7fc710144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc710160ff0 0x7fc710144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52322/0 (socket says 172.21.15.57:52322) 2023-11-24T08:05:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 -- 172.21.15.57:0/345965632 learned_addr learned my addr 172.21.15.57:0/345965632 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:40.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70e7fc640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc71015d640 0x7fc710160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70effd640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71015d260 0x7fc7100cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 -- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc71015d640 msgr2=0x7fc710160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc71015d640 0x7fc710160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 -- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71015d260 msgr2=0x7fc7100cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71015d260 0x7fc7100cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 -- 172.21.15.57:0/345965632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040094d0 con 0x7fc710160ff0 2023-11-24T08:05:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc70f7fe640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc710160ff0 0x7fc710144be0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc708007df0 tx=0x7fc70800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc6f7fff640 1 -- 172.21.15.57:0/345965632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080039a0 con 0x7fc710160ff0 2023-11-24T08:05:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc6f7fff640 1 -- 172.21.15.57:0/345965632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70800f040 con 0x7fc710160ff0 2023-11-24T08:05:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc6f7fff640 1 -- 172.21.15.57:0/345965632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708003d40 con 0x7fc710160ff0 2023-11-24T08:05:40.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7101fa250 con 0x7fc710160ff0 2023-11-24T08:05:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7101fa810 con 0x7fc710160ff0 2023-11-24T08:05:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.521+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71004e850 con 0x7fc710160ff0 2023-11-24T08:05:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.525+0000 7fc6f7fff640 1 -- 172.21.15.57:0/345965632 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc708004030 con 0x7fc710160ff0 2023-11-24T08:05:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.525+0000 7fc6f7fff640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc6fc066650 0x7fc6fc068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.525+0000 7fc6f7fff640 1 -- 172.21.15.57:0/345965632 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc7080844e0 con 0x7fc710160ff0 2023-11-24T08:05:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.525+0000 7fc70effd640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc6fc066650 0x7fc6fc068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.525+0000 7fc70effd640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc6fc066650 0x7fc6fc068b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc700009ae0 tx=0x7fc700009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.529+0000 7fc6f7fff640 1 -- 172.21.15.57:0/345965632 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc708051650 con 0x7fc710160ff0 2023-11-24T08:05:40.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.689+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc71006ec80 con 0x7fc710160ff0 2023-11-24T08:05:40.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.689+0000 7fc6f7fff640 1 -- 172.21.15.57:0/345965632 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc708054c70 con 0x7fc710160ff0 2023-11-24T08:05:40.697 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:05:40.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc6fc066650 msgr2=0x7fc6fc068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc6fc066650 0x7fc6fc068b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc700009ae0 tx=0x7fc700009190 comp rx=0 tx=0).stop 2023-11-24T08:05:40.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc710160ff0 msgr2=0x7fc710144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc710160ff0 0x7fc710144be0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc708007df0 tx=0x7fc70800d4a0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 shutdown_connections 2023-11-24T08:05:40.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc6fc066650 0x7fc6fc068b10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc710160ff0 0x7fc710144be0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc71015d640 0x7fc710160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 --2- 172.21.15.57:0/345965632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc71015d260 0x7fc7100cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 >> 172.21.15.57:0/345965632 conn(0x7fc71006ae90 msgr2=0x7fc7101504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 shutdown_connections 2023-11-24T08:05:40.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.693+0000 7fc7158d6640 1 -- 172.21.15.57:0/345965632 wait complete. 2023-11-24T08:05:40.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.857+0000 7f29fe254640 1 Processor -- start 2023-11-24T08:05:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.857+0000 7f29fe254640 1 -- start start 2023-11-24T08:05:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29fe254640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29f80cad20 0x7f29f80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29fe254640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f815a8b0 con 0x7f29f815a4d0 2023-11-24T08:05:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29fe254640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f80c9c30 con 0x7f29f806d740 2023-11-24T08:05:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29fe254640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80c9f60 con 0x7f29f80cad20 2023-11-24T08:05:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f29f815a4d0 0x7f29f815e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50982/0 (socket says 172.21.15.57:50982) 2023-11-24T08:05:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 -- 172.21.15.57:0/1978227067 learned_addr learned my addr 172.21.15.57:0/1978227067 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f6ffd640 1 --2- 172.21.15.57:0/1978227067 >> v2:172.21.15.132:3300/0 conn(0x7f29f80cad20 0x7f29f80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643097692 0 0) 0x7f29f815a8b0 con 0x7f29f815a4d0 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e0003530 con 0x7f29f815a4d0 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3751625694 0 0) 0x7f29e0003530 con 0x7f29f815a4d0 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 >> v2:172.21.15.132:3300/0 conn(0x7f29f80cad20 msgr2=0x7f29f80c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 --2- 172.21.15.57:0/1978227067 >> v2:172.21.15.132:3300/0 conn(0x7f29f80cad20 0x7f29f80c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 >> v1:172.21.15.132:6789/0 conn(0x7f29f806d740 legacy=0x7f29f806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80ca240 con 0x7f29f815a4d0 2023-11-24T08:05:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f29e8001680 con 0x7f29f815a4d0 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 >> v1:172.21.15.57:6789/0 conn(0x7f29f815a4d0 legacy=0x7f29f815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e0003980 0x7f29e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e00047d0 0x7f29e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29e0005190 0x7f29e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80c9f60 con 0x7f29e0003980 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e000c130 con 0x7f29e0005190 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e000c2f0 con 0x7f29e00047d0 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e0003980 0x7f29e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f7fff640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29e0005190 0x7f29e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f6ffd640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e00047d0 0x7f29e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 -- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e00047d0 msgr2=0x7f29e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e00047d0 0x7f29e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 -- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29e0005190 msgr2=0x7f29e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29e0005190 0x7f29e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f77fe640 1 -- 172.21.15.57:0/1978227067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0003530 con 0x7f29e0003980 2023-11-24T08:05:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.861+0000 7f29f7fff640 1 -- 172.21.15.57:0/1978227067 reap_dead start 2023-11-24T08:05:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29f77fe640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e0003980 0x7f29e0003da0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c240 tx=0x7f29e801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241541c94ed29b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8005ae0 con 0x7f29e0003980 2023-11-24T08:05:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e8005c40 con 0x7f29e0003980 2023-11-24T08:05:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29f67fc640 1 -- 172.21.15.57:0/1978227067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e80a5a40 con 0x7f29e0003980 2023-11-24T08:05:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29fe254640 1 -- 172.21.15.57:0/1978227067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e0003980 msgr2=0x7f29e0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29fe254640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e0003980 0x7f29e0003da0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c240 tx=0x7f29e801cc10 comp rx=0 tx=0).stop 2023-11-24T08:05:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29fe254640 1 -- 172.21.15.57:0/1978227067 shutdown_connections 2023-11-24T08:05:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29fe254640 1 --2- 172.21.15.57:0/1978227067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e0003980 0x7f29e0003da0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29fe254640 1 -- 172.21.15.57:0/1978227067 >> 172.21.15.57:0/1978227067 conn(0x7f29f80b0bf0 msgr2=0x7f29f80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29fe254640 1 -- 172.21.15.57:0/1978227067 shutdown_connections 2023-11-24T08:05:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.865+0000 7f29fe254640 1 -- 172.21.15.57:0/1978227067 wait complete. 2023-11-24T08:05:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 Processor -- start 2023-11-24T08:05:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 -- start start 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e0003980 0x7f29f80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29f8159530 0x7f29f80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f80c80b0 0x7f29f80c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b3490 con 0x7f29f80c80b0 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80c8850 con 0x7f29f8159530 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b2dd0 con 0x7f29e0003980 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f80c80b0 0x7f29f80c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f80c80b0 0x7f29f80c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52340/0 (socket says 172.21.15.57:52340) 2023-11-24T08:05:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 -- 172.21.15.57:0/2149259337 learned_addr learned my addr 172.21.15.57:0/2149259337 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f77fe640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e0003980 0x7f29f80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f6ffd640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29f8159530 0x7f29f80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 -- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e0003980 msgr2=0x7f29f80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e0003980 0x7f29f80b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 -- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29f8159530 msgr2=0x7f29f80b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29f8159530 0x7f29f80b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 -- 172.21.15.57:0/2149259337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80b30b0 con 0x7f29f80c80b0 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29f7fff640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f80c80b0 0x7f29f80c4b40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f29f80729f0 tx=0x7f29f000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29dffff640 1 -- 172.21.15.57:0/2149259337 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f000fec0 con 0x7f29f80c80b0 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29dffff640 1 -- 172.21.15.57:0/2149259337 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f0006d70 con 0x7f29f80c80b0 2023-11-24T08:05:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80c8530 con 0x7f29f80c80b0 2023-11-24T08:05:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29dffff640 1 -- 172.21.15.57:0/2149259337 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0003ba0 con 0x7f29f80c80b0 2023-11-24T08:05:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.869+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f80c5080 con 0x7f29f80c80b0 2023-11-24T08:05:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.873+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f80b35d0 con 0x7f29f80c80b0 2023-11-24T08:05:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.873+0000 7f29dffff640 1 -- 172.21.15.57:0/2149259337 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f29f0003d00 con 0x7f29f80c80b0 2023-11-24T08:05:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.873+0000 7f29dffff640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f29e4066620 0x7f29e4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.873+0000 7f29dffff640 1 -- 172.21.15.57:0/2149259337 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f29f0083890 con 0x7f29f80c80b0 2023-11-24T08:05:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.873+0000 7f29f77fe640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f29e4066620 0x7f29e4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.873+0000 7f29f77fe640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f29e4066620 0x7f29e4068ae0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ab000 tx=0x7f29e80b1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:40.877+0000 7f29dffff640 1 -- 172.21.15.57:0/2149259337 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29f80b35d0 con 0x7f29f80c80b0 2023-11-24T08:05:41.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f29f80b35d0 con 0x7f29f80c80b0 2023-11-24T08:05:41.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29dffff640 1 -- 172.21.15.57:0/2149259337 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f29f80b35d0 con 0x7f29f80c80b0 2023-11-24T08:05:41.052 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:05:41.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f29e4066620 msgr2=0x7f29e4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f29e4066620 0x7f29e4068ae0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ab000 tx=0x7f29e80b1040 comp rx=0 tx=0).stop 2023-11-24T08:05:41.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f80c80b0 msgr2=0x7f29f80c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f80c80b0 0x7f29f80c4b40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f29f80729f0 tx=0x7f29f000fbb0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 shutdown_connections 2023-11-24T08:05:41.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f29e4066620 0x7f29e4068ae0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f80c80b0 0x7f29f80c4b40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29f8159530 0x7f29f80b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 --2- 172.21.15.57:0/2149259337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29e0003980 0x7f29f80b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 >> 172.21.15.57:0/2149259337 conn(0x7f29f80b0bf0 msgr2=0x7f29f80cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 shutdown_connections 2023-11-24T08:05:41.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.044+0000 7f29fe254640 1 -- 172.21.15.57:0/2149259337 wait complete. 2023-11-24T08:05:41.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:05:41.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:41.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:41.106 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:05:41.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:41.106 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:05:41.160 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:41.160 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:41.170 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:05:41.171 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:41.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:41.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.360+0000 7fb9cca9c640 1 Processor -- start 2023-11-24T08:05:41.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.360+0000 7fb9cca9c640 1 -- start start 2023-11-24T08:05:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.360+0000 7fb9cca9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9c8147020 0x7fb9c80d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.360+0000 7fb9cca9c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80cee60 con 0x7fb9c80b3560 2023-11-24T08:05:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.360+0000 7fb9cca9c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80cf140 con 0x7fb9c80d01e0 2023-11-24T08:05:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.360+0000 7fb9cca9c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c80cf420 con 0x7fb9c8147020 2023-11-24T08:05:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c659c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9c8147020 0x7fb9c80d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c6d9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb9c80b3560 0x7fb9c806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50998/0 (socket says 172.21.15.57:50998) 2023-11-24T08:05:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c6d9d640 1 -- 172.21.15.57:0/437615723 learned_addr learned my addr 172.21.15.57:0/437615723 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c659c640 1 -- 172.21.15.57:0/437615723 >> v1:172.21.15.132:6789/0 conn(0x7fb9c80d01e0 legacy=0x7fb9c80b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c659c640 1 -- 172.21.15.57:0/437615723 >> v1:172.21.15.57:6789/0 conn(0x7fb9c80b3560 legacy=0x7fb9c806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c659c640 1 -- 172.21.15.57:0/437615723 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80cf700 con 0x7fb9c8147020 2023-11-24T08:05:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c5d9b640 1 -- 172.21.15.57:0/437615723 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898605397 0 0) 0x7fb9c80cee60 con 0x7fb9c80b3560 2023-11-24T08:05:41.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c659c640 1 --2- 172.21.15.57:0/437615723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c8147020 0x7fb9c80d1a90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80097c0 tx=0x7fb9b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48245d89769648d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c5d9b640 1 -- 172.21.15.57:0/437615723 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80ab610 con 0x7fb9c8147020 2023-11-24T08:05:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c5d9b640 1 -- 172.21.15.57:0/437615723 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b80ab770 con 0x7fb9c8147020 2023-11-24T08:05:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.364+0000 7fb9c5d9b640 1 -- 172.21.15.57:0/437615723 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80abb00 con 0x7fb9c8147020 2023-11-24T08:05:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- 172.21.15.57:0/437615723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c8147020 msgr2=0x7fb9c80d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/437615723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c8147020 0x7fb9c80d1a90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80097c0 tx=0x7fb9b801c410 comp rx=0 tx=0).stop 2023-11-24T08:05:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- 172.21.15.57:0/437615723 shutdown_connections 2023-11-24T08:05:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/437615723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c8147020 0x7fb9c80d1a90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- 172.21.15.57:0/437615723 >> 172.21.15.57:0/437615723 conn(0x7fb9c8060fd0 msgr2=0x7fb9c80613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- 172.21.15.57:0/437615723 shutdown_connections 2023-11-24T08:05:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- 172.21.15.57:0/437615723 wait complete. 2023-11-24T08:05:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 Processor -- start 2023-11-24T08:05:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- start start 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9c80b3560 0x7fb9c8155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c80d01e0 0x7fb9c815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8147020 0x7fb9c815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8160ad0 con 0x7fb9c80d01e0 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80c8360 con 0x7fb9c8147020 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9cca9c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c815bc20 con 0x7fb9c80b3560 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c80d01e0 0x7fb9c815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9bffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c80d01e0 0x7fb9c815c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52370/0 (socket says 172.21.15.57:52370) 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9bffff640 1 -- 172.21.15.57:0/2331716614 learned_addr learned my addr 172.21.15.57:0/2331716614 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9c659c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9c80b3560 0x7fb9c8155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.368+0000 7fb9c6d9d640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8147020 0x7fb9c815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9bffff640 1 -- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9c80b3560 msgr2=0x7fb9c8155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9bffff640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9c80b3560 0x7fb9c8155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9bffff640 1 -- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8147020 msgr2=0x7fb9c815c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9bffff640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8147020 0x7fb9c815c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9bffff640 1 -- 172.21.15.57:0/2331716614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8009420 con 0x7fb9c80d01e0 2023-11-24T08:05:41.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9bffff640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c80d01e0 0x7fb9c815c100 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c450 tx=0x7fb9b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9beffd640 1 -- 172.21.15.57:0/2331716614 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0012830 con 0x7fb9c80d01e0 2023-11-24T08:05:41.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9beffd640 1 -- 172.21.15.57:0/2331716614 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b00129b0 con 0x7fb9c80d01e0 2023-11-24T08:05:41.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9beffd640 1 -- 172.21.15.57:0/2331716614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0012d60 con 0x7fb9c80d01e0 2023-11-24T08:05:41.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c80c8b30 con 0x7fb9c80d01e0 2023-11-24T08:05:41.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c80c8850 con 0x7fb9c80d01e0 2023-11-24T08:05:41.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c815ba80 con 0x7fb9c80d01e0 2023-11-24T08:05:41.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9beffd640 1 -- 172.21.15.57:0/2331716614 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fb9b001c460 con 0x7fb9c80d01e0 2023-11-24T08:05:41.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9beffd640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9a8066650 0x7fb9a8068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9beffd640 1 -- 172.21.15.57:0/2331716614 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb9b0083ee0 con 0x7fb9c80d01e0 2023-11-24T08:05:41.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.372+0000 7fb9c659c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9a8066650 0x7fb9a8068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.376+0000 7fb9c659c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9a8066650 0x7fb9a8068b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80af000 tx=0x7fb9b80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.376+0000 7fb9beffd640 1 -- 172.21.15.57:0/2331716614 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9c815ba80 con 0x7fb9c80d01e0 2023-11-24T08:05:41.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.540+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9c815ba80 con 0x7fb9c80d01e0 2023-11-24T08:05:41.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.540+0000 7fb9beffd640 1 -- 172.21.15.57:0/2331716614 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fb9c815ba80 con 0x7fb9c80d01e0 2023-11-24T08:05:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:41.551 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":50,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:41.507365+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:41.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9a8066650 msgr2=0x7fb9a8068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9a8066650 0x7fb9a8068b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80af000 tx=0x7fb9b80a7000 comp rx=0 tx=0).stop 2023-11-24T08:05:41.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c80d01e0 msgr2=0x7fb9c815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c80d01e0 0x7fb9c815c100 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c450 tx=0x7fb9b000c910 comp rx=0 tx=0).stop 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 shutdown_connections 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9a8066650 0x7fb9a8068b10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8147020 0x7fb9c815c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9c80d01e0 0x7fb9c815c100 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 --2- 172.21.15.57:0/2331716614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9c80b3560 0x7fb9c8155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 >> 172.21.15.57:0/2331716614 conn(0x7fb9c8060fd0 msgr2=0x7fb9c80cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 shutdown_connections 2023-11-24T08:05:41.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.544+0000 7fb9cca9c640 1 -- 172.21.15.57:0/2331716614 wait complete. 2023-11-24T08:05:41.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:22.550537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:23.148396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:41.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd95232640 1 Processor -- start 2023-11-24T08:05:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd95232640 1 -- start start 2023-11-24T08:05:41.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd95232640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900ae4a0 0x7fbd9015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd95232640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd900cd850 0x7fbd900cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd95232640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900b3510 con 0x7fbd900ce250 2023-11-24T08:05:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd95232640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900ce6e0 con 0x7fbd900cd850 2023-11-24T08:05:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd95232640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900b37f0 con 0x7fbd900ae4a0 2023-11-24T08:05:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd87fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd900cd850 0x7fbd900cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd87fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd900cd850 0x7fbd900cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52372/0 (socket says 172.21.15.57:52372) 2023-11-24T08:05:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd87fff640 1 -- 172.21.15.57:0/1730543749 learned_addr learned my addr 172.21.15.57:0/1730543749 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:41.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd87fff640 1 -- 172.21.15.57:0/1730543749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900ae4a0 msgr2=0x7fbd9015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd8ed9d640 1 --2- 172.21.15.57:0/1730543749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900ae4a0 0x7fbd9015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd87fff640 1 --2- 172.21.15.57:0/1730543749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900ae4a0 0x7fbd9015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd87fff640 1 -- 172.21.15.57:0/1730543749 >> v1:172.21.15.132:6789/0 conn(0x7fbd900ce250 legacy=0x7fbd9015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:41.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd87fff640 1 -- 172.21.15.57:0/1730543749 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900b3ad0 con 0x7fbd900cd850 2023-11-24T08:05:41.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.712+0000 7fbd8ed9d640 1 --2- 172.21.15.57:0/1730543749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900ae4a0 0x7fbd9015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:41.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd87fff640 1 --2- 172.21.15.57:0/1730543749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900cd850 0x7fbd900cdd10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009870 tx=0x7fbd7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9a9dc02d6c81c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd8e59c640 1 -- 172.21.15.57:0/1730543749 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd780aa5f0 con 0x7fbd900cd850 2023-11-24T08:05:41.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd8e59c640 1 -- 172.21.15.57:0/1730543749 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd780aa750 con 0x7fbd900cd850 2023-11-24T08:05:41.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd8e59c640 1 -- 172.21.15.57:0/1730543749 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd780aaae0 con 0x7fbd900cd850 2023-11-24T08:05:41.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 -- 172.21.15.57:0/1730543749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900cd850 msgr2=0x7fbd900cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 --2- 172.21.15.57:0/1730543749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900cd850 0x7fbd900cdd10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009870 tx=0x7fbd7801c4d0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 -- 172.21.15.57:0/1730543749 shutdown_connections 2023-11-24T08:05:41.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 --2- 172.21.15.57:0/1730543749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900cd850 0x7fbd900cdd10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 --2- 172.21.15.57:0/1730543749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900ae4a0 0x7fbd9015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 -- 172.21.15.57:0/1730543749 >> 172.21.15.57:0/1730543749 conn(0x7fbd900b0c80 msgr2=0x7fbd900b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 -- 172.21.15.57:0/1730543749 shutdown_connections 2023-11-24T08:05:41.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.716+0000 7fbd95232640 1 -- 172.21.15.57:0/1730543749 wait complete. 2023-11-24T08:05:41.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 Processor -- start 2023-11-24T08:05:41.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 -- start start 2023-11-24T08:05:41.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900ae4a0 0x7fbd901424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900cd850 0x7fbd901463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd900ce250 0x7fbd90145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd90147990 con 0x7fbd900ae4a0 2023-11-24T08:05:41.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd90146d80 con 0x7fbd900ce250 2023-11-24T08:05:41.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd90147060 con 0x7fbd900cd850 2023-11-24T08:05:41.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900ae4a0 0x7fbd901424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900ae4a0 0x7fbd901424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52380/0 (socket says 172.21.15.57:52380) 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 -- 172.21.15.57:0/396792056 learned_addr learned my addr 172.21.15.57:0/396792056 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8f59e640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd900ce250 0x7fbd90145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd87fff640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900cd850 0x7fbd901463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 -- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900cd850 msgr2=0x7fbd901463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900cd850 0x7fbd901463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 -- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd900ce250 msgr2=0x7fbd90145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd900ce250 0x7fbd90145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 -- 172.21.15.57:0/396792056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd780094d0 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8f59e640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd900ce250 0x7fbd90145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd87fff640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900cd850 0x7fbd901463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd8ed9d640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900ae4a0 0x7fbd901424b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c7c0 tx=0x7fbd8000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd877fe640 1 -- 172.21.15.57:0/396792056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80007a30 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd877fe640 1 -- 172.21.15.57:0/396792056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80007b90 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd877fe640 1 -- 172.21.15.57:0/396792056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000ce70 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd90147340 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.720+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd901429f0 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.724+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9004e8c0 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.724+0000 7fbd877fe640 1 -- 172.21.15.57:0/396792056 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fbd800193f0 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.724+0000 7fbd877fe640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd70066620 0x7fbd70068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.724+0000 7fbd877fe640 1 -- 172.21.15.57:0/396792056 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbd800847b0 con 0x7fbd900ae4a0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.724+0000 7fbd87fff640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd70066620 0x7fbd70068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:41.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.724+0000 7fbd87fff640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd70066620 0x7fbd70068ae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbd780ae000 tx=0x7fbd78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:41.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.728+0000 7fbd877fe640 1 -- 172.21.15.57:0/396792056 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd80051850 con 0x7fbd900ae4a0 2023-11-24T08:05:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd900cd630 con 0x7fbd900ae4a0 2023-11-24T08:05:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd877fe640 1 -- 172.21.15.57:0/396792056 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd8001e020 con 0x7fbd900ae4a0 2023-11-24T08:05:41.895 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:05:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd70066620 msgr2=0x7fbd70068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd70066620 0x7fbd70068ae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbd780ae000 tx=0x7fbd78008040 comp rx=0 tx=0).stop 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900ae4a0 msgr2=0x7fbd901424b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900ae4a0 0x7fbd901424b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c7c0 tx=0x7fbd8000cc80 comp rx=0 tx=0).stop 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 shutdown_connections 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbd70066620 0x7fbd70068ae0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd900ce250 0x7fbd90145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbd900cd850 0x7fbd901463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 --2- 172.21.15.57:0/396792056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd900ae4a0 0x7fbd901424b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 >> 172.21.15.57:0/396792056 conn(0x7fbd900b0c80 msgr2=0x7fbd900af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 shutdown_connections 2023-11-24T08:05:41.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:41.888+0000 7fbd95232640 1 -- 172.21.15.57:0/396792056 wait complete. 2023-11-24T08:05:41.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2df5994640 1 Processor -- start 2023-11-24T08:05:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2df5994640 1 -- start start 2023-11-24T08:05:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2df5994640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2df00ccef0 0x7f2df006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2df5994640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df0163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2df5994640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df015a050 con 0x7f2df00b1f80 2023-11-24T08:05:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2df5994640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df00722e0 con 0x7f2df00ccef0 2023-11-24T08:05:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2df5994640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df0072860 con 0x7f2df00ce2e0 2023-11-24T08:05:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2deeffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2df00ccef0 0x7f2df006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2def7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df0163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2deeffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2df00ccef0 0x7f2df006d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:46200/0 (socket says 172.21.15.57:46200) 2023-11-24T08:05:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2deeffd640 1 -- 172.21.15.57:0/101079300 learned_addr learned my addr 172.21.15.57:0/101079300 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.056+0000 7f2def7fe640 1 --2- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df0163730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:56966/0 (socket says 172.21.15.57:56966) 2023-11-24T08:05:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2deeffd640 1 -- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 msgr2=0x7f2df0163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2deeffd640 1 --2- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df0163730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2deeffd640 1 -- 172.21.15.57:0/101079300 >> v1:172.21.15.132:6789/0 conn(0x7f2df00b1f80 legacy=0x7f2df006d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2deeffd640 1 -- 172.21.15.57:0/101079300 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00705e0 con 0x7f2df00ccef0 2023-11-24T08:05:42.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2def7fe640 1 --2- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df0163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:05:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2deeffd640 1 --2- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00ccef0 0x7f2df006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009870 tx=0x7f2de001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba6ff4812e852e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2dee7fc640 1 -- 172.21.15.57:0/101079300 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00aa5f0 con 0x7f2df00ccef0 2023-11-24T08:05:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2dee7fc640 1 -- 172.21.15.57:0/101079300 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de00aa750 con 0x7f2df00ccef0 2023-11-24T08:05:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.060+0000 7f2dee7fc640 1 -- 172.21.15.57:0/101079300 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00aaae0 con 0x7f2df00ccef0 2023-11-24T08:05:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00ccef0 msgr2=0x7f2df006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 --2- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00ccef0 0x7f2df006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009870 tx=0x7f2de001c510 comp rx=0 tx=0).stop 2023-11-24T08:05:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- 172.21.15.57:0/101079300 shutdown_connections 2023-11-24T08:05:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 --2- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df0163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 --2- 172.21.15.57:0/101079300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00ccef0 0x7f2df006d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- 172.21.15.57:0/101079300 >> 172.21.15.57:0/101079300 conn(0x7f2df00b0c80 msgr2=0x7f2df00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- 172.21.15.57:0/101079300 shutdown_connections 2023-11-24T08:05:42.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- 172.21.15.57:0/101079300 wait complete. 2023-11-24T08:05:42.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 Processor -- start 2023-11-24T08:05:42.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- start start 2023-11-24T08:05:42.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00b1f80 0x7f2df014a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2df00ccef0 0x7f2df00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df00b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df015b940 con 0x7f2df00ccef0 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df015bc20 con 0x7f2df00b1f80 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2df5994640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df015bf00 con 0x7f2df00ce2e0 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2df00ccef0 0x7f2df00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2df00ccef0 0x7f2df00b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52386/0 (socket says 172.21.15.57:52386) 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 -- 172.21.15.57:0/1047317469 learned_addr learned my addr 172.21.15.57:0/1047317469 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2deeffd640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00b1f80 0x7f2df014a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2def7fe640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df00b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 -- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 msgr2=0x7f2df00b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df00b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 -- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00b1f80 msgr2=0x7f2df014a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00b1f80 0x7f2df014a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 -- 172.21.15.57:0/1047317469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de800ab80 con 0x7f2df00ccef0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.064+0000 7f2de7fff640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2df00ccef0 0x7f2df00b3490 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c4d0 tx=0x7f2dd800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2decff9640 1 -- 172.21.15.57:0/1047317469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80052d0 con 0x7f2df00ccef0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2decff9640 1 -- 172.21.15.57:0/1047317469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd8005430 con 0x7f2df00ccef0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2decff9640 1 -- 172.21.15.57:0/1047317469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8012830 con 0x7f2df00ccef0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de00094d0 con 0x7f2df00ccef0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df0156720 con 0x7f2df00ccef0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df0156940 con 0x7f2df00ccef0 2023-11-24T08:05:42.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2decff9640 1 -- 172.21.15.57:0/1047317469 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f2dd8012990 con 0x7f2df00ccef0 2023-11-24T08:05:42.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2decff9640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2dd0066620 0x7f2dd0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2decff9640 1 -- 172.21.15.57:0/1047317469 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2dd8083bb0 con 0x7f2df00ccef0 2023-11-24T08:05:42.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.068+0000 7f2deeffd640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2dd0066620 0x7f2dd0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.072+0000 7f2deeffd640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2dd0066620 0x7f2dd0068ae0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ae000 tx=0x7f2de00b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.072+0000 7f2decff9640 1 -- 172.21.15.57:0/1047317469 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2dd8050e10 con 0x7f2df00ccef0 2023-11-24T08:05:42.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.228+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2df015ba80 con 0x7f2df00ccef0 2023-11-24T08:05:42.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.228+0000 7f2decff9640 1 -- 172.21.15.57:0/1047317469 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2df015ba80 con 0x7f2df00ccef0 2023-11-24T08:05:42.238 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:05:42.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2dd0066620 msgr2=0x7f2dd0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2dd0066620 0x7f2dd0068ae0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ae000 tx=0x7f2de00b5040 comp rx=0 tx=0).stop 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2df00ccef0 msgr2=0x7f2df00b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2df00ccef0 0x7f2df00b3490 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c4d0 tx=0x7f2dd800c990 comp rx=0 tx=0).stop 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 shutdown_connections 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2dd0066620 0x7f2dd0068ae0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2df00ce2e0 0x7f2df00b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2df00ccef0 0x7f2df00b3490 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 --2- 172.21.15.57:0/1047317469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df00b1f80 0x7f2df014a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 >> 172.21.15.57:0/1047317469 conn(0x7f2df00b0c80 msgr2=0x7f2df006d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 shutdown_connections 2023-11-24T08:05:42.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.232+0000 7f2df5994640 1 -- 172.21.15.57:0/1047317469 wait complete. 2023-11-24T08:05:42.259 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:42.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.396+0000 7fd21e772640 1 Processor -- start 2023-11-24T08:05:42.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.396+0000 7fd21e772640 1 -- start start 2023-11-24T08:05:42.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd21e772640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd21806d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd21e772640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2180b1f80 0x7fd21806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd21e772640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21815a050 con 0x7fd21806ddb0 2023-11-24T08:05:42.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd21e772640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180722e0 con 0x7fd2180b1f80 2023-11-24T08:05:42.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd21e772640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd218072860 con 0x7fd2180ccef0 2023-11-24T08:05:42.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd2177fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd2180b1f80 0x7fd21806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd21cd0f640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd21806ddb0 0x7fd2180cd2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51000/0 (socket says 172.21.15.57:51000) 2023-11-24T08:05:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd21cd0f640 1 -- 172.21.15.57:0/1611233766 learned_addr learned my addr 172.21.15.57:0/1611233766 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd217fff640 1 --2- 172.21.15.57:0/1611233766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd21806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd2177fe640 1 -- 172.21.15.57:0/1611233766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 msgr2=0x7fd21806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd2177fe640 1 --2- 172.21.15.57:0/1611233766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd21806d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd2177fe640 1 -- 172.21.15.57:0/1611233766 >> v1:172.21.15.57:6789/0 conn(0x7fd21806ddb0 legacy=0x7fd2180cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.400+0000 7fd2177fe640 1 -- 172.21.15.57:0/1611233766 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180705e0 con 0x7fd2180b1f80 2023-11-24T08:05:42.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd2177fe640 1 --2- 172.21.15.57:0/1611233766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21806d870 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0097c0 tx=0x7fd20c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592d31f967a480b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd216ffd640 1 -- 172.21.15.57:0/1611233766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0ab600 con 0x7fd2180b1f80 2023-11-24T08:05:42.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd216ffd640 1 -- 172.21.15.57:0/1611233766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0a7050 con 0x7fd2180b1f80 2023-11-24T08:05:42.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd216ffd640 1 -- 172.21.15.57:0/1611233766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0ab980 con 0x7fd2180b1f80 2023-11-24T08:05:42.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 -- 172.21.15.57:0/1611233766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 msgr2=0x7fd21806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 --2- 172.21.15.57:0/1611233766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21806d870 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0097c0 tx=0x7fd20c01c450 comp rx=0 tx=0).stop 2023-11-24T08:05:42.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 -- 172.21.15.57:0/1611233766 shutdown_connections 2023-11-24T08:05:42.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 --2- 172.21.15.57:0/1611233766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21806d870 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 --2- 172.21.15.57:0/1611233766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd21806d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 -- 172.21.15.57:0/1611233766 >> 172.21.15.57:0/1611233766 conn(0x7fd2180b0c80 msgr2=0x7fd2180b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 -- 172.21.15.57:0/1611233766 shutdown_connections 2023-11-24T08:05:42.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 -- 172.21.15.57:0/1611233766 wait complete. 2023-11-24T08:05:42.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 Processor -- start 2023-11-24T08:05:42.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 -- start start 2023-11-24T08:05:42.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21806ddb0 0x7fd218148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.404+0000 7fd21e772640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd2180cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd21e772640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181f7a60 con 0x7fd2180b1f80 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd21e772640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181f7d40 con 0x7fd21806ddb0 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd21e772640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2181f8020 con 0x7fd2180ccef0 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21814f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52418/0 (socket says 172.21.15.57:52418) 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 -- 172.21.15.57:0/144048017 learned_addr learned my addr 172.21.15.57:0/144048017 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd217fff640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21806ddb0 0x7fd218148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd21cd0f640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd2180cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 -- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 msgr2=0x7fd2180cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd2180cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 -- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21806ddb0 msgr2=0x7fd218148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21806ddb0 0x7fd218148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 -- 172.21.15.57:0/144048017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c009420 con 0x7fd2180b1f80 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd2177fe640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21814f160 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd20c01a080 tx=0x7fd20c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd214ff9640 1 -- 172.21.15.57:0/144048017 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0b7650 con 0x7fd2180b1f80 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd214ff9640 1 -- 172.21.15.57:0/144048017 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0abe90 con 0x7fd2180b1f80 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd214ff9640 1 -- 172.21.15.57:0/144048017 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0b7a10 con 0x7fd2180b1f80 2023-11-24T08:05:42.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2181f8300 con 0x7fd2180b1f80 2023-11-24T08:05:42.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2181490e0 con 0x7fd2180b1f80 2023-11-24T08:05:42.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21804e8c0 con 0x7fd2180b1f80 2023-11-24T08:05:42.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.408+0000 7fd214ff9640 1 -- 172.21.15.57:0/144048017 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fd20c0b7b70 con 0x7fd2180b1f80 2023-11-24T08:05:42.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.412+0000 7fd214ff9640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd204066650 0x7fd204068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.412+0000 7fd214ff9640 1 -- 172.21.15.57:0/144048017 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd20c11e9d0 con 0x7fd2180b1f80 2023-11-24T08:05:42.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.412+0000 7fd217fff640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd204066650 0x7fd204068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.412+0000 7fd217fff640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd204066650 0x7fd204068b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd2180b4640 tx=0x7fd208008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.416+0000 7fd214ff9640 1 -- 172.21.15.57:0/144048017 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd20c0eb9f0 con 0x7fd2180b1f80 2023-11-24T08:05:42.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd218149620 con 0x7fd2180b1f80 2023-11-24T08:05:42.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd214ff9640 1 -- 172.21.15.57:0/144048017 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd20c0b0070 con 0x7fd2180b1f80 2023-11-24T08:05:42.579 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:05:42.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd204066650 msgr2=0x7fd204068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd204066650 0x7fd204068b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd2180b4640 tx=0x7fd208008040 comp rx=0 tx=0).stop 2023-11-24T08:05:42.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 msgr2=0x7fd21814f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21814f160 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd20c01a080 tx=0x7fd20c01ac90 comp rx=0 tx=0).stop 2023-11-24T08:05:42.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 shutdown_connections 2023-11-24T08:05:42.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd204066650 0x7fd204068b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2180ccef0 0x7fd2180cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2180b1f80 0x7fd21814f160 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 --2- 172.21.15.57:0/144048017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd21806ddb0 0x7fd218148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 >> 172.21.15.57:0/144048017 conn(0x7fd2180b0c80 msgr2=0x7fd2180b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 shutdown_connections 2023-11-24T08:05:42.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.572+0000 7fd21e772640 1 -- 172.21.15.57:0/144048017 wait complete. 2023-11-24T08:05:42.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:42.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe9806640 1 Processor -- start 2023-11-24T08:05:42.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe9806640 1 -- start start 2023-11-24T08:05:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe9806640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fe4070e10 0x7f3fe40b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe9806640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40b4030 con 0x7f3fe4143960 2023-11-24T08:05:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe9806640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe4071580 con 0x7f3fe40cf580 2023-11-24T08:05:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe9806640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40ccb50 con 0x7f3fe4070e10 2023-11-24T08:05:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe2ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3fe4143960 0x7f3fe40cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51004/0 (socket says 172.21.15.57:51004) 2023-11-24T08:05:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe2ffd640 1 -- 172.21.15.57:0/2784266497 learned_addr learned my addr 172.21.15.57:0/2784266497 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:42.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/2784266497 >> v2:172.21.15.132:3300/0 conn(0x7f3fe4070e10 0x7f3fe40b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675598290 0 0) 0x7f3fd4001120 con 0x7f3fe4143960 2023-11-24T08:05:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fcc003530 con 0x7f3fe4143960 2023-11-24T08:05:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622731419 0 0) 0x7f3fcc003530 con 0x7f3fe4143960 2023-11-24T08:05:42.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 >> v2:172.21.15.132:3300/0 conn(0x7f3fe4070e10 msgr2=0x7f3fe40b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 --2- 172.21.15.57:0/2784266497 >> v2:172.21.15.132:3300/0 conn(0x7f3fe4070e10 0x7f3fe40b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 >> v1:172.21.15.132:6789/0 conn(0x7f3fe40cf580 legacy=0x7f3fe40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40cce30 con 0x7f3fe4143960 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f3fd4001810 con 0x7f3fe4143960 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 >> v1:172.21.15.57:6789/0 conn(0x7f3fe4143960 legacy=0x7f3fe40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc003980 0x7f3fcc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fcc0047d0 0x7f3fcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc005190 0x7f3fcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40ccb50 con 0x7f3fcc005190 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc00c130 con 0x7f3fcc003980 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc00c2f0 con 0x7f3fcc0047d0 2023-11-24T08:05:42.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc005190 0x7f3fcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe2ffd640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc003980 0x7f3fcc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe27fc640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fcc0047d0 0x7f3fcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe37fe640 1 -- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fcc0047d0 msgr2=0x7f3fcc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fcc0047d0 0x7f3fcc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe37fe640 1 -- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc003980 msgr2=0x7f3fcc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc003980 0x7f3fcc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe37fe640 1 -- 172.21.15.57:0/2784266497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc003530 con 0x7f3fcc005190 2023-11-24T08:05:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.740+0000 7f3fe27fc640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fcc0047d0 0x7f3fcc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe37fe640 1 -- 172.21.15.57:0/2784266497 reap_dead start 2023-11-24T08:05:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc005190 0x7f3fcc00b990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009fc0 tx=0x7f3fdc01eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3429b74a6cdad3d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0a7db0 con 0x7f3fcc005190 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc00f040 con 0x7f3fcc005190 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe1ffb640 1 -- 172.21.15.57:0/2784266497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc003be0 con 0x7f3fcc005190 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe9806640 1 -- 172.21.15.57:0/2784266497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc005190 msgr2=0x7f3fcc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe9806640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc005190 0x7f3fcc00b990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009fc0 tx=0x7f3fdc01eeb0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe9806640 1 -- 172.21.15.57:0/2784266497 shutdown_connections 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe9806640 1 --2- 172.21.15.57:0/2784266497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc005190 0x7f3fcc00b990 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe9806640 1 -- 172.21.15.57:0/2784266497 >> 172.21.15.57:0/2784266497 conn(0x7f3fe406dcc0 msgr2=0x7f3fe406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe9806640 1 -- 172.21.15.57:0/2784266497 shutdown_connections 2023-11-24T08:05:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.744+0000 7f3fe9806640 1 -- 172.21.15.57:0/2784266497 wait complete. 2023-11-24T08:05:42.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 Processor -- start 2023-11-24T08:05:42.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 -- start start 2023-11-24T08:05:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc005190 0x7f3fe415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fe4138dc0 0x7f3fe413a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fe413a920 0x7f3fe41fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe413ada0 con 0x7f3fe413a920 2023-11-24T08:05:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415a860 con 0x7f3fcc005190 2023-11-24T08:05:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415ab40 con 0x7f3fe4138dc0 2023-11-24T08:05:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fe413a920 0x7f3fe41fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fe413a920 0x7f3fe41fa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52430/0 (socket says 172.21.15.57:52430) 2023-11-24T08:05:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 -- 172.21.15.57:0/447625107 learned_addr learned my addr 172.21.15.57:0/447625107 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe27fc640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fe4138dc0 0x7f3fe413a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe2ffd640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc005190 0x7f3fe415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 -- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fe4138dc0 msgr2=0x7f3fe413a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fe4138dc0 0x7f3fe413a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 -- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc005190 msgr2=0x7f3fe415d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc005190 0x7f3fe415d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 -- 172.21.15.57:0/447625107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe413c670 con 0x7f3fe413a920 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe37fe640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fe413a920 0x7f3fe41fa6b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc09a8d0 tx=0x7f3fdc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fcbfff640 1 -- 172.21.15.57:0/447625107 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b0cb0 con 0x7f3fe413a920 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fcbfff640 1 -- 172.21.15.57:0/447625107 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0b0e30 con 0x7f3fe413a920 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fcbfff640 1 -- 172.21.15.57:0/447625107 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc003be0 con 0x7f3fe413a920 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe4139310 con 0x7f3fe413a920 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.748+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41398d0 con 0x7f3fe413a920 2023-11-24T08:05:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.752+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe4139a60 con 0x7f3fe413a920 2023-11-24T08:05:42.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.752+0000 7f3fcbfff640 1 -- 172.21.15.57:0/447625107 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f3fdc003d40 con 0x7f3fe413a920 2023-11-24T08:05:42.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.752+0000 7f3fcbfff640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3fd0066620 0x7f3fd0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:42.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.752+0000 7f3fcbfff640 1 -- 172.21.15.57:0/447625107 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3fdc11ed70 con 0x7f3fe413a920 2023-11-24T08:05:42.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.752+0000 7f3fe2ffd640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3fd0066620 0x7f3fd0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:42.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.752+0000 7f3fe2ffd640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3fd0066620 0x7f3fd0068ae0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4001060 tx=0x7f3fd4001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.756+0000 7f3fcbfff640 1 -- 172.21.15.57:0/447625107 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fdc0ec000 con 0x7f3fe413a920 2023-11-24T08:05:42.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.924+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3fe404e850 con 0x7f3fe413a920 2023-11-24T08:05:42.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fcbfff640 1 -- 172.21.15.57:0/447625107 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3fdc0be070 con 0x7f3fe413a920 2023-11-24T08:05:42.934 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3fd0066620 msgr2=0x7f3fd0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3fd0066620 0x7f3fd0068ae0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4001060 tx=0x7f3fd4001240 comp rx=0 tx=0).stop 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fe413a920 msgr2=0x7f3fe41fa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fe413a920 0x7f3fe41fa6b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc09a8d0 tx=0x7f3fdc009750 comp rx=0 tx=0).stop 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 shutdown_connections 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3fd0066620 0x7f3fd0068ae0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fe413a920 0x7f3fe41fa6b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3fe4138dc0 0x7f3fe413a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 --2- 172.21.15.57:0/447625107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fcc005190 0x7f3fe415d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 >> 172.21.15.57:0/447625107 conn(0x7f3fe406dcc0 msgr2=0x7f3fe4141300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:42.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 shutdown_connections 2023-11-24T08:05:42.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:42.928+0000 7f3fe9806640 1 -- 172.21.15.57:0/447625107 wait complete. 2023-11-24T08:05:42.956 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:05:42.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:42.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:42.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:05:42.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:42.987 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:05:43.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:43.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.172+0000 7ff564032640 1 Processor -- start 2023-11-24T08:05:43.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.172+0000 7ff564032640 1 -- start start 2023-11-24T08:05:43.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff564032640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 0x7ff55c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff564032640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c0cee60 con 0x7ff55c147020 2023-11-24T08:05:43.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff564032640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c0cf0b0 con 0x7ff55c0d0150 2023-11-24T08:05:43.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff564032640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c0d21a0 con 0x7ff55c06bdd0 2023-11-24T08:05:43.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff55c147020 0x7ff55c0d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51012/0 (socket says 172.21.15.57:51012) 2023-11-24T08:05:43.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 -- 172.21.15.57:0/1153614381 learned_addr learned my addr 172.21.15.57:0/1153614381 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:43.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff5625cf640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 0x7ff55c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646905990 0 0) 0x7ff55c0cee60 con 0x7ff55c147020 2023-11-24T08:05:43.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff548003530 con 0x7ff55c147020 2023-11-24T08:05:43.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948034455 0 0) 0x7ff548003530 con 0x7ff55c147020 2023-11-24T08:05:43.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 msgr2=0x7ff55c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:43.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 0x7ff55c0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 >> v1:172.21.15.132:6789/0 conn(0x7ff55c0d0150 legacy=0x7ff55c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0cf390 con 0x7ff55c147020 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7ff558001680 con 0x7ff55c147020 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 >> v1:172.21.15.57:6789/0 conn(0x7ff55c147020 legacy=0x7ff55c0d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5480039b0 0x7ff548003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 0x7ff5480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff548004d10 0x7ff548005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54800ba40 con 0x7ff5480039b0 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54800bb80 con 0x7ff548004d10 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54800bd40 con 0x7ff55c06bdd0 2023-11-24T08:05:43.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5480039b0 0x7ff548003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff5615cd640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 0x7ff5480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff5625cf640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff548004d10 0x7ff548005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 -- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 msgr2=0x7ff5480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c06bdd0 0x7ff5480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 -- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff548004d10 msgr2=0x7ff548005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff548004d10 0x7ff548005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.176+0000 7ff561dce640 1 -- 172.21.15.57:0/1153614381 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548003530 con 0x7ff5480039b0 2023-11-24T08:05:43.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff561dce640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5480039b0 0x7ff548003dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c210 tx=0x7ff55801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddf0ee00717af83 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558005ae0 con 0x7ff5480039b0 2023-11-24T08:05:43.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558005c40 con 0x7ff5480039b0 2023-11-24T08:05:43.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff560dcc640 1 -- 172.21.15.57:0/1153614381 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580a57e0 con 0x7ff5480039b0 2023-11-24T08:05:43.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff564032640 1 -- 172.21.15.57:0/1153614381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5480039b0 msgr2=0x7ff548003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff564032640 1 --2- 172.21.15.57:0/1153614381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5480039b0 0x7ff548003dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c210 tx=0x7ff55801cbf0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff5625cf640 1 -- 172.21.15.57:0/1153614381 reap_dead start 2023-11-24T08:05:43.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff564032640 1 -- 172.21.15.57:0/1153614381 shutdown_connections 2023-11-24T08:05:43.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff564032640 1 -- 172.21.15.57:0/1153614381 >> 172.21.15.57:0/1153614381 conn(0x7ff55c060fd0 msgr2=0x7ff55c0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:43.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff564032640 1 -- 172.21.15.57:0/1153614381 shutdown_connections 2023-11-24T08:05:43.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.180+0000 7ff564032640 1 -- 172.21.15.57:0/1153614381 wait complete. 2023-11-24T08:05:43.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 Processor -- start 2023-11-24T08:05:43.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 -- start start 2023-11-24T08:05:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5480039b0 0x7ff55c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c15c130 0x7ff55c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55c0b5400 0x7ff55c13f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c13e6c0 con 0x7ff55c0b5400 2023-11-24T08:05:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c15c5b0 con 0x7ff5480039b0 2023-11-24T08:05:43.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c13e910 con 0x7ff55c15c130 2023-11-24T08:05:43.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55c0b5400 0x7ff55c13f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55c0b5400 0x7ff55c13f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52446/0 (socket says 172.21.15.57:52446) 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 -- 172.21.15.57:0/3672731729 learned_addr learned my addr 172.21.15.57:0/3672731729 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff561dce640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5480039b0 0x7ff55c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5615cd640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c15c130 0x7ff55c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 -- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c15c130 msgr2=0x7ff55c0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c15c130 0x7ff55c0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 -- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5480039b0 msgr2=0x7ff55c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5480039b0 0x7ff55c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 -- 172.21.15.57:0/3672731729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c13ebf0 con 0x7ff55c0b5400 2023-11-24T08:05:43.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5625cf640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55c0b5400 0x7ff55c13f6d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0ce200 tx=0x7ff5540115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5527fc640 1 -- 172.21.15.57:0/3672731729 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400e070 con 0x7ff55c0b5400 2023-11-24T08:05:43.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5527fc640 1 -- 172.21.15.57:0/3672731729 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff554011e10 con 0x7ff55c0b5400 2023-11-24T08:05:43.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff5527fc640 1 -- 172.21.15.57:0/3672731729 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5540039a0 con 0x7ff55c0b5400 2023-11-24T08:05:43.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c13eed0 con 0x7ff55c0b5400 2023-11-24T08:05:43.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c15c7b0 con 0x7ff55c0b5400 2023-11-24T08:05:43.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.184+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c15c9d0 con 0x7ff55c0b5400 2023-11-24T08:05:43.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.188+0000 7ff5527fc640 1 -- 172.21.15.57:0/3672731729 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ff554003b00 con 0x7ff55c0b5400 2023-11-24T08:05:43.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.188+0000 7ff5527fc640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff540066620 0x7ff540068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.188+0000 7ff5527fc640 1 -- 172.21.15.57:0/3672731729 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff554084760 con 0x7ff55c0b5400 2023-11-24T08:05:43.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.188+0000 7ff561dce640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff540066620 0x7ff540068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.188+0000 7ff561dce640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff540066620 0x7ff540068ae0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff5580ab000 tx=0x7ff5580a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.192+0000 7ff5527fc640 1 -- 172.21.15.57:0/3672731729 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5540518b0 con 0x7ff55c0b5400 2023-11-24T08:05:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.380+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff55c067520 con 0x7ff55c0b5400 2023-11-24T08:05:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.380+0000 7ff5527fc640 1 -- 172.21.15.57:0/3672731729 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7ff554054ed0 con 0x7ff55c0b5400 2023-11-24T08:05:43.389 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:43.390 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:43.390 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:05:43.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff540066620 msgr2=0x7ff540068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff540066620 0x7ff540068ae0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff5580ab000 tx=0x7ff5580a7070 comp rx=0 tx=0).stop 2023-11-24T08:05:43.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55c0b5400 msgr2=0x7ff55c13f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55c0b5400 0x7ff55c13f6d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0ce200 tx=0x7ff5540115a0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 shutdown_connections 2023-11-24T08:05:43.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff540066620 0x7ff540068ae0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff55c0b5400 0x7ff55c13f6d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff55c15c130 0x7ff55c0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 --2- 172.21.15.57:0/3672731729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5480039b0 0x7ff55c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 >> 172.21.15.57:0/3672731729 conn(0x7ff55c060fd0 msgr2=0x7ff55c13d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:43.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 shutdown_connections 2023-11-24T08:05:43.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.384+0000 7ff564032640 1 -- 172.21.15.57:0/3672731729 wait complete. 2023-11-24T08:05:43.411 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:05:43.582 INFO:teuthology.orchestra.run.smithi132.stdout:[] 2023-11-24T08:05:43.582 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T08:05:43.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol2080 2023-11-24T08:05:43.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b96f3f640 1 Processor -- start 2023-11-24T08:05:43.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b96f3f640 1 -- start start 2023-11-24T08:05:43.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b96f3f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b90072490 0x7f6b9006c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b96f3f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900ce090 con 0x7f6b9006cdb0 2023-11-24T08:05:43.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b96f3f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900cb8d0 con 0x7f6b900cb4f0 2023-11-24T08:05:43.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b96f3f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b90159f50 con 0x7f6b90072490 2023-11-24T08:05:43.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b9673e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6b9006cdb0 0x7f6b900c9b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51026/0 (socket says 172.21.15.57:51026) 2023-11-24T08:05:43.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b9673e640 1 -- 172.21.15.57:0/4002172450 learned_addr learned my addr 172.21.15.57:0/4002172450 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:43.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b9573c640 1 --2- 172.21.15.57:0/4002172450 >> v2:172.21.15.57:3300/0 conn(0x7f6b90072490 0x7f6b9006c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b94f3b640 1 -- 172.21.15.57:0/4002172450 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331872150 0 0) 0x7f6b900ce090 con 0x7f6b9006cdb0 2023-11-24T08:05:43.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b94f3b640 1 -- 172.21.15.57:0/4002172450 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b7c003530 con 0x7f6b9006cdb0 2023-11-24T08:05:43.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b94f3b640 1 -- 172.21.15.57:0/4002172450 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153051228 0 0) 0x7f6b900cb8d0 con 0x7f6b900cb4f0 2023-11-24T08:05:43.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b94f3b640 1 -- 172.21.15.57:0/4002172450 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b900ce090 con 0x7f6b900cb4f0 2023-11-24T08:05:43.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b9573c640 1 -- 172.21.15.57:0/4002172450 >> v1:172.21.15.132:6789/0 conn(0x7f6b900cb4f0 legacy=0x7f6b900ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b9573c640 1 -- 172.21.15.57:0/4002172450 >> v1:172.21.15.57:6789/0 conn(0x7f6b9006cdb0 legacy=0x7f6b900c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.724+0000 7f6b9573c640 1 -- 172.21.15.57:0/4002172450 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9006d1d0 con 0x7f6b90072490 2023-11-24T08:05:43.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b9573c640 1 --2- 172.21.15.57:0/4002172450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b9006c870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6b800097c0 tx=0x7f6b8001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e851d8b0898eb4f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b94f3b640 1 -- 172.21.15.57:0/4002172450 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800a8970 con 0x7f6b90072490 2023-11-24T08:05:43.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b94f3b640 1 -- 172.21.15.57:0/4002172450 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b800a8ad0 con 0x7f6b90072490 2023-11-24T08:05:43.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b94f3b640 1 -- 172.21.15.57:0/4002172450 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800a8e60 con 0x7f6b90072490 2023-11-24T08:05:43.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 -- 172.21.15.57:0/4002172450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 msgr2=0x7f6b9006c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/4002172450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b9006c870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6b800097c0 tx=0x7f6b8001ec70 comp rx=0 tx=0).stop 2023-11-24T08:05:43.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 -- 172.21.15.57:0/4002172450 shutdown_connections 2023-11-24T08:05:43.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/4002172450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b9006c870 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 -- 172.21.15.57:0/4002172450 >> 172.21.15.57:0/4002172450 conn(0x7f6b900cbb50 msgr2=0x7f6b900cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:43.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 -- 172.21.15.57:0/4002172450 shutdown_connections 2023-11-24T08:05:43.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 -- 172.21.15.57:0/4002172450 wait complete. 2023-11-24T08:05:43.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 Processor -- start 2023-11-24T08:05:43.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.728+0000 7f6b96f3f640 1 -- start start 2023-11-24T08:05:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b9006cdb0 0x7f6b901592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b900999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b900cb4f0 0x7f6b9014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9014c930 con 0x7f6b90072490 2023-11-24T08:05:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9009c420 con 0x7f6b900cb4f0 2023-11-24T08:05:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9009c700 con 0x7f6b9006cdb0 2023-11-24T08:05:43.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b900999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b900999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52458/0 (socket says 172.21.15.57:52458) 2023-11-24T08:05:43.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 -- 172.21.15.57:0/2685808339 learned_addr learned my addr 172.21.15.57:0/2685808339 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:43.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 -- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b9006cdb0 msgr2=0x7f6b901592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b95f3d640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b9006cdb0 0x7f6b901592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9673e640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b900cb4f0 0x7f6b9014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b9006cdb0 0x7f6b901592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 -- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b900cb4f0 msgr2=0x7f6b9014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b900cb4f0 0x7f6b9014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 -- 172.21.15.57:0/2685808339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80009420 con 0x7f6b90072490 2023-11-24T08:05:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b95f3d640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b9006cdb0 0x7f6b901592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9673e640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b900cb4f0 0x7f6b9014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b9573c640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b900999e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6b800b3040 tx=0x7f6b8001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b867fc640 1 -- 172.21.15.57:0/2685808339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800b0d60 con 0x7f6b90072490 2023-11-24T08:05:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b867fc640 1 -- 172.21.15.57:0/2685808339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b800b9430 con 0x7f6b90072490 2023-11-24T08:05:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b867fc640 1 -- 172.21.15.57:0/2685808339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800b97e0 con 0x7f6b90072490 2023-11-24T08:05:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b900af6d0 con 0x7f6b90072490 2023-11-24T08:05:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b900afc90 con 0x7f6b90072490 2023-11-24T08:05:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b900afe80 con 0x7f6b90072490 2023-11-24T08:05:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.732+0000 7f6b867fc640 1 -- 172.21.15.57:0/2685808339 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f6b800b7040 con 0x7f6b90072490 2023-11-24T08:05:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.736+0000 7f6b867fc640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b74066670 0x7f6b74068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.736+0000 7f6b867fc640 1 -- 172.21.15.57:0/2685808339 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6b80121c20 con 0x7f6b90072490 2023-11-24T08:05:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.736+0000 7f6b95f3d640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b74066670 0x7f6b74068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.736+0000 7f6b95f3d640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b74066670 0x7f6b74068b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000f70 tx=0x7f6b8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.740+0000 7f6b867fc640 1 -- 172.21.15.57:0/2685808339 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b800eeec0 con 0x7f6b90072490 2023-11-24T08:05:43.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.920+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol2080", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b900cd760 con 0x7f6b74066670 2023-11-24T08:05:43.933 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:43.929+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:43.933 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:43.929+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:43.933 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:43.929+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:43.933 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:43.929+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:43.933 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-11-24T08:05:43.929+0000 7f5fbe41b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:05:43.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b867fc640 1 -- 172.21.15.57:0/2685808339 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6b8c001360 con 0x7f6b74066670 2023-11-24T08:05:43.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b74066670 msgr2=0x7f6b74068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b74066670 0x7f6b74068b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000f70 tx=0x7f6b8c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:43.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 msgr2=0x7f6b900999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:43.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b900999e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6b800b3040 tx=0x7f6b8001ba10 comp rx=0 tx=0).stop 2023-11-24T08:05:43.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 shutdown_connections 2023-11-24T08:05:43.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6b74066670 0x7f6b74068b30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b900cb4f0 0x7f6b9014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b90072490 0x7f6b900999e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 --2- 172.21.15.57:0/2685808339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6b9006cdb0 0x7f6b901592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 >> 172.21.15.57:0/2685808339 conn(0x7f6b900cbb50 msgr2=0x7f6b90153140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 shutdown_connections 2023-11-24T08:05:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:43.964+0000 7f6b96f3f640 1 -- 172.21.15.57:0/2685808339 wait complete. 2023-11-24T08:05:43.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:44.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.128+0000 7f48f932a640 1 Processor -- start 2023-11-24T08:05:44.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f932a640 1 -- start start 2023-11-24T08:05:44.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f932a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f932a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f415a700 con 0x7f48f4070da0 2023-11-24T08:05:44.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f932a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f40b2620 con 0x7f48f40b36c0 2023-11-24T08:05:44.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f932a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f40b2430 con 0x7f48f415a320 2023-11-24T08:05:44.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f37fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f48f4070da0 0x7f48f415ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51032/0 (socket says 172.21.15.57:51032) 2023-11-24T08:05:44.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f37fe640 1 -- 172.21.15.57:0/2938786701 learned_addr learned my addr 172.21.15.57:0/2938786701 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:05:44.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f2ffd640 1 --2- 172.21.15.57:0/2938786701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f27fc640 1 -- 172.21.15.57:0/2938786701 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450053135 0 0) 0x7f48f415a700 con 0x7f48f4070da0 2023-11-24T08:05:44.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f27fc640 1 -- 172.21.15.57:0/2938786701 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e0003530 con 0x7f48f4070da0 2023-11-24T08:05:44.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f27fc640 1 -- 172.21.15.57:0/2938786701 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386659285 0 0) 0x7f48f40b2620 con 0x7f48f40b36c0 2023-11-24T08:05:44.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f27fc640 1 -- 172.21.15.57:0/2938786701 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f415a700 con 0x7f48f40b36c0 2023-11-24T08:05:44.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f2ffd640 1 -- 172.21.15.57:0/2938786701 >> v1:172.21.15.132:6789/0 conn(0x7f48f40b36c0 legacy=0x7f48f4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f2ffd640 1 -- 172.21.15.57:0/2938786701 >> v1:172.21.15.57:6789/0 conn(0x7f48f4070da0 legacy=0x7f48f415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.132+0000 7f48f2ffd640 1 -- 172.21.15.57:0/2938786701 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40b2900 con 0x7f48f415a320 2023-11-24T08:05:44.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f2ffd640 1 --2- 172.21.15.57:0/2938786701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f40b1ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48e40097f0 tx=0x7f48e401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba85c4e65eaae77 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f27fc640 1 -- 172.21.15.57:0/2938786701 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40ac600 con 0x7f48f415a320 2023-11-24T08:05:44.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f27fc640 1 -- 172.21.15.57:0/2938786701 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e40a8050 con 0x7f48f415a320 2023-11-24T08:05:44.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f27fc640 1 -- 172.21.15.57:0/2938786701 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40ac980 con 0x7f48f415a320 2023-11-24T08:05:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 -- 172.21.15.57:0/2938786701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 msgr2=0x7f48f40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 --2- 172.21.15.57:0/2938786701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f40b1ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48e40097f0 tx=0x7f48e401c490 comp rx=0 tx=0).stop 2023-11-24T08:05:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 -- 172.21.15.57:0/2938786701 shutdown_connections 2023-11-24T08:05:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 --2- 172.21.15.57:0/2938786701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f40b1ef0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 -- 172.21.15.57:0/2938786701 >> 172.21.15.57:0/2938786701 conn(0x7f48f40b0bf0 msgr2=0x7f48f40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 -- 172.21.15.57:0/2938786701 shutdown_connections 2023-11-24T08:05:44.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 -- 172.21.15.57:0/2938786701 wait complete. 2023-11-24T08:05:44.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.136+0000 7f48f932a640 1 Processor -- start 2023-11-24T08:05:44.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 -- start start 2023-11-24T08:05:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f4070da0 0x7f48f4159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f40b36c0 0x7f48f4154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f41f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41580e0 con 0x7f48f4070da0 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4157780 con 0x7f48f40b36c0 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4157a20 con 0x7f48f415a320 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f4070da0 0x7f48f4159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f4070da0 0x7f48f4159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52472/0 (socket says 172.21.15.57:52472) 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 -- 172.21.15.57:0/938645451 learned_addr learned my addr 172.21.15.57:0/938645451 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 -- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 msgr2=0x7f48f41f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f41f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 -- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f40b36c0 msgr2=0x7f48f4154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f40b36c0 0x7f48f4154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 -- 172.21.15.57:0/938645451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009420 con 0x7f48f4070da0 2023-11-24T08:05:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f2ffd640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f4070da0 0x7f48f4159820 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f48e40190a0 tx=0x7f48e4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48eb7fe640 1 -- 172.21.15.57:0/938645451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40acd20 con 0x7f48f4070da0 2023-11-24T08:05:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48eb7fe640 1 -- 172.21.15.57:0/938645451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e40b6470 con 0x7f48f4070da0 2023-11-24T08:05:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48eb7fe640 1 -- 172.21.15.57:0/938645451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40acea0 con 0x7f48f4070da0 2023-11-24T08:05:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f4157d00 con 0x7f48f4070da0 2023-11-24T08:05:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f4155130 con 0x7f48f4070da0 2023-11-24T08:05:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.140+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f4158220 con 0x7f48f4070da0 2023-11-24T08:05:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.144+0000 7f48eb7fe640 1 -- 172.21.15.57:0/938645451 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f48e40b3040 con 0x7f48f4070da0 2023-11-24T08:05:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.144+0000 7f48eb7fe640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48d4066620 0x7f48d4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.144+0000 7f48eb7fe640 1 -- 172.21.15.57:0/938645451 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f48e411e460 con 0x7f48f4070da0 2023-11-24T08:05:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.144+0000 7f48ebfff640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48d4066620 0x7f48d4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.144+0000 7f48ebfff640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48d4066620 0x7f48d4068ae0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f48dc007fd0 tx=0x7f48dc007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.148+0000 7f48eb7fe640 1 -- 172.21.15.57:0/938645451 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48f4158220 con 0x7f48f4070da0 2023-11-24T08:05:44.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48f4158220 con 0x7f48f4070da0 2023-11-24T08:05:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48eb7fe640 1 -- 172.21.15.57:0/938645451 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f48f4158220 con 0x7f48f4070da0 2023-11-24T08:05:44.348 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:44.348 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:44.349 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:05:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48d4066620 msgr2=0x7f48d4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48d4066620 0x7f48d4068ae0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f48dc007fd0 tx=0x7f48dc007960 comp rx=0 tx=0).stop 2023-11-24T08:05:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f4070da0 msgr2=0x7f48f4159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f4070da0 0x7f48f4159820 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f48e40190a0 tx=0x7f48e4019230 comp rx=0 tx=0).stop 2023-11-24T08:05:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 shutdown_connections 2023-11-24T08:05:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48d4066620 0x7f48d4068ae0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f415a320 0x7f48f41f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f40b36c0 0x7f48f4154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 --2- 172.21.15.57:0/938645451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48f4070da0 0x7f48f4159820 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 >> 172.21.15.57:0/938645451 conn(0x7f48f40b0bf0 msgr2=0x7f48f40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 shutdown_connections 2023-11-24T08:05:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.344+0000 7f48f932a640 1 -- 172.21.15.57:0/938645451 wait complete. 2023-11-24T08:05:44.369 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:05:44.527 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.57599427299999995,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.971470381226265,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:05:44.527 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.971470381226265 }, "state": "open", "uptime": 0.575994273 } ] 2023-11-24T08:05:44.528 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:44.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f25264fe640 1 Processor -- start 2023-11-24T08:05:44.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f25264fe640 1 -- start start 2023-11-24T08:05:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f25264fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25200b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f25264fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2520070da0 0x7f252015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f25264fe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252015a700 con 0x7f25200b36c0 2023-11-24T08:05:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f25264fe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25200b2430 con 0x7f2520070da0 2023-11-24T08:05:44.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f25264fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200b2620 con 0x7f252015a320 2023-11-24T08:05:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f2524a9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2520070da0 0x7f252015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f251ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25200b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f251ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25200b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:57090/0 (socket says 172.21.15.57:57090) 2023-11-24T08:05:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f251ffff640 1 -- 172.21.15.57:0/3635892399 learned_addr learned my addr 172.21.15.57:0/3635892399 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f2524a9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2520070da0 0x7f252015ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:46274/0 (socket says 172.21.15.57:46274) 2023-11-24T08:05:44.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.668+0000 7f251f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f25200b36c0 0x7f2520070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:51052/0 (socket says 172.21.15.57:51052) 2023-11-24T08:05:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f2524a9b640 1 -- 172.21.15.57:0/3635892399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 msgr2=0x7f25200b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f2524a9b640 1 --2- 172.21.15.57:0/3635892399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25200b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f2524a9b640 1 -- 172.21.15.57:0/3635892399 >> v1:172.21.15.132:6789/0 conn(0x7f25200b36c0 legacy=0x7f2520070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f2524a9b640 1 -- 172.21.15.57:0/3635892399 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200b2900 con 0x7f2520070da0 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f2524a9b640 1 --2- 172.21.15.57:0/3635892399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 0x7f252015ddd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2518009d90 tx=0x7f251801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b13a415e0a71af9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f251effd640 1 -- 172.21.15.57:0/3635892399 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180a5a00 con 0x7f2520070da0 2023-11-24T08:05:44.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f251effd640 1 -- 172.21.15.57:0/3635892399 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25180a5b60 con 0x7f2520070da0 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.672+0000 7f251effd640 1 -- 172.21.15.57:0/3635892399 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180ad440 con 0x7f2520070da0 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- 172.21.15.57:0/3635892399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 msgr2=0x7f252015ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 --2- 172.21.15.57:0/3635892399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 0x7f252015ddd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2518009d90 tx=0x7f251801c920 comp rx=0 tx=0).stop 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- 172.21.15.57:0/3635892399 shutdown_connections 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 --2- 172.21.15.57:0/3635892399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 0x7f252015ddd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 --2- 172.21.15.57:0/3635892399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25200b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- 172.21.15.57:0/3635892399 >> 172.21.15.57:0/3635892399 conn(0x7f25200b0bf0 msgr2=0x7f25200b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- 172.21.15.57:0/3635892399 shutdown_connections 2023-11-24T08:05:44.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- 172.21.15.57:0/3635892399 wait complete. 2023-11-24T08:05:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 Processor -- start 2023-11-24T08:05:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- start start 2023-11-24T08:05:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 0x7f25200ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25200b36c0 0x7f25201f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25201f9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520167ff0 con 0x7f25200b36c0 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520151b30 con 0x7f2520070da0 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f25264fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2520167470 con 0x7f252015a320 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25200b36c0 0x7f25201f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25200b36c0 0x7f25201f9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52484/0 (socket says 172.21.15.57:52484) 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 -- 172.21.15.57:0/646840893 learned_addr learned my addr 172.21.15.57:0/646840893 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251ffff640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 0x7f25200ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f2524a9b640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25201f9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 -- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 msgr2=0x7f25201f9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25201f9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 -- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 msgr2=0x7f25200ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 0x7f25200ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.676+0000 7f251f7fe640 1 -- 172.21.15.57:0/646840893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009a70 con 0x7f25200b36c0 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251f7fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25200b36c0 0x7f25201f9a40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f251400c500 tx=0x7f251400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251cff9640 1 -- 172.21.15.57:0/646840893 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514007500 con 0x7f25200b36c0 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251cff9640 1 -- 172.21.15.57:0/646840893 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2514007660 con 0x7f25200b36c0 2023-11-24T08:05:44.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251cff9640 1 -- 172.21.15.57:0/646840893 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514004a10 con 0x7f25200b36c0 2023-11-24T08:05:44.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2520167750 con 0x7f25200b36c0 2023-11-24T08:05:44.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2520167d10 con 0x7f25200b36c0 2023-11-24T08:05:44.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2520067520 con 0x7f25200b36c0 2023-11-24T08:05:44.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251cff9640 1 -- 172.21.15.57:0/646840893 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f2514004b70 con 0x7f25200b36c0 2023-11-24T08:05:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251cff9640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f250c066620 0x7f250c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251cff9640 1 -- 172.21.15.57:0/646840893 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2514083350 con 0x7f25200b36c0 2023-11-24T08:05:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.680+0000 7f251ffff640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f250c066620 0x7f250c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:44.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.684+0000 7f251ffff640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f250c066620 0x7f250c068ae0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2510009ab0 tx=0x7f2510009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:44.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.684+0000 7f251cff9640 1 -- 172.21.15.57:0/646840893 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2514050660 con 0x7f25200b36c0 2023-11-24T08:05:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.872+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2520151cf0 con 0x7f25200b36c0 2023-11-24T08:05:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.872+0000 7f251cff9640 1 -- 172.21.15.57:0/646840893 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f2514053c80 con 0x7f25200b36c0 2023-11-24T08:05:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:44.878 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:44.878 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f250c066620 msgr2=0x7f250c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f250c066620 0x7f250c068ae0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2510009ab0 tx=0x7f2510009240 comp rx=0 tx=0).stop 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25200b36c0 msgr2=0x7f25201f9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25200b36c0 0x7f25201f9a40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f251400c500 tx=0x7f251400c9c0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 shutdown_connections 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f250c066620 0x7f250c068ae0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f252015a320 0x7f25201f9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25200b36c0 0x7f25201f9a40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 --2- 172.21.15.57:0/646840893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2520070da0 0x7f25200ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 >> 172.21.15.57:0/646840893 conn(0x7f25200b0bf0 msgr2=0x7f25200b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 shutdown_connections 2023-11-24T08:05:44.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:44.876+0000 7f25264fe640 1 -- 172.21.15.57:0/646840893 wait complete. 2023-11-24T08:05:44.899 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:05:45.058 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":1.1079889839999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.944480326847067,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:05:45.059 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.944480326847067 }, "state": "open", "uptime": 1.107988984 } ] 2023-11-24T08:05:45.059 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:05:48.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:48.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:50.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:50.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f6245180640 1 Processor -- start 2023-11-24T08:05:50.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f6245180640 1 -- start start 2023-11-24T08:05:50.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f6245180640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62400b36c0 0x7f62400b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f6245180640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6240070da0 0x7f62400711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f6245180640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624015a700 con 0x7f624015a320 2023-11-24T08:05:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f6245180640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400b2430 con 0x7f6240070da0 2023-11-24T08:05:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f6245180640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400b2620 con 0x7f62400b36c0 2023-11-24T08:05:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f623f59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6240070da0 0x7f62400711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f623f59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6240070da0 0x7f62400711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58580/0 (socket says 172.21.15.57:58580) 2023-11-24T08:05:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f623f59e640 1 -- 172.21.15.57:0/1736358273 learned_addr learned my addr 172.21.15.57:0/1736358273 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:50.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f623e59c640 1 --2- 172.21.15.57:0/1736358273 >> v2:172.21.15.132:3300/0 conn(0x7f62400b36c0 0x7f62400b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f623f59e640 1 -- 172.21.15.57:0/1736358273 >> v2:172.21.15.132:3300/0 conn(0x7f62400b36c0 msgr2=0x7f62400b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f623f59e640 1 --2- 172.21.15.57:0/1736358273 >> v2:172.21.15.132:3300/0 conn(0x7f62400b36c0 0x7f62400b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.208+0000 7f623f59e640 1 -- 172.21.15.57:0/1736358273 >> v1:172.21.15.132:6789/0 conn(0x7f624015a320 legacy=0x7f6240070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f623f59e640 1 -- 172.21.15.57:0/1736358273 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400b2900 con 0x7f6240070da0 2023-11-24T08:05:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f623e59c640 1 --2- 172.21.15.57:0/1736358273 >> v2:172.21.15.132:3300/0 conn(0x7f62400b36c0 0x7f62400b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f623f59e640 1 --2- 172.21.15.57:0/1736358273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f62400711f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f624006c180 tx=0x7f623801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb15ea60cb70f64 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f623dd9b640 1 -- 172.21.15.57:0/1736358273 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800b2d0 con 0x7f6240070da0 2023-11-24T08:05:50.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f623dd9b640 1 -- 172.21.15.57:0/1736358273 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800b430 con 0x7f6240070da0 2023-11-24T08:05:50.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f623dd9b640 1 -- 172.21.15.57:0/1736358273 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62380a7b50 con 0x7f6240070da0 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 -- 172.21.15.57:0/1736358273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 msgr2=0x7f62400711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 --2- 172.21.15.57:0/1736358273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f62400711f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f624006c180 tx=0x7f623801eb60 comp rx=0 tx=0).stop 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 -- 172.21.15.57:0/1736358273 shutdown_connections 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 --2- 172.21.15.57:0/1736358273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f62400711f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 --2- 172.21.15.57:0/1736358273 >> v2:172.21.15.132:3300/0 conn(0x7f62400b36c0 0x7f62400b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 -- 172.21.15.57:0/1736358273 >> 172.21.15.57:0/1736358273 conn(0x7f62400b0bf0 msgr2=0x7f62400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 -- 172.21.15.57:0/1736358273 shutdown_connections 2023-11-24T08:05:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.212+0000 7f6245180640 1 -- 172.21.15.57:0/1736358273 wait complete. 2023-11-24T08:05:50.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 Processor -- start 2023-11-24T08:05:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 -- start start 2023-11-24T08:05:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f624014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62400b36c0 0x7f62401f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f624015a320 0x7f624014b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624014aa30 con 0x7f6240070da0 2023-11-24T08:05:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62401f5a00 con 0x7f62400b36c0 2023-11-24T08:05:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f6245180640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6240149e20 con 0x7f624015a320 2023-11-24T08:05:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f624014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f624014e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58592/0 (socket says 172.21.15.57:58592) 2023-11-24T08:05:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 -- 172.21.15.57:0/1584202886 learned_addr learned my addr 172.21.15.57:0/1584202886 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623e59c640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62400b36c0 0x7f62401f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623f59e640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f624015a320 0x7f624014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 -- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f624015a320 msgr2=0x7f624014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f624015a320 0x7f624014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 -- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62400b36c0 msgr2=0x7f62401f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62400b36c0 0x7f62401f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 -- 172.21.15.57:0/1584202886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623800bd40 con 0x7f6240070da0 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.216+0000 7f623ed9d640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f624014e000 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f623000b410 tx=0x7f623000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f62277fe640 1 -- 172.21.15.57:0/1584202886 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230004020 con 0x7f6240070da0 2023-11-24T08:05:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f62277fe640 1 -- 172.21.15.57:0/1584202886 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6230004180 con 0x7f6240070da0 2023-11-24T08:05:50.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f62277fe640 1 -- 172.21.15.57:0/1584202886 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230011630 con 0x7f6240070da0 2023-11-24T08:05:50.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624014a100 con 0x7f6240070da0 2023-11-24T08:05:50.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624014a6c0 con 0x7f6240070da0 2023-11-24T08:05:50.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6240157700 con 0x7f6240070da0 2023-11-24T08:05:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f62277fe640 1 -- 172.21.15.57:0/1584202886 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f6230011790 con 0x7f6240070da0 2023-11-24T08:05:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f62277fe640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f622c0666b0 0x7f622c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f62277fe640 1 -- 172.21.15.57:0/1584202886 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6230084110 con 0x7f6240070da0 2023-11-24T08:05:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.220+0000 7f623e59c640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f622c0666b0 0x7f622c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:50.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.224+0000 7f623e59c640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f622c0666b0 0x7f622c068b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6240159540 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.224+0000 7f62277fe640 1 -- 172.21.15.57:0/1584202886 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6230051150 con 0x7f6240070da0 2023-11-24T08:05:50.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.412+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6240067520 con 0x7f6240070da0 2023-11-24T08:05:50.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.412+0000 7f62277fe640 1 -- 172.21.15.57:0/1584202886 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f6230054770 con 0x7f6240070da0 2023-11-24T08:05:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:50.418 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:50.418 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:05:50.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f622c0666b0 msgr2=0x7f622c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f622c0666b0 0x7f622c068b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6240159540 tx=0x7f6234008040 comp rx=0 tx=0).stop 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 msgr2=0x7f624014e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f624014e000 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f623000b410 tx=0x7f623000b8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 shutdown_connections 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f622c0666b0 0x7f622c068b70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f624015a320 0x7f624014b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62400b36c0 0x7f62401f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 --2- 172.21.15.57:0/1584202886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6240070da0 0x7f624014e000 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 >> 172.21.15.57:0/1584202886 conn(0x7f62400b0bf0 msgr2=0x7f6240150080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 shutdown_connections 2023-11-24T08:05:50.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:50.416+0000 7f6245180640 1 -- 172.21.15.57:0/1584202886 wait complete. 2023-11-24T08:05:50.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:05:50.610 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":6.6599338570000004,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.664780545668638,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:05:50.611 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.664780545668638 }, "state": "open", "uptime": 6.659933857 } ] 2023-11-24T08:05:50.611 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:05:55.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:55.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.760+0000 7fb3abf2a640 1 Processor -- start 2023-11-24T08:05:55.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.760+0000 7fb3abf2a640 1 -- start start 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3abf2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3a4158a50 0x7fb3a406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3abf2a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3a406cb90 0x7fb3a40b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3abf2a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a406dc20 con 0x7fb3a406e340 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3abf2a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a406e0b0 con 0x7fb3a406cb90 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3abf2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a40b3620 con 0x7fb3a4158a50 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3a406cb90 0x7fb3a40b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3a406cb90 0x7fb3a40b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39834/0 (socket says 172.21.15.57:39834) 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 -- 172.21.15.57:0/3554946320 learned_addr learned my addr 172.21.15.57:0/3554946320 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:55.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3a9cc6640 1 --2- 172.21.15.57:0/3554946320 >> v2:172.21.15.132:3300/0 conn(0x7fb3a4158a50 0x7fb3a406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 -- 172.21.15.57:0/3554946320 >> v2:172.21.15.132:3300/0 conn(0x7fb3a4158a50 msgr2=0x7fb3a406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 --2- 172.21.15.57:0/3554946320 >> v2:172.21.15.132:3300/0 conn(0x7fb3a4158a50 0x7fb3a406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 -- 172.21.15.57:0/3554946320 >> v1:172.21.15.132:6789/0 conn(0x7fb3a406e340 legacy=0x7fb3a40707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 -- 172.21.15.57:0/3554946320 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4158e30 con 0x7fb3a406cb90 2023-11-24T08:05:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3aa4c7640 1 --2- 172.21.15.57:0/3554946320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406cb90 0x7fb3a40b24c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40d00d0 tx=0x7fb39c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1673cc7fbf5a328 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.764+0000 7fb3a8cc4640 1 -- 172.21.15.57:0/3554946320 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c0a5820 con 0x7fb3a406cb90 2023-11-24T08:05:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3a8cc4640 1 -- 172.21.15.57:0/3554946320 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c0a5980 con 0x7fb3a406cb90 2023-11-24T08:05:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3a8cc4640 1 -- 172.21.15.57:0/3554946320 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c0a5d10 con 0x7fb3a406cb90 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- 172.21.15.57:0/3554946320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406cb90 msgr2=0x7fb3a40b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/3554946320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406cb90 0x7fb3a40b24c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40d00d0 tx=0x7fb39c01c960 comp rx=0 tx=0).stop 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- 172.21.15.57:0/3554946320 shutdown_connections 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/3554946320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406cb90 0x7fb3a40b24c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/3554946320 >> v2:172.21.15.132:3300/0 conn(0x7fb3a4158a50 0x7fb3a406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- 172.21.15.57:0/3554946320 >> 172.21.15.57:0/3554946320 conn(0x7fb3a40b0bf0 msgr2=0x7fb3a40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- 172.21.15.57:0/3554946320 shutdown_connections 2023-11-24T08:05:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- 172.21.15.57:0/3554946320 wait complete. 2023-11-24T08:05:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 Processor -- start 2023-11-24T08:05:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- start start 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3a406cb90 0x7fb3a409af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406e340 0x7fb3a409a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3a4158a50 0x7fb3a41632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a409c220 con 0x7fb3a406e340 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a409ab70 con 0x7fb3a406cb90 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3abf2a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a409b610 con 0x7fb3a4158a50 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3a94c5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406e340 0x7fb3a409a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3a94c5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406e340 0x7fb3a409a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39850/0 (socket says 172.21.15.57:39850) 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3aa4c7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3a4158a50 0x7fb3a41632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3a94c5640 1 -- 172.21.15.57:0/998161396 learned_addr learned my addr 172.21.15.57:0/998161396 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.768+0000 7fb3a9cc6640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3a406cb90 0x7fb3a409af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3a94c5640 1 -- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3a4158a50 msgr2=0x7fb3a41632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3a94c5640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3a4158a50 0x7fb3a41632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3a94c5640 1 -- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3a406cb90 msgr2=0x7fb3a409af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3a94c5640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3a406cb90 0x7fb3a409af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3a94c5640 1 -- 172.21.15.57:0/998161396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c009b30 con 0x7fb3a406e340 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3a94c5640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406e340 0x7fb3a409a630 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c450 tx=0x7fb39400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb39a7fc640 1 -- 172.21.15.57:0/998161396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394012830 con 0x7fb3a406e340 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb39a7fc640 1 -- 172.21.15.57:0/998161396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3940129b0 con 0x7fb3a406e340 2023-11-24T08:05:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a409b8f0 con 0x7fb3a406e340 2023-11-24T08:05:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb39a7fc640 1 -- 172.21.15.57:0/998161396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394012d60 con 0x7fb3a406e340 2023-11-24T08:05:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a409beb0 con 0x7fb3a406e340 2023-11-24T08:05:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a409c3d0 con 0x7fb3a406e340 2023-11-24T08:05:55.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb39a7fc640 1 -- 172.21.15.57:0/998161396 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fb39401c460 con 0x7fb3a406e340 2023-11-24T08:05:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.772+0000 7fb39a7fc640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3880666b0 0x7fb388068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.776+0000 7fb39a7fc640 1 -- 172.21.15.57:0/998161396 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb394083fb0 con 0x7fb3a406e340 2023-11-24T08:05:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.776+0000 7fb3a9cc6640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3880666b0 0x7fb388068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.776+0000 7fb3a9cc6640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3880666b0 0x7fb388068b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0007a60 tx=0x7fb3a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.780+0000 7fb39a7fc640 1 -- 172.21.15.57:0/998161396 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3940b5280 con 0x7fb3a406e340 2023-11-24T08:05:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.968+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3a4067520 con 0x7fb3a406e340 2023-11-24T08:05:55.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb39a7fc640 1 -- 172.21.15.57:0/998161396 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fb3a409c3d0 con 0x7fb3a406e340 2023-11-24T08:05:55.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:05:55.975 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:05:55.975 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:05:55.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3880666b0 msgr2=0x7fb388068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3880666b0 0x7fb388068b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0007a60 tx=0x7fb3a0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406e340 msgr2=0x7fb3a409a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406e340 0x7fb3a409a630 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c450 tx=0x7fb39400c910 comp rx=0 tx=0).stop 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 shutdown_connections 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3880666b0 0x7fb388068b70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3a4158a50 0x7fb3a41632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3a406e340 0x7fb3a409a630 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 --2- 172.21.15.57:0/998161396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3a406cb90 0x7fb3a409af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 >> 172.21.15.57:0/998161396 conn(0x7fb3a40b0bf0 msgr2=0x7fb3a40af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 shutdown_connections 2023-11-24T08:05:55.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:05:55.972+0000 7fb3abf2a640 1 -- 172.21.15.57:0/998161396 wait complete. 2023-11-24T08:05:55.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:05:56.162 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":12.211878833,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.388645754625625,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:05:56.163 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.388645754625625 }, "state": "open", "uptime": 12.211878833 } ] 2023-11-24T08:05:56.163 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:01.164 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:01.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.308+0000 7f4146d65640 1 Processor -- start 2023-11-24T08:06:01.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.308+0000 7f4146d65640 1 -- start start 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.308+0000 7f4146d65640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f414015a320 0x7f41400b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4146d65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41400b36c0 0x7f4140070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4146d65640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4140070bd0 0x7f4140071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4146d65640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41400b2430 con 0x7f4140070bd0 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4146d65640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414015a700 con 0x7f414015a320 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4146d65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4140071580 con 0x7f41400b36c0 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4140070bd0 0x7f4140071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4140070bd0 0x7f4140071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39858/0 (socket says 172.21.15.57:39858) 2023-11-24T08:06:01.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 -- 172.21.15.57:0/3238809702 learned_addr learned my addr 172.21.15.57:0/3238809702 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f413ffff640 1 --2- 172.21.15.57:0/3238809702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41400b36c0 0x7f4140070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4144b01640 1 --2- 172.21.15.57:0/3238809702 >> v2:172.21.15.132:3300/0 conn(0x7f414015a320 0x7f41400b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 -- 172.21.15.57:0/3238809702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41400b36c0 msgr2=0x7f4140070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 --2- 172.21.15.57:0/3238809702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41400b36c0 0x7f4140070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 -- 172.21.15.57:0/3238809702 >> v2:172.21.15.132:3300/0 conn(0x7f414015a320 msgr2=0x7f41400b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 --2- 172.21.15.57:0/3238809702 >> v2:172.21.15.132:3300/0 conn(0x7f414015a320 0x7f41400b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 -- 172.21.15.57:0/3238809702 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400b2620 con 0x7f4140070bd0 2023-11-24T08:06:01.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4144b01640 1 --2- 172.21.15.57:0/3238809702 >> v2:172.21.15.132:3300/0 conn(0x7f414015a320 0x7f41400b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:01.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f4145302640 1 --2- 172.21.15.57:0/3238809702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140070bd0 0x7f4140071040 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f414006c0c0 tx=0x7f413801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f56e496862e8d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f413f7fe640 1 -- 172.21.15.57:0/3238809702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380a5720 con 0x7f4140070bd0 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f413f7fe640 1 -- 172.21.15.57:0/3238809702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41380a5880 con 0x7f4140070bd0 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.312+0000 7f413f7fe640 1 -- 172.21.15.57:0/3238809702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380a5c10 con 0x7f4140070bd0 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- 172.21.15.57:0/3238809702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140070bd0 msgr2=0x7f4140071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 --2- 172.21.15.57:0/3238809702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140070bd0 0x7f4140071040 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f414006c0c0 tx=0x7f413801c9a0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- 172.21.15.57:0/3238809702 shutdown_connections 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 --2- 172.21.15.57:0/3238809702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4140070bd0 0x7f4140071040 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 --2- 172.21.15.57:0/3238809702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41400b36c0 0x7f4140070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 --2- 172.21.15.57:0/3238809702 >> v2:172.21.15.132:3300/0 conn(0x7f414015a320 0x7f41400b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- 172.21.15.57:0/3238809702 >> 172.21.15.57:0/3238809702 conn(0x7f41400b0bf0 msgr2=0x7f41400b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:01.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- 172.21.15.57:0/3238809702 shutdown_connections 2023-11-24T08:06:01.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- 172.21.15.57:0/3238809702 wait complete. 2023-11-24T08:06:01.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 Processor -- start 2023-11-24T08:06:01.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- start start 2023-11-24T08:06:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4140070bd0 0x7f414014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41400b36c0 0x7f414013bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f414015a320 0x7f4140150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414014fb10 con 0x7f41400b36c0 2023-11-24T08:06:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414014fd40 con 0x7f4140070bd0 2023-11-24T08:06:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4146d65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4140150020 con 0x7f414015a320 2023-11-24T08:06:01.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f413ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41400b36c0 0x7f414013bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f413ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41400b36c0 0x7f414013bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39860/0 (socket says 172.21.15.57:39860) 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f413ffff640 1 -- 172.21.15.57:0/683811195 learned_addr learned my addr 172.21.15.57:0/683811195 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4144b01640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4140070bd0 0x7f414014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.316+0000 7f4145302640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f414015a320 0x7f4140150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413ffff640 1 -- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f414015a320 msgr2=0x7f4140150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413ffff640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f414015a320 0x7f4140150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413ffff640 1 -- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4140070bd0 msgr2=0x7f414014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413ffff640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4140070bd0 0x7f414014f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413ffff640 1 -- 172.21.15.57:0/683811195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4134009420 con 0x7f41400b36c0 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413ffff640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41400b36c0 0x7f414013bc40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f412c009fd0 tx=0x7f412c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413d7fa640 1 -- 172.21.15.57:0/683811195 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00c940 con 0x7f41400b36c0 2023-11-24T08:06:01.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413d7fa640 1 -- 172.21.15.57:0/683811195 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c00caa0 con 0x7f41400b36c0 2023-11-24T08:06:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413d7fa640 1 -- 172.21.15.57:0/683811195 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00ce50 con 0x7f41400b36c0 2023-11-24T08:06:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4138009b30 con 0x7f41400b36c0 2023-11-24T08:06:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41401505e0 con 0x7f41400b36c0 2023-11-24T08:06:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4140067520 con 0x7f41400b36c0 2023-11-24T08:06:01.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413d7fa640 1 -- 172.21.15.57:0/683811195 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f412c013470 con 0x7f41400b36c0 2023-11-24T08:06:01.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413d7fa640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41240666b0 0x7f4124068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:01.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.320+0000 7f413d7fa640 1 -- 172.21.15.57:0/683811195 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f412c084490 con 0x7f41400b36c0 2023-11-24T08:06:01.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.324+0000 7f4144b01640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41240666b0 0x7f4124068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:01.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.324+0000 7f4144b01640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41240666b0 0x7f4124068b70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4134009c50 tx=0x7f4134009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:01.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.328+0000 7f413d7fa640 1 -- 172.21.15.57:0/683811195 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f412c051580 con 0x7f41400b36c0 2023-11-24T08:06:01.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41400b1170 con 0x7f41400b36c0 2023-11-24T08:06:01.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f413d7fa640 1 -- 172.21.15.57:0/683811195 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f412c054ba0 con 0x7f41400b36c0 2023-11-24T08:06:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:01.520 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:01.520 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:01.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41240666b0 msgr2=0x7f4124068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:01.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41240666b0 0x7f4124068b70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4134009c50 tx=0x7f4134009190 comp rx=0 tx=0).stop 2023-11-24T08:06:01.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41400b36c0 msgr2=0x7f414013bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:01.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41400b36c0 0x7f414013bc40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f412c009fd0 tx=0x7f412c00ed40 comp rx=0 tx=0).stop 2023-11-24T08:06:01.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 shutdown_connections 2023-11-24T08:06:01.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f41240666b0 0x7f4124068b70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f414015a320 0x7f4140150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41400b36c0 0x7f414013bc40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 --2- 172.21.15.57:0/683811195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4140070bd0 0x7f414014f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:01.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 >> 172.21.15.57:0/683811195 conn(0x7f41400b0bf0 msgr2=0x7f41400b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:01.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.516+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 shutdown_connections 2023-11-24T08:06:01.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:01.520+0000 7f4146d65640 1 -- 172.21.15.57:0/683811195 wait complete. 2023-11-24T08:06:01.542 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:01.700 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":17.751824032999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.11661597811851,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:01.700 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.11661597811851 }, "state": "open", "uptime": 17.751824033 } ] 2023-11-24T08:06:01.701 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:06.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:06.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d9c32640 1 Processor -- start 2023-11-24T08:06:06.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d9c32640 1 -- start start 2023-11-24T08:06:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d9c32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d4160be0 0x7fb9d415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d9c32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb9d40b37b0 0x7fb9d40b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d9c32640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d40b4150 con 0x7fb9d415db40 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d9c32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d406c650 con 0x7fb9d40b37b0 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d9c32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d415e6a0 con 0x7fb9d4160be0 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d3fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb9d415db40 0x7fb9d415df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49222/0 (socket says 172.21.15.57:49222) 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d3fff640 1 -- 172.21.15.57:0/759782612 learned_addr learned my addr 172.21.15.57:0/759782612 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d37fe640 1 --2- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d4160be0 0x7fb9d415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d2ffd640 1 --2- 172.21.15.57:0/759782612 >> v2:172.21.15.132:3300/0 conn(0x7fb9d40b37b0 0x7fb9d40b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d27fc640 1 -- 172.21.15.57:0/759782612 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951281303 0 0) 0x7fb9d40b4150 con 0x7fb9d415db40 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d27fc640 1 -- 172.21.15.57:0/759782612 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9bc003530 con 0x7fb9d415db40 2023-11-24T08:06:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d2ffd640 1 -- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d4160be0 msgr2=0x7fb9d415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d2ffd640 1 --2- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d4160be0 0x7fb9d415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d2ffd640 1 -- 172.21.15.57:0/759782612 >> v1:172.21.15.57:6789/0 conn(0x7fb9d415db40 legacy=0x7fb9d415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d2ffd640 1 -- 172.21.15.57:0/759782612 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d415e900 con 0x7fb9d40b37b0 2023-11-24T08:06:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.852+0000 7fb9d37fe640 1 --2- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d4160be0 0x7fb9d415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d2ffd640 1 --2- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d40b3c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80097c0 tx=0x7fb9c801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=217581a74d5094e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d27fc640 1 -- 172.21.15.57:0/759782612 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80ab650 con 0x7fb9d40b37b0 2023-11-24T08:06:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d27fc640 1 -- 172.21.15.57:0/759782612 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c80ab7b0 con 0x7fb9d40b37b0 2023-11-24T08:06:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d27fc640 1 -- 172.21.15.57:0/759782612 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80abb40 con 0x7fb9d40b37b0 2023-11-24T08:06:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 -- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 msgr2=0x7fb9d40b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d40b3c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80097c0 tx=0x7fb9c801c450 comp rx=0 tx=0).stop 2023-11-24T08:06:06.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 -- 172.21.15.57:0/759782612 shutdown_connections 2023-11-24T08:06:06.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d40b3c10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:06.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/759782612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d4160be0 0x7fb9d415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:06.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 -- 172.21.15.57:0/759782612 >> 172.21.15.57:0/759782612 conn(0x7fb9d40b0bf0 msgr2=0x7fb9d40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:06.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 -- 172.21.15.57:0/759782612 shutdown_connections 2023-11-24T08:06:06.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.856+0000 7fb9d9c32640 1 -- 172.21.15.57:0/759782612 wait complete. 2023-11-24T08:06:06.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 Processor -- start 2023-11-24T08:06:06.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 -- start start 2023-11-24T08:06:06.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d41576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d415db40 0x7fb9d413db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9d4160be0 0x7fb9d4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d41526d0 con 0x7fb9d4160be0 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d41529b0 con 0x7fb9d40b37b0 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4152c90 con 0x7fb9d415db40 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9d4160be0 0x7fb9d4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9d4160be0 0x7fb9d4158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51340/0 (socket says 172.21.15.57:51340) 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 -- 172.21.15.57:0/3079785574 learned_addr learned my addr 172.21.15.57:0/3079785574 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d37fe640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d41576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d2ffd640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d415db40 0x7fb9d413db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 -- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d415db40 msgr2=0x7fb9d413db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d415db40 0x7fb9d413db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 -- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 msgr2=0x7fb9d41576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d41576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 -- 172.21.15.57:0/3079785574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4009420 con 0x7fb9d4160be0 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d37fe640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d41576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d2ffd640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d415db40 0x7fb9d413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:06.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d3fff640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9d4160be0 0x7fb9d4158e80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00cb40 tx=0x7fb9cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:06.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9bbfff640 1 -- 172.21.15.57:0/3079785574 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00aca0 con 0x7fb9d4160be0 2023-11-24T08:06:06.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9bbfff640 1 -- 172.21.15.57:0/3079785574 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00ae00 con 0x7fb9d4160be0 2023-11-24T08:06:06.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.860+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c8009420 con 0x7fb9d4160be0 2023-11-24T08:06:06.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.864+0000 7fb9bbfff640 1 -- 172.21.15.57:0/3079785574 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc012620 con 0x7fb9d4160be0 2023-11-24T08:06:06.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.864+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d4153250 con 0x7fb9d4160be0 2023-11-24T08:06:06.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.864+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d4153440 con 0x7fb9d4160be0 2023-11-24T08:06:06.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.864+0000 7fb9bbfff640 1 -- 172.21.15.57:0/3079785574 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fb9cc007070 con 0x7fb9d4160be0 2023-11-24T08:06:06.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.864+0000 7fb9bbfff640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9c00666b0 0x7fb9c0068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:06.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.864+0000 7fb9bbfff640 1 -- 172.21.15.57:0/3079785574 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb9cc084380 con 0x7fb9d4160be0 2023-11-24T08:06:06.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.864+0000 7fb9d37fe640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9c00666b0 0x7fb9c0068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:06.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.868+0000 7fb9d37fe640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9c00666b0 0x7fb9c0068b70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40af440 tx=0x7fb9c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:06.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:06.868+0000 7fb9bbfff640 1 -- 172.21.15.57:0/3079785574 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9cc051450 con 0x7fb9d4160be0 2023-11-24T08:06:07.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9d4067520 con 0x7fb9d4160be0 2023-11-24T08:06:07.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9bbfff640 1 -- 172.21.15.57:0/3079785574 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fb9cc054a70 con 0x7fb9d4160be0 2023-11-24T08:06:07.064 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:07.064 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:07.064 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9c00666b0 msgr2=0x7fb9c0068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9c00666b0 0x7fb9c0068b70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40af440 tx=0x7fb9c4008040 comp rx=0 tx=0).stop 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9d4160be0 msgr2=0x7fb9d4158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9d4160be0 0x7fb9d4158e80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00cb40 tx=0x7fb9cc00a060 comp rx=0 tx=0).stop 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 shutdown_connections 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb9c00666b0 0x7fb9c0068b70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9d4160be0 0x7fb9d4158e80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:07.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb9d415db40 0x7fb9d413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:07.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 --2- 172.21.15.57:0/3079785574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d40b37b0 0x7fb9d41576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:07.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 >> 172.21.15.57:0/3079785574 conn(0x7fb9d40b0bf0 msgr2=0x7fb9d40afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:07.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 shutdown_connections 2023-11-24T08:06:07.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:07.060+0000 7fb9d9c32640 1 -- 172.21.15.57:0/3079785574 wait complete. 2023-11-24T08:06:07.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:07.252 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":23.303769224,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.847467968392575,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:07.253 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.847467968392575 }, "state": "open", "uptime": 23.303769224 } ] 2023-11-24T08:06:07.253 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:12.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.404+0000 7f9a929a1640 1 Processor -- start 2023-11-24T08:06:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.404+0000 7f9a929a1640 1 -- start start 2023-11-24T08:06:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a929a1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a8c0b1ef0 0x7f9a8c164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a929a1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8c15a700 con 0x7f9a8c15a320 2023-11-24T08:06:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a929a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8c0b2620 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a929a1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8c0b2900 con 0x7f9a8c0b1ef0 2023-11-24T08:06:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a8bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9a8c15a320 0x7f9a8c070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49234/0 (socket says 172.21.15.57:49234) 2023-11-24T08:06:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a8bfff640 1 -- 172.21.15.57:0/1330866629 learned_addr learned my addr 172.21.15.57:0/1330866629 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:06:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a90f3e640 1 --2- 172.21.15.57:0/1330866629 >> v2:172.21.15.57:3300/0 conn(0x7f9a8c0b1ef0 0x7f9a8c164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a8affd640 1 -- 172.21.15.57:0/1330866629 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068967131 0 0) 0x7f9a8c15a700 con 0x7f9a8c15a320 2023-11-24T08:06:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a8affd640 1 -- 172.21.15.57:0/1330866629 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a74003530 con 0x7f9a8c15a320 2023-11-24T08:06:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a90f3e640 1 -- 172.21.15.57:0/1330866629 >> v1:172.21.15.132:6789/0 conn(0x7f9a8c0b36c0 legacy=0x7f9a8c070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a90f3e640 1 -- 172.21.15.57:0/1330866629 >> v1:172.21.15.57:6789/0 conn(0x7f9a8c15a320 legacy=0x7f9a8c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.408+0000 7f9a90f3e640 1 -- 172.21.15.57:0/1330866629 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c0b2be0 con 0x7f9a8c0b1ef0 2023-11-24T08:06:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a90f3e640 1 --2- 172.21.15.57:0/1330866629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b1ef0 0x7f9a8c164f50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009d90 tx=0x7f9a8401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b2a1cc466f20e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a8affd640 1 -- 172.21.15.57:0/1330866629 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a840a5a10 con 0x7f9a8c0b1ef0 2023-11-24T08:06:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a8affd640 1 -- 172.21.15.57:0/1330866629 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a840a5b70 con 0x7f9a8c0b1ef0 2023-11-24T08:06:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a8affd640 1 -- 172.21.15.57:0/1330866629 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a840ad440 con 0x7f9a8c0b1ef0 2023-11-24T08:06:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 -- 172.21.15.57:0/1330866629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b1ef0 msgr2=0x7f9a8c164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 --2- 172.21.15.57:0/1330866629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b1ef0 0x7f9a8c164f50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009d90 tx=0x7f9a8401c950 comp rx=0 tx=0).stop 2023-11-24T08:06:12.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 -- 172.21.15.57:0/1330866629 shutdown_connections 2023-11-24T08:06:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 --2- 172.21.15.57:0/1330866629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b1ef0 0x7f9a8c164f50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 -- 172.21.15.57:0/1330866629 >> 172.21.15.57:0/1330866629 conn(0x7f9a8c0b0bf0 msgr2=0x7f9a8c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 -- 172.21.15.57:0/1330866629 shutdown_connections 2023-11-24T08:06:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 -- 172.21.15.57:0/1330866629 wait complete. 2023-11-24T08:06:12.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 Processor -- start 2023-11-24T08:06:12.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.412+0000 7f9a929a1640 1 -- start start 2023-11-24T08:06:12.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8c0b1ef0 0x7f9a8c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b36c0 0x7f9a8c149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a8c15a320 0x7f9a8c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c14dd80 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c14fb70 con 0x7f9a8c15a320 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c14fe50 con 0x7f9a8c0b1ef0 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b36c0 0x7f9a8c149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b36c0 0x7f9a8c149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51368/0 (socket says 172.21.15.57:51368) 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 -- 172.21.15.57:0/962307889 learned_addr learned my addr 172.21.15.57:0/962307889 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a90f3e640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a8c15a320 0x7f9a8c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8bfff640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8c0b1ef0 0x7f9a8c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 -- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8c0b1ef0 msgr2=0x7f9a8c14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8c0b1ef0 0x7f9a8c14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 -- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a8c15a320 msgr2=0x7f9a8c158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a8c15a320 0x7f9a8c158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 -- 172.21.15.57:0/962307889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84009a70 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a8b7fe640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b36c0 0x7f9a8c149880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000c500 tx=0x7f9a8000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a88ff9640 1 -- 172.21.15.57:0/962307889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80005220 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a88ff9640 1 -- 172.21.15.57:0/962307889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a80005380 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a88ff9640 1 -- 172.21.15.57:0/962307889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80007270 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c150130 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c1506f0 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.416+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c150910 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.420+0000 7f9a88ff9640 1 -- 172.21.15.57:0/962307889 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f9a800073d0 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.420+0000 7f9a88ff9640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a780666b0 0x7f9a78068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.420+0000 7f9a88ff9640 1 -- 172.21.15.57:0/962307889 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9a80083bb0 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.420+0000 7f9a8bfff640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a780666b0 0x7f9a78068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:12.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.420+0000 7f9a8bfff640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a780666b0 0x7f9a78068b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0011f0 tx=0x7f9a7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:12.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.424+0000 7f9a88ff9640 1 -- 172.21.15.57:0/962307889 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a80050c00 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a8c159ba0 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a88ff9640 1 -- 172.21.15.57:0/962307889 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f9a80054220 con 0x7f9a8c0b36c0 2023-11-24T08:06:12.619 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:12.619 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:12.620 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:12.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a780666b0 msgr2=0x7f9a78068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:12.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a780666b0 0x7f9a78068b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0011f0 tx=0x7f9a7c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:12.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b36c0 msgr2=0x7f9a8c149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b36c0 0x7f9a8c149880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000c500 tx=0x7f9a8000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 shutdown_connections 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9a780666b0 0x7f9a78068b70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a8c15a320 0x7f9a8c158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0b36c0 0x7f9a8c149880 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 --2- 172.21.15.57:0/962307889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8c0b1ef0 0x7f9a8c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 >> 172.21.15.57:0/962307889 conn(0x7f9a8c0b0bf0 msgr2=0x7f9a8c0cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 shutdown_connections 2023-11-24T08:06:12.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:12.616+0000 7f9a929a1640 1 -- 172.21.15.57:0/962307889 wait complete. 2023-11-24T08:06:12.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:12.812 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":28.859714474,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.581560245712769,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:12.813 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.58156024571277 }, "state": "open", "uptime": 28.859714474 } ] 2023-11-24T08:06:12.813 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:17.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:19.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:19.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:20.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.040+0000 7f534a1c1640 1 Processor -- start 2023-11-24T08:06:20.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.040+0000 7f534a1c1640 1 -- start start 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f534a1c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53440b36c0 0x7f53440b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f534a1c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5344070da0 0x7f53440711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f534a1c1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534415a700 con 0x7f534415a320 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f534a1c1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440b2430 con 0x7f5344070da0 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f534a1c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440b2620 con 0x7f53440b36c0 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f53437fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f534415a320 0x7f5344070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:35414/0 (socket says 172.21.15.57:35414) 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f53437fe640 1 -- 172.21.15.57:0/3577150019 learned_addr learned my addr 172.21.15.57:0/3577150019 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f5343fff640 1 --2- 172.21.15.57:0/3577150019 >> v2:172.21.15.57:3300/0 conn(0x7f5344070da0 0x7f53440711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:20.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f5342ffd640 1 --2- 172.21.15.57:0/3577150019 >> v2:172.21.15.132:3300/0 conn(0x7f53440b36c0 0x7f53440b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f53427fc640 1 -- 172.21.15.57:0/3577150019 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481333930 0 0) 0x7f534415a700 con 0x7f534415a320 2023-11-24T08:06:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f53427fc640 1 -- 172.21.15.57:0/3577150019 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f532c003530 con 0x7f534415a320 2023-11-24T08:06:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f5343fff640 1 -- 172.21.15.57:0/3577150019 >> v2:172.21.15.132:3300/0 conn(0x7f53440b36c0 msgr2=0x7f53440b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f5343fff640 1 --2- 172.21.15.57:0/3577150019 >> v2:172.21.15.132:3300/0 conn(0x7f53440b36c0 0x7f53440b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f5343fff640 1 -- 172.21.15.57:0/3577150019 >> v1:172.21.15.57:6789/0 conn(0x7f534415a320 legacy=0x7f5344070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f5343fff640 1 -- 172.21.15.57:0/3577150019 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440b2900 con 0x7f5344070da0 2023-11-24T08:06:20.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.044+0000 7f5342ffd640 1 --2- 172.21.15.57:0/3577150019 >> v2:172.21.15.132:3300/0 conn(0x7f53440b36c0 0x7f53440b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:20.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f5343fff640 1 --2- 172.21.15.57:0/3577150019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5344070da0 0x7f53440711f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f534406c180 tx=0x7f533c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d8d1d93a0faee1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f53427fc640 1 -- 172.21.15.57:0/3577150019 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0a58a0 con 0x7f5344070da0 2023-11-24T08:06:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f53427fc640 1 -- 172.21.15.57:0/3577150019 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0a5a00 con 0x7f5344070da0 2023-11-24T08:06:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f53427fc640 1 -- 172.21.15.57:0/3577150019 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0a5d90 con 0x7f5344070da0 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 -- 172.21.15.57:0/3577150019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5344070da0 msgr2=0x7f53440711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 --2- 172.21.15.57:0/3577150019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5344070da0 0x7f53440711f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f534406c180 tx=0x7f533c01c8e0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 -- 172.21.15.57:0/3577150019 shutdown_connections 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 --2- 172.21.15.57:0/3577150019 >> v2:172.21.15.132:3300/0 conn(0x7f53440b36c0 0x7f53440b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 --2- 172.21.15.57:0/3577150019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5344070da0 0x7f53440711f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 -- 172.21.15.57:0/3577150019 >> 172.21.15.57:0/3577150019 conn(0x7f53440b0bf0 msgr2=0x7f53440b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 -- 172.21.15.57:0/3577150019 shutdown_connections 2023-11-24T08:06:20.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 -- 172.21.15.57:0/3577150019 wait complete. 2023-11-24T08:06:20.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 Processor -- start 2023-11-24T08:06:20.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.048+0000 7f534a1c1640 1 -- start start 2023-11-24T08:06:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5344070da0 0x7f534415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53440b36c0 0x7f534414c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f534415a320 0x7f5344159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534414bd90 con 0x7f534415a320 2023-11-24T08:06:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534415c1b0 con 0x7f53440b36c0 2023-11-24T08:06:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534415c480 con 0x7f5344070da0 2023-11-24T08:06:20.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f534415a320 0x7f5344159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f534415a320 0x7f5344159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60920/0 (socket says 172.21.15.57:60920) 2023-11-24T08:06:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 -- 172.21.15.57:0/815288452 learned_addr learned my addr 172.21.15.57:0/815288452 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f53437fe640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5344070da0 0x7f534415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:20.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5342ffd640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53440b36c0 0x7f534414c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 -- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5344070da0 msgr2=0x7f534415bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5344070da0 0x7f534415bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 -- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53440b36c0 msgr2=0x7f534414c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53440b36c0 0x7f534414c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 -- 172.21.15.57:0/815288452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009a70 con 0x7f534415a320 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f5343fff640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f534415a320 0x7f5344159340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f533c01a510 tx=0x7f533c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f532bfff640 1 -- 172.21.15.57:0/815288452 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c007000 con 0x7f534415a320 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f532bfff640 1 -- 172.21.15.57:0/815288452 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0ad850 con 0x7f534415a320 2023-11-24T08:06:20.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f532bfff640 1 -- 172.21.15.57:0/815288452 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0adc00 con 0x7f534415a320 2023-11-24T08:06:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534415c760 con 0x7f534415a320 2023-11-24T08:06:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534414bfe0 con 0x7f534415a320 2023-11-24T08:06:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.052+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5344067520 con 0x7f534415a320 2023-11-24T08:06:20.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.056+0000 7f532bfff640 1 -- 172.21.15.57:0/815288452 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f533c0b4070 con 0x7f534415a320 2023-11-24T08:06:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.056+0000 7f532bfff640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53300666b0 0x7f5330068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.056+0000 7f532bfff640 1 -- 172.21.15.57:0/815288452 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f533c11ef40 con 0x7f534415a320 2023-11-24T08:06:20.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.056+0000 7f53437fe640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53300666b0 0x7f5330068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:20.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.056+0000 7f53437fe640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53300666b0 0x7f5330068b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5334007fd0 tx=0x7f5334009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:20.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.060+0000 7f532bfff640 1 -- 172.21.15.57:0/815288452 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f533c0ec0c0 con 0x7f534415a320 2023-11-24T08:06:20.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f534414c1a0 con 0x7f534415a320 2023-11-24T08:06:20.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f532bfff640 1 -- 172.21.15.57:0/815288452 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f533c0b2020 con 0x7f534415a320 2023-11-24T08:06:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:20.251 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:20.251 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:20.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53300666b0 msgr2=0x7f5330068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:20.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53300666b0 0x7f5330068b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5334007fd0 tx=0x7f5334009040 comp rx=0 tx=0).stop 2023-11-24T08:06:20.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f534415a320 msgr2=0x7f5344159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f534415a320 0x7f5344159340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f533c01a510 tx=0x7f533c019680 comp rx=0 tx=0).stop 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 shutdown_connections 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f53300666b0 0x7f5330068b70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f534415a320 0x7f5344159340 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53440b36c0 0x7f534414c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 --2- 172.21.15.57:0/815288452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5344070da0 0x7f534415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 >> 172.21.15.57:0/815288452 conn(0x7f53440b0bf0 msgr2=0x7f53440b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 shutdown_connections 2023-11-24T08:06:20.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:20.248+0000 7f534a1c1640 1 -- 172.21.15.57:0/815288452 wait complete. 2023-11-24T08:06:20.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:20.441 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":36.49163944,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.221816580083864,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:20.441 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.221816580083864 }, "state": "open", "uptime": 36.49163944 } ] 2023-11-24T08:06:20.441 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:25.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.591+0000 7fcb717df640 1 Processor -- start 2023-11-24T08:06:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.591+0000 7fcb717df640 1 -- start start 2023-11-24T08:06:25.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.591+0000 7fcb717df640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb6c15a320 0x7fcb6c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.591+0000 7fcb717df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb6c070da0 0x7fcb6c0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.591+0000 7fcb717df640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c15a700 con 0x7fcb6c0b36c0 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.591+0000 7fcb717df640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c0b2430 con 0x7fcb6c15a320 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.591+0000 7fcb717df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c0b2620 con 0x7fcb6c070da0 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb6c15a320 0x7fcb6c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb6c15a320 0x7fcb6c0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60930/0 (socket says 172.21.15.57:60930) 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 -- 172.21.15.57:0/550665003 learned_addr learned my addr 172.21.15.57:0/550665003 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6b7fe640 1 --2- 172.21.15.57:0/550665003 >> v2:172.21.15.132:3300/0 conn(0x7fcb6c070da0 0x7fcb6c0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 -- 172.21.15.57:0/550665003 >> v2:172.21.15.132:3300/0 conn(0x7fcb6c070da0 msgr2=0x7fcb6c0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 --2- 172.21.15.57:0/550665003 >> v2:172.21.15.132:3300/0 conn(0x7fcb6c070da0 0x7fcb6c0711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 -- 172.21.15.57:0/550665003 >> v1:172.21.15.132:6789/0 conn(0x7fcb6c0b36c0 legacy=0x7fcb6c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 -- 172.21.15.57:0/550665003 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0b2900 con 0x7fcb6c15a320 2023-11-24T08:06:25.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6affd640 1 --2- 172.21.15.57:0/550665003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c15a320 0x7fcb6c0b1ef0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06c2d0 tx=0x7fcb5c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7228d937e77c41 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6a7fc640 1 -- 172.21.15.57:0/550665003 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0a7b70 con 0x7fcb6c15a320 2023-11-24T08:06:25.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6a7fc640 1 -- 172.21.15.57:0/550665003 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0a7cd0 con 0x7fcb6c15a320 2023-11-24T08:06:25.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.595+0000 7fcb6a7fc640 1 -- 172.21.15.57:0/550665003 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0af660 con 0x7fcb6c15a320 2023-11-24T08:06:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- 172.21.15.57:0/550665003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c15a320 msgr2=0x7fcb6c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 --2- 172.21.15.57:0/550665003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c15a320 0x7fcb6c0b1ef0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06c2d0 tx=0x7fcb5c01eba0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- 172.21.15.57:0/550665003 shutdown_connections 2023-11-24T08:06:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 --2- 172.21.15.57:0/550665003 >> v2:172.21.15.132:3300/0 conn(0x7fcb6c070da0 0x7fcb6c0711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 --2- 172.21.15.57:0/550665003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c15a320 0x7fcb6c0b1ef0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- 172.21.15.57:0/550665003 >> 172.21.15.57:0/550665003 conn(0x7fcb6c0b0bf0 msgr2=0x7fcb6c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- 172.21.15.57:0/550665003 shutdown_connections 2023-11-24T08:06:25.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- 172.21.15.57:0/550665003 wait complete. 2023-11-24T08:06:25.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 Processor -- start 2023-11-24T08:06:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- start start 2023-11-24T08:06:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c070da0 0x7fcb6c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb6c15a320 0x7fcb6c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c159620 con 0x7fcb6c070da0 2023-11-24T08:06:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c14d4c0 con 0x7fcb6c15a320 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb717df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c15aa30 con 0x7fcb6c0b36c0 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb6affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c070da0 0x7fcb6c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb6affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c070da0 0x7fcb6c158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60940/0 (socket says 172.21.15.57:60940) 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb6affd640 1 -- 172.21.15.57:0/1132656465 learned_addr learned my addr 172.21.15.57:0/1132656465 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb63fff640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.599+0000 7fcb6b7fe640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb6c15a320 0x7fcb6c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb6affd640 1 -- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb6c0b36c0 msgr2=0x7fcb6c14cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb6affd640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c14cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb6affd640 1 -- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb6c15a320 msgr2=0x7fcb6c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb6affd640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb6c15a320 0x7fcb6c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb6affd640 1 -- 172.21.15.57:0/1132656465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c00b770 con 0x7fcb6c070da0 2023-11-24T08:06:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb6affd640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c070da0 0x7fcb6c158f90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c01b7b0 tx=0x7fcb5c01b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb637fe640 1 -- 172.21.15.57:0/1132656465 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0afd90 con 0x7fcb6c070da0 2023-11-24T08:06:25.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb637fe640 1 -- 172.21.15.57:0/1132656465 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0ba410 con 0x7fcb6c070da0 2023-11-24T08:06:25.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c15ad10 con 0x7fcb6c070da0 2023-11-24T08:06:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb637fe640 1 -- 172.21.15.57:0/1132656465 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0ba7c0 con 0x7fcb6c070da0 2023-11-24T08:06:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c15b2d0 con 0x7fcb6c070da0 2023-11-24T08:06:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c15ab70 con 0x7fcb6c070da0 2023-11-24T08:06:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.603+0000 7fcb637fe640 1 -- 172.21.15.57:0/1132656465 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fcb5c0c3450 con 0x7fcb6c070da0 2023-11-24T08:06:25.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.607+0000 7fcb637fe640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcb4c0666b0 0x7fcb4c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:25.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.607+0000 7fcb637fe640 1 -- 172.21.15.57:0/1132656465 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcb5c0a7e40 con 0x7fcb6c070da0 2023-11-24T08:06:25.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.607+0000 7fcb63fff640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcb4c0666b0 0x7fcb4c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:25.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.607+0000 7fcb63fff640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcb4c0666b0 0x7fcb4c068b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c09bfc0 tx=0x7fcb54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:25.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.611+0000 7fcb637fe640 1 -- 172.21.15.57:0/1132656465 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb6c15ab70 con 0x7fcb6c070da0 2023-11-24T08:06:25.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb6c15ab70 con 0x7fcb6c070da0 2023-11-24T08:06:25.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb637fe640 1 -- 172.21.15.57:0/1132656465 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fcb6c15ab70 con 0x7fcb6c070da0 2023-11-24T08:06:25.808 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:25.808 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:25.808 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcb4c0666b0 msgr2=0x7fcb4c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcb4c0666b0 0x7fcb4c068b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c09bfc0 tx=0x7fcb54009040 comp rx=0 tx=0).stop 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c070da0 msgr2=0x7fcb6c158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c070da0 0x7fcb6c158f90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c01b7b0 tx=0x7fcb5c01b940 comp rx=0 tx=0).stop 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 shutdown_connections 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fcb4c0666b0 0x7fcb4c068b70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb6c15a320 0x7fcb6c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb6c0b36c0 0x7fcb6c14cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 --2- 172.21.15.57:0/1132656465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb6c070da0 0x7fcb6c158f90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 >> 172.21.15.57:0/1132656465 conn(0x7fcb6c0b0bf0 msgr2=0x7fcb6c099c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 shutdown_connections 2023-11-24T08:06:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:25.803+0000 7fcb717df640 1 -- 172.21.15.57:0/1132656465 wait complete. 2023-11-24T08:06:25.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:25.997 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":42.047584934,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.963888977650505,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:25.997 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.963888977650505 }, "state": "open", "uptime": 42.047584934 } ] 2023-11-24T08:06:25.997 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:30.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:31.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.147+0000 7f9468ff8640 1 Processor -- start 2023-11-24T08:06:31.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.147+0000 7f9468ff8640 1 -- start start 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9468ff8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9464160be0 0x7f946415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9468ff8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f946415e250 0x7f94640b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9468ff8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946415e660 con 0x7f94640b37b0 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9468ff8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946406c650 con 0x7f946415e250 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9468ff8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94640b4180 con 0x7f9464160be0 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9462d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f946415e250 0x7f94640b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9462d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f946415e250 0x7f94640b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53012/0 (socket says 172.21.15.57:53012) 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9462d9d640 1 -- 172.21.15.57:0/1278069921 learned_addr learned my addr 172.21.15.57:0/1278069921 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f946259c640 1 --2- 172.21.15.57:0/1278069921 >> v2:172.21.15.132:3300/0 conn(0x7f9464160be0 0x7f946415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9462d9d640 1 -- 172.21.15.57:0/1278069921 >> v2:172.21.15.132:3300/0 conn(0x7f9464160be0 msgr2=0x7f946415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9462d9d640 1 --2- 172.21.15.57:0/1278069921 >> v2:172.21.15.132:3300/0 conn(0x7f9464160be0 0x7f946415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9462d9d640 1 -- 172.21.15.57:0/1278069921 >> v1:172.21.15.132:6789/0 conn(0x7f94640b37b0 legacy=0x7f946415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.151+0000 7f9462d9d640 1 -- 172.21.15.57:0/1278069921 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946415e900 con 0x7f946415e250 2023-11-24T08:06:31.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9462d9d640 1 --2- 172.21.15.57:0/1278069921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f946415e250 0x7f94640b3c40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f946406b600 tx=0x7f945c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82967e0cc23a8ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:31.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9461d9b640 1 -- 172.21.15.57:0/1278069921 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c0a5860 con 0x7f946415e250 2023-11-24T08:06:31.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9461d9b640 1 -- 172.21.15.57:0/1278069921 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c0a59c0 con 0x7f946415e250 2023-11-24T08:06:31.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9461d9b640 1 -- 172.21.15.57:0/1278069921 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c0a5d50 con 0x7f946415e250 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 -- 172.21.15.57:0/1278069921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f946415e250 msgr2=0x7f94640b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 --2- 172.21.15.57:0/1278069921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f946415e250 0x7f94640b3c40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f946406b600 tx=0x7f945c01c9a0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 -- 172.21.15.57:0/1278069921 shutdown_connections 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 --2- 172.21.15.57:0/1278069921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f946415e250 0x7f94640b3c40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 --2- 172.21.15.57:0/1278069921 >> v2:172.21.15.132:3300/0 conn(0x7f9464160be0 0x7f946415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 -- 172.21.15.57:0/1278069921 >> 172.21.15.57:0/1278069921 conn(0x7f94640b0bf0 msgr2=0x7f94640b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 -- 172.21.15.57:0/1278069921 shutdown_connections 2023-11-24T08:06:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 -- 172.21.15.57:0/1278069921 wait complete. 2023-11-24T08:06:31.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 Processor -- start 2023-11-24T08:06:31.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.155+0000 7f9468ff8640 1 -- start start 2023-11-24T08:06:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94640b37b0 0x7f9464151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946415e250 0x7f94640999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464160be0 0x7f94640adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640acc50 con 0x7f94640b37b0 2023-11-24T08:06:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946415aa20 con 0x7f9464160be0 2023-11-24T08:06:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946415ad00 con 0x7f946415e250 2023-11-24T08:06:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94640b37b0 0x7f9464151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94640b37b0 0x7f9464151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53022/0 (socket says 172.21.15.57:53022) 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 -- 172.21.15.57:0/3938819881 learned_addr learned my addr 172.21.15.57:0/3938819881 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9462d9d640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464160be0 0x7f94640adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f945bfff640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946415e250 0x7f94640999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 -- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946415e250 msgr2=0x7f94640999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946415e250 0x7f94640999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 -- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464160be0 msgr2=0x7f94640adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464160be0 0x7f94640adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 -- 172.21.15.57:0/3938819881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c009b30 con 0x7f94640b37b0 2023-11-24T08:06:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f946259c640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94640b37b0 0x7f9464151170 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f945400d800 tx=0x7f945400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f945affd640 1 -- 172.21.15.57:0/3938819881 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400b6c0 con 0x7f94640b37b0 2023-11-24T08:06:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f945affd640 1 -- 172.21.15.57:0/3938819881 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945400b820 con 0x7f94640b37b0 2023-11-24T08:06:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f945affd640 1 -- 172.21.15.57:0/3938819881 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400bb90 con 0x7f94640b37b0 2023-11-24T08:06:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946415afe0 con 0x7f94640b37b0 2023-11-24T08:06:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640ad0e0 con 0x7f94640b37b0 2023-11-24T08:06:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9464067520 con 0x7f94640b37b0 2023-11-24T08:06:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.159+0000 7f945affd640 1 -- 172.21.15.57:0/3938819881 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f945400bcf0 con 0x7f94640b37b0 2023-11-24T08:06:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.163+0000 7f945affd640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f94440666e0 0x7f9444068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:31.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.163+0000 7f945affd640 1 -- 172.21.15.57:0/3938819881 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f94540845f0 con 0x7f94640b37b0 2023-11-24T08:06:31.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.163+0000 7f945bfff640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f94440666e0 0x7f9444068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:31.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.163+0000 7f945bfff640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f94440666e0 0x7f9444068ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f94640cef30 tx=0x7f944c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.167+0000 7f945affd640 1 -- 172.21.15.57:0/3938819881 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9454051810 con 0x7f94640b37b0 2023-11-24T08:06:31.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f946409d030 con 0x7f94640b37b0 2023-11-24T08:06:31.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f945affd640 1 -- 172.21.15.57:0/3938819881 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f9454054e30 con 0x7f94640b37b0 2023-11-24T08:06:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:31.363 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:31.363 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f94440666e0 msgr2=0x7f9444068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f94440666e0 0x7f9444068ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f94640cef30 tx=0x7f944c009040 comp rx=0 tx=0).stop 2023-11-24T08:06:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94640b37b0 msgr2=0x7f9464151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94640b37b0 0x7f9464151170 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f945400d800 tx=0x7f945400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 shutdown_connections 2023-11-24T08:06:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f94440666e0 0x7f9444068ba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464160be0 0x7f94640adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946415e250 0x7f94640999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 --2- 172.21.15.57:0/3938819881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94640b37b0 0x7f9464151170 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 >> 172.21.15.57:0/3938819881 conn(0x7f94640b0bf0 msgr2=0x7f946415b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 shutdown_connections 2023-11-24T08:06:31.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:31.359+0000 7f9468ff8640 1 -- 172.21.15.57:0/3938819881 wait complete. 2023-11-24T08:06:31.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:31.554 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":47.603530523000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.709251216184288,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:31.555 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.70925121618429 }, "state": "open", "uptime": 47.603530523 } ] 2023-11-24T08:06:31.555 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:36.556 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:36.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.703+0000 7f2b5c1f8640 1 Processor -- start 2023-11-24T08:06:36.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.703+0000 7f2b5c1f8640 1 -- start start 2023-11-24T08:06:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b5c1f8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b54144030 0x7f2b5406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b5c1f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b5409cc20 0x7f2b5406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b5c1f8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5406d8b0 con 0x7f2b5406e280 2023-11-24T08:06:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b5c1f8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b54145020 con 0x7f2b54144030 2023-11-24T08:06:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b5c1f8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5409d0a0 con 0x7f2b5409cc20 2023-11-24T08:06:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59f94640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b54144030 0x7f2b5406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:36.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59f94640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b54144030 0x7f2b5406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51478/0 (socket says 172.21.15.57:51478) 2023-11-24T08:06:36.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59f94640 1 -- 172.21.15.57:0/2913936009 learned_addr learned my addr 172.21.15.57:0/2913936009 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:36.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59793640 1 --2- 172.21.15.57:0/2913936009 >> v2:172.21.15.132:3300/0 conn(0x7f2b5409cc20 0x7f2b5406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:36.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59f94640 1 -- 172.21.15.57:0/2913936009 >> v2:172.21.15.132:3300/0 conn(0x7f2b5409cc20 msgr2=0x7f2b5406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:36.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59f94640 1 --2- 172.21.15.57:0/2913936009 >> v2:172.21.15.132:3300/0 conn(0x7f2b5409cc20 0x7f2b5406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59f94640 1 -- 172.21.15.57:0/2913936009 >> v1:172.21.15.132:6789/0 conn(0x7f2b5406e280 legacy=0x7f2b540709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59f94640 1 -- 172.21.15.57:0/2913936009 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5406cca0 con 0x7f2b54144030 2023-11-24T08:06:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.707+0000 7f2b59793640 1 --2- 172.21.15.57:0/2913936009 >> v2:172.21.15.132:3300/0 conn(0x7f2b5409cc20 0x7f2b5406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:36.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b59f94640 1 --2- 172.21.15.57:0/2913936009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b5406c650 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2b540700a0 tx=0x7f2b5001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee37753a3d085740 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:36.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b58f92640 1 -- 172.21.15.57:0/2913936009 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500aa5f0 con 0x7f2b54144030 2023-11-24T08:06:36.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b58f92640 1 -- 172.21.15.57:0/2913936009 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500aa750 con 0x7f2b54144030 2023-11-24T08:06:36.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b58f92640 1 -- 172.21.15.57:0/2913936009 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500aaae0 con 0x7f2b54144030 2023-11-24T08:06:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/2913936009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 msgr2=0x7f2b5406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/2913936009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b5406c650 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2b540700a0 tx=0x7f2b5001c490 comp rx=0 tx=0).stop 2023-11-24T08:06:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/2913936009 shutdown_connections 2023-11-24T08:06:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/2913936009 >> v2:172.21.15.132:3300/0 conn(0x7f2b5409cc20 0x7f2b5406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/2913936009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b5406c650 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/2913936009 >> 172.21.15.57:0/2913936009 conn(0x7f2b540b0bf0 msgr2=0x7f2b540b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/2913936009 shutdown_connections 2023-11-24T08:06:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/2913936009 wait complete. 2023-11-24T08:06:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 Processor -- start 2023-11-24T08:06:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.711+0000 7f2b5c1f8640 1 -- start start 2023-11-24T08:06:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b5406e280 0x7f2b5415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5409cc20 0x7f2b54135020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b54132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54133c60 con 0x7f2b54144030 2023-11-24T08:06:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5413e770 con 0x7f2b5409cc20 2023-11-24T08:06:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5409a590 con 0x7f2b5406e280 2023-11-24T08:06:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b54132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:36.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b54132ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51486/0 (socket says 172.21.15.57:51486) 2023-11-24T08:06:36.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 -- 172.21.15.57:0/3488577947 learned_addr learned my addr 172.21.15.57:0/3488577947 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:36.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b59f94640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b5406e280 0x7f2b5415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:36.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b59793640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5409cc20 0x7f2b54135020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:36.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 -- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b5406e280 msgr2=0x7f2b5415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:36.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b5406e280 0x7f2b5415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 -- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5409cc20 msgr2=0x7f2b54135020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5409cc20 0x7f2b54135020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 -- 172.21.15.57:0/3488577947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500094d0 con 0x7f2b54144030 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5a795640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b54132ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c780 tx=0x7f2b4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b4a7fc640 1 -- 172.21.15.57:0/3488577947 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00a9f0 con 0x7f2b54144030 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b4a7fc640 1 -- 172.21.15.57:0/3488577947 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c00ce90 con 0x7f2b54144030 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b4a7fc640 1 -- 172.21.15.57:0/3488577947 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00add0 con 0x7f2b54144030 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5409a870 con 0x7f2b54144030 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b54135560 con 0x7f2b54144030 2023-11-24T08:06:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.715+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5409a3c0 con 0x7f2b54144030 2023-11-24T08:06:36.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.719+0000 7f2b4a7fc640 1 -- 172.21.15.57:0/3488577947 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f2b4c012420 con 0x7f2b54144030 2023-11-24T08:06:36.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.719+0000 7f2b4a7fc640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b380666b0 0x7f2b38068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:36.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.719+0000 7f2b4a7fc640 1 -- 172.21.15.57:0/3488577947 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2b4c0842e0 con 0x7f2b54144030 2023-11-24T08:06:36.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.719+0000 7f2b59f94640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b380666b0 0x7f2b38068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:36.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.719+0000 7f2b59f94640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b380666b0 0x7f2b38068b70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2b500ae000 tx=0x7f2b500b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:36.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.723+0000 7f2b4a7fc640 1 -- 172.21.15.57:0/3488577947 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b4c051460 con 0x7f2b54144030 2023-11-24T08:06:36.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b54067520 con 0x7f2b54144030 2023-11-24T08:06:36.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b4a7fc640 1 -- 172.21.15.57:0/3488577947 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f2b4c054a80 con 0x7f2b54144030 2023-11-24T08:06:36.924 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:36.924 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:36.924 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b380666b0 msgr2=0x7f2b38068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b380666b0 0x7f2b38068b70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2b500ae000 tx=0x7f2b500b5040 comp rx=0 tx=0).stop 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 msgr2=0x7f2b54132ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b54132ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c780 tx=0x7f2b4c00cc40 comp rx=0 tx=0).stop 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 shutdown_connections 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2b380666b0 0x7f2b38068b70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b54144030 0x7f2b54132ea0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5409cc20 0x7f2b54135020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 --2- 172.21.15.57:0/3488577947 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b5406e280 0x7f2b5415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:36.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 >> 172.21.15.57:0/3488577947 conn(0x7f2b540b0bf0 msgr2=0x7f2b5413bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:36.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 shutdown_connections 2023-11-24T08:06:36.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:36.919+0000 7f2b5c1f8640 1 -- 172.21.15.57:0/3488577947 wait complete. 2023-11-24T08:06:36.945 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:37.113 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":53.163476166999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.457681507951676,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:37.114 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.457681507951676 }, "state": "open", "uptime": 53.163476167 } ] 2023-11-24T08:06:37.114 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:42.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:42.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.263+0000 7fb32b46b640 1 Processor -- start 2023-11-24T08:06:42.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb32b46b640 1 -- start start 2023-11-24T08:06:42.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb32b46b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3240710d0 0x7fb32409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb32b46b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32406d8b0 con 0x7fb324144030 2023-11-24T08:06:42.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb32b46b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32406cca0 con 0x7fb32406c650 2023-11-24T08:06:42.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb32b46b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb324145020 con 0x7fb3240710d0 2023-11-24T08:06:42.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb329207640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb324144030 0x7fb32406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39416/0 (socket says 172.21.15.57:39416) 2023-11-24T08:06:42.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb329207640 1 -- 172.21.15.57:0/852846271 learned_addr learned my addr 172.21.15.57:0/852846271 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:06:42.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb329a08640 1 --2- 172.21.15.57:0/852846271 >> v2:172.21.15.132:3300/0 conn(0x7fb3240710d0 0x7fb32409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb31bfff640 1 -- 172.21.15.57:0/852846271 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551694448 0 0) 0x7fb32406d8b0 con 0x7fb324144030 2023-11-24T08:06:42.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb31bfff640 1 -- 172.21.15.57:0/852846271 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb310003530 con 0x7fb324144030 2023-11-24T08:06:42.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb329a08640 1 -- 172.21.15.57:0/852846271 >> v1:172.21.15.132:6789/0 conn(0x7fb32406c650 legacy=0x7fb3240709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb329a08640 1 -- 172.21.15.57:0/852846271 >> v1:172.21.15.57:6789/0 conn(0x7fb324144030 legacy=0x7fb32406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.267+0000 7fb329a08640 1 -- 172.21.15.57:0/852846271 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32406cf80 con 0x7fb3240710d0 2023-11-24T08:06:42.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb329a08640 1 --2- 172.21.15.57:0/852846271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3240710d0 0x7fb32409cc20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d58625f95e39d72 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb31bfff640 1 -- 172.21.15.57:0/852846271 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a5900 con 0x7fb3240710d0 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb31bfff640 1 -- 172.21.15.57:0/852846271 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0a5a60 con 0x7fb3240710d0 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb31bfff640 1 -- 172.21.15.57:0/852846271 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a5df0 con 0x7fb3240710d0 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 -- 172.21.15.57:0/852846271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3240710d0 msgr2=0x7fb32409cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 --2- 172.21.15.57:0/852846271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3240710d0 0x7fb32409cc20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c01c950 comp rx=0 tx=0).stop 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 -- 172.21.15.57:0/852846271 shutdown_connections 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 --2- 172.21.15.57:0/852846271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3240710d0 0x7fb32409cc20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 -- 172.21.15.57:0/852846271 >> 172.21.15.57:0/852846271 conn(0x7fb3240b0bf0 msgr2=0x7fb3240b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:42.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 -- 172.21.15.57:0/852846271 shutdown_connections 2023-11-24T08:06:42.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 -- 172.21.15.57:0/852846271 wait complete. 2023-11-24T08:06:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 Processor -- start 2023-11-24T08:06:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.271+0000 7fb32b46b640 1 -- start start 2023-11-24T08:06:42.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406c650 0x7fb324157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3240710d0 0x7fb32413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb324144030 0x7fb32413cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324138870 con 0x7fb32406c650 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415a2f0 con 0x7fb324144030 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415a5d0 con 0x7fb3240710d0 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406c650 0x7fb324157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406c650 0x7fb324157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51488/0 (socket says 172.21.15.57:51488) 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 -- 172.21.15.57:0/3347751855 learned_addr learned my addr 172.21.15.57:0/3347751855 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329a08640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb324144030 0x7fb32413cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb328a06640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3240710d0 0x7fb32413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 -- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3240710d0 msgr2=0x7fb32413c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3240710d0 0x7fb32413c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 -- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb324144030 msgr2=0x7fb32413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb324144030 0x7fb32413cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 -- 172.21.15.57:0/3347751855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c009a70 con 0x7fb32406c650 2023-11-24T08:06:42.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb328a06640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3240710d0 0x7fb32413c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:06:42.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb329207640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406c650 0x7fb324157f90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c420 tx=0x7fb32000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb319ffb640 1 -- 172.21.15.57:0/3347751855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320005cf0 con 0x7fb32406c650 2023-11-24T08:06:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb319ffb640 1 -- 172.21.15.57:0/3347751855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb320005e50 con 0x7fb32406c650 2023-11-24T08:06:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32415a8b0 con 0x7fb32406c650 2023-11-24T08:06:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb319ffb640 1 -- 172.21.15.57:0/3347751855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200072d0 con 0x7fb32406c650 2023-11-24T08:06:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32415b280 con 0x7fb32406c650 2023-11-24T08:06:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.275+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32415a150 con 0x7fb32406c650 2023-11-24T08:06:42.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.279+0000 7fb319ffb640 1 -- 172.21.15.57:0/3347751855 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fb320007430 con 0x7fb32406c650 2023-11-24T08:06:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.279+0000 7fb319ffb640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3080666e0 0x7fb308068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.279+0000 7fb319ffb640 1 -- 172.21.15.57:0/3347751855 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb320083930 con 0x7fb32406c650 2023-11-24T08:06:42.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.279+0000 7fb328a06640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3080666e0 0x7fb308068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:42.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.279+0000 7fb328a06640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3080666e0 0x7fb308068ba0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb3241f72d0 tx=0x7fb314009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:42.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.283+0000 7fb319ffb640 1 -- 172.21.15.57:0/3347751855 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb32415a150 con 0x7fb32406c650 2023-11-24T08:06:42.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb32415a150 con 0x7fb32406c650 2023-11-24T08:06:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb319ffb640 1 -- 172.21.15.57:0/3347751855 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fb32415a150 con 0x7fb32406c650 2023-11-24T08:06:42.475 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:42.475 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:42.476 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3080666e0 msgr2=0x7fb308068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3080666e0 0x7fb308068ba0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb3241f72d0 tx=0x7fb314009040 comp rx=0 tx=0).stop 2023-11-24T08:06:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406c650 msgr2=0x7fb324157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406c650 0x7fb324157f90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c420 tx=0x7fb32000c8e0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 shutdown_connections 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3080666e0 0x7fb308068ba0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb324144030 0x7fb32413cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3240710d0 0x7fb32413c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 --2- 172.21.15.57:0/3347751855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406c650 0x7fb324157f90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 >> 172.21.15.57:0/3347751855 conn(0x7fb3240b0bf0 msgr2=0x7fb3240abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 shutdown_connections 2023-11-24T08:06:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:42.471+0000 7fb32b46b640 1 -- 172.21.15.57:0/3347751855 wait complete. 2023-11-24T08:06:42.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:42.666 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":58.715421986000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.209677905207908,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:42.667 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.209677905207908 }, "state": "open", "uptime": 58.715421986 } ] 2023-11-24T08:06:42.667 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:47.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:47.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.815+0000 7f8027b72640 1 Processor -- start 2023-11-24T08:06:47.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.815+0000 7f8027b72640 1 -- start start 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f8027b72640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 0x7f802016c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f8027b72640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802006dc20 con 0x7f802006e340 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f8027b72640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802006cd60 con 0x7f8020158a50 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f8027b72640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802006e0b0 con 0x7f8020070ec0 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802510d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f802006e340 0x7f80200707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:35908/0 (socket says 172.21.15.57:35908) 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802510d640 1 -- 172.21.15.57:0/2470112244 learned_addr learned my addr 172.21.15.57:0/2470112244 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802610f640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 0x7f802016c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921908600 0 0) 0x7f802006dc20 con 0x7f802006e340 2023-11-24T08:06:47.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c003530 con 0x7f802006e340 2023-11-24T08:06:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124098703 0 0) 0x7f802006cd60 con 0x7f8020158a50 2023-11-24T08:06:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802006dc20 con 0x7f8020158a50 2023-11-24T08:06:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3663404587 0 0) 0x7f800c003530 con 0x7f802006e340 2023-11-24T08:06:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 msgr2=0x7f802016c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 0x7f802016c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 >> v1:172.21.15.132:6789/0 conn(0x7f8020158a50 legacy=0x7f802006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200b3620 con 0x7f802006e340 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f8010001680 con 0x7f802006e340 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 >> v1:172.21.15.57:6789/0 conn(0x7f802006e340 legacy=0x7f80200707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f800c003b40 0x7f800c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f800c0047d0 0x7f800c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 0x7f800c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c00ba40 con 0x7f800c003b40 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c00bb80 con 0x7f800c0047d0 2023-11-24T08:06:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c00bd10 con 0x7f8020070ec0 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802590e640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f800c003b40 0x7f800c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802510d640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f800c0047d0 0x7f800c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802610f640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 0x7f800c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802590e640 1 -- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 msgr2=0x7f800c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802590e640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8020070ec0 0x7f800c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802590e640 1 -- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f800c0047d0 msgr2=0x7f800c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802590e640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f800c0047d0 0x7f800c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.819+0000 7f802590e640 1 -- 172.21.15.57:0/2470112244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c003530 con 0x7f800c003b40 2023-11-24T08:06:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f802590e640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f800c003b40 0x7f800c003f40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f801c0018d0 tx=0x7f801c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643ae0ef1a2456a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0052d0 con 0x7f800c003b40 2023-11-24T08:06:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c005450 con 0x7f800c003b40 2023-11-24T08:06:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f802490c640 1 -- 172.21.15.57:0/2470112244 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c003840 con 0x7f800c003b40 2023-11-24T08:06:47.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 -- 172.21.15.57:0/2470112244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f800c003b40 msgr2=0x7f800c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 --2- 172.21.15.57:0/2470112244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f800c003b40 0x7f800c003f40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f801c0018d0 tx=0x7f801c01c4d0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f802610f640 1 -- 172.21.15.57:0/2470112244 reap_dead start 2023-11-24T08:06:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 -- 172.21.15.57:0/2470112244 shutdown_connections 2023-11-24T08:06:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 -- 172.21.15.57:0/2470112244 >> 172.21.15.57:0/2470112244 conn(0x7f80200b0bf0 msgr2=0x7f80200b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 -- 172.21.15.57:0/2470112244 shutdown_connections 2023-11-24T08:06:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 -- 172.21.15.57:0/2470112244 wait complete. 2023-11-24T08:06:47.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 Processor -- start 2023-11-24T08:06:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.823+0000 7f8027b72640 1 -- start start 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f800c003b40 0x7f8020151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8020152250 0x7f8020153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8020151c70 0x7f80201536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80200ac340 con 0x7f8020151c70 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802015f7e0 con 0x7f8020152250 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802015fac0 con 0x7f800c003b40 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8020151c70 0x7f80201536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8020151c70 0x7f80201536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60172/0 (socket says 172.21.15.57:60172) 2023-11-24T08:06:47.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 -- 172.21.15.57:0/1398949661 learned_addr learned my addr 172.21.15.57:0/1398949661 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802590e640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f800c003b40 0x7f8020151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802510d640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8020152250 0x7f8020153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 -- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f800c003b40 msgr2=0x7f8020151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f800c003b40 0x7f8020151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 -- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8020152250 msgr2=0x7f8020153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8020152250 0x7f8020153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 -- 172.21.15.57:0/1398949661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802015fda0 con 0x7f8020151c70 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f802610f640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8020151c70 0x7f80201536d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8020071820 tx=0x7f801800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f80167fc640 1 -- 172.21.15.57:0/1398949661 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800e040 con 0x7f8020151c70 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f80167fc640 1 -- 172.21.15.57:0/1398949661 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800f040 con 0x7f8020151c70 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f80167fc640 1 -- 172.21.15.57:0/1398949661 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018015670 con 0x7f8020151c70 2023-11-24T08:06:47.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8020160080 con 0x7f8020151c70 2023-11-24T08:06:47.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80200ac0a0 con 0x7f8020151c70 2023-11-24T08:06:47.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.827+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8020067520 con 0x7f8020151c70 2023-11-24T08:06:47.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.831+0000 7f80167fc640 1 -- 172.21.15.57:0/1398949661 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f80180157d0 con 0x7f8020151c70 2023-11-24T08:06:47.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.831+0000 7f80167fc640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f80040666b0 0x7f8004068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:47.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.831+0000 7f80167fc640 1 -- 172.21.15.57:0/1398949661 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8018084cb0 con 0x7f8020151c70 2023-11-24T08:06:47.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.831+0000 7f802590e640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f80040666b0 0x7f8004068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:47.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.831+0000 7f802590e640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f80040666b0 0x7f8004068b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f801c0ad000 tx=0x7f801c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:47.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:47.835+0000 7f80167fc640 1 -- 172.21.15.57:0/1398949661 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8018051be0 con 0x7f8020151c70 2023-11-24T08:06:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.023+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8020156d20 con 0x7f8020151c70 2023-11-24T08:06:48.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.023+0000 7f80167fc640 1 -- 172.21.15.57:0/1398949661 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f8018055200 con 0x7f8020151c70 2023-11-24T08:06:48.029 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:48.029 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:48.029 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f80040666b0 msgr2=0x7f8004068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f80040666b0 0x7f8004068b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f801c0ad000 tx=0x7f801c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8020151c70 msgr2=0x7f80201536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8020151c70 0x7f80201536d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8020071820 tx=0x7f801800f580 comp rx=0 tx=0).stop 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 shutdown_connections 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f80040666b0 0x7f8004068b70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8020151c70 0x7f80201536d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8020152250 0x7f8020153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 --2- 172.21.15.57:0/1398949661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f800c003b40 0x7f8020151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:48.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 >> 172.21.15.57:0/1398949661 conn(0x7f80200b0bf0 msgr2=0x7f80200aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:48.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 shutdown_connections 2023-11-24T08:06:48.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:48.027+0000 7f8027b72640 1 -- 172.21.15.57:0/1398949661 wait complete. 2023-11-24T08:06:48.050 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:48.217 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":64.267367899000007,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.964835301209266,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:48.218 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.964835301209266 }, "state": "open", "uptime": 64.267367899 } ] 2023-11-24T08:06:48.218 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:49.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:49.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:53.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165f32e640 1 Processor -- start 2023-11-24T08:06:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165f32e640 1 -- start start 2023-11-24T08:06:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165f32e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f165815d570 0x7f165806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165f32e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16580d3020 0x7f16580d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165f32e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16580d39f0 con 0x7f16580ce8b0 2023-11-24T08:06:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165f32e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580d1cc0 con 0x7f16580d3020 2023-11-24T08:06:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165f32e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580d1fa0 con 0x7f165815d570 2023-11-24T08:06:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165c8c9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16580d3020 0x7f16580d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165c8c9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f16580d3020 0x7f16580d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60178/0 (socket says 172.21.15.57:60178) 2023-11-24T08:06:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165c8c9640 1 -- 172.21.15.57:0/1235656926 learned_addr learned my addr 172.21.15.57:0/1235656926 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165d0ca640 1 --2- 172.21.15.57:0/1235656926 >> v2:172.21.15.132:3300/0 conn(0x7f165815d570 0x7f165806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165c8c9640 1 -- 172.21.15.57:0/1235656926 >> v2:172.21.15.132:3300/0 conn(0x7f165815d570 msgr2=0x7f165806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:06:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165c8c9640 1 --2- 172.21.15.57:0/1235656926 >> v2:172.21.15.132:3300/0 conn(0x7f165815d570 0x7f165806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165c8c9640 1 -- 172.21.15.57:0/1235656926 >> v1:172.21.15.132:6789/0 conn(0x7f16580ce8b0 legacy=0x7f16580ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.371+0000 7f165c8c9640 1 -- 172.21.15.57:0/1235656926 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16580ce0b0 con 0x7f16580d3020 2023-11-24T08:06:53.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165c8c9640 1 --2- 172.21.15.57:0/1235656926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580d3020 0x7f16580d34b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f16580d0eb0 tx=0x7f164801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edd6253554fda02 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f164ffff640 1 -- 172.21.15.57:0/1235656926 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480aa650 con 0x7f16580d3020 2023-11-24T08:06:53.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f164ffff640 1 -- 172.21.15.57:0/1235656926 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480aa7b0 con 0x7f16580d3020 2023-11-24T08:06:53.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f164ffff640 1 -- 172.21.15.57:0/1235656926 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480aab40 con 0x7f16580d3020 2023-11-24T08:06:53.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 -- 172.21.15.57:0/1235656926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580d3020 msgr2=0x7f16580d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 --2- 172.21.15.57:0/1235656926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580d3020 0x7f16580d34b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f16580d0eb0 tx=0x7f164801c4d0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 -- 172.21.15.57:0/1235656926 shutdown_connections 2023-11-24T08:06:53.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 --2- 172.21.15.57:0/1235656926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580d3020 0x7f16580d34b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 --2- 172.21.15.57:0/1235656926 >> v2:172.21.15.132:3300/0 conn(0x7f165815d570 0x7f165806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 -- 172.21.15.57:0/1235656926 >> 172.21.15.57:0/1235656926 conn(0x7f165808ceb0 msgr2=0x7f165809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 -- 172.21.15.57:0/1235656926 shutdown_connections 2023-11-24T08:06:53.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.375+0000 7f165f32e640 1 -- 172.21.15.57:0/1235656926 wait complete. 2023-11-24T08:06:53.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 Processor -- start 2023-11-24T08:06:53.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 -- start start 2023-11-24T08:06:53.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580ce8b0 0x7f16580cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16580d3020 0x7f1658160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f165815d570 0x7f1658154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1658155c30 con 0x7f16580ce8b0 2023-11-24T08:06:53.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580ccac0 con 0x7f16580d3020 2023-11-24T08:06:53.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1658160bc0 con 0x7f165815d570 2023-11-24T08:06:53.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580ce8b0 0x7f16580cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580ce8b0 0x7f16580cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60188/0 (socket says 172.21.15.57:60188) 2023-11-24T08:06:53.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 -- 172.21.15.57:0/770247630 learned_addr learned my addr 172.21.15.57:0/770247630 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:53.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165c8c9640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16580d3020 0x7f1658160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d8cb640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f165815d570 0x7f1658154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 -- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f165815d570 msgr2=0x7f1658154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f165815d570 0x7f1658154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 -- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16580d3020 msgr2=0x7f1658160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16580d3020 0x7f1658160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 -- 172.21.15.57:0/770247630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480094d0 con 0x7f16580ce8b0 2023-11-24T08:06:53.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165c8c9640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16580d3020 0x7f1658160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165d0ca640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580ce8b0 0x7f16580cc200 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f165400e8a0 tx=0x7f165400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f164dffb640 1 -- 172.21.15.57:0/770247630 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654009510 con 0x7f16580ce8b0 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f164dffb640 1 -- 172.21.15.57:0/770247630 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165400c940 con 0x7f16580ce8b0 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16580cc7e0 con 0x7f16580ce8b0 2023-11-24T08:06:53.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f164dffb640 1 -- 172.21.15.57:0/770247630 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165400ccb0 con 0x7f16580ce8b0 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.379+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165815df70 con 0x7f16580ce8b0 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.383+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1658067520 con 0x7f16580ce8b0 2023-11-24T08:06:53.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.383+0000 7f164dffb640 1 -- 172.21.15.57:0/770247630 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f1654013470 con 0x7f16580ce8b0 2023-11-24T08:06:53.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.383+0000 7f164dffb640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f163c0666b0 0x7f163c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:53.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.383+0000 7f164dffb640 1 -- 172.21.15.57:0/770247630 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1654084320 con 0x7f16580ce8b0 2023-11-24T08:06:53.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.383+0000 7f165c8c9640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f163c0666b0 0x7f163c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:53.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.383+0000 7f165c8c9640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f163c0666b0 0x7f163c068b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f16480ae000 tx=0x7f16480b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:53.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.387+0000 7f164dffb640 1 -- 172.21.15.57:0/770247630 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16540514a0 con 0x7f16580ce8b0 2023-11-24T08:06:53.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.575+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f165806b7b0 con 0x7f16580ce8b0 2023-11-24T08:06:53.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.575+0000 7f164dffb640 1 -- 172.21.15.57:0/770247630 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f1654054ac0 con 0x7f16580ce8b0 2023-11-24T08:06:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:53.582 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:53.582 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f163c0666b0 msgr2=0x7f163c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f163c0666b0 0x7f163c068b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f16480ae000 tx=0x7f16480b5040 comp rx=0 tx=0).stop 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580ce8b0 msgr2=0x7f16580cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580ce8b0 0x7f16580cc200 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f165400e8a0 tx=0x7f165400eca0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 shutdown_connections 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f163c0666b0 0x7f163c068b70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f165815d570 0x7f1658154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16580d3020 0x7f1658160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 --2- 172.21.15.57:0/770247630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16580ce8b0 0x7f16580cc200 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 >> 172.21.15.57:0/770247630 conn(0x7f165808ceb0 msgr2=0x7f16580b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 shutdown_connections 2023-11-24T08:06:53.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:53.579+0000 7f165f32e640 1 -- 172.21.15.57:0/770247630 wait complete. 2023-11-24T08:06:53.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:53.769 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":69.823313841000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.722940371922689,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:53.769 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.72294037192269 }, "state": "open", "uptime": 69.823313841 } ] 2023-11-24T08:06:53.769 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:06:58.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:06:58.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.919+0000 7ff5073c1640 1 Processor -- start 2023-11-24T08:06:58.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff5073c1640 1 -- start start 2023-11-24T08:06:58.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff5073c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff50015a320 0x7ff5000b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff5073c1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50015a700 con 0x7ff5000b36c0 2023-11-24T08:06:58.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff5073c1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000b2620 con 0x7ff500070da0 2023-11-24T08:06:58.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff5073c1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5000b2430 con 0x7ff50015a320 2023-11-24T08:06:58.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff50515d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff50015a320 0x7ff5000b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff50495c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff5000b36c0 0x7ff500070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34282/0 (socket says 172.21.15.57:34282) 2023-11-24T08:06:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff50495c640 1 -- 172.21.15.57:0/2921887317 learned_addr learned my addr 172.21.15.57:0/2921887317 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:06:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff50515d640 1 -- 172.21.15.57:0/2921887317 >> v1:172.21.15.132:6789/0 conn(0x7ff500070da0 legacy=0x7ff50015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff50515d640 1 -- 172.21.15.57:0/2921887317 >> v1:172.21.15.57:6789/0 conn(0x7ff5000b36c0 legacy=0x7ff500070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff50515d640 1 -- 172.21.15.57:0/2921887317 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000b2900 con 0x7ff50015a320 2023-11-24T08:06:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.923+0000 7ff4f7fff640 1 -- 172.21.15.57:0/2921887317 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787301653 0 0) 0x7ff50015a700 con 0x7ff5000b36c0 2023-11-24T08:06:58.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff50515d640 1 --2- 172.21.15.57:0/2921887317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff5000b1ef0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0097c0 tx=0x7ff4fc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b502ac9ab11bfcab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff4f7fff640 1 -- 172.21.15.57:0/2921887317 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0ad660 con 0x7ff50015a320 2023-11-24T08:06:58.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff4f7fff640 1 -- 172.21.15.57:0/2921887317 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0ad7c0 con 0x7ff50015a320 2023-11-24T08:06:58.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff4f7fff640 1 -- 172.21.15.57:0/2921887317 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0adb50 con 0x7ff50015a320 2023-11-24T08:06:58.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 -- 172.21.15.57:0/2921887317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 msgr2=0x7ff5000b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2921887317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff5000b1ef0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0097c0 tx=0x7ff4fc01c450 comp rx=0 tx=0).stop 2023-11-24T08:06:58.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 -- 172.21.15.57:0/2921887317 shutdown_connections 2023-11-24T08:06:58.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2921887317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff5000b1ef0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 -- 172.21.15.57:0/2921887317 >> 172.21.15.57:0/2921887317 conn(0x7ff5000b0bf0 msgr2=0x7ff5000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:58.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 -- 172.21.15.57:0/2921887317 shutdown_connections 2023-11-24T08:06:58.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 -- 172.21.15.57:0/2921887317 wait complete. 2023-11-24T08:06:58.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 Processor -- start 2023-11-24T08:06:58.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.927+0000 7ff5073c1640 1 -- start start 2023-11-24T08:06:58.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff500070da0 0x7ff500145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5000b36c0 0x7ff50015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff500160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001602a0 con 0x7ff50015a320 2023-11-24T08:06:58.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff500161230 con 0x7ff5000b36c0 2023-11-24T08:06:58.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff500165cf0 con 0x7ff500070da0 2023-11-24T08:06:58.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff500160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff500160cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37018/0 (socket says 172.21.15.57:37018) 2023-11-24T08:06:58.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 -- 172.21.15.57:0/2245697223 learned_addr learned my addr 172.21.15.57:0/2245697223 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:06:58.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50515d640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff500070da0 0x7ff500145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50495c640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5000b36c0 0x7ff50015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 -- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff500070da0 msgr2=0x7ff500145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff500070da0 0x7ff500145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 -- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5000b36c0 msgr2=0x7ff50015fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:58.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5000b36c0 0x7ff50015fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:58.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 -- 172.21.15.57:0/2245697223 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc009420 con 0x7ff50015a320 2023-11-24T08:06:58.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50495c640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5000b36c0 0x7ff50015fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:06:58.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff50595e640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff500160cf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c770 tx=0x7ff4f800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff4f5ffb640 1 -- 172.21.15.57:0/2245697223 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8003b80 con 0x7ff50015a320 2023-11-24T08:06:58.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff4f5ffb640 1 -- 172.21.15.57:0/2245697223 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8003ce0 con 0x7ff50015a320 2023-11-24T08:06:58.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff4f5ffb640 1 -- 172.21.15.57:0/2245697223 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800aa90 con 0x7ff50015a320 2023-11-24T08:06:58.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50015efa0 con 0x7ff50015a320 2023-11-24T08:06:58.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50015f560 con 0x7ff50015a320 2023-11-24T08:06:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.931+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500067520 con 0x7ff50015a320 2023-11-24T08:06:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.935+0000 7ff4f5ffb640 1 -- 172.21.15.57:0/2245697223 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7ff4f800abf0 con 0x7ff50015a320 2023-11-24T08:06:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.935+0000 7ff4f5ffb640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff4e40666b0 0x7ff4e4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:06:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.935+0000 7ff4f5ffb640 1 -- 172.21.15.57:0/2245697223 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff4f8084110 con 0x7ff50015a320 2023-11-24T08:06:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.935+0000 7ff50515d640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff4e40666b0 0x7ff4e4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:06:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.935+0000 7ff50515d640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff4e40666b0 0x7ff4e4068b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0af000 tx=0x7ff4fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:06:58.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:58.939+0000 7ff4f5ffb640 1 -- 172.21.15.57:0/2245697223 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4f8051160 con 0x7ff50015a320 2023-11-24T08:06:59.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.127+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff50009bf30 con 0x7ff50015a320 2023-11-24T08:06:59.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.127+0000 7ff4f5ffb640 1 -- 172.21.15.57:0/2245697223 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7ff4f8054780 con 0x7ff50015a320 2023-11-24T08:06:59.134 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:06:59.134 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:06:59.134 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:06:59.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff4e40666b0 msgr2=0x7ff4e4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff4e40666b0 0x7ff4e4068b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0af000 tx=0x7ff4fc008040 comp rx=0 tx=0).stop 2023-11-24T08:06:59.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 msgr2=0x7ff500160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:06:59.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff500160cf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c770 tx=0x7ff4f800cc30 comp rx=0 tx=0).stop 2023-11-24T08:06:59.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 shutdown_connections 2023-11-24T08:06:59.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff4e40666b0 0x7ff4e4068b70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50015a320 0x7ff500160cf0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5000b36c0 0x7ff50015fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 --2- 172.21.15.57:0/2245697223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff500070da0 0x7ff500145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 >> 172.21.15.57:0/2245697223 conn(0x7ff5000b0bf0 msgr2=0x7ff5000716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 shutdown_connections 2023-11-24T08:06:59.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:06:59.131+0000 7ff5073c1640 1 -- 172.21.15.57:0/2245697223 wait complete. 2023-11-24T08:06:59.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:06:59.323 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":75.379259877999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.484130788695861,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:06:59.324 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.48413078869586 }, "state": "open", "uptime": 75.379259878 } ] 2023-11-24T08:06:59.324 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:07:04.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:04.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febee901640 1 Processor -- start 2023-11-24T08:07:04.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febee901640 1 -- start start 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febee901640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febe8144030 0x7febe806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febee901640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7febe80709c0 0x7febe8070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febee901640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe806d8b0 con 0x7febe809cc20 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febee901640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe8145020 con 0x7febe8144030 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febee901640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe809d0a0 con 0x7febe80709c0 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febe7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febe8144030 0x7febe806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febe7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febe8144030 0x7febe806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37026/0 (socket says 172.21.15.57:37026) 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.475+0000 7febe7fff640 1 -- 172.21.15.57:0/432566910 learned_addr learned my addr 172.21.15.57:0/432566910 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:04.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febece9e640 1 --2- 172.21.15.57:0/432566910 >> v2:172.21.15.132:3300/0 conn(0x7febe80709c0 0x7febe8070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe7fff640 1 -- 172.21.15.57:0/432566910 >> v2:172.21.15.132:3300/0 conn(0x7febe80709c0 msgr2=0x7febe8070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:04.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe7fff640 1 --2- 172.21.15.57:0/432566910 >> v2:172.21.15.132:3300/0 conn(0x7febe80709c0 0x7febe8070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe7fff640 1 -- 172.21.15.57:0/432566910 >> v1:172.21.15.132:6789/0 conn(0x7febe809cc20 legacy=0x7febe806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:04.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe7fff640 1 -- 172.21.15.57:0/432566910 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8071370 con 0x7febe8144030 2023-11-24T08:07:04.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febece9e640 1 --2- 172.21.15.57:0/432566910 >> v2:172.21.15.132:3300/0 conn(0x7febe80709c0 0x7febe8070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:04.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe7fff640 1 --2- 172.21.15.57:0/432566910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe806c650 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7febe8145220 tx=0x7febd801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c546d14a43a0841 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe6ffd640 1 -- 172.21.15.57:0/432566910 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80aa5f0 con 0x7febe8144030 2023-11-24T08:07:04.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe6ffd640 1 -- 172.21.15.57:0/432566910 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd80aa750 con 0x7febe8144030 2023-11-24T08:07:04.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.479+0000 7febe6ffd640 1 -- 172.21.15.57:0/432566910 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80aaae0 con 0x7febe8144030 2023-11-24T08:07:04.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- 172.21.15.57:0/432566910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 msgr2=0x7febe806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 --2- 172.21.15.57:0/432566910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe806c650 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7febe8145220 tx=0x7febd801c490 comp rx=0 tx=0).stop 2023-11-24T08:07:04.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- 172.21.15.57:0/432566910 shutdown_connections 2023-11-24T08:07:04.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 --2- 172.21.15.57:0/432566910 >> v2:172.21.15.132:3300/0 conn(0x7febe80709c0 0x7febe8070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 --2- 172.21.15.57:0/432566910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe806c650 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- 172.21.15.57:0/432566910 >> 172.21.15.57:0/432566910 conn(0x7febe80b0bf0 msgr2=0x7febe80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:04.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- 172.21.15.57:0/432566910 shutdown_connections 2023-11-24T08:07:04.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- 172.21.15.57:0/432566910 wait complete. 2023-11-24T08:07:04.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 Processor -- start 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- start start 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe80709c0 0x7febe81451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7febe809cc20 0x7febe8145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe8099f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8146ff0 con 0x7febe8144030 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8145f50 con 0x7febe80709c0 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febee901640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8146230 con 0x7febe809cc20 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febece9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe8099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febece9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe8099f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37034/0 (socket says 172.21.15.57:37034) 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febece9e640 1 -- 172.21.15.57:0/2370502404 learned_addr learned my addr 172.21.15.57:0/2370502404 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:04.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febe7fff640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe80709c0 0x7febe81451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febe77fe640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7febe809cc20 0x7febe8145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febece9e640 1 -- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7febe809cc20 msgr2=0x7febe8145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febece9e640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7febe809cc20 0x7febe8145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febece9e640 1 -- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe80709c0 msgr2=0x7febe81451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.483+0000 7febece9e640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe80709c0 0x7febe81451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febece9e640 1 -- 172.21.15.57:0/2370502404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80094d0 con 0x7febe8144030 2023-11-24T08:07:04.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febece9e640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe8099f00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7febe000cd50 tx=0x7febe000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febe4ff9640 1 -- 172.21.15.57:0/2370502404 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000f680 con 0x7febe8144030 2023-11-24T08:07:04.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febe4ff9640 1 -- 172.21.15.57:0/2370502404 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000f800 con 0x7febe8144030 2023-11-24T08:07:04.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febe4ff9640 1 -- 172.21.15.57:0/2370502404 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000fbb0 con 0x7febe8144030 2023-11-24T08:07:04.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe8146510 con 0x7febe8144030 2023-11-24T08:07:04.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe8146ad0 con 0x7febe8144030 2023-11-24T08:07:04.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe8146cf0 con 0x7febe8144030 2023-11-24T08:07:04.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febe4ff9640 1 -- 172.21.15.57:0/2370502404 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7febe000b040 con 0x7febe8144030 2023-11-24T08:07:04.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febe4ff9640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7febd40666b0 0x7febd4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:04.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.487+0000 7febe4ff9640 1 -- 172.21.15.57:0/2370502404 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7febe0084c30 con 0x7febe8144030 2023-11-24T08:07:04.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.491+0000 7febe7fff640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7febd40666b0 0x7febd4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:04.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.491+0000 7febe7fff640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7febd40666b0 0x7febd4068b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7febd80ae000 tx=0x7febd80b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:04.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.491+0000 7febe4ff9640 1 -- 172.21.15.57:0/2370502404 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7febe0051cb0 con 0x7febe8144030 2023-11-24T08:07:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.679+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febe8067520 con 0x7febe8144030 2023-11-24T08:07:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febe4ff9640 1 -- 172.21.15.57:0/2370502404 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7febe001d020 con 0x7febe8144030 2023-11-24T08:07:04.687 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:04.687 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:04.687 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:07:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7febd40666b0 msgr2=0x7febd4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7febd40666b0 0x7febd4068b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7febd80ae000 tx=0x7febd80b5040 comp rx=0 tx=0).stop 2023-11-24T08:07:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 msgr2=0x7febe8099f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe8099f00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7febe000cd50 tx=0x7febe000a650 comp rx=0 tx=0).stop 2023-11-24T08:07:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 shutdown_connections 2023-11-24T08:07:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7febd40666b0 0x7febd4068b70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febe8144030 0x7febe8099f00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7febe809cc20 0x7febe8145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 --2- 172.21.15.57:0/2370502404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe80709c0 0x7febe81451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 >> 172.21.15.57:0/2370502404 conn(0x7febe80b0bf0 msgr2=0x7febe80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 shutdown_connections 2023-11-24T08:07:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:04.683+0000 7febee901640 1 -- 172.21.15.57:0/2370502404 wait complete. 2023-11-24T08:07:04.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:07:04.877 INFO:teuthology.orchestra.run.smithi132.stdout:[{"id":55199,"entity":{"name":{"type":"client","num":55199},"addr":{"type":"any","addr":"172.21.15.132:0","nonce":1564054474}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":5,"uptime":80.931206041999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.248535848448398,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.55199 172.21.15.132:0/1564054474","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi132","pid":"38120","root":"/"}}] 2023-11-24T08:07:04.878 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi132", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "38120", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.132:0", "nonce": 1564054474, "type": "any" }, "name": { "num": 55199, "type": "client" } }, "id": 55199, "inst": "client.55199 172.21.15.132:0/1564054474", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.248535848448398 }, "state": "open", "uptime": 80.931206042 } ] 2023-11-24T08:07:04.878 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:07:09.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:10.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 Processor -- start 2023-11-24T08:07:10.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 -- start start 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ed415d570 0x7f3ed406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ed40d3020 0x7f3ed40d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed40ce8b0 0x7f3ed40ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed40d39f0 con 0x7f3ed415d570 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed40d1cc0 con 0x7f3ed40d3020 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed9372640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed40d1fa0 con 0x7f3ed40ce8b0 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ed415d570 0x7f3ed406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ed415d570 0x7f3ed406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55844/0 (socket says 172.21.15.57:55844) 2023-11-24T08:07:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 -- 172.21.15.57:0/2003236979 learned_addr learned my addr 172.21.15.57:0/2003236979 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:10.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ecbfff640 1 --2- 172.21.15.57:0/2003236979 >> v2:172.21.15.132:3300/0 conn(0x7f3ed40d3020 0x7f3ed40d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed37fe640 1 --2- 172.21.15.57:0/2003236979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed40ce8b0 0x7f3ed40ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 -- 172.21.15.57:0/2003236979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed40ce8b0 msgr2=0x7f3ed40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:10.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 --2- 172.21.15.57:0/2003236979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed40ce8b0 0x7f3ed40ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 -- 172.21.15.57:0/2003236979 >> v2:172.21.15.132:3300/0 conn(0x7f3ed40d3020 msgr2=0x7f3ed40d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:10.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 --2- 172.21.15.57:0/2003236979 >> v2:172.21.15.132:3300/0 conn(0x7f3ed40d3020 0x7f3ed40d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.031+0000 7f3ed2ffd640 1 -- 172.21.15.57:0/2003236979 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40ce0b0 con 0x7f3ed415d570 2023-11-24T08:07:10.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.035+0000 7f3ed2ffd640 1 --2- 172.21.15.57:0/2003236979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed415d570 0x7f3ed406b9d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40b5f00 tx=0x7f3ec401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c96d67a9363117 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:10.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.035+0000 7f3ed27fc640 1 -- 172.21.15.57:0/2003236979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40aa610 con 0x7f3ed415d570 2023-11-24T08:07:10.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.035+0000 7f3ed27fc640 1 -- 172.21.15.57:0/2003236979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec40a6040 con 0x7f3ed415d570 2023-11-24T08:07:10.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.035+0000 7f3ed27fc640 1 -- 172.21.15.57:0/2003236979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40aa990 con 0x7f3ed415d570 2023-11-24T08:07:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.035+0000 7f3ed9372640 1 -- 172.21.15.57:0/2003236979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed415d570 msgr2=0x7f3ed406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.035+0000 7f3ed9372640 1 --2- 172.21.15.57:0/2003236979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed415d570 0x7f3ed406b9d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40b5f00 tx=0x7f3ec401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- 172.21.15.57:0/2003236979 shutdown_connections 2023-11-24T08:07:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 --2- 172.21.15.57:0/2003236979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed40ce8b0 0x7f3ed40ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 --2- 172.21.15.57:0/2003236979 >> v2:172.21.15.132:3300/0 conn(0x7f3ed40d3020 0x7f3ed40d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 --2- 172.21.15.57:0/2003236979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed415d570 0x7f3ed406b9d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- 172.21.15.57:0/2003236979 >> 172.21.15.57:0/2003236979 conn(0x7f3ed408ceb0 msgr2=0x7f3ed409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:10.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- 172.21.15.57:0/2003236979 shutdown_connections 2023-11-24T08:07:10.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- 172.21.15.57:0/2003236979 wait complete. 2023-11-24T08:07:10.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 Processor -- start 2023-11-24T08:07:10.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- start start 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ed40ce8b0 0x7f3ed415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed40d3020 0x7f3ed415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed415d570 0x7f3ed415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed4150e90 con 0x7f3ed40d3020 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed414f400 con 0x7f3ed40ce8b0 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed9372640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed415baf0 con 0x7f3ed415d570 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed40d3020 0x7f3ed415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed40d3020 0x7f3ed415bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55852/0 (socket says 172.21.15.57:55852) 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 -- 172.21.15.57:0/1323322765 learned_addr learned my addr 172.21.15.57:0/1323322765 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed2ffd640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ed40ce8b0 0x7f3ed415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed37fe640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed415d570 0x7f3ed415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 -- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed415d570 msgr2=0x7f3ed415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed415d570 0x7f3ed415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 -- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ed40ce8b0 msgr2=0x7f3ed415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ed40ce8b0 0x7f3ed415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ecbfff640 1 -- 172.21.15.57:0/1323322765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40094d0 con 0x7f3ed40d3020 2023-11-24T08:07:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.039+0000 7f3ed2ffd640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ed40ce8b0 0x7f3ed415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:10.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ecbfff640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed40d3020 0x7f3ed415bf40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00e930 tx=0x7f3ebc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:10.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ecb7fe640 1 -- 172.21.15.57:0/1323322765 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc009690 con 0x7f3ed40d3020 2023-11-24T08:07:10.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ecb7fe640 1 -- 172.21.15.57:0/1323322765 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00ca00 con 0x7f3ed40d3020 2023-11-24T08:07:10.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed4150460 con 0x7f3ed40d3020 2023-11-24T08:07:10.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ecb7fe640 1 -- 172.21.15.57:0/1323322765 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00cd70 con 0x7f3ed40d3020 2023-11-24T08:07:10.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed40b1030 con 0x7f3ed40d3020 2023-11-24T08:07:10.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed4067520 con 0x7f3ed40d3020 2023-11-24T08:07:10.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ecb7fe640 1 -- 172.21.15.57:0/1323322765 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f3ebc013470 con 0x7f3ed40d3020 2023-11-24T08:07:10.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ecb7fe640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3eb40666b0 0x7f3eb4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.043+0000 7f3ecb7fe640 1 -- 172.21.15.57:0/1323322765 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3ebc084640 con 0x7f3ed40d3020 2023-11-24T08:07:10.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.047+0000 7f3ed2ffd640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3eb40666b0 0x7f3eb4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.047+0000 7f3ed2ffd640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3eb40666b0 0x7f3eb4068b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40ae000 tx=0x7f3ec40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:10.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.051+0000 7f3ecb7fe640 1 -- 172.21.15.57:0/1323322765 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ebc051740 con 0x7f3ed40d3020 2023-11-24T08:07:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.239+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ed40b00d0 con 0x7f3ed40d3020 2023-11-24T08:07:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.239+0000 7f3ecb7fe640 1 -- 172.21.15.57:0/1323322765 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f3ebc054d60 con 0x7f3ed40d3020 2023-11-24T08:07:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:10.244 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.239+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3eb40666b0 msgr2=0x7f3eb4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.239+0000 7f3ed9372640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3eb40666b0 0x7f3eb4068b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40ae000 tx=0x7f3ec40a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.239+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed40d3020 msgr2=0x7f3ed415bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.239+0000 7f3ed9372640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed40d3020 0x7f3ed415bf40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00e930 tx=0x7f3ebc00edf0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 shutdown_connections 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3eb40666b0 0x7f3eb4068b70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ed415d570 0x7f3ed415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ed40d3020 0x7f3ed415bf40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 --2- 172.21.15.57:0/1323322765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ed40ce8b0 0x7f3ed415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 >> 172.21.15.57:0/1323322765 conn(0x7f3ed408ceb0 msgr2=0x7f3ed40d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 shutdown_connections 2023-11-24T08:07:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.243+0000 7f3ed9372640 1 -- 172.21.15.57:0/1323322765 wait complete. 2023-11-24T08:07:10.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2023-11-24T08:07:10.431 INFO:teuthology.orchestra.run.smithi132.stdout:[] 2023-11-24T08:07:10.432 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T08:07:10.432 DEBUG:tasks.ceph_test_case:wait_until_true: success in 75s and 0 retries 2023-11-24T08:07:10.432 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:07:10.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:10.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:10.578 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:07:10.579 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:10.579 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:10.588 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:07:10.589 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:10.589 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:10.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:07:10.597 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:10.597 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:10.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:07:10.638 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:10.638 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:10.647 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:07:10.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:10.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.823+0000 7f57c731d640 1 Processor -- start 2023-11-24T08:07:10.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.823+0000 7f57c731d640 1 -- start start 2023-11-24T08:07:10.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c731d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57c0070ec0 0x7f57c016c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c731d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c006dc20 con 0x7f57c0158a50 2023-11-24T08:07:10.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c731d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c006cd60 con 0x7f57c006e340 2023-11-24T08:07:10.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c731d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c006e0b0 con 0x7f57c0070ec0 2023-11-24T08:07:10.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c58ba640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57c0070ec0 0x7f57c016c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c50b9640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f57c0158a50 0x7f57c006c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49230/0 (socket says 172.21.15.57:49230) 2023-11-24T08:07:10.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c50b9640 1 -- 172.21.15.57:0/4023721651 learned_addr learned my addr 172.21.15.57:0/4023721651 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:10.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c58ba640 1 -- 172.21.15.57:0/4023721651 >> v1:172.21.15.132:6789/0 conn(0x7f57c006e340 legacy=0x7f57c00707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c58ba640 1 -- 172.21.15.57:0/4023721651 >> v1:172.21.15.57:6789/0 conn(0x7f57c0158a50 legacy=0x7f57c006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.827+0000 7f57c58ba640 1 -- 172.21.15.57:0/4023721651 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00b3620 con 0x7f57c0070ec0 2023-11-24T08:07:10.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c58ba640 1 --2- 172.21.15.57:0/4023721651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c0070ec0 0x7f57c016c6a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009d90 tx=0x7f57b801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e41f863c16bcb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:10.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57b7fff640 1 -- 172.21.15.57:0/4023721651 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80a59e0 con 0x7f57c0070ec0 2023-11-24T08:07:10.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57b7fff640 1 -- 172.21.15.57:0/4023721651 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b80a5b40 con 0x7f57c0070ec0 2023-11-24T08:07:10.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57b7fff640 1 -- 172.21.15.57:0/4023721651 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80ad440 con 0x7f57c0070ec0 2023-11-24T08:07:10.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 -- 172.21.15.57:0/4023721651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c0070ec0 msgr2=0x7f57c016c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 --2- 172.21.15.57:0/4023721651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c0070ec0 0x7f57c016c6a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009d90 tx=0x7f57b801c920 comp rx=0 tx=0).stop 2023-11-24T08:07:10.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 -- 172.21.15.57:0/4023721651 shutdown_connections 2023-11-24T08:07:10.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 --2- 172.21.15.57:0/4023721651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c0070ec0 0x7f57c016c6a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 -- 172.21.15.57:0/4023721651 >> 172.21.15.57:0/4023721651 conn(0x7f57c00b0bf0 msgr2=0x7f57c00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:10.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 -- 172.21.15.57:0/4023721651 shutdown_connections 2023-11-24T08:07:10.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 -- 172.21.15.57:0/4023721651 wait complete. 2023-11-24T08:07:10.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 Processor -- start 2023-11-24T08:07:10.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.831+0000 7f57c731d640 1 -- start start 2023-11-24T08:07:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c006e340 0x7f57c00cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f57c0070ec0 0x7f57c014e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c0158a50 0x7f57c014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0151500 con 0x7f57c006e340 2023-11-24T08:07:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00ad670 con 0x7f57c0158a50 2023-11-24T08:07:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00ad950 con 0x7f57c0070ec0 2023-11-24T08:07:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c006e340 0x7f57c00cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c006e340 0x7f57c00cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55874/0 (socket says 172.21.15.57:55874) 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 -- 172.21.15.57:0/2983782166 learned_addr learned my addr 172.21.15.57:0/2983782166 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c48b8640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f57c0070ec0 0x7f57c014e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c58ba640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c0158a50 0x7f57c014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 -- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f57c0070ec0 msgr2=0x7f57c014e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f57c0070ec0 0x7f57c014e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 -- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c0158a50 msgr2=0x7f57c014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:10.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c0158a50 0x7f57c014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:10.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 -- 172.21.15.57:0/2983782166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009a70 con 0x7f57c006e340 2023-11-24T08:07:10.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c50b9640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c006e340 0x7f57c00cea90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c500 tx=0x7f57bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:10.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57b5ffb640 1 -- 172.21.15.57:0/2983782166 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc005cf0 con 0x7f57c006e340 2023-11-24T08:07:10.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57b5ffb640 1 -- 172.21.15.57:0/2983782166 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc005e50 con 0x7f57c006e340 2023-11-24T08:07:10.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57b5ffb640 1 -- 172.21.15.57:0/2983782166 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0072f0 con 0x7f57c006e340 2023-11-24T08:07:10.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c00adc30 con 0x7f57c006e340 2023-11-24T08:07:10.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0151200 con 0x7f57c006e340 2023-11-24T08:07:10.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c00ae150 con 0x7f57c006e340 2023-11-24T08:07:10.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.835+0000 7f57b5ffb640 1 -- 172.21.15.57:0/2983782166 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7f57bc007450 con 0x7f57c006e340 2023-11-24T08:07:10.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.839+0000 7f57b5ffb640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f57a40666b0 0x7f57a4068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:10.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.839+0000 7f57b5ffb640 1 -- 172.21.15.57:0/2983782166 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f57bc083700 con 0x7f57c006e340 2023-11-24T08:07:10.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.839+0000 7f57c48b8640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f57a40666b0 0x7f57a4068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:10.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.839+0000 7f57c48b8640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f57a40666b0 0x7f57a4068b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f57c0162ac0 tx=0x7f57b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:10.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:10.843+0000 7f57b5ffb640 1 -- 172.21.15.57:0/2983782166 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57bc050920 con 0x7f57c006e340 2023-11-24T08:07:11.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.031+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57c0067520 con 0x7f57c006e340 2023-11-24T08:07:11.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.031+0000 7f57b5ffb640 1 -- 172.21.15.57:0/2983782166 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f57bc017090 con 0x7f57c006e340 2023-11-24T08:07:11.037 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:11.037 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:11.038 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f57a40666b0 msgr2=0x7f57a4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f57a40666b0 0x7f57a4068b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f57c0162ac0 tx=0x7f57b0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c006e340 msgr2=0x7f57c00cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c006e340 0x7f57c00cea90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c500 tx=0x7f57bc00c9c0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 shutdown_connections 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f57a40666b0 0x7f57a4068b70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c0158a50 0x7f57c014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f57c0070ec0 0x7f57c014e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 --2- 172.21.15.57:0/2983782166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57c006e340 0x7f57c00cea90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 >> 172.21.15.57:0/2983782166 conn(0x7f57c00b0bf0 msgr2=0x7f57c006c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 shutdown_connections 2023-11-24T08:07:11.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.035+0000 7f57c731d640 1 -- 172.21.15.57:0/2983782166 wait complete. 2023-11-24T08:07:11.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:11.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd441580640 1 Processor -- start 2023-11-24T08:07:11.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd441580640 1 -- start start 2023-11-24T08:07:11.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd441580640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd43c15d570 0x7fd43c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd441580640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c0d3020 0x7fd43c0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd441580640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0d39c0 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd441580640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0d1cc0 con 0x7fd43c15d570 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd441580640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0d1fa0 con 0x7fd43c0d3020 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd43c0ce8b0 0x7fd43c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49240/0 (socket says 172.21.15.57:49240) 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43b7fe640 1 -- 172.21.15.57:0/2167823390 learned_addr learned my addr 172.21.15.57:0/2167823390 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43affd640 1 --2- 172.21.15.57:0/2167823390 >> v2:172.21.15.132:3300/0 conn(0x7fd43c15d570 0x7fd43c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd433fff640 1 --2- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c0d3020 0x7fd43c0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43a7fc640 1 -- 172.21.15.57:0/2167823390 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469940044 0 0) 0x7fd43c0d39c0 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43a7fc640 1 -- 172.21.15.57:0/2167823390 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd428003530 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43affd640 1 -- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c0d3020 msgr2=0x7fd43c0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43affd640 1 --2- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c0d3020 0x7fd43c0d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43affd640 1 -- 172.21.15.57:0/2167823390 >> v1:172.21.15.57:6789/0 conn(0x7fd43c0ce8b0 legacy=0x7fd43c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.199+0000 7fd43affd640 1 -- 172.21.15.57:0/2167823390 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0ce0b0 con 0x7fd43c15d570 2023-11-24T08:07:11.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd43affd640 1 --2- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c15d570 0x7fd43c06b9d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097c0 tx=0x7fd42c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3bfed994c135281 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd43a7fc640 1 -- 172.21.15.57:0/2167823390 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ac640 con 0x7fd43c15d570 2023-11-24T08:07:11.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd43a7fc640 1 -- 172.21.15.57:0/2167823390 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0ac7a0 con 0x7fd43c15d570 2023-11-24T08:07:11.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd43a7fc640 1 -- 172.21.15.57:0/2167823390 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0acb30 con 0x7fd43c15d570 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 -- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c15d570 msgr2=0x7fd43c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 --2- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c15d570 0x7fd43c06b9d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097c0 tx=0x7fd42c01c3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 -- 172.21.15.57:0/2167823390 shutdown_connections 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 --2- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c0d3020 0x7fd43c0d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 --2- 172.21.15.57:0/2167823390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c15d570 0x7fd43c06b9d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 -- 172.21.15.57:0/2167823390 >> 172.21.15.57:0/2167823390 conn(0x7fd43c08ceb0 msgr2=0x7fd43c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 -- 172.21.15.57:0/2167823390 shutdown_connections 2023-11-24T08:07:11.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.203+0000 7fd441580640 1 -- 172.21.15.57:0/2167823390 wait complete. 2023-11-24T08:07:11.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 Processor -- start 2023-11-24T08:07:11.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 -- start start 2023-11-24T08:07:11.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0ce8b0 0x7fd43c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c0d3020 0x7fd43c157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c15d570 0x7fd43c0b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b8ff0 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c159050 con 0x7fd43c0d3020 2023-11-24T08:07:11.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b6780 con 0x7fd43c15d570 2023-11-24T08:07:11.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0ce8b0 0x7fd43c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0ce8b0 0x7fd43c158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55876/0 (socket says 172.21.15.57:55876) 2023-11-24T08:07:11.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 -- 172.21.15.57:0/1136549791 learned_addr learned my addr 172.21.15.57:0/1136549791 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:11.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43b7fe640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c15d570 0x7fd43c0b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd433fff640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c0d3020 0x7fd43c157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 -- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c15d570 msgr2=0x7fd43c0b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c15d570 0x7fd43c0b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 -- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c0d3020 msgr2=0x7fd43c157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c0d3020 0x7fd43c157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 -- 172.21.15.57:0/1136549791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009420 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd43affd640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0ce8b0 0x7fd43c158b10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0af040 tx=0x7fd42c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd4337fe640 1 -- 172.21.15.57:0/1136549791 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b8650 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd4337fe640 1 -- 172.21.15.57:0/1136549791 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0b87b0 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c0b61c0 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.207+0000 7fd4337fe640 1 -- 172.21.15.57:0/1136549791 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b8b60 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.211+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c158310 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.211+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c067520 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.211+0000 7fd4337fe640 1 -- 172.21.15.57:0/1136549791 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 86056+0+0 (secure 0 0 0) 0x7fd42c0b8cc0 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.211+0000 7fd4337fe640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd41c0666b0 0x7fd41c068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.211+0000 7fd4337fe640 1 -- 172.21.15.57:0/1136549791 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd42c11ed70 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.211+0000 7fd433fff640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd41c0666b0 0x7fd41c068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.211+0000 7fd433fff640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd41c0666b0 0x7fd41c068b70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0cf050 tx=0x7fd424009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.215+0000 7fd4337fe640 1 -- 172.21.15.57:0/1136549791 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd42c0ebe60 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd43c06b7b0 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd4337fe640 1 -- 172.21.15.57:0/1136549791 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fd42c0b1020 con 0x7fd43c0ce8b0 2023-11-24T08:07:11.379 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:11.379 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":50,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:41.507365+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:11.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd41c0666b0 msgr2=0x7fd41c068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd41c0666b0 0x7fd41c068b70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0cf050 tx=0x7fd424009190 comp rx=0 tx=0).stop 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0ce8b0 msgr2=0x7fd43c158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0ce8b0 0x7fd43c158b10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0af040 tx=0x7fd42c01ac00 comp rx=0 tx=0).stop 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 shutdown_connections 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd41c0666b0 0x7fd41c068b70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd43c15d570 0x7fd43c0b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c0d3020 0x7fd43c157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 --2- 172.21.15.57:0/1136549791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd43c0ce8b0 0x7fd43c158b10 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 >> 172.21.15.57:0/1136549791 conn(0x7fd43c08ceb0 msgr2=0x7fd43c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 shutdown_connections 2023-11-24T08:07:11.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.375+0000 7fd441580640 1 -- 172.21.15.57:0/1136549791 wait complete. 2023-11-24T08:07:11.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:05:22.550537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:05:23.148396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:11.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:11.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a4b901640 1 Processor -- start 2023-11-24T08:07:11.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a4b901640 1 -- start start 2023-11-24T08:07:11.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a4b901640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a440cdf10 0x7f7a440ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a4b901640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4415dda0 con 0x7f7a44161d70 2023-11-24T08:07:11.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a4b901640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a440d42e0 con 0x7f7a440d19e0 2023-11-24T08:07:11.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a4b901640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a440d3b10 con 0x7f7a440cdf10 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a48e9c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7a44161d70 0x7f7a440d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49246/0 (socket says 172.21.15.57:49246) 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a48e9c640 1 -- 172.21.15.57:0/4058872537 learned_addr learned my addr 172.21.15.57:0/4058872537 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a49e9e640 1 --2- 172.21.15.57:0/4058872537 >> v2:172.21.15.132:3300/0 conn(0x7f7a440cdf10 0x7f7a440ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a3bfff640 1 -- 172.21.15.57:0/4058872537 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270528822 0 0) 0x7f7a4415dda0 con 0x7f7a44161d70 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a3bfff640 1 -- 172.21.15.57:0/4058872537 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a30003530 con 0x7f7a44161d70 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a49e9e640 1 -- 172.21.15.57:0/4058872537 >> v1:172.21.15.132:6789/0 conn(0x7f7a440d19e0 legacy=0x7f7a440d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a3bfff640 1 -- 172.21.15.57:0/4058872537 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925238366 0 0) 0x7f7a440d42e0 con 0x7f7a440d19e0 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a49e9e640 1 -- 172.21.15.57:0/4058872537 >> v1:172.21.15.57:6789/0 conn(0x7f7a44161d70 legacy=0x7f7a440d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.547+0000 7f7a49e9e640 1 -- 172.21.15.57:0/4058872537 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440d3d20 con 0x7f7a440cdf10 2023-11-24T08:07:11.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a49e9e640 1 --2- 172.21.15.57:0/4058872537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a440cdf10 0x7f7a440ce340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009d90 tx=0x7f7a3c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d58fb58ec57613e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a3bfff640 1 -- 172.21.15.57:0/4058872537 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0a58f0 con 0x7f7a440cdf10 2023-11-24T08:07:11.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a3bfff640 1 -- 172.21.15.57:0/4058872537 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0a5a50 con 0x7f7a440cdf10 2023-11-24T08:07:11.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a3bfff640 1 -- 172.21.15.57:0/4058872537 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0a5dc0 con 0x7f7a440cdf10 2023-11-24T08:07:11.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a4b901640 1 -- 172.21.15.57:0/4058872537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a440cdf10 msgr2=0x7f7a440ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a4b901640 1 --2- 172.21.15.57:0/4058872537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a440cdf10 0x7f7a440ce340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009d90 tx=0x7f7a3c01c920 comp rx=0 tx=0).stop 2023-11-24T08:07:11.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a4b901640 1 -- 172.21.15.57:0/4058872537 shutdown_connections 2023-11-24T08:07:11.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a4b901640 1 --2- 172.21.15.57:0/4058872537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a440cdf10 0x7f7a440ce340 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a4b901640 1 -- 172.21.15.57:0/4058872537 >> 172.21.15.57:0/4058872537 conn(0x7f7a4409c760 msgr2=0x7f7a440d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a4b901640 1 -- 172.21.15.57:0/4058872537 shutdown_connections 2023-11-24T08:07:11.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.551+0000 7f7a4b901640 1 -- 172.21.15.57:0/4058872537 wait complete. 2023-11-24T08:07:11.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 Processor -- start 2023-11-24T08:07:11.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 -- start start 2023-11-24T08:07:11.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a440cdf10 0x7f7a440b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a440d19e0 0x7f7a4415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a44161d70 0x7f7a4406be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415d280 con 0x7f7a440cdf10 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440b8d50 con 0x7f7a44161d70 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440b84b0 con 0x7f7a440d19e0 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a440cdf10 0x7f7a440b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a440cdf10 0x7f7a440b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55892/0 (socket says 172.21.15.57:55892) 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 -- 172.21.15.57:0/1673361502 learned_addr learned my addr 172.21.15.57:0/1673361502 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a48e9c640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a440d19e0 0x7f7a4415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a49e9e640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a44161d70 0x7f7a4406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 -- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a440d19e0 msgr2=0x7f7a4415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a440d19e0 0x7f7a4415cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 -- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a44161d70 msgr2=0x7f7a4406be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a44161d70 0x7f7a4406be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 -- 172.21.15.57:0/1673361502 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009a70 con 0x7f7a440cdf10 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4969d640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a440cdf10 0x7f7a440b7dc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000c4b0 tx=0x7f7a4000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a39ffb640 1 -- 172.21.15.57:0/1673361502 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40005480 con 0x7f7a440cdf10 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a39ffb640 1 -- 172.21.15.57:0/1673361502 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a40003600 con 0x7f7a440cdf10 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a440b8790 con 0x7f7a440cdf10 2023-11-24T08:07:11.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a39ffb640 1 -- 172.21.15.57:0/1673361502 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a400039b0 con 0x7f7a440cdf10 2023-11-24T08:07:11.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.555+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a440ca600 con 0x7f7a440cdf10 2023-11-24T08:07:11.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.559+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a440ca7f0 con 0x7f7a440cdf10 2023-11-24T08:07:11.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.559+0000 7f7a39ffb640 1 -- 172.21.15.57:0/1673361502 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f7a40003b10 con 0x7f7a440cdf10 2023-11-24T08:07:11.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.559+0000 7f7a39ffb640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7a28066620 0x7f7a28068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.559+0000 7f7a39ffb640 1 -- 172.21.15.57:0/1673361502 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7a40083bd0 con 0x7f7a440cdf10 2023-11-24T08:07:11.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.559+0000 7f7a48e9c640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7a28066620 0x7f7a28068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.559+0000 7f7a48e9c640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7a28066620 0x7f7a28068ae0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7a4415cc20 tx=0x7f7a34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.563+0000 7f7a39ffb640 1 -- 172.21.15.57:0/1673361502 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a40050e30 con 0x7f7a440cdf10 2023-11-24T08:07:11.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a4404e8c0 con 0x7f7a440cdf10 2023-11-24T08:07:11.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a39ffb640 1 -- 172.21.15.57:0/1673361502 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a40054450 con 0x7f7a440cdf10 2023-11-24T08:07:11.727 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:07:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7a28066620 msgr2=0x7f7a28068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7a28066620 0x7f7a28068ae0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7a4415cc20 tx=0x7f7a34009040 comp rx=0 tx=0).stop 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a440cdf10 msgr2=0x7f7a440b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a440cdf10 0x7f7a440b7dc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000c4b0 tx=0x7f7a4000c970 comp rx=0 tx=0).stop 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 shutdown_connections 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7a28066620 0x7f7a28068ae0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a44161d70 0x7f7a4406be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a440d19e0 0x7f7a4415cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 --2- 172.21.15.57:0/1673361502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a440cdf10 0x7f7a440b7dc0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 >> 172.21.15.57:0/1673361502 conn(0x7f7a4409c760 msgr2=0x7f7a4406cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 shutdown_connections 2023-11-24T08:07:11.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.723+0000 7f7a4b901640 1 -- 172.21.15.57:0/1673361502 wait complete. 2023-11-24T08:07:11.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:11.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ec46b640 1 Processor -- start 2023-11-24T08:07:11.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ec46b640 1 -- start start 2023-11-24T08:07:11.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ec46b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71e415a290 0x7f71e40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ec46b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e415ec60 0x7f71e40cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ec46b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e4071170 con 0x7f71e40cc6b0 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ec46b640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40cb690 con 0x7f71e415a290 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ec46b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e40cb970 con 0x7f71e415ec60 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ea207640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71e415a290 0x7f71e40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ea207640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71e415a290 0x7f71e40707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55906/0 (socket says 172.21.15.57:55906) 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ea207640 1 -- 172.21.15.57:0/1864668103 learned_addr learned my addr 172.21.15.57:0/1864668103 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71e9a06640 1 --2- 172.21.15.57:0/1864668103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e415ec60 0x7f71e40cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ea207640 1 -- 172.21.15.57:0/1864668103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e415ec60 msgr2=0x7f71e40cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ea207640 1 --2- 172.21.15.57:0/1864668103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e415ec60 0x7f71e40cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ea207640 1 -- 172.21.15.57:0/1864668103 >> v1:172.21.15.132:6789/0 conn(0x7f71e40cc6b0 legacy=0x7f71e40b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.891+0000 7f71ea207640 1 -- 172.21.15.57:0/1864668103 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40cbc50 con 0x7f71e415a290 2023-11-24T08:07:11.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ea207640 1 --2- 172.21.15.57:0/1864668103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40707f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009870 tx=0x7f71e001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488de5871579bf0b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71e9205640 1 -- 172.21.15.57:0/1864668103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00aa430 con 0x7f71e415a290 2023-11-24T08:07:11.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71e9205640 1 -- 172.21.15.57:0/1864668103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e00aa590 con 0x7f71e415a290 2023-11-24T08:07:11.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71e9205640 1 -- 172.21.15.57:0/1864668103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00aa920 con 0x7f71e415a290 2023-11-24T08:07:11.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 -- 172.21.15.57:0/1864668103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 msgr2=0x7f71e40707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1864668103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40707f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009870 tx=0x7f71e001c4b0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 -- 172.21.15.57:0/1864668103 shutdown_connections 2023-11-24T08:07:11.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1864668103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e415ec60 0x7f71e40cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1864668103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40707f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 -- 172.21.15.57:0/1864668103 >> 172.21.15.57:0/1864668103 conn(0x7f71e40b0c80 msgr2=0x7f71e40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:11.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 -- 172.21.15.57:0/1864668103 shutdown_connections 2023-11-24T08:07:11.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.895+0000 7f71ec46b640 1 -- 172.21.15.57:0/1864668103 wait complete. 2023-11-24T08:07:11.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 Processor -- start 2023-11-24T08:07:11.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 -- start start 2023-11-24T08:07:11.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e40cc6b0 0x7f71e4152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e415ec60 0x7f71e4151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e40ace90 con 0x7f71e415a290 2023-11-24T08:07:11.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4152c40 con 0x7f71e415ec60 2023-11-24T08:07:11.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4152f20 con 0x7f71e40cc6b0 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40ac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55914/0 (socket says 172.21.15.57:55914) 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 -- 172.21.15.57:0/1847621348 learned_addr learned my addr 172.21.15.57:0/1847621348 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ea207640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e40cc6b0 0x7f71e4152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71eaa08640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e415ec60 0x7f71e4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 -- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e40cc6b0 msgr2=0x7f71e4152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e40cc6b0 0x7f71e4152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 -- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e415ec60 msgr2=0x7f71e4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:11.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e415ec60 0x7f71e4151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:11.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 -- 172.21.15.57:0/1847621348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00094d0 con 0x7f71e415a290 2023-11-24T08:07:11.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71e9a06640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40ac950 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f71d400d7d0 tx=0x7f71d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71daffd640 1 -- 172.21.15.57:0/1847621348 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400b6c0 con 0x7f71e415a290 2023-11-24T08:07:11.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71daffd640 1 -- 172.21.15.57:0/1847621348 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400b820 con 0x7f71e415a290 2023-11-24T08:07:11.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71daffd640 1 -- 172.21.15.57:0/1847621348 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400bbb0 con 0x7f71e415a290 2023-11-24T08:07:11.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e4153200 con 0x7f71e415a290 2023-11-24T08:07:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.899+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41537c0 con 0x7f71e415a290 2023-11-24T08:07:11.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.903+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e4153980 con 0x7f71e415a290 2023-11-24T08:07:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.903+0000 7f71daffd640 1 -- 172.21.15.57:0/1847621348 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f71d400bd10 con 0x7f71e415a290 2023-11-24T08:07:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.903+0000 7f71daffd640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f71c8066670 0x7f71c8068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.903+0000 7f71daffd640 1 -- 172.21.15.57:0/1847621348 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f71d4084570 con 0x7f71e415a290 2023-11-24T08:07:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.903+0000 7f71ea207640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f71c8066670 0x7f71c8068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:11.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.903+0000 7f71ea207640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f71c8066670 0x7f71c8068b30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f71e00ae000 tx=0x7f71e00b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:11.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:11.907+0000 7f71daffd640 1 -- 172.21.15.57:0/1847621348 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71d40517c0 con 0x7f71e415a290 2023-11-24T08:07:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71e404e8c0 con 0x7f71e415a290 2023-11-24T08:07:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71daffd640 1 -- 172.21.15.57:0/1847621348 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71d4054de0 con 0x7f71e415a290 2023-11-24T08:07:12.068 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:07:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f71c8066670 msgr2=0x7f71c8068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f71c8066670 0x7f71c8068b30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f71e00ae000 tx=0x7f71e00b5040 comp rx=0 tx=0).stop 2023-11-24T08:07:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 msgr2=0x7f71e40ac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40ac950 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f71d400d7d0 tx=0x7f71d400dc90 comp rx=0 tx=0).stop 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 shutdown_connections 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f71c8066670 0x7f71c8068b30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e415ec60 0x7f71e4151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e415a290 0x7f71e40ac950 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 --2- 172.21.15.57:0/1847621348 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e40cc6b0 0x7f71e4152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 >> 172.21.15.57:0/1847621348 conn(0x7f71e40b0c80 msgr2=0x7f71e40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 shutdown_connections 2023-11-24T08:07:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.063+0000 7f71ec46b640 1 -- 172.21.15.57:0/1847621348 wait complete. 2023-11-24T08:07:12.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:12.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59efcc9640 1 Processor -- start 2023-11-24T08:07:12.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59efcc9640 1 -- start start 2023-11-24T08:07:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59efcc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59e80cd380 0x7f59e80cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59efcc9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e80723c0 con 0x7f59e81624f0 2023-11-24T08:07:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59efcc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e80726a0 con 0x7f59e80ccef0 2023-11-24T08:07:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59efcc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e8072980 con 0x7f59e80cd380 2023-11-24T08:07:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f59e81624f0 0x7f59e81628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49252/0 (socket says 172.21.15.57:49252) 2023-11-24T08:07:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 -- 172.21.15.57:0/223338760 learned_addr learned my addr 172.21.15.57:0/223338760 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59ee266640 1 --2- 172.21.15.57:0/223338760 >> v2:172.21.15.132:3300/0 conn(0x7f59e80cd380 0x7f59e80cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049143100 0 0) 0x7f59e80723c0 con 0x7f59e81624f0 2023-11-24T08:07:12.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d4003530 con 0x7f59e81624f0 2023-11-24T08:07:12.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281963953 0 0) 0x7f59d4003530 con 0x7f59e81624f0 2023-11-24T08:07:12.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 >> v2:172.21.15.132:3300/0 conn(0x7f59e80cd380 msgr2=0x7f59e80cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:12.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 --2- 172.21.15.57:0/223338760 >> v2:172.21.15.132:3300/0 conn(0x7f59e80cd380 0x7f59e80cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 >> v1:172.21.15.132:6789/0 conn(0x7f59e80ccef0 legacy=0x7f59e8071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e806c7e0 con 0x7f59e81624f0 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f59e4001680 con 0x7f59e81624f0 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 >> v1:172.21.15.57:6789/0 conn(0x7f59e81624f0 legacy=0x7f59e81628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d4003980 0x7f59d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d40047d0 0x7f59d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59d4005190 0x7f59d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8072980 con 0x7f59d4003980 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d400c130 con 0x7f59d40047d0 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d400c2f0 con 0x7f59d4005190 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d4003980 0x7f59d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59ed264640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d40047d0 0x7f59d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59ee266640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59d4005190 0x7f59d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 -- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59d4005190 msgr2=0x7f59d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:12.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59d4005190 0x7f59d400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 -- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d40047d0 msgr2=0x7f59d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:12.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d40047d0 0x7f59d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.231+0000 7f59eda65640 1 -- 172.21.15.57:0/223338760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4003530 con 0x7f59d4003980 2023-11-24T08:07:12.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59ee266640 1 -- 172.21.15.57:0/223338760 reap_dead start 2023-11-24T08:07:12.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59eda65640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d4003980 0x7f59d4003da0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c240 tx=0x7f59e401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3ff860ba9a3f61 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4005ae0 con 0x7f59d4003980 2023-11-24T08:07:12.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4005c40 con 0x7f59d4003980 2023-11-24T08:07:12.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59eca63640 1 -- 172.21.15.57:0/223338760 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40a5ad0 con 0x7f59d4003980 2023-11-24T08:07:12.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59efcc9640 1 -- 172.21.15.57:0/223338760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d4003980 msgr2=0x7f59d4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59efcc9640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d4003980 0x7f59d4003da0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c240 tx=0x7f59e401cb90 comp rx=0 tx=0).stop 2023-11-24T08:07:12.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59efcc9640 1 -- 172.21.15.57:0/223338760 shutdown_connections 2023-11-24T08:07:12.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59efcc9640 1 --2- 172.21.15.57:0/223338760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59d4003980 0x7f59d4003da0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59efcc9640 1 -- 172.21.15.57:0/223338760 >> 172.21.15.57:0/223338760 conn(0x7f59e80b0c80 msgr2=0x7f59e80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59efcc9640 1 -- 172.21.15.57:0/223338760 shutdown_connections 2023-11-24T08:07:12.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.235+0000 7f59efcc9640 1 -- 172.21.15.57:0/223338760 wait complete. 2023-11-24T08:07:12.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 Processor -- start 2023-11-24T08:07:12.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 -- start start 2023-11-24T08:07:12.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d4003980 0x7f59e814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e80b1f50 0x7f59e81640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59e8164630 0x7f59e80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8164ab0 con 0x7f59e80b1f50 2023-11-24T08:07:12.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80b1190 con 0x7f59d4003980 2023-11-24T08:07:12.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e80b1470 con 0x7f59e8164630 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e80b1f50 0x7f59e81640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e80b1f50 0x7f59e81640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55936/0 (socket says 172.21.15.57:55936) 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 -- 172.21.15.57:0/2522879398 learned_addr learned my addr 172.21.15.57:0/2522879398 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59eda65640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d4003980 0x7f59e814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ee266640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59e8164630 0x7f59e80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 -- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59e8164630 msgr2=0x7f59e80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59e8164630 0x7f59e80b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 -- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d4003980 msgr2=0x7f59e814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d4003980 0x7f59e814c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 -- 172.21.15.57:0/2522879398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e80b1750 con 0x7f59e80b1f50 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59ed264640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e80b1f50 0x7f59e81640f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f59d800e4b0 tx=0x7f59d800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59de7fc640 1 -- 172.21.15.57:0/2522879398 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80052e0 con 0x7f59e80b1f50 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59de7fc640 1 -- 172.21.15.57:0/2522879398 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8005440 con 0x7f59e80b1f50 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59de7fc640 1 -- 172.21.15.57:0/2522879398 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8003840 con 0x7f59e80b1f50 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.239+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e80b1a30 con 0x7f59e80b1f50 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.243+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e80b23b0 con 0x7f59e80b1f50 2023-11-24T08:07:12.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.243+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e80b12d0 con 0x7f59e80b1f50 2023-11-24T08:07:12.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.243+0000 7f59de7fc640 1 -- 172.21.15.57:0/2522879398 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f59d80039a0 con 0x7f59e80b1f50 2023-11-24T08:07:12.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.243+0000 7f59de7fc640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f59cc066620 0x7f59cc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.243+0000 7f59de7fc640 1 -- 172.21.15.57:0/2522879398 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f59d8083dc0 con 0x7f59e80b1f50 2023-11-24T08:07:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.243+0000 7f59eda65640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f59cc066620 0x7f59cc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.247+0000 7f59eda65640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f59cc066620 0x7f59cc068ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f59e40ab000 tx=0x7f59e40b1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.247+0000 7f59de7fc640 1 -- 172.21.15.57:0/2522879398 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59e80b12d0 con 0x7f59e80b1f50 2023-11-24T08:07:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.403+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59e80b12d0 con 0x7f59e80b1f50 2023-11-24T08:07:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.403+0000 7f59de7fc640 1 -- 172.21.15.57:0/2522879398 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59e80b12d0 con 0x7f59e80b1f50 2023-11-24T08:07:12.409 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:07:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f59cc066620 msgr2=0x7f59cc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f59cc066620 0x7f59cc068ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f59e40ab000 tx=0x7f59e40b1040 comp rx=0 tx=0).stop 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e80b1f50 msgr2=0x7f59e81640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e80b1f50 0x7f59e81640f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f59d800e4b0 tx=0x7f59d800e970 comp rx=0 tx=0).stop 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 shutdown_connections 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f59cc066620 0x7f59cc068ae0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59e8164630 0x7f59e80b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e80b1f50 0x7f59e81640f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 --2- 172.21.15.57:0/2522879398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59d4003980 0x7f59e814c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 >> 172.21.15.57:0/2522879398 conn(0x7f59e80b0c80 msgr2=0x7f59e80af560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 shutdown_connections 2023-11-24T08:07:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.407+0000 7f59efcc9640 1 -- 172.21.15.57:0/2522879398 wait complete. 2023-11-24T08:07:12.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:12.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d2817640 1 Processor -- start 2023-11-24T08:07:12.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d2817640 1 -- start start 2023-11-24T08:07:12.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d2817640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f65cc0d3020 0x7f65cc0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d2817640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc06c0e0 con 0x7f65cc0ce8b0 2023-11-24T08:07:12.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d2817640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc0d39f0 con 0x7f65cc15d570 2023-11-24T08:07:12.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d2817640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0d1cc0 con 0x7f65cc0d3020 2023-11-24T08:07:12.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65cb7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f65cc0d3020 0x7f65cc0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d0db4640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f65cc0ce8b0 0x7f65cc0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49256/0 (socket says 172.21.15.57:49256) 2023-11-24T08:07:12.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65d0db4640 1 -- 172.21.15.57:0/3784405328 learned_addr learned my addr 172.21.15.57:0/3784405328 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:12.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65cb7fe640 1 -- 172.21.15.57:0/3784405328 >> v1:172.21.15.132:6789/0 conn(0x7f65cc15d570 legacy=0x7f65cc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65cb7fe640 1 -- 172.21.15.57:0/3784405328 >> v1:172.21.15.57:6789/0 conn(0x7f65cc0ce8b0 legacy=0x7f65cc0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.571+0000 7f65cb7fe640 1 -- 172.21.15.57:0/3784405328 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0d1fa0 con 0x7f65cc0d3020 2023-11-24T08:07:12.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65cb7fe640 1 --2- 172.21.15.57:0/3784405328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc0d34b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f65c00097c0 tx=0x7f65c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d7a0da7da704f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65caffd640 1 -- 172.21.15.57:0/3784405328 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00ab650 con 0x7f65cc0d3020 2023-11-24T08:07:12.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65caffd640 1 -- 172.21.15.57:0/3784405328 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c00ab7b0 con 0x7f65cc0d3020 2023-11-24T08:07:12.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65caffd640 1 -- 172.21.15.57:0/3784405328 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00abb40 con 0x7f65cc0d3020 2023-11-24T08:07:12.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65d2817640 1 -- 172.21.15.57:0/3784405328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 msgr2=0x7f65cc0d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65d2817640 1 --2- 172.21.15.57:0/3784405328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc0d34b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f65c00097c0 tx=0x7f65c001c450 comp rx=0 tx=0).stop 2023-11-24T08:07:12.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65d2817640 1 -- 172.21.15.57:0/3784405328 shutdown_connections 2023-11-24T08:07:12.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65d2817640 1 --2- 172.21.15.57:0/3784405328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc0d34b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65d2817640 1 -- 172.21.15.57:0/3784405328 >> 172.21.15.57:0/3784405328 conn(0x7f65cc08ceb0 msgr2=0x7f65cc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65d2817640 1 -- 172.21.15.57:0/3784405328 shutdown_connections 2023-11-24T08:07:12.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.575+0000 7f65d2817640 1 -- 172.21.15.57:0/3784405328 wait complete. 2023-11-24T08:07:12.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 Processor -- start 2023-11-24T08:07:12.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 -- start start 2023-11-24T08:07:12.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65cc0ce8b0 0x7f65cc150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65cc15d570 0x7f65cc0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0c7c70 con 0x7f65cc0d3020 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0c7060 con 0x7f65cc15d570 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0c7340 con 0x7f65cc0ce8b0 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55954/0 (socket says 172.21.15.57:55954) 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 -- 172.21.15.57:0/832606914 learned_addr learned my addr 172.21.15.57:0/832606914 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cbfff640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65cc0ce8b0 0x7f65cc150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d0db4640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65cc15d570 0x7f65cc0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 -- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65cc0ce8b0 msgr2=0x7f65cc150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65cc0ce8b0 0x7f65cc150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 -- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65cc15d570 msgr2=0x7f65cc0b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65cc15d570 0x7f65cc0b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 -- 172.21.15.57:0/832606914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0009420 con 0x7f65cc0d3020 2023-11-24T08:07:12.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65cb7fe640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc151290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f65c00ad040 tx=0x7f65c001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65c8ff9640 1 -- 172.21.15.57:0/832606914 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00b5810 con 0x7f65cc0d3020 2023-11-24T08:07:12.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65c8ff9640 1 -- 172.21.15.57:0/832606914 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c00b5970 con 0x7f65cc0d3020 2023-11-24T08:07:12.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65c8ff9640 1 -- 172.21.15.57:0/832606914 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00b5d20 con 0x7f65cc0d3020 2023-11-24T08:07:12.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc0c7620 con 0x7f65cc0d3020 2023-11-24T08:07:12.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.579+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc0b8c40 con 0x7f65cc0d3020 2023-11-24T08:07:12.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.583+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc0c7480 con 0x7f65cc0d3020 2023-11-24T08:07:12.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.583+0000 7f65c8ff9640 1 -- 172.21.15.57:0/832606914 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f65c00bf410 con 0x7f65cc0d3020 2023-11-24T08:07:12.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.583+0000 7f65c8ff9640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f65b8066620 0x7f65b8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.583+0000 7f65c8ff9640 1 -- 172.21.15.57:0/832606914 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f65c011ef90 con 0x7f65cc0d3020 2023-11-24T08:07:12.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.583+0000 7f65cbfff640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f65b8066620 0x7f65b8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.583+0000 7f65cbfff640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f65b8066620 0x7f65b8068ae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0b1140 tx=0x7f65bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.587+0000 7f65c8ff9640 1 -- 172.21.15.57:0/832606914 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65cc0c7480 con 0x7f65cc0d3020 2023-11-24T08:07:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65cc0c7480 con 0x7f65cc0d3020 2023-11-24T08:07:12.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65c8ff9640 1 -- 172.21.15.57:0/832606914 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f65cc0c7480 con 0x7f65cc0d3020 2023-11-24T08:07:12.779 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:12.780 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:12.780 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:07:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f65b8066620 msgr2=0x7f65b8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f65b8066620 0x7f65b8068ae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0b1140 tx=0x7f65bc009040 comp rx=0 tx=0).stop 2023-11-24T08:07:12.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 msgr2=0x7f65cc151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc151290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f65c00ad040 tx=0x7f65c001ac90 comp rx=0 tx=0).stop 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 shutdown_connections 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f65b8066620 0x7f65b8068ae0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65cc15d570 0x7f65cc0b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65cc0d3020 0x7f65cc151290 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 --2- 172.21.15.57:0/832606914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f65cc0ce8b0 0x7f65cc150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 >> 172.21.15.57:0/832606914 conn(0x7f65cc08ceb0 msgr2=0x7f65cc0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 shutdown_connections 2023-11-24T08:07:12.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.775+0000 7f65d2817640 1 -- 172.21.15.57:0/832606914 wait complete. 2023-11-24T08:07:12.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:12.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.939+0000 7f5f54957640 1 Processor -- start 2023-11-24T08:07:12.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.939+0000 7f5f54957640 1 -- start start 2023-11-24T08:07:12.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f54957640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f5009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f54957640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f500709c0 0x7f5f50070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f54957640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5006d8b0 con 0x7f5f50144030 2023-11-24T08:07:12.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f54957640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f50145020 con 0x7f5f500709c0 2023-11-24T08:07:12.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f54957640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50071390 con 0x7f5f5006c650 2023-11-24T08:07:12.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4e59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5f50144030 0x7f5f5006dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49262/0 (socket says 172.21.15.57:49262) 2023-11-24T08:07:12.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4e59c640 1 -- 172.21.15.57:0/913593801 learned_addr learned my addr 172.21.15.57:0/913593801 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:12.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4ed9d640 1 --2- 172.21.15.57:0/913593801 >> v2:172.21.15.57:3300/0 conn(0x7f5f500709c0 0x7f5f50070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f47fff640 1 --2- 172.21.15.57:0/913593801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f5009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4dd9b640 1 -- 172.21.15.57:0/913593801 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271951385 0 0) 0x7f5f5006d8b0 con 0x7f5f50144030 2023-11-24T08:07:12.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4dd9b640 1 -- 172.21.15.57:0/913593801 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f3c003530 con 0x7f5f50144030 2023-11-24T08:07:12.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4ed9d640 1 -- 172.21.15.57:0/913593801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 msgr2=0x7f5f5009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:12.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4ed9d640 1 --2- 172.21.15.57:0/913593801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f5009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4ed9d640 1 -- 172.21.15.57:0/913593801 >> v1:172.21.15.57:6789/0 conn(0x7f5f50144030 legacy=0x7f5f5006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4ed9d640 1 -- 172.21.15.57:0/913593801 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5006cca0 con 0x7f5f500709c0 2023-11-24T08:07:12.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4ed9d640 1 --2- 172.21.15.57:0/913593801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500709c0 0x7f5f50070e50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d90 tx=0x7f5f4801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b715e01d1e04685f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4dd9b640 1 -- 172.21.15.57:0/913593801 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480a5900 con 0x7f5f500709c0 2023-11-24T08:07:12.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4dd9b640 1 -- 172.21.15.57:0/913593801 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480a5a60 con 0x7f5f500709c0 2023-11-24T08:07:12.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.943+0000 7f5f4dd9b640 1 -- 172.21.15.57:0/913593801 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480a5df0 con 0x7f5f500709c0 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- 172.21.15.57:0/913593801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500709c0 msgr2=0x7f5f50070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 --2- 172.21.15.57:0/913593801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500709c0 0x7f5f50070e50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d90 tx=0x7f5f4801c950 comp rx=0 tx=0).stop 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- 172.21.15.57:0/913593801 shutdown_connections 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 --2- 172.21.15.57:0/913593801 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f5009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 --2- 172.21.15.57:0/913593801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500709c0 0x7f5f50070e50 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- 172.21.15.57:0/913593801 >> 172.21.15.57:0/913593801 conn(0x7f5f500b0bf0 msgr2=0x7f5f500b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- 172.21.15.57:0/913593801 shutdown_connections 2023-11-24T08:07:12.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- 172.21.15.57:0/913593801 wait complete. 2023-11-24T08:07:12.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 Processor -- start 2023-11-24T08:07:12.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- start start 2023-11-24T08:07:12.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f501f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f500709c0 0x7f5f5013ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50144030 0x7f5f50156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500ce0e0 con 0x7f5f50144030 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50157430 con 0x7f5f500709c0 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f54957640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500cd210 con 0x7f5f5006c650 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50144030 0x7f5f50156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50144030 0x7f5f50156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55960/0 (socket says 172.21.15.57:55960) 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f4ed9d640 1 -- 172.21.15.57:0/1249757017 learned_addr learned my addr 172.21.15.57:0/1249757017 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:12.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.947+0000 7f5f4e59c640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f501f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f47fff640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f500709c0 0x7f5f5013ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f4ed9d640 1 -- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 msgr2=0x7f5f501f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f4ed9d640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f501f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f4ed9d640 1 -- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f500709c0 msgr2=0x7f5f5013ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:12.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f4ed9d640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f500709c0 0x7f5f5013ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:12.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f4ed9d640 1 -- 172.21.15.57:0/1249757017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009a70 con 0x7f5f50144030 2023-11-24T08:07:12.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f47fff640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f500709c0 0x7f5f5013ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:12.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f4ed9d640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50144030 0x7f5f50156ef0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5f480b0040 tx=0x7f5f480196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f46ffd640 1 -- 172.21.15.57:0/1249757017 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480ad850 con 0x7f5f50144030 2023-11-24T08:07:12.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f46ffd640 1 -- 172.21.15.57:0/1249757017 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480a58f0 con 0x7f5f50144030 2023-11-24T08:07:12.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f46ffd640 1 -- 172.21.15.57:0/1249757017 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480adc30 con 0x7f5f50144030 2023-11-24T08:07:12.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f500cd460 con 0x7f5f50144030 2023-11-24T08:07:12.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f500cda20 con 0x7f5f50144030 2023-11-24T08:07:12.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f50165f50 con 0x7f5f50144030 2023-11-24T08:07:12.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f46ffd640 1 -- 172.21.15.57:0/1249757017 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5f480b4050 con 0x7f5f50144030 2023-11-24T08:07:12.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f46ffd640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f30066620 0x7f5f30068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:12.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.951+0000 7f5f46ffd640 1 -- 172.21.15.57:0/1249757017 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5f4811f030 con 0x7f5f50144030 2023-11-24T08:07:12.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.955+0000 7f5f4e59c640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f30066620 0x7f5f30068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:12.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.955+0000 7f5f4e59c640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f30066620 0x7f5f30068ae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5f400011f0 tx=0x7f5f40007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:12.955+0000 7f5f46ffd640 1 -- 172.21.15.57:0/1249757017 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f480ec450 con 0x7f5f50144030 2023-11-24T08:07:13.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.115+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f50067520 con 0x7f5f50144030 2023-11-24T08:07:13.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.115+0000 7f5f46ffd640 1 -- 172.21.15.57:0/1249757017 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f5f480efa70 con 0x7f5f50144030 2023-11-24T08:07:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:13.120 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":50,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:41.507365+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:13.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f30066620 msgr2=0x7f5f30068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f30066620 0x7f5f30068ae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5f400011f0 tx=0x7f5f40007d40 comp rx=0 tx=0).stop 2023-11-24T08:07:13.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50144030 msgr2=0x7f5f50156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50144030 0x7f5f50156ef0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5f480b0040 tx=0x7f5f480196f0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 shutdown_connections 2023-11-24T08:07:13.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f30066620 0x7f5f30068ae0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50144030 0x7f5f50156ef0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f500709c0 0x7f5f5013ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 --2- 172.21.15.57:0/1249757017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f5006c650 0x7f5f501f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 >> 172.21.15.57:0/1249757017 conn(0x7f5f500b0bf0 msgr2=0x7f5f5015ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 shutdown_connections 2023-11-24T08:07:13.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.119+0000 7f5f54957640 1 -- 172.21.15.57:0/1249757017 wait complete. 2023-11-24T08:07:13.141 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:07:13.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:13.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.279+0000 7f7b55e5a640 1 Processor -- start 2023-11-24T08:07:13.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.279+0000 7f7b55e5a640 1 -- start start 2023-11-24T08:07:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b55e5a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b50160be0 0x7f7b5015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b55e5a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5015e6a0 con 0x7f7b5015e250 2023-11-24T08:07:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b55e5a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5015e900 con 0x7f7b500b37b0 2023-11-24T08:07:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b55e5a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5006c650 con 0x7f7b50160be0 2023-11-24T08:07:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4ffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7b5015e250 0x7f7b5006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49270/0 (socket says 172.21.15.57:49270) 2023-11-24T08:07:13.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4ffff640 1 -- 172.21.15.57:0/2893933702 learned_addr learned my addr 172.21.15.57:0/2893933702 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:13.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4f7fe640 1 --2- 172.21.15.57:0/2893933702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b50160be0 0x7f7b5015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4e7fc640 1 -- 172.21.15.57:0/2893933702 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506591315 0 0) 0x7f7b5015e6a0 con 0x7f7b5015e250 2023-11-24T08:07:13.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4e7fc640 1 -- 172.21.15.57:0/2893933702 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b38003530 con 0x7f7b5015e250 2023-11-24T08:07:13.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4f7fe640 1 -- 172.21.15.57:0/2893933702 >> v1:172.21.15.132:6789/0 conn(0x7f7b500b37b0 legacy=0x7f7b5015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4f7fe640 1 -- 172.21.15.57:0/2893933702 >> v1:172.21.15.57:6789/0 conn(0x7f7b5015e250 legacy=0x7f7b5006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.283+0000 7f7b4f7fe640 1 -- 172.21.15.57:0/2893933702 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5006c830 con 0x7f7b50160be0 2023-11-24T08:07:13.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b4f7fe640 1 --2- 172.21.15.57:0/2893933702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b50160be0 0x7f7b5015ed00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097f0 tx=0x7f7b4001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11321d319d6d1819 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b4e7fc640 1 -- 172.21.15.57:0/2893933702 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400aa5f0 con 0x7f7b50160be0 2023-11-24T08:07:13.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b4e7fc640 1 -- 172.21.15.57:0/2893933702 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400aa750 con 0x7f7b50160be0 2023-11-24T08:07:13.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b4e7fc640 1 -- 172.21.15.57:0/2893933702 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400aaae0 con 0x7f7b50160be0 2023-11-24T08:07:13.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 -- 172.21.15.57:0/2893933702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b50160be0 msgr2=0x7f7b5015ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/2893933702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b50160be0 0x7f7b5015ed00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097f0 tx=0x7f7b4001c490 comp rx=0 tx=0).stop 2023-11-24T08:07:13.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 -- 172.21.15.57:0/2893933702 shutdown_connections 2023-11-24T08:07:13.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/2893933702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b50160be0 0x7f7b5015ed00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 -- 172.21.15.57:0/2893933702 >> 172.21.15.57:0/2893933702 conn(0x7f7b500b0bf0 msgr2=0x7f7b500b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 -- 172.21.15.57:0/2893933702 shutdown_connections 2023-11-24T08:07:13.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 -- 172.21.15.57:0/2893933702 wait complete. 2023-11-24T08:07:13.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 Processor -- start 2023-11-24T08:07:13.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.287+0000 7f7b55e5a640 1 -- start start 2023-11-24T08:07:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b500b37b0 0x7f7b501469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b5015e250 0x7f7b5014ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b50160be0 0x7f7b5014bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5014d1e0 con 0x7f7b5015e250 2023-11-24T08:07:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b50147470 con 0x7f7b50160be0 2023-11-24T08:07:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b50146f30 con 0x7f7b500b37b0 2023-11-24T08:07:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b5015e250 0x7f7b5014ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b5015e250 0x7f7b5014ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55974/0 (socket says 172.21.15.57:55974) 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 -- 172.21.15.57:0/3768236917 learned_addr learned my addr 172.21.15.57:0/3768236917 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4ffff640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b50160be0 0x7f7b5014bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4f7fe640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b500b37b0 0x7f7b501469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 -- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b500b37b0 msgr2=0x7f7b501469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b500b37b0 0x7f7b501469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 -- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b50160be0 msgr2=0x7f7b5014bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b50160be0 0x7f7b5014bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 -- 172.21.15.57:0/3768236917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40009420 con 0x7f7b5015e250 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b4effd640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b5015e250 0x7f7b5014ba60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c500 tx=0x7f7b4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b37fff640 1 -- 172.21.15.57:0/3768236917 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44005220 con 0x7f7b5015e250 2023-11-24T08:07:13.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b37fff640 1 -- 172.21.15.57:0/3768236917 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44005380 con 0x7f7b5015e250 2023-11-24T08:07:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b37fff640 1 -- 172.21.15.57:0/3768236917 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44007270 con 0x7f7b5015e250 2023-11-24T08:07:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5014c5d0 con 0x7f7b5015e250 2023-11-24T08:07:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5014cb90 con 0x7f7b5015e250 2023-11-24T08:07:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.291+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5014d350 con 0x7f7b5015e250 2023-11-24T08:07:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.295+0000 7f7b37fff640 1 -- 172.21.15.57:0/3768236917 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f7b440073d0 con 0x7f7b5015e250 2023-11-24T08:07:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.295+0000 7f7b37fff640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7b3c066650 0x7f7b3c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.295+0000 7f7b37fff640 1 -- 172.21.15.57:0/3768236917 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7b440839e0 con 0x7f7b5015e250 2023-11-24T08:07:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.295+0000 7f7b4f7fe640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7b3c066650 0x7f7b3c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.295+0000 7f7b4f7fe640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7b3c066650 0x7f7b3c068b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7b400ae000 tx=0x7f7b400b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.299+0000 7f7b37fff640 1 -- 172.21.15.57:0/3768236917 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b44050bc0 con 0x7f7b5015e250 2023-11-24T08:07:13.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b50067520 con 0x7f7b5015e250 2023-11-24T08:07:13.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b37fff640 1 -- 172.21.15.57:0/3768236917 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f7b440541e0 con 0x7f7b5015e250 2023-11-24T08:07:13.495 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:13.495 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:13.495 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:07:13.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7b3c066650 msgr2=0x7f7b3c068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7b3c066650 0x7f7b3c068b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7b400ae000 tx=0x7f7b400b5040 comp rx=0 tx=0).stop 2023-11-24T08:07:13.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b5015e250 msgr2=0x7f7b5014ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b5015e250 0x7f7b5014ba60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c500 tx=0x7f7b4400c9c0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 shutdown_connections 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7b3c066650 0x7f7b3c068b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b50160be0 0x7f7b5014bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b5015e250 0x7f7b5014ba60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 --2- 172.21.15.57:0/3768236917 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b500b37b0 0x7f7b501469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 >> 172.21.15.57:0/3768236917 conn(0x7f7b500b0bf0 msgr2=0x7f7b500718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 shutdown_connections 2023-11-24T08:07:13.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.491+0000 7f7b55e5a640 1 -- 172.21.15.57:0/3768236917 wait complete. 2023-11-24T08:07:13.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48d11ec640 1 Processor -- start 2023-11-24T08:07:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48d11ec640 1 -- start start 2023-11-24T08:07:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48d11ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48cc15d570 0x7f48cc06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48d11ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48d11ec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc0d39c0 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48d11ec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc0d1cc0 con 0x7f48cc15d570 2023-11-24T08:07:13.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48d11ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0d1fa0 con 0x7f48cc0d3020 2023-11-24T08:07:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48cad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48cc15d570 0x7f48cc06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc0d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:51624/0 (socket says 172.21.15.57:51624) 2023-11-24T08:07:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.655+0000 7f48c3fff640 1 -- 172.21.15.57:0/2820431694 learned_addr learned my addr 172.21.15.57:0/2820431694 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48cad9d640 1 -- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 msgr2=0x7f48cc0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48cad9d640 1 --2- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc0d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48cad9d640 1 -- 172.21.15.57:0/2820431694 >> v1:172.21.15.132:6789/0 conn(0x7f48cc0ce8b0 legacy=0x7f48cc0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48cad9d640 1 -- 172.21.15.57:0/2820431694 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0ce0b0 con 0x7f48cc15d570 2023-11-24T08:07:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48ca59c640 1 -- 172.21.15.57:0/2820431694 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875362698 0 0) 0x7f48cc0d39c0 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48c3fff640 1 --2- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc0d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48cad9d640 1 --2- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc06b9d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84aeba6343e4dd42 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48ca59c640 1 -- 172.21.15.57:0/2820431694 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0ac640 con 0x7f48cc15d570 2023-11-24T08:07:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48ca59c640 1 -- 172.21.15.57:0/2820431694 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc0ac7a0 con 0x7f48cc15d570 2023-11-24T08:07:13.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.659+0000 7f48ca59c640 1 -- 172.21.15.57:0/2820431694 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0acb30 con 0x7f48cc15d570 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 msgr2=0x7f48cc06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 --2- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc06b9d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc01c3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- 172.21.15.57:0/2820431694 shutdown_connections 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 --2- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc0d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 --2- 172.21.15.57:0/2820431694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc06b9d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- 172.21.15.57:0/2820431694 >> 172.21.15.57:0/2820431694 conn(0x7f48cc08ceb0 msgr2=0x7f48cc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- 172.21.15.57:0/2820431694 shutdown_connections 2023-11-24T08:07:13.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- 172.21.15.57:0/2820431694 wait complete. 2023-11-24T08:07:13.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 Processor -- start 2023-11-24T08:07:13.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- start start 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48cc0ce8b0 0x7f48cc150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc14ee80 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc152c70 con 0x7f48cc15d570 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48d11ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc155e40 con 0x7f48cc0d3020 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48cc0ce8b0 0x7f48cc150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48cc0ce8b0 0x7f48cc150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55986/0 (socket says 172.21.15.57:55986) 2023-11-24T08:07:13.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 -- 172.21.15.57:0/730834719 learned_addr learned my addr 172.21.15.57:0/730834719 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48c3fff640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cb59e640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 -- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 msgr2=0x7f48cc157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 -- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 msgr2=0x7f48cc14e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc14e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cad9d640 1 -- 172.21.15.57:0/730834719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40094d0 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.663+0000 7f48cb59e640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:13.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48cad9d640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48cc0ce8b0 0x7f48cc150520 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f48bc000c10 tx=0x7f48bc01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48c37fe640 1 -- 172.21.15.57:0/730834719 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc004230 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48c37fe640 1 -- 172.21.15.57:0/730834719 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc004390 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48c37fe640 1 -- 172.21.15.57:0/730834719 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc003820 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc009420 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc1563e0 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc067520 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48c37fe640 1 -- 172.21.15.57:0/730834719 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f48bc0b3050 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48c37fe640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48ac066620 0x7f48ac068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:13.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48c37fe640 1 -- 172.21.15.57:0/730834719 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f48bc11d9f0 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.667+0000 7f48c3fff640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48ac066620 0x7f48ac068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:13.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.671+0000 7f48c3fff640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48ac066620 0x7f48ac068ae0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f48cc160d60 tx=0x7f48b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:13.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.671+0000 7f48c37fe640 1 -- 172.21.15.57:0/730834719 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48bc0eabb0 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48cc06b7b0 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48c37fe640 1 -- 172.21.15.57:0/730834719 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f48bc0bf090 con 0x7f48cc0ce8b0 2023-11-24T08:07:13.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:13.867 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:05:24.160281+0000","modified":"2023-11-24T08:05:27.205680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55016":{"gid":55016,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1528560341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1528560341},{"type":"v1","addr":"172.21.15.132:6837","nonce":1528560341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:07:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 26 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48ac066620 msgr2=0x7f48ac068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48ac066620 0x7f48ac068ae0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f48cc160d60 tx=0x7f48b4008040 comp rx=0 tx=0).stop 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48cc0ce8b0 msgr2=0x7f48cc150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48cc0ce8b0 0x7f48cc150520 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f48bc000c10 tx=0x7f48bc01ac00 comp rx=0 tx=0).stop 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 shutdown_connections 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f48ac066620 0x7f48ac068ae0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48cc15d570 0x7f48cc14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48cc0d3020 0x7f48cc157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 --2- 172.21.15.57:0/730834719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48cc0ce8b0 0x7f48cc150520 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 >> 172.21.15.57:0/730834719 conn(0x7f48cc08ceb0 msgr2=0x7f48cc0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 shutdown_connections 2023-11-24T08:07:13.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:13.863+0000 7f48d11ec640 1 -- 172.21.15.57:0/730834719 wait complete. 2023-11-24T08:07:13.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:14.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f9679640 1 Processor -- start 2023-11-24T08:07:14.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f9679640 1 -- start start 2023-11-24T08:07:14.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f9679640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f16f40ce710 0x7f16f4070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f9679640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f406acc0 con 0x7f16f406dd30 2023-11-24T08:07:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f9679640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f406af20 con 0x7f16f415d4f0 2023-11-24T08:07:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f9679640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f406bba0 con 0x7f16f40ce710 2023-11-24T08:07:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f37fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f16f406dd30 0x7f16f4167120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49278/0 (socket says 172.21.15.57:49278) 2023-11-24T08:07:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f37fe640 1 -- 172.21.15.57:0/1167419246 learned_addr learned my addr 172.21.15.57:0/1167419246 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16ebfff640 1 --2- 172.21.15.57:0/1167419246 >> v2:172.21.15.132:3300/0 conn(0x7f16f40ce710 0x7f16f4070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437792637 0 0) 0x7f16f406acc0 con 0x7f16f406dd30 2023-11-24T08:07:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e0003530 con 0x7f16f406dd30 2023-11-24T08:07:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.027+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472727042 0 0) 0x7f16e0003530 con 0x7f16f406dd30 2023-11-24T08:07:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 >> v2:172.21.15.132:3300/0 conn(0x7f16f40ce710 msgr2=0x7f16f4070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 --2- 172.21.15.57:0/1167419246 >> v2:172.21.15.132:3300/0 conn(0x7f16f40ce710 0x7f16f4070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 >> v1:172.21.15.132:6789/0 conn(0x7f16f415d4f0 legacy=0x7f16f406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f406b200 con 0x7f16f406dd30 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f16ec001a00 con 0x7f16f406dd30 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 >> v1:172.21.15.57:6789/0 conn(0x7f16f406dd30 legacy=0x7f16f4167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16e0003980 0x7f16e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16e00047d0 0x7f16e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0005190 0x7f16e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f406bba0 con 0x7f16e0003980 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e000c030 con 0x7f16e0005190 2023-11-24T08:07:14.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e000c1f0 con 0x7f16e00047d0 2023-11-24T08:07:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f2ffd640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16e0003980 0x7f16e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16ebfff640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16e00047d0 0x7f16e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f37fe640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0005190 0x7f16e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f2ffd640 1 -- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16e00047d0 msgr2=0x7f16e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f2ffd640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16e00047d0 0x7f16e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f2ffd640 1 -- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0005190 msgr2=0x7f16e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:14.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f2ffd640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0005190 0x7f16e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f2ffd640 1 -- 172.21.15.57:0/1167419246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0003530 con 0x7f16e0003980 2023-11-24T08:07:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f37fe640 1 -- 172.21.15.57:0/1167419246 reap_dead start 2023-11-24T08:07:14.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16ebfff640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16e00047d0 0x7f16e0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:14.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f2ffd640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16e0003980 0x7f16e0003da0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f16e4001780 tx=0x7f16e401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f666543d988e0b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40052d0 con 0x7f16e0003980 2023-11-24T08:07:14.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40a7050 con 0x7f16e0003980 2023-11-24T08:07:14.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.031+0000 7f16f27fc640 1 -- 172.21.15.57:0/1167419246 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4003600 con 0x7f16e0003980 2023-11-24T08:07:14.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- 172.21.15.57:0/1167419246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16e0003980 msgr2=0x7f16e0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16e0003980 0x7f16e0003da0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f16e4001780 tx=0x7f16e401c3b0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- 172.21.15.57:0/1167419246 shutdown_connections 2023-11-24T08:07:14.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 --2- 172.21.15.57:0/1167419246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16e0003980 0x7f16e0003da0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- 172.21.15.57:0/1167419246 >> 172.21.15.57:0/1167419246 conn(0x7f16f40cc330 msgr2=0x7f16f40cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- 172.21.15.57:0/1167419246 shutdown_connections 2023-11-24T08:07:14.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- 172.21.15.57:0/1167419246 wait complete. 2023-11-24T08:07:14.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 Processor -- start 2023-11-24T08:07:14.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- start start 2023-11-24T08:07:14.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0003980 0x7f16f41f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16f4153730 0x7f16f4154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f4156520 0x7f16f41569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4154070 con 0x7f16f4156520 2023-11-24T08:07:14.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f41588e0 con 0x7f16e0003980 2023-11-24T08:07:14.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f9679640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4154310 con 0x7f16f4153730 2023-11-24T08:07:14.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f4156520 0x7f16f41569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f4156520 0x7f16f41569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56004/0 (socket says 172.21.15.57:56004) 2023-11-24T08:07:14.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f37fe640 1 -- 172.21.15.57:0/2001536898 learned_addr learned my addr 172.21.15.57:0/2001536898 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:14.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16f2ffd640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0003980 0x7f16f41f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.035+0000 7f16ebfff640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16f4153730 0x7f16f4154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f37fe640 1 -- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16f4153730 msgr2=0x7f16f4154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f37fe640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16f4153730 0x7f16f4154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f37fe640 1 -- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0003980 msgr2=0x7f16f41f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f37fe640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0003980 0x7f16f41f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f37fe640 1 -- 172.21.15.57:0/2001536898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f41545f0 con 0x7f16f4156520 2023-11-24T08:07:14.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f37fe640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f4156520 0x7f16f41569a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f16f40af520 tx=0x7f16ec007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16eb7fe640 1 -- 172.21.15.57:0/2001536898 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00e9c0 con 0x7f16f4156520 2023-11-24T08:07:14.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16eb7fe640 1 -- 172.21.15.57:0/2001536898 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00eb20 con 0x7f16f4156520 2023-11-24T08:07:14.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16eb7fe640 1 -- 172.21.15.57:0/2001536898 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00eed0 con 0x7f16f4156520 2023-11-24T08:07:14.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f4158ba0 con 0x7f16f4156520 2023-11-24T08:07:14.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f41f6380 con 0x7f16f4156520 2023-11-24T08:07:14.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f4158d90 con 0x7f16f4156520 2023-11-24T08:07:14.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16eb7fe640 1 -- 172.21.15.57:0/2001536898 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f16ec01d460 con 0x7f16f4156520 2023-11-24T08:07:14.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16eb7fe640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f16d4066620 0x7f16d4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.039+0000 7f16eb7fe640 1 -- 172.21.15.57:0/2001536898 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f16ec084460 con 0x7f16f4156520 2023-11-24T08:07:14.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.043+0000 7f16f2ffd640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f16d4066620 0x7f16d4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.043+0000 7f16f2ffd640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f16d4066620 0x7f16d4068ae0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16e4001750 tx=0x7f16e40011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.043+0000 7f16eb7fe640 1 -- 172.21.15.57:0/2001536898 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16ec0516d0 con 0x7f16f4156520 2023-11-24T08:07:14.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f4067520 con 0x7f16f4156520 2023-11-24T08:07:14.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16eb7fe640 1 -- 172.21.15.57:0/2001536898 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f16ec05b020 con 0x7f16f4156520 2023-11-24T08:07:14.208 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:14.208 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":50,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:05:41.507365+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:05:22.550537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:05:23.148396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.3c","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f16d4066620 msgr2=0x7f16d4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f16d4066620 0x7f16d4068ae0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16e4001750 tx=0x7f16e40011a0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f4156520 msgr2=0x7f16f41569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f4156520 0x7f16f41569a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f16f40af520 tx=0x7f16ec007ad0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 shutdown_connections 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f16d4066620 0x7f16d4068ae0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f4156520 0x7f16f41569a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16f4153730 0x7f16f4154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.203+0000 7f16f9679640 1 --2- 172.21.15.57:0/2001536898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16e0003980 0x7f16f41f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.207+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 >> 172.21.15.57:0/2001536898 conn(0x7f16f40cc330 msgr2=0x7f16f40aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.207+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 shutdown_connections 2023-11-24T08:07:14.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.207+0000 7f16f9679640 1 -- 172.21.15.57:0/2001536898 wait complete. 2023-11-24T08:07:14.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:07:14.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.367+0000 7fe3218e4640 1 Processor -- start 2023-11-24T08:07:14.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe3218e4640 1 -- start start 2023-11-24T08:07:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe3218e4640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe31c15a4d0 0x7fe31c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe3218e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe31c0cad20 0x7fe31c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe3218e4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c15a8b0 con 0x7fe31c06d740 2023-11-24T08:07:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe3218e4640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c0c9c30 con 0x7fe31c15a4d0 2023-11-24T08:07:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe3218e4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c15ee80 con 0x7fe31c0cad20 2023-11-24T08:07:14.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe31affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe31c15a4d0 0x7fe31c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe31affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe31c15a4d0 0x7fe31c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56020/0 (socket says 172.21.15.57:56020) 2023-11-24T08:07:14.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe31affd640 1 -- 172.21.15.57:0/1672786574 learned_addr learned my addr 172.21.15.57:0/1672786574 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:14.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe313fff640 1 --2- 172.21.15.57:0/1672786574 >> v2:172.21.15.132:3300/0 conn(0x7fe31c0cad20 0x7fe31c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe31affd640 1 -- 172.21.15.57:0/1672786574 >> v2:172.21.15.132:3300/0 conn(0x7fe31c0cad20 msgr2=0x7fe31c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:14.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe31affd640 1 --2- 172.21.15.57:0/1672786574 >> v2:172.21.15.132:3300/0 conn(0x7fe31c0cad20 0x7fe31c15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe31affd640 1 -- 172.21.15.57:0/1672786574 >> v1:172.21.15.132:6789/0 conn(0x7fe31c06d740 legacy=0x7fe31c06db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.371+0000 7fe31affd640 1 -- 172.21.15.57:0/1672786574 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0c9f60 con 0x7fe31c15a4d0 2023-11-24T08:07:14.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe31affd640 1 --2- 172.21.15.57:0/1672786574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0c9650 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0cb9a0 tx=0x7fe30c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde762aeec657748 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe31a7fc640 1 -- 172.21.15.57:0/1672786574 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0ab640 con 0x7fe31c15a4d0 2023-11-24T08:07:14.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe31a7fc640 1 -- 172.21.15.57:0/1672786574 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c0a7070 con 0x7fe31c15a4d0 2023-11-24T08:07:14.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe31a7fc640 1 -- 172.21.15.57:0/1672786574 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0ab9c0 con 0x7fe31c15a4d0 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 -- 172.21.15.57:0/1672786574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 msgr2=0x7fe31c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 --2- 172.21.15.57:0/1672786574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0c9650 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0cb9a0 tx=0x7fe30c01c440 comp rx=0 tx=0).stop 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 -- 172.21.15.57:0/1672786574 shutdown_connections 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 --2- 172.21.15.57:0/1672786574 >> v2:172.21.15.132:3300/0 conn(0x7fe31c0cad20 0x7fe31c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 --2- 172.21.15.57:0/1672786574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0c9650 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 -- 172.21.15.57:0/1672786574 >> 172.21.15.57:0/1672786574 conn(0x7fe31c0b0bf0 msgr2=0x7fe31c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 -- 172.21.15.57:0/1672786574 shutdown_connections 2023-11-24T08:07:14.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 -- 172.21.15.57:0/1672786574 wait complete. 2023-11-24T08:07:14.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 Processor -- start 2023-11-24T08:07:14.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.375+0000 7fe3218e4640 1 -- start start 2023-11-24T08:07:14.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe31c06d740 0x7fe31c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe31c0cad20 0x7fe31c14e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0c4ae0 con 0x7fe31c15a4d0 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c071fb0 con 0x7fe31c0cad20 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c09cac0 con 0x7fe31c06d740 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56028/0 (socket says 172.21.15.57:56028) 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 -- 172.21.15.57:0/4126515545 learned_addr learned my addr 172.21.15.57:0/4126515545 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe313fff640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe31c0cad20 0x7fe31c14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31affd640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe31c06d740 0x7fe31c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 -- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe31c06d740 msgr2=0x7fe31c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe31c06d740 0x7fe31c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 -- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe31c0cad20 msgr2=0x7fe31c14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe31c0cad20 0x7fe31c14e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 -- 172.21.15.57:0/4126515545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0094d0 con 0x7fe31c15a4d0 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe31b7fe640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0ad050 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c770 tx=0x7fe31400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe318ff9640 1 -- 172.21.15.57:0/4126515545 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314003b80 con 0x7fe31c15a4d0 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe318ff9640 1 -- 172.21.15.57:0/4126515545 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe314003ce0 con 0x7fe31c15a4d0 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c0c4d10 con 0x7fe31c15a4d0 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe318ff9640 1 -- 172.21.15.57:0/4126515545 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31400aa90 con 0x7fe31c15a4d0 2023-11-24T08:07:14.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c0c52d0 con 0x7fe31c15a4d0 2023-11-24T08:07:14.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c09d250 con 0x7fe31c15a4d0 2023-11-24T08:07:14.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.379+0000 7fe318ff9640 1 -- 172.21.15.57:0/4126515545 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe31400abf0 con 0x7fe31c15a4d0 2023-11-24T08:07:14.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.383+0000 7fe318ff9640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe2fc066620 0x7fe2fc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.383+0000 7fe318ff9640 1 -- 172.21.15.57:0/4126515545 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe314083f90 con 0x7fe31c15a4d0 2023-11-24T08:07:14.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.383+0000 7fe31affd640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe2fc066620 0x7fe2fc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.383+0000 7fe31affd640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe2fc066620 0x7fe2fc068ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0af000 tx=0x7fe30c0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.387+0000 7fe318ff9640 1 -- 172.21.15.57:0/4126515545 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe314051160 con 0x7fe31c15a4d0 2023-11-24T08:07:14.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.579+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe31c04e930 con 0x7fe31c15a4d0 2023-11-24T08:07:14.583 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-11-24T08:07:14.579+0000 7f305c7a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:07:14.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.579+0000 7fe318ff9640 1 -- 172.21.15.57:0/4126515545 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe314054780 con 0x7fe31c15a4d0 2023-11-24T08:07:14.585 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:07:14.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe2fc066620 msgr2=0x7fe2fc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe2fc066620 0x7fe2fc068ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0af000 tx=0x7fe30c0b6040 comp rx=0 tx=0).stop 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 msgr2=0x7fe31c0ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0ad050 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c770 tx=0x7fe31400cc30 comp rx=0 tx=0).stop 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 shutdown_connections 2023-11-24T08:07:14.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe2fc066620 0x7fe2fc068ae0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe31c15a4d0 0x7fe31c0ad050 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe31c0cad20 0x7fe31c14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 --2- 172.21.15.57:0/4126515545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe31c06d740 0x7fe31c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 >> 172.21.15.57:0/4126515545 conn(0x7fe31c0b0bf0 msgr2=0x7fe31c155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 shutdown_connections 2023-11-24T08:07:14.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.583+0000 7fe3218e4640 1 -- 172.21.15.57:0/4126515545 wait complete. 2023-11-24T08:07:14.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:07:14.657 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-11-24T08:07:14.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff793832640 1 Processor -- start 2023-11-24T08:07:14.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff793832640 1 -- start start 2023-11-24T08:07:14.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff793832640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c1624f0 0x7ff78c1628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff793832640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff78c0cd350 0x7ff78c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff793832640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c0723c0 con 0x7ff78c0ccef0 2023-11-24T08:07:14.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff793832640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c072980 con 0x7ff78c0cd350 2023-11-24T08:07:14.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff793832640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0726a0 con 0x7ff78c1624f0 2023-11-24T08:07:14.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff790dcd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff78c0ccef0 0x7ff78c071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49286/0 (socket says 172.21.15.57:49286) 2023-11-24T08:07:14.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.751+0000 7ff790dcd640 1 -- 172.21.15.57:0/4018651136 learned_addr learned my addr 172.21.15.57:0/4018651136 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:14.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff791dcf640 1 --2- 172.21.15.57:0/4018651136 >> v2:172.21.15.132:3300/0 conn(0x7ff78c0cd350 0x7ff78c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff7915ce640 1 --2- 172.21.15.57:0/4018651136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c1624f0 0x7ff78c1628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff783fff640 1 -- 172.21.15.57:0/4018651136 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205467899 0 0) 0x7ff78c0723c0 con 0x7ff78c0ccef0 2023-11-24T08:07:14.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff783fff640 1 -- 172.21.15.57:0/4018651136 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff778003530 con 0x7ff78c0ccef0 2023-11-24T08:07:14.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff7915ce640 1 -- 172.21.15.57:0/4018651136 >> v2:172.21.15.132:3300/0 conn(0x7ff78c0cd350 msgr2=0x7ff78c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:14.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff7915ce640 1 --2- 172.21.15.57:0/4018651136 >> v2:172.21.15.132:3300/0 conn(0x7ff78c0cd350 0x7ff78c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff7915ce640 1 -- 172.21.15.57:0/4018651136 >> v1:172.21.15.57:6789/0 conn(0x7ff78c0ccef0 legacy=0x7ff78c071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff7915ce640 1 -- 172.21.15.57:0/4018651136 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c06c7e0 con 0x7ff78c1624f0 2023-11-24T08:07:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff7915ce640 1 --2- 172.21.15.57:0/4018651136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c1624f0 0x7ff78c1628d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b26c9c152a914b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff783fff640 1 -- 172.21.15.57:0/4018651136 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880ab600 con 0x7ff78c1624f0 2023-11-24T08:07:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff783fff640 1 -- 172.21.15.57:0/4018651136 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880a7050 con 0x7ff78c1624f0 2023-11-24T08:07:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.755+0000 7ff783fff640 1 -- 172.21.15.57:0/4018651136 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880ab980 con 0x7ff78c1624f0 2023-11-24T08:07:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- 172.21.15.57:0/4018651136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c1624f0 msgr2=0x7ff78c1628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 --2- 172.21.15.57:0/4018651136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c1624f0 0x7ff78c1628d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801c3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- 172.21.15.57:0/4018651136 shutdown_connections 2023-11-24T08:07:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 --2- 172.21.15.57:0/4018651136 >> v2:172.21.15.132:3300/0 conn(0x7ff78c0cd350 0x7ff78c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 --2- 172.21.15.57:0/4018651136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c1624f0 0x7ff78c1628d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- 172.21.15.57:0/4018651136 >> 172.21.15.57:0/4018651136 conn(0x7ff78c0b0c80 msgr2=0x7ff78c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- 172.21.15.57:0/4018651136 shutdown_connections 2023-11-24T08:07:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- 172.21.15.57:0/4018651136 wait complete. 2023-11-24T08:07:14.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 Processor -- start 2023-11-24T08:07:14.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- start start 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c0ccef0 0x7ff78c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c0cd350 0x7ff78c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff78c1624f0 0x7ff78c15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c15fe10 con 0x7ff78c1624f0 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0ad210 con 0x7ff78c0ccef0 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff793832640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c160060 con 0x7ff78c0cd350 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff791dcf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff78c1624f0 0x7ff78c15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff791dcf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff78c1624f0 0x7ff78c15c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56044/0 (socket says 172.21.15.57:56044) 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff791dcf640 1 -- 172.21.15.57:0/2924601542 learned_addr learned my addr 172.21.15.57:0/2924601542 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.759+0000 7ff7915ce640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c0ccef0 0x7ff78c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff790dcd640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c0cd350 0x7ff78c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff791dcf640 1 -- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c0cd350 msgr2=0x7ff78c15e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff791dcf640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c0cd350 0x7ff78c15e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff791dcf640 1 -- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c0ccef0 msgr2=0x7ff78c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:14.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff791dcf640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c0ccef0 0x7ff78c0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:14.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff791dcf640 1 -- 172.21.15.57:0/2924601542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff788009420 con 0x7ff78c1624f0 2023-11-24T08:07:14.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff7915ce640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c0ccef0 0x7ff78c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:14.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff791dcf640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff78c1624f0 0x7ff78c15c1b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff78400efc0 tx=0x7ff78400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff781ffb640 1 -- 172.21.15.57:0/2924601542 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784014480 con 0x7ff78c1624f0 2023-11-24T08:07:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff781ffb640 1 -- 172.21.15.57:0/2924601542 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78400f040 con 0x7ff78c1624f0 2023-11-24T08:07:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff781ffb640 1 -- 172.21.15.57:0/2924601542 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784014820 con 0x7ff78c1624f0 2023-11-24T08:07:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c160340 con 0x7ff78c1624f0 2023-11-24T08:07:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c160900 con 0x7ff78c1624f0 2023-11-24T08:07:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c04e8c0 con 0x7ff78c1624f0 2023-11-24T08:07:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff781ffb640 1 -- 172.21.15.57:0/2924601542 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ff784014980 con 0x7ff78c1624f0 2023-11-24T08:07:14.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.763+0000 7ff781ffb640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff770066620 0x7ff770068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:14.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.767+0000 7ff781ffb640 1 -- 172.21.15.57:0/2924601542 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff784084f00 con 0x7ff78c1624f0 2023-11-24T08:07:14.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.767+0000 7ff7915ce640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff770066620 0x7ff770068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:14.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.767+0000 7ff7915ce640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff770066620 0x7ff770068ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff7880ad000 tx=0x7ff7880a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:14.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.767+0000 7ff781ffb640 1 -- 172.21.15.57:0/2924601542 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff784051f60 con 0x7ff78c1624f0 2023-11-24T08:07:14.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:14.959+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff78c16d760 con 0x7ff78c1624f0 2023-11-24T08:07:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.587+0000 7ff781ffb640 1 -- 172.21.15.57:0/2924601542 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff7840180a0 con 0x7ff78c1624f0 2023-11-24T08:07:15.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff770066620 msgr2=0x7ff770068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff770066620 0x7ff770068ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff7880ad000 tx=0x7ff7880a6000 comp rx=0 tx=0).stop 2023-11-24T08:07:15.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff78c1624f0 msgr2=0x7ff78c15c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff78c1624f0 0x7ff78c15c1b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff78400efc0 tx=0x7ff78400c490 comp rx=0 tx=0).stop 2023-11-24T08:07:15.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 shutdown_connections 2023-11-24T08:07:15.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff770066620 0x7ff770068ae0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff78c1624f0 0x7ff78c15c1b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c0cd350 0x7ff78c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 --2- 172.21.15.57:0/2924601542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c0ccef0 0x7ff78c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 >> 172.21.15.57:0/2924601542 conn(0x7ff78c0b0c80 msgr2=0x7ff78c0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:15.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 shutdown_connections 2023-11-24T08:07:15.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.591+0000 7ff793832640 1 -- 172.21.15.57:0/2924601542 wait complete. 2023-11-24T08:07:15.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:07:15.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.763+0000 7ff7c8432640 1 Processor -- start 2023-11-24T08:07:15.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.763+0000 7ff7c8432640 1 -- start start 2023-11-24T08:07:15.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.763+0000 7ff7c8432640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c0144030 0x7ff7c006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.763+0000 7ff7c8432640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff7c009cc20 0x7ff7c006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.763+0000 7ff7c8432640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c006d8b0 con 0x7ff7c006e280 2023-11-24T08:07:15.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.763+0000 7ff7c8432640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c0145020 con 0x7ff7c009cc20 2023-11-24T08:07:15.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.763+0000 7ff7c8432640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c009d0a0 con 0x7ff7c0144030 2023-11-24T08:07:15.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c59cd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff7c009cc20 0x7ff7c006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c69cf640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff7c006e280 0x7ff7c00709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33610/0 (socket says 172.21.15.57:33610) 2023-11-24T08:07:15.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c69cf640 1 -- 172.21.15.57:0/1241416128 learned_addr learned my addr 172.21.15.57:0/1241416128 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:15.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c61ce640 1 --2- 172.21.15.57:0/1241416128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c0144030 0x7ff7c006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c59cd640 1 -- 172.21.15.57:0/1241416128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c0144030 msgr2=0x7ff7c006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c51cc640 1 -- 172.21.15.57:0/1241416128 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540727751 0 0) 0x7ff7c006d8b0 con 0x7ff7c006e280 2023-11-24T08:07:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c59cd640 1 --2- 172.21.15.57:0/1241416128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c0144030 0x7ff7c006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c59cd640 1 -- 172.21.15.57:0/1241416128 >> v1:172.21.15.57:6789/0 conn(0x7ff7c006e280 legacy=0x7ff7c00709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c59cd640 1 -- 172.21.15.57:0/1241416128 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c006cca0 con 0x7ff7c009cc20 2023-11-24T08:07:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c59cd640 1 --2- 172.21.15.57:0/1241416128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c006dd40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00097c0 tx=0x7ff7b001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790b57434af0886b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c51cc640 1 -- 172.21.15.57:0/1241416128 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00ab650 con 0x7ff7c009cc20 2023-11-24T08:07:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c51cc640 1 -- 172.21.15.57:0/1241416128 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00ab7b0 con 0x7ff7c009cc20 2023-11-24T08:07:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.767+0000 7ff7c51cc640 1 -- 172.21.15.57:0/1241416128 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00abb40 con 0x7ff7c009cc20 2023-11-24T08:07:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- 172.21.15.57:0/1241416128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 msgr2=0x7ff7c006dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 --2- 172.21.15.57:0/1241416128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c006dd40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00097c0 tx=0x7ff7b001c450 comp rx=0 tx=0).stop 2023-11-24T08:07:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- 172.21.15.57:0/1241416128 shutdown_connections 2023-11-24T08:07:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 --2- 172.21.15.57:0/1241416128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c006dd40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 --2- 172.21.15.57:0/1241416128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c0144030 0x7ff7c006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- 172.21.15.57:0/1241416128 >> 172.21.15.57:0/1241416128 conn(0x7ff7c00b0bf0 msgr2=0x7ff7c00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- 172.21.15.57:0/1241416128 shutdown_connections 2023-11-24T08:07:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- 172.21.15.57:0/1241416128 wait complete. 2023-11-24T08:07:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 Processor -- start 2023-11-24T08:07:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- start start 2023-11-24T08:07:15.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c006e280 0x7ff7c0132740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7c0144030 0x7ff7c013f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c013fa80 con 0x7ff7c009cc20 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01339e0 con 0x7ff7c0144030 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c8432640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0132dd0 con 0x7ff7c006e280 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c59cd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c59cd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c015aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53298/0 (socket says 172.21.15.57:53298) 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c59cd640 1 -- 172.21.15.57:0/4140213996 learned_addr learned my addr 172.21.15.57:0/4140213996 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c61ce640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c006e280 0x7ff7c0132740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.771+0000 7ff7c69cf640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7c0144030 0x7ff7c013f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c59cd640 1 -- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c006e280 msgr2=0x7ff7c0132740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c59cd640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c006e280 0x7ff7c0132740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c59cd640 1 -- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7c0144030 msgr2=0x7ff7c013f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:15.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c59cd640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7c0144030 0x7ff7c013f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:15.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c59cd640 1 -- 172.21.15.57:0/4140213996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0009420 con 0x7ff7c009cc20 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c59cd640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c015aec0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff7b001a080 tx=0x7ff7b001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7b6ffd640 1 -- 172.21.15.57:0/4140213996 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0004220 con 0x7ff7c009cc20 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7b6ffd640 1 -- 172.21.15.57:0/4140213996 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00b9070 con 0x7ff7c009cc20 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7b6ffd640 1 -- 172.21.15.57:0/4140213996 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0003620 con 0x7ff7c009cc20 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c01330b0 con 0x7ff7c009cc20 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c0133670 con 0x7ff7c009cc20 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c0067520 con 0x7ff7c009cc20 2023-11-24T08:07:15.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7b6ffd640 1 -- 172.21.15.57:0/4140213996 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ff7b0003780 con 0x7ff7c009cc20 2023-11-24T08:07:15.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7b6ffd640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff7a4066620 0x7ff7a4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:15.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.775+0000 7ff7b6ffd640 1 -- 172.21.15.57:0/4140213996 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff7b00bb070 con 0x7ff7c009cc20 2023-11-24T08:07:15.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.779+0000 7ff7c61ce640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff7a4066620 0x7ff7a4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:15.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.779+0000 7ff7c61ce640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff7a4066620 0x7ff7a4068ae0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009ac0 tx=0x7ff7bc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:15.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.779+0000 7ff7b6ffd640 1 -- 172.21.15.57:0/4140213996 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7b00ebf30 con 0x7ff7c009cc20 2023-11-24T08:07:15.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:15.939+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7c013b250 con 0x7ff7c009cc20 2023-11-24T08:07:16.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7b6ffd640 1 -- 172.21.15.57:0/4140213996 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff7b00c4070 con 0x7ff7c009cc20 2023-11-24T08:07:16.594 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:07:16.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff7a4066620 msgr2=0x7ff7a4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff7a4066620 0x7ff7a4068ae0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009ac0 tx=0x7ff7bc009190 comp rx=0 tx=0).stop 2023-11-24T08:07:16.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 msgr2=0x7ff7c015aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c015aec0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff7b001a080 tx=0x7ff7b001ac90 comp rx=0 tx=0).stop 2023-11-24T08:07:16.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 shutdown_connections 2023-11-24T08:07:16.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff7a4066620 0x7ff7a4068ae0 secure :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009ac0 tx=0x7ff7bc009190 comp rx=0 tx=0).stop 2023-11-24T08:07:16.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7c0144030 0x7ff7c013f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7c009cc20 0x7ff7c015aec0 secure :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff7b001a080 tx=0x7ff7b001ac90 comp rx=0 tx=0).stop 2023-11-24T08:07:16.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 --2- 172.21.15.57:0/4140213996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7c006e280 0x7ff7c0132740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.591+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 >> 172.21.15.57:0/4140213996 conn(0x7ff7c00b0bf0 msgr2=0x7ff7c013b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:16.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.595+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 shutdown_connections 2023-11-24T08:07:16.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.595+0000 7ff7c8432640 1 -- 172.21.15.57:0/4140213996 wait complete. 2023-11-24T08:07:16.623 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:07:16.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.767+0000 7f90e0017640 1 Processor -- start 2023-11-24T08:07:16.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.767+0000 7f90e0017640 1 -- start start 2023-11-24T08:07:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90e0017640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90d815a320 0x7f90d80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90e0017640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d8070da0 0x7f90d815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90e0017640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d815a700 con 0x7f90d80b36c0 2023-11-24T08:07:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90e0017640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80b2430 con 0x7f90d815a320 2023-11-24T08:07:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90e0017640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80b2620 con 0x7f90d8070da0 2023-11-24T08:07:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90d815a320 0x7f90d80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90d815a320 0x7f90d80b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53308/0 (socket says 172.21.15.57:53308) 2023-11-24T08:07:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 -- 172.21.15.57:0/731550272 learned_addr learned my addr 172.21.15.57:0/731550272 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90de5b4640 1 --2- 172.21.15.57:0/731550272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d8070da0 0x7f90d815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 -- 172.21.15.57:0/731550272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d8070da0 msgr2=0x7f90d815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 --2- 172.21.15.57:0/731550272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d8070da0 0x7f90d815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 -- 172.21.15.57:0/731550272 >> v1:172.21.15.132:6789/0 conn(0x7f90d80b36c0 legacy=0x7f90d8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 -- 172.21.15.57:0/731550272 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80b2900 con 0x7f90d815a320 2023-11-24T08:07:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90de5b4640 1 --2- 172.21.15.57:0/731550272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d8070da0 0x7f90d815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.771+0000 7f90dddb3640 1 --2- 172.21.15.57:0/731550272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d815a320 0x7f90d80b1ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009870 tx=0x7f90d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca465b3a7908ae62 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90dcdb1640 1 -- 172.21.15.57:0/731550272 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40ac600 con 0x7f90d815a320 2023-11-24T08:07:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90dcdb1640 1 -- 172.21.15.57:0/731550272 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40a8050 con 0x7f90d815a320 2023-11-24T08:07:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90dcdb1640 1 -- 172.21.15.57:0/731550272 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40ac980 con 0x7f90d815a320 2023-11-24T08:07:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- 172.21.15.57:0/731550272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d815a320 msgr2=0x7f90d80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 --2- 172.21.15.57:0/731550272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d815a320 0x7f90d80b1ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009870 tx=0x7f90d401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- 172.21.15.57:0/731550272 shutdown_connections 2023-11-24T08:07:16.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 --2- 172.21.15.57:0/731550272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d8070da0 0x7f90d815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 --2- 172.21.15.57:0/731550272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d815a320 0x7f90d80b1ef0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- 172.21.15.57:0/731550272 >> 172.21.15.57:0/731550272 conn(0x7f90d80b0bf0 msgr2=0x7f90d80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:16.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- 172.21.15.57:0/731550272 shutdown_connections 2023-11-24T08:07:16.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- 172.21.15.57:0/731550272 wait complete. 2023-11-24T08:07:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 Processor -- start 2023-11-24T08:07:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- start start 2023-11-24T08:07:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d8070da0 0x7f90d81636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d80b36c0 0x7f90d809be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d815a320 0x7f90d8158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d81606c0 con 0x7f90d8070da0 2023-11-24T08:07:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8160090 con 0x7f90d815a320 2023-11-24T08:07:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90e0017640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8163d50 con 0x7f90d80b36c0 2023-11-24T08:07:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90dddb3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d8070da0 0x7f90d81636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90dddb3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d8070da0 0x7f90d81636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53316/0 (socket says 172.21.15.57:53316) 2023-11-24T08:07:16.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.775+0000 7f90dddb3640 1 -- 172.21.15.57:0/3146522146 learned_addr learned my addr 172.21.15.57:0/3146522146 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:16.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90dd5b2640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d80b36c0 0x7f90d809be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90de5b4640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d815a320 0x7f90d8158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90dddb3640 1 -- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d80b36c0 msgr2=0x7f90d809be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90dddb3640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d80b36c0 0x7f90d809be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90dddb3640 1 -- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d815a320 msgr2=0x7f90d8158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90dddb3640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d815a320 0x7f90d8158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90dddb3640 1 -- 172.21.15.57:0/3146522146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40094d0 con 0x7f90d8070da0 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90dddb3640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d8070da0 0x7f90d81636b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f90d401cd70 tx=0x7f90d401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90ce7fc640 1 -- 172.21.15.57:0/3146522146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40b7620 con 0x7f90d8070da0 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90ce7fc640 1 -- 172.21.15.57:0/3146522146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40b77a0 con 0x7f90d8070da0 2023-11-24T08:07:16.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90ce7fc640 1 -- 172.21.15.57:0/3146522146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40b7b50 con 0x7f90d8070da0 2023-11-24T08:07:16.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d8160350 con 0x7f90d8070da0 2023-11-24T08:07:16.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d809c390 con 0x7f90d8070da0 2023-11-24T08:07:16.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d8067520 con 0x7f90d8070da0 2023-11-24T08:07:16.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90ce7fc640 1 -- 172.21.15.57:0/3146522146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f90d40b3040 con 0x7f90d8070da0 2023-11-24T08:07:16.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90ce7fc640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f90bc066620 0x7f90bc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:16.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.779+0000 7f90ce7fc640 1 -- 172.21.15.57:0/3146522146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f90d411e4f0 con 0x7f90d8070da0 2023-11-24T08:07:16.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.783+0000 7f90dd5b2640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f90bc066620 0x7f90bc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:16.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.783+0000 7f90dd5b2640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f90bc066620 0x7f90bc068ae0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f90d80cac60 tx=0x7f90c8007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:16.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.783+0000 7f90ce7fc640 1 -- 172.21.15.57:0/3146522146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90d40eb710 con 0x7f90d8070da0 2023-11-24T08:07:16.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:16.955+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90d806dcb0 con 0x7f90d8070da0 2023-11-24T08:07:17.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.595+0000 7f90ce7fc640 1 -- 172.21.15.57:0/3146522146 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7f90d40eed30 con 0x7f90d8070da0 2023-11-24T08:07:17.601 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-11-24T08:07:17.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f90bc066620 msgr2=0x7f90bc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f90bc066620 0x7f90bc068ae0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f90d80cac60 tx=0x7f90c8007e40 comp rx=0 tx=0).stop 2023-11-24T08:07:17.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d8070da0 msgr2=0x7f90d81636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d8070da0 0x7f90d81636b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f90d401cd70 tx=0x7f90d401ad10 comp rx=0 tx=0).stop 2023-11-24T08:07:17.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 shutdown_connections 2023-11-24T08:07:17.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f90bc066620 0x7f90bc068ae0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d815a320 0x7f90d8158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90d80b36c0 0x7f90d809be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 --2- 172.21.15.57:0/3146522146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d8070da0 0x7f90d81636b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 >> 172.21.15.57:0/3146522146 conn(0x7f90d80b0bf0 msgr2=0x7f90d80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 shutdown_connections 2023-11-24T08:07:17.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.599+0000 7f90e0017640 1 -- 172.21.15.57:0/3146522146 wait complete. 2023-11-24T08:07:17.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:07:17.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.779+0000 7fe15ef65640 1 Processor -- start 2023-11-24T08:07:17.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15ef65640 1 -- start start 2023-11-24T08:07:17.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15ef65640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe15806b8f0 0x7fe15806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15ef65640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15806dd40 con 0x7fe15815d450 2023-11-24T08:07:17.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15ef65640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15806b460 con 0x7fe15806d8f0 2023-11-24T08:07:17.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15ef65640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15806a5b0 con 0x7fe15806b8f0 2023-11-24T08:07:17.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15cd01640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe15815d450 0x7fe158161af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33614/0 (socket says 172.21.15.57:33614) 2023-11-24T08:07:17.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15cd01640 1 -- 172.21.15.57:0/258165345 learned_addr learned my addr 172.21.15.57:0/258165345 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:17.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe157fff640 1 --2- 172.21.15.57:0/258165345 >> v2:172.21.15.132:3300/0 conn(0x7fe15806b8f0 0x7fe15806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214212683 0 0) 0x7fe14c001120 con 0x7fe15815d450 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe148003530 con 0x7fe15815d450 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293396731 0 0) 0x7fe15806b460 con 0x7fe15806d8f0 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c001120 con 0x7fe15806d8f0 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2912173727 0 0) 0x7fe148003530 con 0x7fe15815d450 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 >> v2:172.21.15.132:3300/0 conn(0x7fe15806b8f0 msgr2=0x7fe15806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 --2- 172.21.15.57:0/258165345 >> v2:172.21.15.132:3300/0 conn(0x7fe15806b8f0 0x7fe15806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 >> v1:172.21.15.132:6789/0 conn(0x7fe15806d8f0 legacy=0x7fe1580ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15806a850 con 0x7fe15815d450 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fe14c001810 con 0x7fe15815d450 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 >> v1:172.21.15.57:6789/0 conn(0x7fe15815d450 legacy=0x7fe158161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe148003b10 0x7fe148003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1480047d0 0x7fe148004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe148005190 0x7fe14800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15806a5b0 con 0x7fe148005190 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14800c010 con 0x7fe148003b10 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14800c1d0 con 0x7fe1480047d0 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15d502640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe148005190 0x7fe14800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15cd01640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe148003b10 0x7fe148003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe157fff640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1480047d0 0x7fe148004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15d502640 1 -- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1480047d0 msgr2=0x7fe148004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15d502640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1480047d0 0x7fe148004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15d502640 1 -- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe148003b10 msgr2=0x7fe148003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:17.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15d502640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe148003b10 0x7fe148003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.783+0000 7fe15d502640 1 -- 172.21.15.57:0/258165345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148003530 con 0x7fe148005190 2023-11-24T08:07:17.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15d502640 1 -- 172.21.15.57:0/258165345 reap_dead start 2023-11-24T08:07:17.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15d502640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe148005190 0x7fe14800b990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe150001fd0 tx=0x7fe15001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed61b7939f3350c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150003b80 con 0x7fe148005190 2023-11-24T08:07:17.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150003ce0 con 0x7fe148005190 2023-11-24T08:07:17.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe1577fe640 1 -- 172.21.15.57:0/258165345 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150005310 con 0x7fe148005190 2023-11-24T08:07:17.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15ef65640 1 -- 172.21.15.57:0/258165345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe148005190 msgr2=0x7fe14800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15ef65640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe148005190 0x7fe14800b990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe150001fd0 tx=0x7fe15001c8e0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15ef65640 1 -- 172.21.15.57:0/258165345 shutdown_connections 2023-11-24T08:07:17.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15ef65640 1 --2- 172.21.15.57:0/258165345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe148005190 0x7fe14800b990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15ef65640 1 -- 172.21.15.57:0/258165345 >> 172.21.15.57:0/258165345 conn(0x7fe1580cf8f0 msgr2=0x7fe1580cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15ef65640 1 -- 172.21.15.57:0/258165345 shutdown_connections 2023-11-24T08:07:17.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.787+0000 7fe15ef65640 1 -- 172.21.15.57:0/258165345 wait complete. 2023-11-24T08:07:17.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 Processor -- start 2023-11-24T08:07:17.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 -- start start 2023-11-24T08:07:17.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe148005190 0x7fe15815f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe15815db30 0x7fe158153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe158151400 0x7fe158153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581537b0 con 0x7fe158151400 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15815df90 con 0x7fe15815db30 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15815e1f0 con 0x7fe148005190 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe158151400 0x7fe158153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe158151400 0x7fe158153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53336/0 (socket says 172.21.15.57:53336) 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 -- 172.21.15.57:0/284034117 learned_addr learned my addr 172.21.15.57:0/284034117 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe157fff640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe15815db30 0x7fe158153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15cd01640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe148005190 0x7fe15815f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 -- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe148005190 msgr2=0x7fe15815f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe148005190 0x7fe15815f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 -- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe15815db30 msgr2=0x7fe158153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe15815db30 0x7fe158153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 -- 172.21.15.57:0/284034117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15815e4d0 con 0x7fe158151400 2023-11-24T08:07:17.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15cd01640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe148005190 0x7fe15815f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:17.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15d502640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe158151400 0x7fe158153970 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe15001c710 tx=0x7fe148005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe1557fa640 1 -- 172.21.15.57:0/284034117 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500b3070 con 0x7fe158151400 2023-11-24T08:07:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe1557fa640 1 -- 172.21.15.57:0/284034117 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500014e0 con 0x7fe158151400 2023-11-24T08:07:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15815e7b0 con 0x7fe158151400 2023-11-24T08:07:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe1557fa640 1 -- 172.21.15.57:0/284034117 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150006da0 con 0x7fe158151400 2023-11-24T08:07:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.791+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15815ed70 con 0x7fe158151400 2023-11-24T08:07:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.795+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15804e8c0 con 0x7fe158151400 2023-11-24T08:07:17.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.795+0000 7fe1557fa640 1 -- 172.21.15.57:0/284034117 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe1500a64d0 con 0x7fe158151400 2023-11-24T08:07:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.795+0000 7fe1557fa640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe13c066620 0x7fe13c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.795+0000 7fe1557fa640 1 -- 172.21.15.57:0/284034117 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1500aa070 con 0x7fe158151400 2023-11-24T08:07:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.795+0000 7fe15cd01640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe13c066620 0x7fe13c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:17.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.795+0000 7fe15cd01640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe13c066620 0x7fe13c068ae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe14c000c10 tx=0x7fe14c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:17.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.799+0000 7fe1557fa640 1 -- 172.21.15.57:0/284034117 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1500eb090 con 0x7fe158151400 2023-11-24T08:07:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.959+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe15804e8c0 con 0x7fe158151400 2023-11-24T08:07:17.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.963+0000 7fe1557fa640 1 -- 172.21.15.57:0/284034117 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1500ee6b0 con 0x7fe158151400 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe13c066620 msgr2=0x7fe13c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe13c066620 0x7fe13c068ae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe14c000c10 tx=0x7fe14c009040 comp rx=0 tx=0).stop 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe158151400 msgr2=0x7fe158153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe158151400 0x7fe158153970 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe15001c710 tx=0x7fe148005800 comp rx=0 tx=0).stop 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 shutdown_connections 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe13c066620 0x7fe13c068ae0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe158151400 0x7fe158153970 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe15815db30 0x7fe158153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 --2- 172.21.15.57:0/284034117 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe148005190 0x7fe15815f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:17.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 >> 172.21.15.57:0/284034117 conn(0x7fe1580cf8f0 msgr2=0x7fe1580affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:17.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 shutdown_connections 2023-11-24T08:07:17.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:17.967+0000 7fe15ef65640 1 -- 172.21.15.57:0/284034117 wait complete. 2023-11-24T08:07:17.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T08:07:18.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.127+0000 7f87121c1640 1 Processor -- start 2023-11-24T08:07:18.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.127+0000 7f87121c1640 1 -- start start 2023-11-24T08:07:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f87121c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f870c15d4f0 0x7f870c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f87121c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f870c0715b0 0x7f870c167120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f87121c1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c06af20 con 0x7f870c0ce710 2023-11-24T08:07:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f87121c1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c06bba0 con 0x7f870c0715b0 2023-11-24T08:07:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f87121c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c06b200 con 0x7f870c15d4f0 2023-11-24T08:07:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f870c0715b0 0x7f870c167120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f870c0715b0 0x7f870c167120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53342/0 (socket says 172.21.15.57:53342) 2023-11-24T08:07:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870bfff640 1 -- 172.21.15.57:0/677017981 learned_addr learned my addr 172.21.15.57:0/677017981 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870b7fe640 1 --2- 172.21.15.57:0/677017981 >> v2:172.21.15.132:3300/0 conn(0x7f870c15d4f0 0x7f870c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870bfff640 1 -- 172.21.15.57:0/677017981 >> v2:172.21.15.132:3300/0 conn(0x7f870c15d4f0 msgr2=0x7f870c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870bfff640 1 --2- 172.21.15.57:0/677017981 >> v2:172.21.15.132:3300/0 conn(0x7f870c15d4f0 0x7f870c06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870bfff640 1 -- 172.21.15.57:0/677017981 >> v1:172.21.15.132:6789/0 conn(0x7f870c0ce710 legacy=0x7f870c070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.131+0000 7f870bfff640 1 -- 172.21.15.57:0/677017981 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c06b4e0 con 0x7f870c0715b0 2023-11-24T08:07:18.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f870bfff640 1 --2- 172.21.15.57:0/677017981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c167120 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f870c06ef30 tx=0x7f870401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2ab0699aa00dec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f870a7fc640 1 -- 172.21.15.57:0/677017981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040a57b0 con 0x7f870c0715b0 2023-11-24T08:07:18.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f870a7fc640 1 -- 172.21.15.57:0/677017981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87040a5910 con 0x7f870c0715b0 2023-11-24T08:07:18.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f870a7fc640 1 -- 172.21.15.57:0/677017981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040a5ca0 con 0x7f870c0715b0 2023-11-24T08:07:18.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 -- 172.21.15.57:0/677017981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 msgr2=0x7f870c167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 --2- 172.21.15.57:0/677017981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c167120 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f870c06ef30 tx=0x7f870401c960 comp rx=0 tx=0).stop 2023-11-24T08:07:18.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 -- 172.21.15.57:0/677017981 shutdown_connections 2023-11-24T08:07:18.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 --2- 172.21.15.57:0/677017981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c167120 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 --2- 172.21.15.57:0/677017981 >> v2:172.21.15.132:3300/0 conn(0x7f870c15d4f0 0x7f870c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 -- 172.21.15.57:0/677017981 >> 172.21.15.57:0/677017981 conn(0x7f870c0cc330 msgr2=0x7f870c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 -- 172.21.15.57:0/677017981 shutdown_connections 2023-11-24T08:07:18.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 -- 172.21.15.57:0/677017981 wait complete. 2023-11-24T08:07:18.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 Processor -- start 2023-11-24T08:07:18.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.135+0000 7f87121c1640 1 -- start start 2023-11-24T08:07:18.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f870c0ce710 0x7f870c0ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f870c15d4f0 0x7f870c155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c154c80 con 0x7f870c0715b0 2023-11-24T08:07:18.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0ad750 con 0x7f870c0ce710 2023-11-24T08:07:18.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0ad9d0 con 0x7f870c15d4f0 2023-11-24T08:07:18.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53358/0 (socket says 172.21.15.57:53358) 2023-11-24T08:07:18.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 -- 172.21.15.57:0/282832086 learned_addr learned my addr 172.21.15.57:0/282832086 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:18.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870affd640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f870c0ce710 0x7f870c0ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870bfff640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f870c15d4f0 0x7f870c155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 -- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f870c15d4f0 msgr2=0x7f870c155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f870c15d4f0 0x7f870c155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 -- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f870c0ce710 msgr2=0x7f870c0ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f870c0ce710 0x7f870c0ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 -- 172.21.15.57:0/282832086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704009b30 con 0x7f870c0715b0 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f870b7fe640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c154740 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d5f0 tx=0x7f86fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f86f3fff640 1 -- 172.21.15.57:0/282832086 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0125f0 con 0x7f870c0715b0 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f86f3fff640 1 -- 172.21.15.57:0/282832086 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc012750 con 0x7f870c0715b0 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f86f3fff640 1 -- 172.21.15.57:0/282832086 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc012ae0 con 0x7f870c0715b0 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c0adcb0 con 0x7f870c0715b0 2023-11-24T08:07:18.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c0ae270 con 0x7f870c0715b0 2023-11-24T08:07:18.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c067520 con 0x7f870c0715b0 2023-11-24T08:07:18.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.139+0000 7f86f3fff640 1 -- 172.21.15.57:0/282832086 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f86fc012c40 con 0x7f870c0715b0 2023-11-24T08:07:18.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.143+0000 7f86f3fff640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86f8066620 0x7f86f8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.143+0000 7f86f3fff640 1 -- 172.21.15.57:0/282832086 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86fc0842f0 con 0x7f870c0715b0 2023-11-24T08:07:18.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.143+0000 7f870affd640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86f8066620 0x7f86f8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.143+0000 7f870affd640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86f8066620 0x7f86f8068ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8700007fd0 tx=0x7f8700007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.147+0000 7f86f3fff640 1 -- 172.21.15.57:0/282832086 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86fc051800 con 0x7f870c0715b0 2023-11-24T08:07:18.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.371+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f870c14ce40 con 0x7f870c0715b0 2023-11-24T08:07:18.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f86f3fff640 1 -- 172.21.15.57:0/282832086 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v182) v1 ==== 140+0+0 (secure 0 0 0) 0x7f86fc007380 con 0x7f870c0715b0 2023-11-24T08:07:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86f8066620 msgr2=0x7f86f8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86f8066620 0x7f86f8068ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8700007fd0 tx=0x7f8700007e40 comp rx=0 tx=0).stop 2023-11-24T08:07:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 msgr2=0x7f870c154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c154740 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d5f0 tx=0x7f86fc00dab0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 shutdown_connections 2023-11-24T08:07:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f86f8066620 0x7f86f8068ae0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f870c15d4f0 0x7f870c155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f870c0ce710 0x7f870c0ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 --2- 172.21.15.57:0/282832086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f870c0715b0 0x7f870c154740 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 >> 172.21.15.57:0/282832086 conn(0x7f870c0cc330 msgr2=0x7f870c0b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 shutdown_connections 2023-11-24T08:07:18.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.603+0000 7f87121c1640 1 -- 172.21.15.57:0/282832086 wait complete. 2023-11-24T08:07:18.629 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-11-24T08:07:18.629 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:07:18.629 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:18.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:18.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.767+0000 7f224fd57640 1 Processor -- start 2023-11-24T08:07:18.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224fd57640 1 -- start start 2023-11-24T08:07:18.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224fd57640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22480d3020 0x7f22480d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224fd57640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f22480ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224fd57640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224806c0e0 con 0x7f224815d570 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224fd57640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480d39f0 con 0x7f22480d3020 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224fd57640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22480d1cc0 con 0x7f22480ce8b0 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224d2f2640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22480d3020 0x7f22480d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224d2f2640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22480d3020 0x7f22480d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53374/0 (socket says 172.21.15.57:53374) 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224d2f2640 1 -- 172.21.15.57:0/3253880213 learned_addr learned my addr 172.21.15.57:0/3253880213 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224e2f4640 1 --2- 172.21.15.57:0/3253880213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f22480ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224d2f2640 1 -- 172.21.15.57:0/3253880213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 msgr2=0x7f22480ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224d2f2640 1 --2- 172.21.15.57:0/3253880213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f22480ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224d2f2640 1 -- 172.21.15.57:0/3253880213 >> v1:172.21.15.132:6789/0 conn(0x7f224815d570 legacy=0x7f224806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.771+0000 7f224d2f2640 1 -- 172.21.15.57:0/3253880213 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480d1fa0 con 0x7f22480d3020 2023-11-24T08:07:18.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224d2f2640 1 --2- 172.21.15.57:0/3253880213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22480d34b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2238009870 tx=0x7f223801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283d299dedfa8e3f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224caf1640 1 -- 172.21.15.57:0/3253880213 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380aa670 con 0x7f22480d3020 2023-11-24T08:07:18.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224caf1640 1 -- 172.21.15.57:0/3253880213 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22380aa7d0 con 0x7f22480d3020 2023-11-24T08:07:18.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224caf1640 1 -- 172.21.15.57:0/3253880213 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380aab60 con 0x7f22480d3020 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 -- 172.21.15.57:0/3253880213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 msgr2=0x7f22480d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 --2- 172.21.15.57:0/3253880213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22480d34b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2238009870 tx=0x7f223801c510 comp rx=0 tx=0).stop 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 -- 172.21.15.57:0/3253880213 shutdown_connections 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 --2- 172.21.15.57:0/3253880213 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f22480ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 --2- 172.21.15.57:0/3253880213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22480d34b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 -- 172.21.15.57:0/3253880213 >> 172.21.15.57:0/3253880213 conn(0x7f224808ceb0 msgr2=0x7f224809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 -- 172.21.15.57:0/3253880213 shutdown_connections 2023-11-24T08:07:18.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 -- 172.21.15.57:0/3253880213 wait complete. 2023-11-24T08:07:18.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 Processor -- start 2023-11-24T08:07:18.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.775+0000 7f224fd57640 1 -- start start 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f2248156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22481554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224815d570 0x7f22480b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248155a20 con 0x7f22480d3020 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248156840 con 0x7f224815d570 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224815f680 con 0x7f22480ce8b0 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22481554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22481554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53384/0 (socket says 172.21.15.57:53384) 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 -- 172.21.15.57:0/914516555 learned_addr learned my addr 172.21.15.57:0/914516555 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224daf3640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f2248156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224e2f4640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224815d570 0x7f22480b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 -- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 msgr2=0x7f2248156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f2248156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 -- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224815d570 msgr2=0x7f22480b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224815d570 0x7f22480b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 -- 172.21.15.57:0/914516555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380094d0 con 0x7f22480d3020 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224d2f2640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22481554e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f223801a140 tx=0x7f223801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f223e7fc640 1 -- 172.21.15.57:0/914516555 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380aa670 con 0x7f22480d3020 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f223e7fc640 1 -- 172.21.15.57:0/914516555 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22380b3800 con 0x7f22480d3020 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2248155c30 con 0x7f22480d3020 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f223e7fc640 1 -- 172.21.15.57:0/914516555 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380b3bb0 con 0x7f22480d3020 2023-11-24T08:07:18.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22481561f0 con 0x7f22480d3020 2023-11-24T08:07:18.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.779+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22480cb9d0 con 0x7f22480d3020 2023-11-24T08:07:18.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.783+0000 7f223e7fc640 1 -- 172.21.15.57:0/914516555 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f22380b3d10 con 0x7f22480d3020 2023-11-24T08:07:18.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.783+0000 7f223e7fc640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f222c066620 0x7f222c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:18.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.783+0000 7f223e7fc640 1 -- 172.21.15.57:0/914516555 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f223811e710 con 0x7f22480d3020 2023-11-24T08:07:18.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.783+0000 7f224daf3640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f222c066620 0x7f222c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:18.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.783+0000 7f224daf3640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f222c066620 0x7f222c068ae0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2248160d00 tx=0x7f2244009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:18.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.787+0000 7f223e7fc640 1 -- 172.21.15.57:0/914516555 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22380ebb10 con 0x7f22480d3020 2023-11-24T08:07:18.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.943+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2248067520 con 0x7f22480d3020 2023-11-24T08:07:18.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f223e7fc640 1 -- 172.21.15.57:0/914516555 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+12928 (secure 0 0 0) 0x7f22380ef130 con 0x7f22480d3020 2023-11-24T08:07:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:18.951 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":53,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:17.593788+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6837/1528560341":"2023-11-25T08:07:14.581761+0000","172.21.15.132:6835/1528560341":"2023-11-25T08:07:14.581761+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:18.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f222c066620 msgr2=0x7f222c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f222c066620 0x7f222c068ae0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2248160d00 tx=0x7f2244009040 comp rx=0 tx=0).stop 2023-11-24T08:07:18.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 msgr2=0x7f22481554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:18.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22481554e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f223801a140 tx=0x7f223801ad50 comp rx=0 tx=0).stop 2023-11-24T08:07:18.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 shutdown_connections 2023-11-24T08:07:18.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f222c066620 0x7f222c068ae0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f224815d570 0x7f22480b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22480d3020 0x7f22481554e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 --2- 172.21.15.57:0/914516555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22480ce8b0 0x7f2248156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:18.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 >> 172.21.15.57:0/914516555 conn(0x7f224808ceb0 msgr2=0x7f22480d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:18.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 shutdown_connections 2023-11-24T08:07:18.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:18.947+0000 7f224fd57640 1 -- 172.21.15.57:0/914516555 wait complete. 2023-11-24T08:07:18.972 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:18.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:19.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb0529e7640 1 Processor -- start 2023-11-24T08:07:19.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb0529e7640 1 -- start start 2023-11-24T08:07:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb0529e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb04c15ec60 0x7fb04c0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb0529e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 0x7fb04c0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb0529e7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c070f00 con 0x7fb04c15a290 2023-11-24T08:07:19.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb0529e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c071170 con 0x7fb04c15ec60 2023-11-24T08:07:19.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb0529e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0cb690 con 0x7fb04c0cc6b0 2023-11-24T08:07:19.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb04c15a290 0x7fb04c0707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33622/0 (socket says 172.21.15.57:33622) 2023-11-24T08:07:19.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04bfff640 1 -- 172.21.15.57:0/715030845 learned_addr learned my addr 172.21.15.57:0/715030845 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822870539 0 0) 0x7fb04c070f00 con 0x7fb04c15a290 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034003530 con 0x7fb04c15a290 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb050f84640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 0x7fb04c0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04b7fe640 1 --2- 172.21.15.57:0/715030845 >> v2:172.21.15.132:3300/0 conn(0x7fb04c15ec60 0x7fb04c0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699940629 0 0) 0x7fb034003530 con 0x7fb04c15a290 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 msgr2=0x7fb04c0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 0x7fb04c0b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 >> v2:172.21.15.132:3300/0 conn(0x7fb04c15ec60 msgr2=0x7fb04c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 --2- 172.21.15.57:0/715030845 >> v2:172.21.15.132:3300/0 conn(0x7fb04c15ec60 0x7fb04c0cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0cb970 con 0x7fb04c15a290 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fb03c001680 con 0x7fb04c15a290 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 >> v1:172.21.15.57:6789/0 conn(0x7fb04c15a290 legacy=0x7fb04c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034003980 0x7fb034003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 0x7fb0340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb034004d10 0x7fb034005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c071170 con 0x7fb034004d10 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0cb690 con 0x7fb034003980 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400bb20 con 0x7fb04c0cc6b0 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb050f84640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb034004d10 0x7fb034005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04bfff640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034003980 0x7fb034003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04b7fe640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 0x7fb0340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb050f84640 1 -- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 msgr2=0x7fb0340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb050f84640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0cc6b0 0x7fb0340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb050f84640 1 -- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034003980 msgr2=0x7fb034003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb050f84640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034003980 0x7fb034003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb050f84640 1 -- 172.21.15.57:0/715030845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034003530 con 0x7fb034004d10 2023-11-24T08:07:19.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.115+0000 7fb04bfff640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034003980 0x7fb034003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:19.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb050f84640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb034004d10 0x7fb034005190 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb044009ba0 tx=0x7fb04401f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb24d12defdbdcd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440ae600 con 0x7fb034004d10 2023-11-24T08:07:19.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0440aa050 con 0x7fb034004d10 2023-11-24T08:07:19.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb04affd640 1 -- 172.21.15.57:0/715030845 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440ae980 con 0x7fb034004d10 2023-11-24T08:07:19.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb0529e7640 1 -- 172.21.15.57:0/715030845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb034004d10 msgr2=0x7fb034005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb0529e7640 1 --2- 172.21.15.57:0/715030845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb034004d10 0x7fb034005190 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb044009ba0 tx=0x7fb04401f050 comp rx=0 tx=0).stop 2023-11-24T08:07:19.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb050f84640 1 -- 172.21.15.57:0/715030845 reap_dead start 2023-11-24T08:07:19.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb0529e7640 1 -- 172.21.15.57:0/715030845 shutdown_connections 2023-11-24T08:07:19.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb0529e7640 1 -- 172.21.15.57:0/715030845 >> 172.21.15.57:0/715030845 conn(0x7fb04c0b0c80 msgr2=0x7fb04c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb0529e7640 1 -- 172.21.15.57:0/715030845 shutdown_connections 2023-11-24T08:07:19.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.119+0000 7fb0529e7640 1 -- 172.21.15.57:0/715030845 wait complete. 2023-11-24T08:07:19.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 Processor -- start 2023-11-24T08:07:19.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 -- start start 2023-11-24T08:07:19.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034004d10 0x7fb04c14cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0b3620 0x7fb04c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0b3aa0 0x7fb04c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c14d0c0 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c15c880 con 0x7fb034004d10 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c15aba0 con 0x7fb04c0b3620 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0b3aa0 0x7fb04c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0b3aa0 0x7fb04c06cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53394/0 (socket says 172.21.15.57:53394) 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 -- 172.21.15.57:0/3134378330 learned_addr learned my addr 172.21.15.57:0/3134378330 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb04bfff640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034004d10 0x7fb04c14cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb04b7fe640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0b3620 0x7fb04c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 -- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0b3620 msgr2=0x7fb04c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0b3620 0x7fb04c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 -- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034004d10 msgr2=0x7fb04c14cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034004d10 0x7fb04c14cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 -- 172.21.15.57:0/3134378330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c15ae80 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb04b7fe640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0b3620 0x7fb04c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:19.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb050f84640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0b3aa0 0x7fb04c06cbe0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb044002240 tx=0x7fb034005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb048ff9640 1 -- 172.21.15.57:0/3134378330 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440aeb10 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb048ff9640 1 -- 172.21.15.57:0/3134378330 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0440aec90 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb048ff9640 1 -- 172.21.15.57:0/3134378330 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440b8440 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.123+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c15cb20 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.127+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c0b2c60 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.127+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c15c6e0 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.127+0000 7fb048ff9640 1 -- 172.21.15.57:0/3134378330 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fb0440b85a0 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.127+0000 7fb048ff9640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb038066620 0x7fb038068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.127+0000 7fb048ff9640 1 -- 172.21.15.57:0/3134378330 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb044120b90 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.127+0000 7fb04bfff640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb038066620 0x7fb038068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.127+0000 7fb04bfff640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb038066620 0x7fb038068ae0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0078f0 tx=0x7fb03c001de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.131+0000 7fb048ff9640 1 -- 172.21.15.57:0/3134378330 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb04c15c6e0 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb04c15c6e0 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb048ff9640 1 -- 172.21.15.57:0/3134378330 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb04c15c6e0 con 0x7fb04c0b3aa0 2023-11-24T08:07:19.295 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:07:19.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb038066620 msgr2=0x7fb038068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb038066620 0x7fb038068ae0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0078f0 tx=0x7fb03c001de0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0b3aa0 msgr2=0x7fb04c06cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0b3aa0 0x7fb04c06cbe0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb044002240 tx=0x7fb034005800 comp rx=0 tx=0).stop 2023-11-24T08:07:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 shutdown_connections 2023-11-24T08:07:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb038066620 0x7fb038068ae0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c0b3aa0 0x7fb04c06cbe0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb04c0b3620 0x7fb04c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 --2- 172.21.15.57:0/3134378330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb034004d10 0x7fb04c14cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 >> 172.21.15.57:0/3134378330 conn(0x7fb04c0b0c80 msgr2=0x7fb04c0705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 shutdown_connections 2023-11-24T08:07:19.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.291+0000 7fb0529e7640 1 -- 172.21.15.57:0/3134378330 wait complete. 2023-11-24T08:07:19.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:07:19.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.455+0000 7fbb85f55640 1 Processor -- start 2023-11-24T08:07:19.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.455+0000 7fbb85f55640 1 -- start start 2023-11-24T08:07:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.455+0000 7fbb85f55640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb800d3020 0x7fbb800d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.455+0000 7fbb85f55640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb800ce8b0 0x7fbb800ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.455+0000 7fbb85f55640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8006c0e0 con 0x7fbb8015d570 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.455+0000 7fbb85f55640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800d39c0 con 0x7fbb800ce8b0 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.455+0000 7fbb85f55640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800d1cc0 con 0x7fbb800d3020 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb800ce8b0 0x7fbb800ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb800ce8b0 0x7fbb800ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:36710/0 (socket says 172.21.15.57:36710) 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 -- 172.21.15.57:0/2850290181 learned_addr learned my addr 172.21.15.57:0/2850290181 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb800d3020 0x7fbb800d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7f7fe640 1 --1- 172.21.15.57:0/2850290181 >> v1:172.21.15.132:6789/0 conn(0x7fbb8015d570 0x7fbb8006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:54270/0 (socket says 172.21.15.57:54270) 2023-11-24T08:07:19.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 -- 172.21.15.57:0/2850290181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb800d3020 msgr2=0x7fbb800d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:19.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 --2- 172.21.15.57:0/2850290181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb800d3020 0x7fbb800d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 -- 172.21.15.57:0/2850290181 >> v1:172.21.15.132:6789/0 conn(0x7fbb8015d570 legacy=0x7fbb8006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 -- 172.21.15.57:0/2850290181 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800d1fa0 con 0x7fbb800ce8b0 2023-11-24T08:07:19.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7ffff640 1 --2- 172.21.15.57:0/2850290181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800ce8b0 0x7fbb800ced40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009e50 tx=0x7fbb7801c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5484048dfc7f5856 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7e7fc640 1 -- 172.21.15.57:0/2850290181 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb780a58a0 con 0x7fbb800ce8b0 2023-11-24T08:07:19.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7e7fc640 1 -- 172.21.15.57:0/2850290181 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb780a5a00 con 0x7fbb800ce8b0 2023-11-24T08:07:19.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.459+0000 7fbb7e7fc640 1 -- 172.21.15.57:0/2850290181 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb780a5d90 con 0x7fbb800ce8b0 2023-11-24T08:07:19.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- 172.21.15.57:0/2850290181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800ce8b0 msgr2=0x7fbb800ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2850290181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800ce8b0 0x7fbb800ced40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009e50 tx=0x7fbb7801c9e0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- 172.21.15.57:0/2850290181 shutdown_connections 2023-11-24T08:07:19.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2850290181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800ce8b0 0x7fbb800ced40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2850290181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb800d3020 0x7fbb800d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- 172.21.15.57:0/2850290181 >> 172.21.15.57:0/2850290181 conn(0x7fbb8008ceb0 msgr2=0x7fbb8009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:19.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- 172.21.15.57:0/2850290181 shutdown_connections 2023-11-24T08:07:19.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- 172.21.15.57:0/2850290181 wait complete. 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 Processor -- start 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- start start 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800ce8b0 0x7fbb800b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800d3020 0x7fbb80153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb8015d570 0x7fbb800c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b92b0 con 0x7fbb800ce8b0 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015e900 con 0x7fbb800d3020 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb85f55640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b8c60 con 0x7fbb8015d570 2023-11-24T08:07:19.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb7f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800ce8b0 0x7fbb800b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb7f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800ce8b0 0x7fbb800b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53410/0 (socket says 172.21.15.57:53410) 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb7f7fe640 1 -- 172.21.15.57:0/2493647126 learned_addr learned my addr 172.21.15.57:0/2493647126 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb7ffff640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb8015d570 0x7fbb800c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.463+0000 7fbb7effd640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800d3020 0x7fbb80153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb7f7fe640 1 -- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb8015d570 msgr2=0x7fbb800c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb7f7fe640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb8015d570 0x7fbb800c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb7f7fe640 1 -- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800d3020 msgr2=0x7fbb80153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb7f7fe640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800d3020 0x7fbb80153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:19.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb7f7fe640 1 -- 172.21.15.57:0/2493647126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78009b30 con 0x7fbb800ce8b0 2023-11-24T08:07:19.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb7f7fe640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800ce8b0 0x7fbb800b2060 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c430 tx=0x7fbb7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb67fff640 1 -- 172.21.15.57:0/2493647126 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700074e0 con 0x7fbb800ce8b0 2023-11-24T08:07:19.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb67fff640 1 -- 172.21.15.57:0/2493647126 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70007640 con 0x7fbb800ce8b0 2023-11-24T08:07:19.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb67fff640 1 -- 172.21.15.57:0/2493647126 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70004a10 con 0x7fbb800ce8b0 2023-11-24T08:07:19.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800b8f40 con 0x7fbb800ce8b0 2023-11-24T08:07:19.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb80158ef0 con 0x7fbb800ce8b0 2023-11-24T08:07:19.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb80067520 con 0x7fbb800ce8b0 2023-11-24T08:07:19.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.467+0000 7fbb67fff640 1 -- 172.21.15.57:0/2493647126 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fbb70004b70 con 0x7fbb800ce8b0 2023-11-24T08:07:19.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.471+0000 7fbb67fff640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb6c066620 0x7fbb6c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:19.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.471+0000 7fbb67fff640 1 -- 172.21.15.57:0/2493647126 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbb70083770 con 0x7fbb800ce8b0 2023-11-24T08:07:19.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.471+0000 7fbb7effd640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb6c066620 0x7fbb6c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:19.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.471+0000 7fbb7effd640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb6c066620 0x7fbb6c068ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbb8006bf40 tx=0x7fbb74009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:19.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.475+0000 7fbb67fff640 1 -- 172.21.15.57:0/2493647126 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb70050d10 con 0x7fbb800ce8b0 2023-11-24T08:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:19.687+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fbb8006b7b0 con 0x7fbb800ce8b0 2023-11-24T08:07:20.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:20.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.619+0000 7fbb67fff640 1 -- 172.21.15.57:0/2493647126 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v184) v1 ==== 164+0+0 (secure 0 0 0) 0x7fbb70054330 con 0x7fbb800ce8b0 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb6c066620 msgr2=0x7fbb6c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb6c066620 0x7fbb6c068ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbb8006bf40 tx=0x7fbb74009190 comp rx=0 tx=0).stop 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800ce8b0 msgr2=0x7fbb800b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800ce8b0 0x7fbb800b2060 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c430 tx=0x7fbb7000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 shutdown_connections 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb6c066620 0x7fbb6c068ae0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb8015d570 0x7fbb800c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb800d3020 0x7fbb80153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 --2- 172.21.15.57:0/2493647126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb800ce8b0 0x7fbb800b2060 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 >> 172.21.15.57:0/2493647126 conn(0x7fbb8008ceb0 msgr2=0x7fbb800b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 shutdown_connections 2023-11-24T08:07:20.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.623+0000 7fbb85f55640 1 -- 172.21.15.57:0/2493647126 wait complete. 2023-11-24T08:07:20.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:07:20.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb226d6640 1 Processor -- start 2023-11-24T08:07:20.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb226d6640 1 -- start start 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb226d6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb1c15d450 0x7feb1c161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb226d6640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feb1c06dac0 0x7feb1c0ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb226d6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c06b460 con 0x7feb1c06b8f0 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb226d6640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c06a5b0 con 0x7feb1c06dac0 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb226d6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c162030 con 0x7feb1c15d450 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb20c73640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feb1c06dac0 0x7feb1c0ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb1b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7feb1c06b8f0 0x7feb1c06d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33626/0 (socket says 172.21.15.57:33626) 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb1b7fe640 1 -- 172.21.15.57:0/2937195002 learned_addr learned my addr 172.21.15.57:0/2937195002 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:20.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb1bfff640 1 --2- 172.21.15.57:0/2937195002 >> v2:172.21.15.132:3300/0 conn(0x7feb1c15d450 0x7feb1c161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb20c73640 1 -- 172.21.15.57:0/2937195002 >> v2:172.21.15.132:3300/0 conn(0x7feb1c15d450 msgr2=0x7feb1c161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:20.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb20c73640 1 --2- 172.21.15.57:0/2937195002 >> v2:172.21.15.132:3300/0 conn(0x7feb1c15d450 0x7feb1c161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb20c73640 1 -- 172.21.15.57:0/2937195002 >> v1:172.21.15.57:6789/0 conn(0x7feb1c06b8f0 legacy=0x7feb1c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb1affd640 1 -- 172.21.15.57:0/2937195002 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242541712 0 0) 0x7feb1c06b460 con 0x7feb1c06b8f0 2023-11-24T08:07:20.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.799+0000 7feb20c73640 1 -- 172.21.15.57:0/2937195002 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c06a850 con 0x7feb1c06dac0 2023-11-24T08:07:20.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb20c73640 1 --2- 172.21.15.57:0/2937195002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06dac0 0x7feb1c0ac850 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0b4db0 tx=0x7feb1401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d469acbf79f5583a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb1affd640 1 -- 172.21.15.57:0/2937195002 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140a59a0 con 0x7feb1c06dac0 2023-11-24T08:07:20.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb1affd640 1 -- 172.21.15.57:0/2937195002 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb140a5b00 con 0x7feb1c06dac0 2023-11-24T08:07:20.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb1affd640 1 -- 172.21.15.57:0/2937195002 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140a5e90 con 0x7feb1c06dac0 2023-11-24T08:07:20.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 -- 172.21.15.57:0/2937195002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06dac0 msgr2=0x7feb1c0ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 --2- 172.21.15.57:0/2937195002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06dac0 0x7feb1c0ac850 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0b4db0 tx=0x7feb1401c8e0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 -- 172.21.15.57:0/2937195002 shutdown_connections 2023-11-24T08:07:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 --2- 172.21.15.57:0/2937195002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06dac0 0x7feb1c0ac850 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 --2- 172.21.15.57:0/2937195002 >> v2:172.21.15.132:3300/0 conn(0x7feb1c15d450 0x7feb1c161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 -- 172.21.15.57:0/2937195002 >> 172.21.15.57:0/2937195002 conn(0x7feb1c0cf8f0 msgr2=0x7feb1c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 -- 172.21.15.57:0/2937195002 shutdown_connections 2023-11-24T08:07:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.803+0000 7feb226d6640 1 -- 172.21.15.57:0/2937195002 wait complete. 2023-11-24T08:07:20.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 Processor -- start 2023-11-24T08:07:20.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 -- start start 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06b8f0 0x7feb1c1fe180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb1c06dac0 0x7feb1c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb1c15d450 0x7feb1c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c1fee00 con 0x7feb1c06b8f0 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c154a10 con 0x7feb1c06dac0 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c154cc0 con 0x7feb1c15d450 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06b8f0 0x7feb1c1fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06b8f0 0x7feb1c1fe180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53428/0 (socket says 172.21.15.57:53428) 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 -- 172.21.15.57:0/2796494725 learned_addr learned my addr 172.21.15.57:0/2796494725 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1b7fe640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb1c06dac0 0x7feb1c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb20c73640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb1c15d450 0x7feb1c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 -- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb1c15d450 msgr2=0x7feb1c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb1c15d450 0x7feb1c15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 -- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb1c06dac0 msgr2=0x7feb1c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb1c06dac0 0x7feb1c0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 -- 172.21.15.57:0/2796494725 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14009a70 con 0x7feb1c06b8f0 2023-11-24T08:07:20.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb1bfff640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06b8f0 0x7feb1c1fe180 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00d5f0 tx=0x7feb0c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb18ff9640 1 -- 172.21.15.57:0/2796494725 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0125f0 con 0x7feb1c06b8f0 2023-11-24T08:07:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb18ff9640 1 -- 172.21.15.57:0/2796494725 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c012750 con 0x7feb1c06b8f0 2023-11-24T08:07:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb18ff9640 1 -- 172.21.15.57:0/2796494725 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c012ae0 con 0x7feb1c06b8f0 2023-11-24T08:07:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c154fa0 con 0x7feb1c06b8f0 2023-11-24T08:07:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.807+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c155560 con 0x7feb1c06b8f0 2023-11-24T08:07:20.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.811+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c04e8c0 con 0x7feb1c06b8f0 2023-11-24T08:07:20.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.811+0000 7feb18ff9640 1 -- 172.21.15.57:0/2796494725 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7feb0c012c40 con 0x7feb1c06b8f0 2023-11-24T08:07:20.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.811+0000 7feb18ff9640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb08066620 0x7feb08068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:20.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.811+0000 7feb18ff9640 1 -- 172.21.15.57:0/2796494725 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb0c084420 con 0x7feb1c06b8f0 2023-11-24T08:07:20.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.811+0000 7feb1b7fe640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb08066620 0x7feb08068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:20.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.811+0000 7feb1b7fe640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb08066620 0x7feb08068ae0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feb1c06ee10 tx=0x7feb10007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:20.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.815+0000 7feb18ff9640 1 -- 172.21.15.57:0/2796494725 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb0c051880 con 0x7feb1c06b8f0 2023-11-24T08:07:20.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.975+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feb1c0612e0 con 0x7feb1c06b8f0 2023-11-24T08:07:20.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb18ff9640 1 -- 172.21.15.57:0/2796494725 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7feb0c007380 con 0x7feb1c06b8f0 2023-11-24T08:07:20.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb08066620 msgr2=0x7feb08068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb08066620 0x7feb08068ae0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feb1c06ee10 tx=0x7feb10007b60 comp rx=0 tx=0).stop 2023-11-24T08:07:20.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06b8f0 msgr2=0x7feb1c1fe180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06b8f0 0x7feb1c1fe180 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00d5f0 tx=0x7feb0c00dab0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 shutdown_connections 2023-11-24T08:07:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb08066620 0x7feb08068ae0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb1c15d450 0x7feb1c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb1c06dac0 0x7feb1c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 --2- 172.21.15.57:0/2796494725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb1c06b8f0 0x7feb1c1fe180 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 >> 172.21.15.57:0/2796494725 conn(0x7feb1c0cf8f0 msgr2=0x7feb1c0af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 shutdown_connections 2023-11-24T08:07:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:20.983+0000 7feb226d6640 1 -- 172.21.15.57:0/2796494725 wait complete. 2023-11-24T08:07:21.007 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:07:21.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:21.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:21.190 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:07:21.190 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:21.191 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:21.200 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:07:21.201 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:21.201 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:21.210 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:07:21.210 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:21.211 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:21.250 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:07:21.250 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:21.250 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:21.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:07:21.264 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:07:21.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:21.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3ffd1640 1 Processor -- start 2023-11-24T08:07:21.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3ffd1640 1 -- start start 2023-11-24T08:07:21.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3ffd1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efd3815d6f0 0x7efd380d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3ffd1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efd380d3be0 0x7efd380d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3ffd1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd380d22f0 con 0x7efd380d1ef0 2023-11-24T08:07:21.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3ffd1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3815dae0 con 0x7efd3815d6f0 2023-11-24T08:07:21.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3ffd1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3815dda0 con 0x7efd380d3be0 2023-11-24T08:07:21.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3dd6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efd3815d6f0 0x7efd380d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3e56e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efd380d1ef0 0x7efd381610d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33640/0 (socket says 172.21.15.57:33640) 2023-11-24T08:07:21.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3e56e640 1 -- 172.21.15.57:0/871269981 learned_addr learned my addr 172.21.15.57:0/871269981 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:21.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3d56c640 1 --2- 172.21.15.57:0/871269981 >> v2:172.21.15.132:3300/0 conn(0x7efd380d3be0 0x7efd380d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3dd6d640 1 -- 172.21.15.57:0/871269981 >> v2:172.21.15.132:3300/0 conn(0x7efd380d3be0 msgr2=0x7efd380d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:21.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3dd6d640 1 --2- 172.21.15.57:0/871269981 >> v2:172.21.15.132:3300/0 conn(0x7efd380d3be0 0x7efd380d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3dd6d640 1 -- 172.21.15.57:0/871269981 >> v1:172.21.15.57:6789/0 conn(0x7efd380d1ef0 legacy=0x7efd381610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3dd6d640 1 -- 172.21.15.57:0/871269981 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3815e080 con 0x7efd3815d6f0 2023-11-24T08:07:21.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.435+0000 7efd3cd6b640 1 -- 172.21.15.57:0/871269981 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045926779 0 0) 0x7efd380d22f0 con 0x7efd380d1ef0 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3dd6d640 1 --2- 172.21.15.57:0/871269981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd3815d6f0 0x7efd380d0fc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efd3808d020 tx=0x7efd3401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748a0a65d33af345 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3cd6b640 1 -- 172.21.15.57:0/871269981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd340ab660 con 0x7efd3815d6f0 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3cd6b640 1 -- 172.21.15.57:0/871269981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd340ab7c0 con 0x7efd3815d6f0 2023-11-24T08:07:21.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3cd6b640 1 -- 172.21.15.57:0/871269981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd340abb50 con 0x7efd3815d6f0 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 -- 172.21.15.57:0/871269981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd3815d6f0 msgr2=0x7efd380d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/871269981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd3815d6f0 0x7efd380d0fc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efd3808d020 tx=0x7efd3401c460 comp rx=0 tx=0).stop 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 -- 172.21.15.57:0/871269981 shutdown_connections 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/871269981 >> v2:172.21.15.132:3300/0 conn(0x7efd380d3be0 0x7efd380d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/871269981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd3815d6f0 0x7efd380d0fc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 -- 172.21.15.57:0/871269981 >> 172.21.15.57:0/871269981 conn(0x7efd3808af70 msgr2=0x7efd380d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 -- 172.21.15.57:0/871269981 shutdown_connections 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.439+0000 7efd3ffd1640 1 -- 172.21.15.57:0/871269981 wait complete. 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 Processor -- start 2023-11-24T08:07:21.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 -- start start 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd380d1ef0 0x7efd380cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd380d3be0 0x7efd380b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd380cbc90 0x7efd38157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd380b7640 con 0x7efd380d3be0 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd380cccb0 con 0x7efd380d1ef0 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd380cb1b0 con 0x7efd380cbc90 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd380d3be0 0x7efd380b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd380d3be0 0x7efd380b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53446/0 (socket says 172.21.15.57:53446) 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 -- 172.21.15.57:0/287528677 learned_addr learned my addr 172.21.15.57:0/287528677 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3dd6d640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd380d1ef0 0x7efd380cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3e56e640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd380cbc90 0x7efd38157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 -- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd380cbc90 msgr2=0x7efd38157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd380cbc90 0x7efd38157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 -- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd380d1ef0 msgr2=0x7efd380cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd380d1ef0 0x7efd380cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 -- 172.21.15.57:0/287528677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd34009420 con 0x7efd380d3be0 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3d56c640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd380d3be0 0x7efd380b7100 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efd2800d800 tx=0x7efd2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd2e7fc640 1 -- 172.21.15.57:0/287528677 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800b6c0 con 0x7efd380d3be0 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd2e7fc640 1 -- 172.21.15.57:0/287528677 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2800b820 con 0x7efd380d3be0 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd2e7fc640 1 -- 172.21.15.57:0/287528677 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800bb90 con 0x7efd380d3be0 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd380cb490 con 0x7efd380d3be0 2023-11-24T08:07:21.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd380caea0 con 0x7efd380d3be0 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.443+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd38067520 con 0x7efd380d3be0 2023-11-24T08:07:21.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.447+0000 7efd2e7fc640 1 -- 172.21.15.57:0/287528677 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7efd2800bcf0 con 0x7efd380d3be0 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.447+0000 7efd2e7fc640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd1c0666a0 0x7efd1c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.447+0000 7efd2e7fc640 1 -- 172.21.15.57:0/287528677 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd280843b0 con 0x7efd380d3be0 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.447+0000 7efd3dd6d640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd1c0666a0 0x7efd1c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.447+0000 7efd3dd6d640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd1c0666a0 0x7efd1c068b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd340af000 tx=0x7efd340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.451+0000 7efd2e7fc640 1 -- 172.21.15.57:0/287528677 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd28051890 con 0x7efd380d3be0 2023-11-24T08:07:21.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd380d0b50 con 0x7efd380d3be0 2023-11-24T08:07:21.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd2e7fc640 1 -- 172.21.15.57:0/287528677 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3707 (secure 0 0 0) 0x7efd28054eb0 con 0x7efd380d3be0 2023-11-24T08:07:21.648 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:21.648 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1181122075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1181122075},{"type":"v1","addr":"172.21.15.57:6834","nonce":1181122075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3508190418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3508190418},{"type":"v1","addr":"172.21.15.57:6835","nonce":3508190418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":55013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2536403991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2536403991},{"type":"v1","addr":"172.21.15.132:6836","nonce":2536403991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":55316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3812793185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3812793185},{"type":"v1","addr":"172.21.15.132:6837","nonce":3812793185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-11-24T08:07:21.648 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 28 2023-11-24T08:07:21.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd1c0666a0 msgr2=0x7efd1c068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd1c0666a0 0x7efd1c068b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd340af000 tx=0x7efd340a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:21.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd380d3be0 msgr2=0x7efd380b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd380d3be0 0x7efd380b7100 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efd2800d800 tx=0x7efd2800dcc0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 shutdown_connections 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efd1c0666a0 0x7efd1c068b60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd380cbc90 0x7efd38157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd380d3be0 0x7efd380b7100 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 --2- 172.21.15.57:0/287528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd380d1ef0 0x7efd380cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 >> 172.21.15.57:0/287528677 conn(0x7efd3808af70 msgr2=0x7efd380b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 shutdown_connections 2023-11-24T08:07:21.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.643+0000 7efd3ffd1640 1 -- 172.21.15.57:0/287528677 wait complete. 2023-11-24T08:07:21.669 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:07:21.669 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:07:21.669 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:07:21.669 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:21.669 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:07:21.669 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:07:21.670 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:07:21.670 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:21.670 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:07:21.670 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:07:21.670 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:07:21.670 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:21.671 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:07:21.671 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:07:21.671 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:07:21.671 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:07:21.682 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:07:21.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:07:21.683 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:07:21.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:07:21.686 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:07:21.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:07:21.687 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:07:21.687 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:07:21.730 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:07:21.731 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:21.732 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:07:21.732 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:21.732 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:07:21.733 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:21.734 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:07:21.734 DEBUG:teuthology.parallel:result is None 2023-11-24T08:07:21.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:07:21.820 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-11-24T08:07:21.821 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-11-24T08:07:21.821 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-11-24T08:07:21.822 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-11-24T08:07:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.879+0000 7fc485da0640 1 Processor -- start 2023-11-24T08:07:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.879+0000 7fc485da0640 1 -- start start 2023-11-24T08:07:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc485da0640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4800b1790 0x7fc48015a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc485da0640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800ae9a0 con 0x7fc480159f90 2023-11-24T08:07:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc485da0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800cd9a0 con 0x7fc48015ddb0 2023-11-24T08:07:21.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc485da0640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800cdd40 con 0x7fc4800b1790 2023-11-24T08:07:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc47ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4800b1790 0x7fc48015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc484d9e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc480159f90 0x7fc480070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33660/0 (socket says 172.21.15.57:33660) 2023-11-24T08:07:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc484d9e640 1 -- 172.21.15.57:0/1245019240 learned_addr learned my addr 172.21.15.57:0/1245019240 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc47ffff640 1 -- 172.21.15.57:0/1245019240 >> v1:172.21.15.132:6789/0 conn(0x7fc48015ddb0 legacy=0x7fc48006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc47ffff640 1 -- 172.21.15.57:0/1245019240 >> v1:172.21.15.57:6789/0 conn(0x7fc480159f90 legacy=0x7fc480070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc47ffff640 1 -- 172.21.15.57:0/1245019240 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48015e6c0 con 0x7fc4800b1790 2023-11-24T08:07:21.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.883+0000 7fc47f7fe640 1 -- 172.21.15.57:0/1245019240 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818426120 0 0) 0x7fc4800ae9a0 con 0x7fc480159f90 2023-11-24T08:07:21.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-24T08:07:21.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-24T08:07:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc47ffff640 1 --2- 172.21.15.57:0/1245019240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc48015a370 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0097c0 tx=0x7fc46c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c983bbd72936b057 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc47f7fe640 1 -- 172.21.15.57:0/1245019240 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0ab670 con 0x7fc4800b1790 2023-11-24T08:07:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc47f7fe640 1 -- 172.21.15.57:0/1245019240 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c0ab7d0 con 0x7fc4800b1790 2023-11-24T08:07:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc47f7fe640 1 -- 172.21.15.57:0/1245019240 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0abb60 con 0x7fc4800b1790 2023-11-24T08:07:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 -- 172.21.15.57:0/1245019240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 msgr2=0x7fc48015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 --2- 172.21.15.57:0/1245019240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc48015a370 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0097c0 tx=0x7fc46c01c450 comp rx=0 tx=0).stop 2023-11-24T08:07:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 -- 172.21.15.57:0/1245019240 shutdown_connections 2023-11-24T08:07:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 --2- 172.21.15.57:0/1245019240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc48015a370 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 -- 172.21.15.57:0/1245019240 >> 172.21.15.57:0/1245019240 conn(0x7fc4800cbb50 msgr2=0x7fc4800cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 -- 172.21.15.57:0/1245019240 shutdown_connections 2023-11-24T08:07:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 -- 172.21.15.57:0/1245019240 wait complete. 2023-11-24T08:07:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 Processor -- start 2023-11-24T08:07:21.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 -- start start 2023-11-24T08:07:21.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc4801634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.887+0000 7fc485da0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc480159f90 0x7fc4801f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc485da0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc48015ddb0 0x7fc48006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc485da0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc480163ab0 con 0x7fc4800b1790 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc485da0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4801f6830 con 0x7fc48015ddb0 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc485da0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800c6240 con 0x7fc480159f90 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc4801634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc4801634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53504/0 (socket says 172.21.15.57:53504) 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 -- 172.21.15.57:0/1529866140 learned_addr learned my addr 172.21.15.57:0/1529866140 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc47ffff640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc480159f90 0x7fc4801f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc48559f640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc48015ddb0 0x7fc48006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 -- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc480159f90 msgr2=0x7fc4801f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc480159f90 0x7fc4801f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 -- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc48015ddb0 msgr2=0x7fc48006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc48015ddb0 0x7fc48006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 -- 172.21.15.57:0/1529866140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c009420 con 0x7fc4800b1790 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc48559f640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc48015ddb0 0x7fc48006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc484d9e640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc4801634b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c4d0 tx=0x7fc47400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc47d7fa640 1 -- 172.21.15.57:0/1529866140 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740074e0 con 0x7fc4800b1790 2023-11-24T08:07:21.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc47d7fa640 1 -- 172.21.15.57:0/1529866140 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474007640 con 0x7fc4800b1790 2023-11-24T08:07:21.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc480163de0 con 0x7fc4800b1790 2023-11-24T08:07:21.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc47d7fa640 1 -- 172.21.15.57:0/1529866140 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474004a30 con 0x7fc4800b1790 2023-11-24T08:07:21.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4801643a0 con 0x7fc4800b1790 2023-11-24T08:07:21.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4800c6410 con 0x7fc4800b1790 2023-11-24T08:07:21.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.891+0000 7fc47d7fa640 1 -- 172.21.15.57:0/1529866140 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc474004b90 con 0x7fc4800b1790 2023-11-24T08:07:21.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.895+0000 7fc47d7fa640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc464066620 0x7fc464068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:21.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.895+0000 7fc47d7fa640 1 -- 172.21.15.57:0/1529866140 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc4740833b0 con 0x7fc4800b1790 2023-11-24T08:07:21.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.895+0000 7fc47ffff640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc464066620 0x7fc464068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:21.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.895+0000 7fc47ffff640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc464066620 0x7fc464068ae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0af000 tx=0x7fc46c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:21.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:21.895+0000 7fc47d7fa640 1 -- 172.21.15.57:0/1529866140 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4740508c0 con 0x7fc4800b1790 2023-11-24T08:07:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.063+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc48004e850 con 0x7fc4800b1790 2023-11-24T08:07:22.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.651+0000 7fc47d7fa640 1 -- 172.21.15.57:0/1529866140 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc474053ee0 con 0x7fc4800b1790 2023-11-24T08:07:22.656 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blocklist entries 2023-11-24T08:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc464066620 msgr2=0x7fc464068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc464066620 0x7fc464068ae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0af000 tx=0x7fc46c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 msgr2=0x7fc4801634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc4801634b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c4d0 tx=0x7fc47400c990 comp rx=0 tx=0).stop 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 shutdown_connections 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc464066620 0x7fc464068ae0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc48015ddb0 0x7fc48006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc480159f90 0x7fc4801f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 --2- 172.21.15.57:0/1529866140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4800b1790 0x7fc4801634b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 >> 172.21.15.57:0/1529866140 conn(0x7fc4800cbb50 msgr2=0x7fc4800ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 shutdown_connections 2023-11-24T08:07:22.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.655+0000 7fc485da0640 1 -- 172.21.15.57:0/1529866140 wait complete. 2023-11-24T08:07:22.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:07:22.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7bcc3a640 1 Processor -- start 2023-11-24T08:07:22.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7bcc3a640 1 -- start start 2023-11-24T08:07:22.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7bcc3a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b815d5e0 0x7fe7b80d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7bcc3a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7b80d1ed0 0x7fe7b80b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7bcc3a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b815d9c0 con 0x7fe7b80d3ee0 2023-11-24T08:07:22.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7bcc3a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b80d1190 con 0x7fe7b80d1ed0 2023-11-24T08:07:22.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7bcc3a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80d1470 con 0x7fe7b815d5e0 2023-11-24T08:07:22.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b6ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe7b80d3ee0 0x7fe7b80d17c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33664/0 (socket says 172.21.15.57:33664) 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b6ffd640 1 -- 172.21.15.57:0/3727928523 learned_addr learned my addr 172.21.15.57:0/3727928523 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b77fe640 1 --2- 172.21.15.57:0/3727928523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b815d5e0 0x7fe7b80d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b7fff640 1 --2- 172.21.15.57:0/3727928523 >> v2:172.21.15.132:3300/0 conn(0x7fe7b80d1ed0 0x7fe7b80b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b67fc640 1 -- 172.21.15.57:0/3727928523 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140481234 0 0) 0x7fe7b815d9c0 con 0x7fe7b80d3ee0 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b67fc640 1 -- 172.21.15.57:0/3727928523 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a0003530 con 0x7fe7b80d3ee0 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b77fe640 1 -- 172.21.15.57:0/3727928523 >> v2:172.21.15.132:3300/0 conn(0x7fe7b80d1ed0 msgr2=0x7fe7b80b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b77fe640 1 --2- 172.21.15.57:0/3727928523 >> v2:172.21.15.132:3300/0 conn(0x7fe7b80d1ed0 0x7fe7b80b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b77fe640 1 -- 172.21.15.57:0/3727928523 >> v1:172.21.15.57:6789/0 conn(0x7fe7b80d3ee0 legacy=0x7fe7b80d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b77fe640 1 -- 172.21.15.57:0/3727928523 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b80b2a80 con 0x7fe7b815d5e0 2023-11-24T08:07:22.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.827+0000 7fe7b7fff640 1 --2- 172.21.15.57:0/3727928523 >> v2:172.21.15.132:3300/0 conn(0x7fe7b80d1ed0 0x7fe7b80b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:22.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7b77fe640 1 --2- 172.21.15.57:0/3727928523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b815d5e0 0x7fe7b80d39a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80097c0 tx=0x7fe7a801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3280aee972b4c319 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7b67fc640 1 -- 172.21.15.57:0/3727928523 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80ab650 con 0x7fe7b815d5e0 2023-11-24T08:07:22.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7b67fc640 1 -- 172.21.15.57:0/3727928523 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a80ab7b0 con 0x7fe7b815d5e0 2023-11-24T08:07:22.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7b67fc640 1 -- 172.21.15.57:0/3727928523 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80abb20 con 0x7fe7b815d5e0 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/3727928523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b815d5e0 msgr2=0x7fe7b80d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/3727928523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b815d5e0 0x7fe7b80d39a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80097c0 tx=0x7fe7a801c450 comp rx=0 tx=0).stop 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/3727928523 shutdown_connections 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/3727928523 >> v2:172.21.15.132:3300/0 conn(0x7fe7b80d1ed0 0x7fe7b80b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/3727928523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b815d5e0 0x7fe7b80d39a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/3727928523 >> 172.21.15.57:0/3727928523 conn(0x7fe7b809c520 msgr2=0x7fe7b80d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/3727928523 shutdown_connections 2023-11-24T08:07:22.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.831+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/3727928523 wait complete. 2023-11-24T08:07:22.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 Processor -- start 2023-11-24T08:07:22.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 -- start start 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b80d1ed0 0x7fe7b815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b80d3ee0 0x7fe7b814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b815d5e0 0x7fe7b814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b814ae90 con 0x7fe7b815d5e0 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b8158670 con 0x7fe7b80d3ee0 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b815ae20 con 0x7fe7b80d1ed0 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b815d5e0 0x7fe7b814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b815d5e0 0x7fe7b814a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53516/0 (socket says 172.21.15.57:53516) 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 -- 172.21.15.57:0/2309686309 learned_addr learned my addr 172.21.15.57:0/2309686309 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b77fe640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b80d1ed0 0x7fe7b815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b6ffd640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b80d3ee0 0x7fe7b814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 -- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b80d1ed0 msgr2=0x7fe7b815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b80d1ed0 0x7fe7b815a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 -- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b80d3ee0 msgr2=0x7fe7b814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b80d3ee0 0x7fe7b814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 -- 172.21.15.57:0/2309686309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0009a70 con 0x7fe7b815d5e0 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7b7fff640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b815d5e0 0x7fe7b814a950 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009d50 tx=0x7fe7b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe79ffff640 1 -- 172.21.15.57:0/2309686309 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000cd30 con 0x7fe7b815d5e0 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe79ffff640 1 -- 172.21.15.57:0/2309686309 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000f040 con 0x7fe7b815d5e0 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a8009420 con 0x7fe7b815d5e0 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe79ffff640 1 -- 172.21.15.57:0/2309686309 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0003be0 con 0x7fe7b815d5e0 2023-11-24T08:07:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.835+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b8157df0 con 0x7fe7b815d5e0 2023-11-24T08:07:22.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.839+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b8158420 con 0x7fe7b815d5e0 2023-11-24T08:07:22.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.839+0000 7fe79ffff640 1 -- 172.21.15.57:0/2309686309 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe7b0014480 con 0x7fe7b815d5e0 2023-11-24T08:07:22.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.839+0000 7fe79ffff640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7a4066620 0x7fe7a4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:22.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.839+0000 7fe79ffff640 1 -- 172.21.15.57:0/2309686309 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe7b0084990 con 0x7fe7b815d5e0 2023-11-24T08:07:22.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.839+0000 7fe7b77fe640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7a4066620 0x7fe7a4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:22.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.839+0000 7fe7b77fe640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7a4066620 0x7fe7a4068ae0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80af000 tx=0x7fe7a80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:22.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:22.843+0000 7fe79ffff640 1 -- 172.21.15.57:0/2309686309 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7b0051de0 con 0x7fe7b815d5e0 2023-11-24T08:07:23.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.059+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe7b804e850 con 0x7fe7b815d5e0 2023-11-24T08:07:23.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.059+0000 7fe79ffff640 1 -- 172.21.15.57:0/2309686309 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe7b0055400 con 0x7fe7b815d5e0 2023-11-24T08:07:23.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:23.065 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:23.065 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2023-11-24T08:07:23.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.066 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2023-11-24T08:07:23.066 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBli5Y5IBAAnvP0ucgaWCMVrPGzxD66SA==", 2023-11-24T08:07:23.066 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.067 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.067 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:07:23.067 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:07:23.067 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.067 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlIvACLRAA3GBFpw4471E7VMC1v83uKw==", 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:07:23.068 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBltsHpJxAA4cXeOlSioW+qpB6iET0JYA==", 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:07:23.069 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.d", 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlMAZmNBAAJ764yAUaJrB0C/NMgccnIQ==", 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.070 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCxWGBlL0EOIRAAGl5XgP5YNoKHFXcAZ7x8Dw==", 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.071 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC0WGBllgHlKBAAs4PpDKC95e8EbMikLNYamg==", 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.072 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC3WGBl0BHZMBAAO9QEi1GOOfCUoxneHsmMtQ==", 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC6WGBl7854ORAAjYNCXFSYc+rSJHmK5WNuBQ==", 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.074 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDBWGBlOWLlCBAAn/3woUG2ZUM65EvKQ/plBg==", 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDEWGBlbNduDxAABASB690ioHFg1QYgfbclaA==", 2023-11-24T08:07:23.075 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDHWGBlpKlsFRAAIIo9fYbozro/Zf40wo7pqg==", 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.076 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDKWGBlVZj5GxAAkCx/Ev5UjrAu+8MKzlZrWw==", 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg==", 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBl+4YCBxAAKfb7t9BjuhCDnWDrdkswdA==", 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.079 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.2", 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBlzP4XAxAAgbiVgyWCJo76uqBghI1FOw==", 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.3", 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCrWGBlm45BDRAAv46vHB8X5TFKK0XqdxA1tQ==", 2023-11-24T08:07:23.080 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2023-11-24T08:07:23.081 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlCwEjAxAAPy/bfz67KrMkV+ORpi2LWA==", 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlE12EGxAAnyGvPcM8AfeaVmxsl+MaBg==", 2023-11-24T08:07:23.082 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQCqWGBlAy9zFxAA6XZfIsLKTOoOTouFh2tD9w==", 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-11-24T08:07:23.083 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-11-24T08:07:23.084 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.084 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:23.084 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-11-24T08:07:23.084 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7a4066620 msgr2=0x7fe7a4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7a4066620 0x7fe7a4068ae0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80af000 tx=0x7fe7a80a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b815d5e0 msgr2=0x7fe7b814a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b815d5e0 0x7fe7b814a950 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009d50 tx=0x7fe7b000c490 comp rx=0 tx=0).stop 2023-11-24T08:07:23.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 shutdown_connections 2023-11-24T08:07:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7a4066620 0x7fe7a4068ae0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7b815d5e0 0x7fe7b814a950 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7b80d3ee0 0x7fe7b814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 --2- 172.21.15.57:0/2309686309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7b80d1ed0 0x7fe7b815a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 >> 172.21.15.57:0/2309686309 conn(0x7fe7b809c520 msgr2=0x7fe7b815c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 shutdown_connections 2023-11-24T08:07:23.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.063+0000 7fe7bcc3a640 1 -- 172.21.15.57:0/2309686309 wait complete. 2023-11-24T08:07:23.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:23.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e9772640 1 Processor -- start 2023-11-24T08:07:23.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e9772640 1 -- start start 2023-11-24T08:07:23.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e9772640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81e4147020 0x7f81e40d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e9772640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e40d01e0 0x7f81e40b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e9772640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e40cee60 con 0x7f81e40d0640 2023-11-24T08:07:23.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e9772640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e40cf140 con 0x7f81e4147020 2023-11-24T08:07:23.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e9772640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e40cf420 con 0x7f81e40d01e0 2023-11-24T08:07:23.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e37fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f81e40d0640 0x7f81e406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33680/0 (socket says 172.21.15.57:33680) 2023-11-24T08:07:23.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e37fe640 1 -- 172.21.15.57:0/2499221938 learned_addr learned my addr 172.21.15.57:0/2499221938 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:23.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e2ffd640 1 --2- 172.21.15.57:0/2499221938 >> v2:172.21.15.132:3300/0 conn(0x7f81e4147020 0x7f81e40d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81dbfff640 1 --2- 172.21.15.57:0/2499221938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e40d01e0 0x7f81e40b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e27fc640 1 -- 172.21.15.57:0/2499221938 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873813827 0 0) 0x7f81e40cee60 con 0x7f81e40d0640 2023-11-24T08:07:23.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81e27fc640 1 -- 172.21.15.57:0/2499221938 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d0003530 con 0x7f81e40d0640 2023-11-24T08:07:23.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81dbfff640 1 -- 172.21.15.57:0/2499221938 >> v2:172.21.15.132:3300/0 conn(0x7f81e4147020 msgr2=0x7f81e40d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:23.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81dbfff640 1 --2- 172.21.15.57:0/2499221938 >> v2:172.21.15.132:3300/0 conn(0x7f81e4147020 0x7f81e40d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81dbfff640 1 -- 172.21.15.57:0/2499221938 >> v1:172.21.15.57:6789/0 conn(0x7f81e40d0640 legacy=0x7f81e406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.227+0000 7f81dbfff640 1 -- 172.21.15.57:0/2499221938 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e40cf700 con 0x7f81e40d01e0 2023-11-24T08:07:23.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81dbfff640 1 --2- 172.21.15.57:0/2499221938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e40d01e0 0x7f81e40b2e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097c0 tx=0x7f81cc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce0f59b16b5925aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e27fc640 1 -- 172.21.15.57:0/2499221938 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0ab650 con 0x7f81e40d01e0 2023-11-24T08:07:23.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e27fc640 1 -- 172.21.15.57:0/2499221938 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0ab7b0 con 0x7f81e40d01e0 2023-11-24T08:07:23.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e27fc640 1 -- 172.21.15.57:0/2499221938 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0abb20 con 0x7f81e40d01e0 2023-11-24T08:07:23.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 -- 172.21.15.57:0/2499221938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e40d01e0 msgr2=0x7f81e40b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 --2- 172.21.15.57:0/2499221938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e40d01e0 0x7f81e40b2e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097c0 tx=0x7f81cc01c450 comp rx=0 tx=0).stop 2023-11-24T08:07:23.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 -- 172.21.15.57:0/2499221938 shutdown_connections 2023-11-24T08:07:23.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 --2- 172.21.15.57:0/2499221938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e40d01e0 0x7f81e40b2e50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 --2- 172.21.15.57:0/2499221938 >> v2:172.21.15.132:3300/0 conn(0x7f81e4147020 0x7f81e40d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 -- 172.21.15.57:0/2499221938 >> 172.21.15.57:0/2499221938 conn(0x7f81e4060fd0 msgr2=0x7f81e40613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 -- 172.21.15.57:0/2499221938 shutdown_connections 2023-11-24T08:07:23.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.231+0000 7f81e9772640 1 -- 172.21.15.57:0/2499221938 wait complete. 2023-11-24T08:07:23.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 Processor -- start 2023-11-24T08:07:23.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 -- start start 2023-11-24T08:07:23.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e40d01e0 0x7f81e415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e40d0640 0x7f81e413e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e4147020 0x7f81e415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e415a780 con 0x7f81e40d01e0 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e413e560 con 0x7f81e40d0640 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e41578a0 con 0x7f81e4147020 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e40d01e0 0x7f81e415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e40d01e0 0x7f81e415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53518/0 (socket says 172.21.15.57:53518) 2023-11-24T08:07:23.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 -- 172.21.15.57:0/784487648 learned_addr learned my addr 172.21.15.57:0/784487648 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e37fe640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e4147020 0x7f81e415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81dbfff640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e40d0640 0x7f81e413e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 -- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e4147020 msgr2=0x7f81e415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e4147020 0x7f81e415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 -- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e40d0640 msgr2=0x7f81e413e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e40d0640 0x7f81e413e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 -- 172.21.15.57:0/784487648 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc009420 con 0x7f81e40d01e0 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e2ffd640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e40d01e0 0x7f81e415aa80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e870 tx=0x7f81d400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81db7fe640 1 -- 172.21.15.57:0/784487648 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4009510 con 0x7f81e40d01e0 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81db7fe640 1 -- 172.21.15.57:0/784487648 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400eec0 con 0x7f81e40d01e0 2023-11-24T08:07:23.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81db7fe640 1 -- 172.21.15.57:0/784487648 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400cb40 con 0x7f81e40d01e0 2023-11-24T08:07:23.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e41564b0 con 0x7f81e40d01e0 2023-11-24T08:07:23.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.235+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e415a4a0 con 0x7f81e40d01e0 2023-11-24T08:07:23.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.239+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e4067520 con 0x7f81e40d01e0 2023-11-24T08:07:23.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.239+0000 7f81db7fe640 1 -- 172.21.15.57:0/784487648 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f81d400cca0 con 0x7f81e40d01e0 2023-11-24T08:07:23.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.239+0000 7f81db7fe640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81c4066620 0x7f81c4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.239+0000 7f81db7fe640 1 -- 172.21.15.57:0/784487648 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f81d4083f70 con 0x7f81e40d01e0 2023-11-24T08:07:23.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.239+0000 7f81dbfff640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81c4066620 0x7f81c4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.239+0000 7f81dbfff640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81c4066620 0x7f81c4068ae0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0af000 tx=0x7f81cc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.243+0000 7f81db7fe640 1 -- 172.21.15.57:0/784487648 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81d40514f0 con 0x7f81e40d01e0 2023-11-24T08:07:23.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.403+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81e4144390 con 0x7f81e40d01e0 2023-11-24T08:07:23.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.403+0000 7f81db7fe640 1 -- 172.21.15.57:0/784487648 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f81d4021090 con 0x7f81e40d01e0 2023-11-24T08:07:23.409 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:23.410 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":57,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:22.665811+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:23.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81c4066620 msgr2=0x7f81c4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81c4066620 0x7f81c4068ae0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0af000 tx=0x7f81cc0a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:23.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e40d01e0 msgr2=0x7f81e415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e40d01e0 0x7f81e415aa80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e870 tx=0x7f81d400ec70 comp rx=0 tx=0).stop 2023-11-24T08:07:23.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 shutdown_connections 2023-11-24T08:07:23.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f81c4066620 0x7f81c4068ae0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81e4147020 0x7f81e415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e40d0640 0x7f81e413e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 --2- 172.21.15.57:0/784487648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e40d01e0 0x7f81e415aa80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 >> 172.21.15.57:0/784487648 conn(0x7f81e4060fd0 msgr2=0x7f81e40cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 shutdown_connections 2023-11-24T08:07:23.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.407+0000 7f81e9772640 1 -- 172.21.15.57:0/784487648 wait complete. 2023-11-24T08:07:23.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:23.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:23.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd3e68640 1 Processor -- start 2023-11-24T08:07:23.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd3e68640 1 -- start start 2023-11-24T08:07:23.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd3e68640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc15d7f0 0x7f7ccc0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd3e68640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ccc0d37e0 0x7f7ccc0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd3e68640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc0d3c60 con 0x7f7ccc0b1630 2023-11-24T08:07:23.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd3e68640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ccc06b980 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd3e68640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc0b0090 con 0x7f7ccc15d7f0 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd2405640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7ccc0b1630 0x7f7ccc0b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33686/0 (socket says 172.21.15.57:33686) 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd2405640 1 -- 172.21.15.57:0/1408717614 learned_addr learned my addr 172.21.15.57:0/1408717614 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd1403640 1 --2- 172.21.15.57:0/1408717614 >> v2:172.21.15.57:3300/0 conn(0x7f7ccc0d37e0 0x7f7ccc0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd1c04640 1 --2- 172.21.15.57:0/1408717614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc15d7f0 0x7f7ccc0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd0c02640 1 -- 172.21.15.57:0/1408717614 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957634732 0 0) 0x7f7ccc0d3c60 con 0x7f7ccc0b1630 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd0c02640 1 -- 172.21.15.57:0/1408717614 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb8003530 con 0x7f7ccc0b1630 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd1403640 1 -- 172.21.15.57:0/1408717614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc15d7f0 msgr2=0x7f7ccc0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd1403640 1 --2- 172.21.15.57:0/1408717614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc15d7f0 0x7f7ccc0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd1403640 1 -- 172.21.15.57:0/1408717614 >> v1:172.21.15.57:6789/0 conn(0x7f7ccc0b1630 legacy=0x7f7ccc0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.575+0000 7f7cd1403640 1 -- 172.21.15.57:0/1408717614 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0b0330 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd1403640 1 --2- 172.21.15.57:0/1408717614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc0b10f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097c0 tx=0x7f7cbc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88c692192654243 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd0c02640 1 -- 172.21.15.57:0/1408717614 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0ab600 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd0c02640 1 -- 172.21.15.57:0/1408717614 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc0a7050 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd0c02640 1 -- 172.21.15.57:0/1408717614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0ab960 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd3e68640 1 -- 172.21.15.57:0/1408717614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 msgr2=0x7f7ccc0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/1408717614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc0b10f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097c0 tx=0x7f7cbc01c480 comp rx=0 tx=0).stop 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd3e68640 1 -- 172.21.15.57:0/1408717614 shutdown_connections 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/1408717614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc0b10f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/1408717614 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc15d7f0 0x7f7ccc0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.579+0000 7f7cd3e68640 1 -- 172.21.15.57:0/1408717614 >> 172.21.15.57:0/1408717614 conn(0x7f7ccc09c790 msgr2=0x7f7ccc08af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 -- 172.21.15.57:0/1408717614 shutdown_connections 2023-11-24T08:07:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 -- 172.21.15.57:0/1408717614 wait complete. 2023-11-24T08:07:23.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 Processor -- start 2023-11-24T08:07:23.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 -- start start 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc0b1630 0x7f7ccc0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ccc15d7f0 0x7f7ccc14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc155300 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc155830 con 0x7f7ccc15d7f0 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd3e68640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc155550 con 0x7f7ccc0b1630 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc14ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53542/0 (socket says 172.21.15.57:53542) 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 -- 172.21.15.57:0/2307807312 learned_addr learned my addr 172.21.15.57:0/2307807312 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1c04640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc0b1630 0x7f7ccc0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd2405640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ccc15d7f0 0x7f7ccc14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 -- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc0b1630 msgr2=0x7f7ccc0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc0b1630 0x7f7ccc0b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 -- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ccc15d7f0 msgr2=0x7f7ccc14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ccc15d7f0 0x7f7ccc14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 -- 172.21.15.57:0/2307807312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc009420 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1c04640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc0b1630 0x7f7ccc0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd2405640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ccc15d7f0 0x7f7ccc14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.583+0000 7f7cd1403640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc14ef80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc01ab30 tx=0x7f7cbc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cc27fc640 1 -- 172.21.15.57:0/2307807312 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0b9070 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cc27fc640 1 -- 172.21.15.57:0/2307807312 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc0abd10 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cc27fc640 1 -- 172.21.15.57:0/2307807312 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0b4620 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc0b51f0 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc14fc00 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ccc14fe20 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cc27fc640 1 -- 172.21.15.57:0/2307807312 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f7cbc0b2040 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cc27fc640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7cb0066620 0x7f7cb0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cc27fc640 1 -- 172.21.15.57:0/2307807312 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7cbc11d4f0 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.587+0000 7f7cd1c04640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7cb0066620 0x7f7cb0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.591+0000 7f7cd1c04640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7cb0066620 0x7f7cb0068ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc08d620 tx=0x7f7cc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.591+0000 7f7cc27fc640 1 -- 172.21.15.57:0/2307807312 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7cbc0ea920 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.759+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ccc04e8c0 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.759+0000 7f7cc27fc640 1 -- 172.21.15.57:0/2307807312 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cbc0edf40 con 0x7f7ccc0d37e0 2023-11-24T08:07:23.764 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:07:23.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7cb0066620 msgr2=0x7f7cb0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7cb0066620 0x7f7cb0068ae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc08d620 tx=0x7f7cc8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:23.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 msgr2=0x7f7ccc14ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc14ef80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc01ab30 tx=0x7f7cbc019220 comp rx=0 tx=0).stop 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 shutdown_connections 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7cb0066620 0x7f7cb0068ae0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ccc15d7f0 0x7f7ccc14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ccc0d37e0 0x7f7ccc14ef80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 --2- 172.21.15.57:0/2307807312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ccc0b1630 0x7f7ccc0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 >> 172.21.15.57:0/2307807312 conn(0x7f7ccc09c790 msgr2=0x7f7ccc15ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 shutdown_connections 2023-11-24T08:07:23.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.763+0000 7f7cd3e68640 1 -- 172.21.15.57:0/2307807312 wait complete. 2023-11-24T08:07:23.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:07:23.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.923+0000 7f0959e32640 1 Processor -- start 2023-11-24T08:07:23.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.923+0000 7f0959e32640 1 -- start start 2023-11-24T08:07:23.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f0959e32640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0954144030 0x7f095406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f0959e32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09540709c0 0x7f0954070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f0959e32640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095406d8b0 con 0x7f095409cc20 2023-11-24T08:07:23.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f0959e32640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0954145020 con 0x7f0954144030 2023-11-24T08:07:23.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f0959e32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095409d0a0 con 0x7f09540709c0 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f09537fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0954144030 0x7f095406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f09537fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0954144030 0x7f095406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53544/0 (socket says 172.21.15.57:53544) 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f09537fe640 1 -- 172.21.15.57:0/4001116143 learned_addr learned my addr 172.21.15.57:0/4001116143 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f0953fff640 1 --2- 172.21.15.57:0/4001116143 >> v2:172.21.15.132:3300/0 conn(0x7f09540709c0 0x7f0954070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f09537fe640 1 -- 172.21.15.57:0/4001116143 >> v2:172.21.15.132:3300/0 conn(0x7f09540709c0 msgr2=0x7f0954070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f09537fe640 1 --2- 172.21.15.57:0/4001116143 >> v2:172.21.15.132:3300/0 conn(0x7f09540709c0 0x7f0954070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f09537fe640 1 -- 172.21.15.57:0/4001116143 >> v1:172.21.15.132:6789/0 conn(0x7f095409cc20 legacy=0x7f095406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:23.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.927+0000 7f09537fe640 1 -- 172.21.15.57:0/4001116143 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954071370 con 0x7f0954144030 2023-11-24T08:07:23.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f09537fe640 1 --2- 172.21.15.57:0/4001116143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0954144030 0x7f095406c650 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0954145220 tx=0x7f094401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e24f0c4fdfa917 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f09527fc640 1 -- 172.21.15.57:0/4001116143 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440aa5f0 con 0x7f0954144030 2023-11-24T08:07:23.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f09527fc640 1 -- 172.21.15.57:0/4001116143 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09440aa750 con 0x7f0954144030 2023-11-24T08:07:23.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f09527fc640 1 -- 172.21.15.57:0/4001116143 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440aaae0 con 0x7f0954144030 2023-11-24T08:07:23.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 -- 172.21.15.57:0/4001116143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0954144030 msgr2=0x7f095406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 --2- 172.21.15.57:0/4001116143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0954144030 0x7f095406c650 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0954145220 tx=0x7f094401c490 comp rx=0 tx=0).stop 2023-11-24T08:07:23.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 -- 172.21.15.57:0/4001116143 shutdown_connections 2023-11-24T08:07:23.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 --2- 172.21.15.57:0/4001116143 >> v2:172.21.15.132:3300/0 conn(0x7f09540709c0 0x7f0954070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 --2- 172.21.15.57:0/4001116143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0954144030 0x7f095406c650 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 -- 172.21.15.57:0/4001116143 >> 172.21.15.57:0/4001116143 conn(0x7f09540b0bf0 msgr2=0x7f09540b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:23.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 -- 172.21.15.57:0/4001116143 shutdown_connections 2023-11-24T08:07:23.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 -- 172.21.15.57:0/4001116143 wait complete. 2023-11-24T08:07:23.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 Processor -- start 2023-11-24T08:07:23.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.931+0000 7f0959e32640 1 -- start start 2023-11-24T08:07:23.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09540709c0 0x7f0954158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f095409cc20 0x7f09541fdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0954144030 0x7f095415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09541fe500 con 0x7f095409cc20 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095413d7c0 con 0x7f09540709c0 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095413da10 con 0x7f0954144030 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f095409cc20 0x7f09541fdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f095409cc20 0x7f09541fdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53558/0 (socket says 172.21.15.57:53558) 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f09537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09540709c0 0x7f0954158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 -- 172.21.15.57:0/2848467543 learned_addr learned my addr 172.21.15.57:0/2848467543 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:23.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0953fff640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0954144030 0x7f095415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 -- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0954144030 msgr2=0x7f095415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0954144030 0x7f095415ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 -- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09540709c0 msgr2=0x7f0954158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09540709c0 0x7f0954158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 -- 172.21.15.57:0/2848467543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440094d0 con 0x7f095409cc20 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0952ffd640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f095409cc20 0x7f09541fdfc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f094800c450 tx=0x7f094800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f093bfff640 1 -- 172.21.15.57:0/2848467543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948012830 con 0x7f095409cc20 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f093bfff640 1 -- 172.21.15.57:0/2848467543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09480129b0 con 0x7f095409cc20 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f093bfff640 1 -- 172.21.15.57:0/2848467543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948012d60 con 0x7f095409cc20 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095413dcf0 con 0x7f095409cc20 2023-11-24T08:07:23.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095413e2b0 con 0x7f095409cc20 2023-11-24T08:07:23.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954067520 con 0x7f095409cc20 2023-11-24T08:07:23.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.935+0000 7f093bfff640 1 -- 172.21.15.57:0/2848467543 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f094801c460 con 0x7f095409cc20 2023-11-24T08:07:23.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.939+0000 7f093bfff640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0940066620 0x7f0940068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:23.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.939+0000 7f093bfff640 1 -- 172.21.15.57:0/2848467543 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0948083c50 con 0x7f095409cc20 2023-11-24T08:07:23.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.939+0000 7f09537fe640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0940066620 0x7f0940068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:23.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.939+0000 7f09537fe640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0940066620 0x7f0940068ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f09440ae000 tx=0x7f09440b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:23.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:23.943+0000 7f093bfff640 1 -- 172.21.15.57:0/2848467543 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0948051190 con 0x7f095409cc20 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.099+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09540726d0 con 0x7f095409cc20 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.099+0000 7f093bfff640 1 -- 172.21.15.57:0/2848467543 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+65 (secure 0 0 0) 0x7f09480547b0 con 0x7f095409cc20 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-11-24T08:07:24.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:24.106 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-11-24T08:07:24.106 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-11-24T08:07:24.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:24.106 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0940066620 msgr2=0x7f0940068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0940066620 0x7f0940068ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f09440ae000 tx=0x7f09440b5040 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f095409cc20 msgr2=0x7f09541fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f095409cc20 0x7f09541fdfc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f094800c450 tx=0x7f094800c910 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 shutdown_connections 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0940066620 0x7f0940068ae0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0954144030 0x7f095415ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f095409cc20 0x7f09541fdfc0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 --2- 172.21.15.57:0/2848467543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09540709c0 0x7f0954158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 >> 172.21.15.57:0/2848467543 conn(0x7f09540b0bf0 msgr2=0x7f09540b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 shutdown_connections 2023-11-24T08:07:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.103+0000 7f0959e32640 1 -- 172.21.15.57:0/2848467543 wait complete. 2023-11-24T08:07:24.126 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:07:24.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:07:24.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f57f65640 1 Processor -- start 2023-11-24T08:07:24.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f57f65640 1 -- start start 2023-11-24T08:07:24.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f57f65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f50144030 0x7f6f5006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f57f65640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f5009cc20 0x7f6f5006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f57f65640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5006d8b0 con 0x7f6f5006e280 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f57f65640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f50145020 con 0x7f6f5009cc20 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f57f65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5009d0a0 con 0x7f6f50144030 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f55500640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f5009cc20 0x7f6f5006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f55500640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f5009cc20 0x7f6f5006dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53570/0 (socket says 172.21.15.57:53570) 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f55500640 1 -- 172.21.15.57:0/449398811 learned_addr learned my addr 172.21.15.57:0/449398811 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f55d01640 1 --2- 172.21.15.57:0/449398811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f50144030 0x7f6f5006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f55500640 1 -- 172.21.15.57:0/449398811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f50144030 msgr2=0x7f6f5006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f55500640 1 --2- 172.21.15.57:0/449398811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f50144030 0x7f6f5006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.271+0000 7f6f55500640 1 -- 172.21.15.57:0/449398811 >> v1:172.21.15.132:6789/0 conn(0x7f6f5006e280 legacy=0x7f6f500709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f55500640 1 -- 172.21.15.57:0/449398811 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5006cca0 con 0x7f6f5009cc20 2023-11-24T08:07:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f55500640 1 --2- 172.21.15.57:0/449398811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5009cc20 0x7f6f5006dd40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db893466abd16a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f54cff640 1 -- 172.21.15.57:0/449398811 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400aa670 con 0x7f6f5009cc20 2023-11-24T08:07:24.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f54cff640 1 -- 172.21.15.57:0/449398811 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400aa7d0 con 0x7f6f5009cc20 2023-11-24T08:07:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f54cff640 1 -- 172.21.15.57:0/449398811 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400aab60 con 0x7f6f5009cc20 2023-11-24T08:07:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 -- 172.21.15.57:0/449398811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5009cc20 msgr2=0x7f6f5006dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 --2- 172.21.15.57:0/449398811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5009cc20 0x7f6f5006dd40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4001c510 comp rx=0 tx=0).stop 2023-11-24T08:07:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 -- 172.21.15.57:0/449398811 shutdown_connections 2023-11-24T08:07:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 --2- 172.21.15.57:0/449398811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5009cc20 0x7f6f5006dd40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 --2- 172.21.15.57:0/449398811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f50144030 0x7f6f5006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 -- 172.21.15.57:0/449398811 >> 172.21.15.57:0/449398811 conn(0x7f6f500b0bf0 msgr2=0x7f6f500b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 -- 172.21.15.57:0/449398811 shutdown_connections 2023-11-24T08:07:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.275+0000 7f6f57f65640 1 -- 172.21.15.57:0/449398811 wait complete. 2023-11-24T08:07:24.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 Processor -- start 2023-11-24T08:07:24.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 -- start start 2023-11-24T08:07:24.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5006e280 0x7f6f50138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f5009cc20 0x7f6f50141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f50144030 0x7f6f50142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500cbbb0 con 0x7f6f5006e280 2023-11-24T08:07:24.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500cbe90 con 0x7f6f50144030 2023-11-24T08:07:24.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f57f65640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500cc170 con 0x7f6f5009cc20 2023-11-24T08:07:24.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5006e280 0x7f6f50138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5006e280 0x7f6f50138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53578/0 (socket says 172.21.15.57:53578) 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 -- 172.21.15.57:0/1243977039 learned_addr learned my addr 172.21.15.57:0/1243977039 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55500640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f5009cc20 0x7f6f50141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f56502640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f50144030 0x7f6f50142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 -- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f5009cc20 msgr2=0x7f6f50141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f5009cc20 0x7f6f50141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 -- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f50144030 msgr2=0x7f6f50142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f50144030 0x7f6f50142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 -- 172.21.15.57:0/1243977039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400094d0 con 0x7f6f5006e280 2023-11-24T08:07:24.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f56502640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f50144030 0x7f6f50142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:24.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f55d01640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5006e280 0x7f6f50138d10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00e870 tx=0x7f6f4c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.279+0000 7f6f467fc640 1 -- 172.21.15.57:0/1243977039 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c009510 con 0x7f6f5006e280 2023-11-24T08:07:24.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f467fc640 1 -- 172.21.15.57:0/1243977039 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00eec0 con 0x7f6f5006e280 2023-11-24T08:07:24.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f500cc450 con 0x7f6f5006e280 2023-11-24T08:07:24.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f467fc640 1 -- 172.21.15.57:0/1243977039 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00cb40 con 0x7f6f5006e280 2023-11-24T08:07:24.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f50139250 con 0x7f6f5006e280 2023-11-24T08:07:24.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f50067520 con 0x7f6f5006e280 2023-11-24T08:07:24.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f467fc640 1 -- 172.21.15.57:0/1243977039 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f6f4c00cca0 con 0x7f6f5006e280 2023-11-24T08:07:24.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f467fc640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f34066620 0x7f6f34068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f467fc640 1 -- 172.21.15.57:0/1243977039 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f4c083e40 con 0x7f6f5006e280 2023-11-24T08:07:24.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.283+0000 7f6f55500640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f34066620 0x7f6f34068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.287+0000 7f6f55500640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f34066620 0x7f6f34068ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6f400ae000 tx=0x7f6f400b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.287+0000 7f6f467fc640 1 -- 172.21.15.57:0/1243977039 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f4c0514d0 con 0x7f6f5006e280 2023-11-24T08:07:24.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.451+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6f500b1430 con 0x7f6f5006e280 2023-11-24T08:07:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f467fc640 1 -- 172.21.15.57:0/1243977039 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6f4c054af0 con 0x7f6f5006e280 2023-11-24T08:07:24.683 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-11-24T08:07:24.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f34066620 msgr2=0x7f6f34068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f34066620 0x7f6f34068ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6f400ae000 tx=0x7f6f400b5040 comp rx=0 tx=0).stop 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5006e280 msgr2=0x7f6f50138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5006e280 0x7f6f50138d10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00e870 tx=0x7f6f4c00ec70 comp rx=0 tx=0).stop 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 shutdown_connections 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f34066620 0x7f6f34068ae0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f50144030 0x7f6f50142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6f5009cc20 0x7f6f50141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 --2- 172.21.15.57:0/1243977039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f5006e280 0x7f6f50138d10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 >> 172.21.15.57:0/1243977039 conn(0x7f6f500b0bf0 msgr2=0x7f6f50099f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 shutdown_connections 2023-11-24T08:07:24.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.679+0000 7f6f57f65640 1 -- 172.21.15.57:0/1243977039 wait complete. 2023-11-24T08:07:24.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:07:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b31780640 1 Processor -- start 2023-11-24T08:07:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b31780640 1 -- start start 2023-11-24T08:07:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b31780640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b2c15a4d0 0x7f0b2c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b31780640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c06d740 0x7f0b2c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b31780640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2c06e0d0 con 0x7f0b2c0cad20 2023-11-24T08:07:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b31780640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2c15a8b0 con 0x7f0b2c15a4d0 2023-11-24T08:07:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b31780640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0c9c30 con 0x7f0b2c06d740 2023-11-24T08:07:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c06d740 0x7f0b2c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2affd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b2c15a4d0 0x7f0b2c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2a7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0b2c0cad20 0x7f0b2c15e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:54320/0 (socket says 172.21.15.57:54320) 2023-11-24T08:07:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2affd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b2c15a4d0 0x7f0b2c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.57:36882/0 (socket says 172.21.15.57:36882) 2023-11-24T08:07:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2a7fc640 1 -- 172.21.15.57:0/1868051426 learned_addr learned my addr 172.21.15.57:0/1868051426 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c06d740 0x7f0b2c06db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:60976/0 (socket says 172.21.15.57:60976) 2023-11-24T08:07:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2affd640 1 -- 172.21.15.57:0/1868051426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c06d740 msgr2=0x7f0b2c06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2affd640 1 --2- 172.21.15.57:0/1868051426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c06d740 0x7f0b2c06db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2affd640 1 -- 172.21.15.57:0/1868051426 >> v1:172.21.15.132:6789/0 conn(0x7f0b2c0cad20 legacy=0x7f0b2c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b2affd640 1 -- 172.21.15.57:0/1868051426 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0c9f60 con 0x7f0b2c15a4d0 2023-11-24T08:07:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.859+0000 7f0b29ffb640 1 -- 172.21.15.57:0/1868051426 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172449925 0 0) 0x7f0b20001120 con 0x7f0b2c0cad20 2023-11-24T08:07:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b2affd640 1 --2- 172.21.15.57:0/1868051426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c15a4d0 0x7f0b2c0c9650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0097c0 tx=0x7f0b1c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3aa8e47d61f105c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b29ffb640 1 -- 172.21.15.57:0/1868051426 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0ac620 con 0x7f0b2c15a4d0 2023-11-24T08:07:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b29ffb640 1 -- 172.21.15.57:0/1868051426 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c0ac780 con 0x7f0b2c15a4d0 2023-11-24T08:07:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b29ffb640 1 -- 172.21.15.57:0/1868051426 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0acb10 con 0x7f0b2c15a4d0 2023-11-24T08:07:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 -- 172.21.15.57:0/1868051426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c15a4d0 msgr2=0x7f0b2c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 --2- 172.21.15.57:0/1868051426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c15a4d0 0x7f0b2c0c9650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0097c0 tx=0x7f0b1c01c3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 -- 172.21.15.57:0/1868051426 shutdown_connections 2023-11-24T08:07:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 --2- 172.21.15.57:0/1868051426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c06d740 0x7f0b2c06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 --2- 172.21.15.57:0/1868051426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c15a4d0 0x7f0b2c0c9650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 -- 172.21.15.57:0/1868051426 >> 172.21.15.57:0/1868051426 conn(0x7f0b2c0b0bf0 msgr2=0x7f0b2c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 -- 172.21.15.57:0/1868051426 shutdown_connections 2023-11-24T08:07:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.863+0000 7f0b31780640 1 -- 172.21.15.57:0/1868051426 wait complete. 2023-11-24T08:07:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 Processor -- start 2023-11-24T08:07:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 -- start start 2023-11-24T08:07:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c06d740 0x7f0b2c0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2c0cad20 0x7f0b2c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c15a4d0 0x7f0b2c15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c15bfd0 con 0x7f0b2c0cad20 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c15c2b0 con 0x7f0b2c06d740 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c15c590 con 0x7f0b2c15a4d0 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2c0cad20 0x7f0b2c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2c0cad20 0x7f0b2c14ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53592/0 (socket says 172.21.15.57:53592) 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 -- 172.21.15.57:0/136511345 learned_addr learned my addr 172.21.15.57:0/136511345 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c06d740 0x7f0b2c0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2b7fe640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c15a4d0 0x7f0b2c15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 -- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c15a4d0 msgr2=0x7f0b2c15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c15a4d0 0x7f0b2c15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 -- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c06d740 msgr2=0x7f0b2c0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c06d740 0x7f0b2c0c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 -- 172.21.15.57:0/136511345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c009420 con 0x7f0b2c0cad20 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2affd640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c06d740 0x7f0b2c0c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b2a7fc640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2c0cad20 0x7f0b2c14ebb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000c780 tx=0x7f0b2000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b137fe640 1 -- 172.21.15.57:0/136511345 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200072d0 con 0x7f0b2c0cad20 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b137fe640 1 -- 172.21.15.57:0/136511345 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20007450 con 0x7f0b2c0cad20 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b137fe640 1 -- 172.21.15.57:0/136511345 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200047f0 con 0x7f0b2c0cad20 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2c15c870 con 0x7f0b2c0cad20 2023-11-24T08:07:24.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.867+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c14f6a0 con 0x7f0b2c0cad20 2023-11-24T08:07:24.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.871+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2c09d250 con 0x7f0b2c0cad20 2023-11-24T08:07:24.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.871+0000 7f0b137fe640 1 -- 172.21.15.57:0/136511345 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f0b20004950 con 0x7f0b2c0cad20 2023-11-24T08:07:24.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.871+0000 7f0b137fe640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b18066620 0x7f0b18068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:24.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.871+0000 7f0b137fe640 1 -- 172.21.15.57:0/136511345 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0b20083040 con 0x7f0b2c0cad20 2023-11-24T08:07:24.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.871+0000 7f0b2affd640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b18066620 0x7f0b18068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:24.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.875+0000 7f0b2affd640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b18066620 0x7f0b18068ae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0ae000 tx=0x7f0b1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:24.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:24.875+0000 7f0b137fe640 1 -- 172.21.15.57:0/136511345 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b200b4280 con 0x7f0b2c0cad20 2023-11-24T08:07:25.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.047+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0b2c06e0d0 con 0x7f0b2c0cad20 2023-11-24T08:07:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.691+0000 7f0b137fe640 1 -- 172.21.15.57:0/136511345 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0b2c06e0d0 con 0x7f0b2c0cad20 2023-11-24T08:07:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-11-24T08:07:25.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b18066620 msgr2=0x7f0b18068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b18066620 0x7f0b18068ae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0ae000 tx=0x7f0b1c008040 comp rx=0 tx=0).stop 2023-11-24T08:07:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2c0cad20 msgr2=0x7f0b2c14ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2c0cad20 0x7f0b2c14ebb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000c780 tx=0x7f0b2000cc40 comp rx=0 tx=0).stop 2023-11-24T08:07:25.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 shutdown_connections 2023-11-24T08:07:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b18066620 0x7f0b18068ae0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b2c15a4d0 0x7f0b2c15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2c0cad20 0x7f0b2c14ebb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 --2- 172.21.15.57:0/136511345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b2c06d740 0x7f0b2c0c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 >> 172.21.15.57:0/136511345 conn(0x7f0b2c0b0bf0 msgr2=0x7f0b2c0afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 shutdown_connections 2023-11-24T08:07:25.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.695+0000 7f0b31780640 1 -- 172.21.15.57:0/136511345 wait complete. 2023-11-24T08:07:25.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:07:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.883+0000 7fdadc4bb640 1 Processor -- start 2023-11-24T08:07:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.883+0000 7fdadc4bb640 1 -- start start 2023-11-24T08:07:25.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.883+0000 7fdadc4bb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ce420 0x7fdad415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.883+0000 7fdadc4bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdad40cd850 0x7fdad406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.883+0000 7fdadc4bb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40b3510 con 0x7fdad40ae4a0 2023-11-24T08:07:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.883+0000 7fdadc4bb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40b37f0 con 0x7fdad40cd850 2023-11-24T08:07:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.883+0000 7fdadc4bb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40b3ad0 con 0x7fdad40ce420 2023-11-24T08:07:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9a56640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ce420 0x7fdad415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdada257640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdad40ae4a0 0x7fdad40cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:49812/0 (socket says 172.21.15.57:49812) 2023-11-24T08:07:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdada257640 1 -- 172.21.15.57:0/4254565880 learned_addr learned my addr 172.21.15.57:0/4254565880 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:25.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdadaa58640 1 --2- 172.21.15.57:0/4254565880 >> v2:172.21.15.132:3300/0 conn(0x7fdad40cd850 0x7fdad406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9255640 1 -- 172.21.15.57:0/4254565880 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094481233 0 0) 0x7fdad40b3510 con 0x7fdad40ae4a0 2023-11-24T08:07:25.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9a56640 1 -- 172.21.15.57:0/4254565880 >> v2:172.21.15.132:3300/0 conn(0x7fdad40cd850 msgr2=0x7fdad406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:25.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9a56640 1 --2- 172.21.15.57:0/4254565880 >> v2:172.21.15.132:3300/0 conn(0x7fdad40cd850 0x7fdad406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9a56640 1 -- 172.21.15.57:0/4254565880 >> v1:172.21.15.132:6789/0 conn(0x7fdad40ae4a0 legacy=0x7fdad40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9a56640 1 -- 172.21.15.57:0/4254565880 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40b3db0 con 0x7fdad40ce420 2023-11-24T08:07:25.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9a56640 1 --2- 172.21.15.57:0/4254565880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ce420 0x7fdad415ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdac40097c0 tx=0x7fdac401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf5e04d70daad058 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9255640 1 -- 172.21.15.57:0/4254565880 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40ab670 con 0x7fdad40ce420 2023-11-24T08:07:25.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9255640 1 -- 172.21.15.57:0/4254565880 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40ab7d0 con 0x7fdad40ce420 2023-11-24T08:07:25.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.887+0000 7fdad9255640 1 -- 172.21.15.57:0/4254565880 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40abb60 con 0x7fdad40ce420 2023-11-24T08:07:25.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- 172.21.15.57:0/4254565880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ce420 msgr2=0x7fdad415ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/4254565880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ce420 0x7fdad415ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdac40097c0 tx=0x7fdac401c450 comp rx=0 tx=0).stop 2023-11-24T08:07:25.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- 172.21.15.57:0/4254565880 shutdown_connections 2023-11-24T08:07:25.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/4254565880 >> v2:172.21.15.132:3300/0 conn(0x7fdad40cd850 0x7fdad406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/4254565880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ce420 0x7fdad415ba00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- 172.21.15.57:0/4254565880 >> 172.21.15.57:0/4254565880 conn(0x7fdad40b0c80 msgr2=0x7fdad40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:25.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- 172.21.15.57:0/4254565880 shutdown_connections 2023-11-24T08:07:25.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- 172.21.15.57:0/4254565880 wait complete. 2023-11-24T08:07:25.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 Processor -- start 2023-11-24T08:07:25.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- start start 2023-11-24T08:07:25.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ae4a0 0x7fdad41446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdad40cd850 0x7fdad40706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdad40ce420 0x7fdad414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414ef40 con 0x7fdad40cd850 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4150650 con 0x7fdad40ce420 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadc4bb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414e880 con 0x7fdad40ae4a0 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdad40cd850 0x7fdad40706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdad40cd850 0x7fdad40706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34004/0 (socket says 172.21.15.57:34004) 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 -- 172.21.15.57:0/1100698119 learned_addr learned my addr 172.21.15.57:0/1100698119 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdada257640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ae4a0 0x7fdad41446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadaa58640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdad40ce420 0x7fdad414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 -- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ae4a0 msgr2=0x7fdad41446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ae4a0 0x7fdad41446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 -- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdad40ce420 msgr2=0x7fdad414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdad40ce420 0x7fdad414f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdad9a56640 1 -- 172.21.15.57:0/1100698119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009420 con 0x7fdad40cd850 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.891+0000 7fdadaa58640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdad40ce420 0x7fdad414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdad9a56640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdad40cd850 0x7fdad40706e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdac401ab00 tx=0x7fdac40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdacaffd640 1 -- 172.21.15.57:0/1100698119 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40abe90 con 0x7fdad40cd850 2023-11-24T08:07:25.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdacaffd640 1 -- 172.21.15.57:0/1100698119 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40bf450 con 0x7fdad40cd850 2023-11-24T08:07:25.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad414eb60 con 0x7fdad40cd850 2023-11-24T08:07:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdacaffd640 1 -- 172.21.15.57:0/1100698119 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40bf7e0 con 0x7fdad40cd850 2023-11-24T08:07:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad4144c30 con 0x7fdad40cd850 2023-11-24T08:07:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad414f080 con 0x7fdad40cd850 2023-11-24T08:07:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdacaffd640 1 -- 172.21.15.57:0/1100698119 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fdac40bf940 con 0x7fdad40cd850 2023-11-24T08:07:25.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdacaffd640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdab8066620 0x7fdab8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:25.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.895+0000 7fdacaffd640 1 -- 172.21.15.57:0/1100698119 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdac411ef00 con 0x7fdad40cd850 2023-11-24T08:07:25.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.899+0000 7fdada257640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdab8066620 0x7fdab8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:25.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.899+0000 7fdada257640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdab8066620 0x7fdab8068ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdad0000f70 tx=0x7fdad0007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:25.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:25.899+0000 7fdacaffd640 1 -- 172.21.15.57:0/1100698119 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdac40ec1c0 con 0x7fdad40cd850 2023-11-24T08:07:26.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.091+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdad414f080 con 0x7fdad40cd850 2023-11-24T08:07:26.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdacaffd640 1 -- 172.21.15.57:0/1100698119 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdad414f080 con 0x7fdad40cd850 2023-11-24T08:07:26.699 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 8 and data pool 9 2023-11-24T08:07:26.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdab8066620 msgr2=0x7fdab8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdab8066620 0x7fdab8068ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdad0000f70 tx=0x7fdad0007df0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdad40cd850 msgr2=0x7fdad40706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdad40cd850 0x7fdad40706e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdac401ab00 tx=0x7fdac40191f0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 shutdown_connections 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fdab8066620 0x7fdab8068ae0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdad40ce420 0x7fdad414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdad40cd850 0x7fdad40706e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 --2- 172.21.15.57:0/1100698119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdad40ae4a0 0x7fdad41446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 >> 172.21.15.57:0/1100698119 conn(0x7fdad40b0c80 msgr2=0x7fdad4147450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 shutdown_connections 2023-11-24T08:07:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.695+0000 7fdadc4bb640 1 -- 172.21.15.57:0/1100698119 wait complete. 2023-11-24T08:07:26.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:26.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.887+0000 7fc1b4032640 1 Processor -- start 2023-11-24T08:07:26.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.887+0000 7fc1b4032640 1 -- start start 2023-11-24T08:07:26.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b4032640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc1ac144030 0x7fc1ac06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b4032640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 0x7fc1ac06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b4032640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac06d8b0 con 0x7fc1ac06e280 2023-11-24T08:07:26.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b4032640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac145020 con 0x7fc1ac144030 2023-11-24T08:07:26.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b4032640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac09d0a0 con 0x7fc1ac09cc20 2023-11-24T08:07:26.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b25cf640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc1ac06e280 0x7fc1ac0709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36454/0 (socket says 172.21.15.57:36454) 2023-11-24T08:07:26.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b25cf640 1 -- 172.21.15.57:0/2486625453 learned_addr learned my addr 172.21.15.57:0/2486625453 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:26.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b15cd640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 0x7fc1ac06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2486625453 >> v2:172.21.15.132:3300/0 conn(0x7fc1ac144030 0x7fc1ac06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54211233 0 0) 0x7fc1ac06d8b0 con 0x7fc1ac06e280 2023-11-24T08:07:26.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc198003530 con 0x7fc1ac06e280 2023-11-24T08:07:26.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1440365984 0 0) 0x7fc198003530 con 0x7fc1ac06e280 2023-11-24T08:07:26.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 msgr2=0x7fc1ac06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 0x7fc1ac06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 >> v2:172.21.15.132:3300/0 conn(0x7fc1ac144030 msgr2=0x7fc1ac06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 --2- 172.21.15.57:0/2486625453 >> v2:172.21.15.132:3300/0 conn(0x7fc1ac144030 0x7fc1ac06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac06cca0 con 0x7fc1ac06e280 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7fc1a4001a00 con 0x7fc1ac06e280 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 >> v1:172.21.15.57:6789/0 conn(0x7fc1ac06e280 legacy=0x7fc1ac0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc198003980 0x7fc198003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 0x7fc1980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198004d10 0x7fc198005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac09d0a0 con 0x7fc198003980 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19800b990 con 0x7fc198004d10 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19800bad0 con 0x7fc1ac09cc20 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc198003980 0x7fc198003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b15cd640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 0x7fc1980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b25cf640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198004d10 0x7fc198005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b1dce640 1 -- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 msgr2=0x7fc1980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09cc20 0x7fc1980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b1dce640 1 -- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198004d10 msgr2=0x7fc198005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198004d10 0x7fc198005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b1dce640 1 -- 172.21.15.57:0/2486625453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198003530 con 0x7fc198003980 2023-11-24T08:07:26.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.891+0000 7fc1b25cf640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198004d10 0x7fc198005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc198003980 0x7fc198003da0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009ae0 tx=0x7fc1a801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74776dfb47cf3ce9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80a5630 con 0x7fc198003980 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80a5790 con 0x7fc198003980 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b0dcc640 1 -- 172.21.15.57:0/2486625453 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80a5b40 con 0x7fc198003980 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b4032640 1 -- 172.21.15.57:0/2486625453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc198003980 msgr2=0x7fc198003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b4032640 1 --2- 172.21.15.57:0/2486625453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc198003980 0x7fc198003da0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009ae0 tx=0x7fc1a801ca60 comp rx=0 tx=0).stop 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b25cf640 1 -- 172.21.15.57:0/2486625453 reap_dead start 2023-11-24T08:07:26.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b4032640 1 -- 172.21.15.57:0/2486625453 shutdown_connections 2023-11-24T08:07:26.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b4032640 1 -- 172.21.15.57:0/2486625453 >> 172.21.15.57:0/2486625453 conn(0x7fc1ac0b0bf0 msgr2=0x7fc1ac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:26.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b4032640 1 -- 172.21.15.57:0/2486625453 shutdown_connections 2023-11-24T08:07:26.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b4032640 1 -- 172.21.15.57:0/2486625453 wait complete. 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.895+0000 7fc1b4032640 1 Processor -- start 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 -- start start 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198003980 0x7fc1ac09c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09b170 0x7fc1ac13a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1ac132c90 0x7fc1ac1330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac132520 con 0x7fc1ac132c90 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac132800 con 0x7fc198003980 2023-11-24T08:07:26.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac09b610 con 0x7fc1ac09b170 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1ac132c90 0x7fc1ac1330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1ac132c90 0x7fc1ac1330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34026/0 (socket says 172.21.15.57:34026) 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 -- 172.21.15.57:0/2798596828 learned_addr learned my addr 172.21.15.57:0/2798596828 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b15cd640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09b170 0x7fc1ac13a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198003980 0x7fc1ac09c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 -- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09b170 msgr2=0x7fc1ac13a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09b170 0x7fc1ac13a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 -- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198003980 msgr2=0x7fc1ac09c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198003980 0x7fc1ac09c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:26.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 -- 172.21.15.57:0/2798596828 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac09b8f0 con 0x7fc1ac132c90 2023-11-24T08:07:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198003980 0x7fc1ac09c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b25cf640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1ac132c90 0x7fc1ac1330f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac144bf0 tx=0x7fc1a4007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1a27fc640 1 -- 172.21.15.57:0/2798596828 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4015070 con 0x7fc1ac132c90 2023-11-24T08:07:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1a27fc640 1 -- 172.21.15.57:0/2798596828 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a401a410 con 0x7fc1ac132c90 2023-11-24T08:07:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1a27fc640 1 -- 172.21.15.57:0/2798596828 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a401a780 con 0x7fc1ac132c90 2023-11-24T08:07:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac09bbd0 con 0x7fc1ac132c90 2023-11-24T08:07:26.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac13a810 con 0x7fc1ac132c90 2023-11-24T08:07:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.899+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac132990 con 0x7fc1ac132c90 2023-11-24T08:07:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.903+0000 7fc1a27fc640 1 -- 172.21.15.57:0/2798596828 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc1a40193c0 con 0x7fc1ac132c90 2023-11-24T08:07:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.903+0000 7fc1a27fc640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc190066620 0x7fc190068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.903+0000 7fc1a27fc640 1 -- 172.21.15.57:0/2798596828 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a4087d30 con 0x7fc1ac132c90 2023-11-24T08:07:26.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.903+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc190066620 0x7fc190068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:26.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.903+0000 7fc1b1dce640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc190066620 0x7fc190068ae0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80af000 tx=0x7fc1a80046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:26.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:26.907+0000 7fc1a27fc640 1 -- 172.21.15.57:0/2798596828 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1a4054f20 con 0x7fc1ac132c90 2023-11-24T08:07:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.063+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1ac067520 con 0x7fc1ac132c90 2023-11-24T08:07:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1a27fc640 1 -- 172.21.15.57:0/2798596828 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16518 (secure 0 0 0) 0x7fc1a401f070 con 0x7fc1ac132c90 2023-11-24T08:07:27.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:27.071 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":60,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:26.096166+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc190066620 msgr2=0x7fc190068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc190066620 0x7fc190068ae0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80af000 tx=0x7fc1a80046d0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1ac132c90 msgr2=0x7fc1ac1330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1ac132c90 0x7fc1ac1330f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac144bf0 tx=0x7fc1a4007420 comp rx=0 tx=0).stop 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 shutdown_connections 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc190066620 0x7fc190068ae0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1ac132c90 0x7fc1ac1330f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1ac09b170 0x7fc1ac13a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 --2- 172.21.15.57:0/2798596828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc198003980 0x7fc1ac09c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 >> 172.21.15.57:0/2798596828 conn(0x7fc1ac0b0bf0 msgr2=0x7fc1ac0acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 shutdown_connections 2023-11-24T08:07:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.067+0000 7fc1b4032640 1 -- 172.21.15.57:0/2798596828 wait complete. 2023-11-24T08:07:27.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:27.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f038a291640 1 Processor -- start 2023-11-24T08:07:27.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f038a291640 1 -- start start 2023-11-24T08:07:27.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f038a291640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f038415d4f0 0x7f038406a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f038a291640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038406af20 con 0x7f03840ce710 2023-11-24T08:07:27.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f038a291640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038406b200 con 0x7f03840715b0 2023-11-24T08:07:27.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f038a291640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038406bba0 con 0x7f038415d4f0 2023-11-24T08:07:27.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f03837fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f03840ce710 0x7f0384070ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36466/0 (socket says 172.21.15.57:36466) 2023-11-24T08:07:27.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.231+0000 7f03837fe640 1 -- 172.21.15.57:0/725802745 learned_addr learned my addr 172.21.15.57:0/725802745 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:27.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0383fff640 1 --2- 172.21.15.57:0/725802745 >> v2:172.21.15.132:3300/0 conn(0x7f038415d4f0 0x7f038406a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248258079 0 0) 0x7f038406af20 con 0x7f03840ce710 2023-11-24T08:07:27.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f036c003530 con 0x7f03840ce710 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3451297429 0 0) 0x7f036c003530 con 0x7f03840ce710 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 >> v2:172.21.15.132:3300/0 conn(0x7f038415d4f0 msgr2=0x7f038406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 --2- 172.21.15.57:0/725802745 >> v2:172.21.15.132:3300/0 conn(0x7f038415d4f0 0x7f038406a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 >> v1:172.21.15.132:6789/0 conn(0x7f03840715b0 legacy=0x7f0384167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038406b4e0 con 0x7f03840ce710 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f0378001680 con 0x7f03840ce710 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 >> v1:172.21.15.57:6789/0 conn(0x7f03840ce710 legacy=0x7f0384070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f036c003980 0x7f036c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f036c0047d0 0x7f036c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f036c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038406bba0 con 0x7f036c005190 2023-11-24T08:07:27.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c00c030 con 0x7f036c0047d0 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c00c1f0 con 0x7f036c003980 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f038882e640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f036c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f0383fff640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f036c003980 0x7f036c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f03837fe640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f036c0047d0 0x7f036c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f038882e640 1 -- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f036c003980 msgr2=0x7f036c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f038882e640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f036c003980 0x7f036c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f038882e640 1 -- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f036c0047d0 msgr2=0x7f036c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f038882e640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f036c0047d0 0x7f036c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.235+0000 7f038882e640 1 -- 172.21.15.57:0/725802745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c003530 con 0x7f036c005190 2023-11-24T08:07:27.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038882e640 1 -- 172.21.15.57:0/725802745 reap_dead start 2023-11-24T08:07:27.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038882e640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f036c00b990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f037c001e40 tx=0x7f037c01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9021388cab8e85 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c003b80 con 0x7f036c005190 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c003ce0 con 0x7f036c005190 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f0382ffd640 1 -- 172.21.15.57:0/725802745 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c005260 con 0x7f036c005190 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- 172.21.15.57:0/725802745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 msgr2=0x7f036c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f036c00b990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f037c001e40 tx=0x7f037c01c740 comp rx=0 tx=0).stop 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- 172.21.15.57:0/725802745 shutdown_connections 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 --2- 172.21.15.57:0/725802745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f036c00b990 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- 172.21.15.57:0/725802745 >> 172.21.15.57:0/725802745 conn(0x7f03840cc330 msgr2=0x7f03840cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- 172.21.15.57:0/725802745 shutdown_connections 2023-11-24T08:07:27.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- 172.21.15.57:0/725802745 wait complete. 2023-11-24T08:07:27.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 Processor -- start 2023-11-24T08:07:27.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- start start 2023-11-24T08:07:27.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f0384153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0384155920 0x7f0384155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f038413efc0 0x7f038413f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038414e990 con 0x7f036c005190 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384159aa0 con 0x7f0384155920 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.239+0000 7f038a291640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0384159d80 con 0x7f038413efc0 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f0384153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f0384153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34036/0 (socket says 172.21.15.57:34036) 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 -- 172.21.15.57:0/970947389 learned_addr learned my addr 172.21.15.57:0/970947389 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f03837fe640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0384155920 0x7f0384155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f038882e640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f038413efc0 0x7f038413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 -- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f038413efc0 msgr2=0x7f038413f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f038413efc0 0x7f038413f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 -- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0384155920 msgr2=0x7f0384155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0384155920 0x7f0384155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 -- 172.21.15.57:0/970947389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038415a060 con 0x7f036c005190 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f038882e640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f038413efc0 0x7f038413f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0383fff640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f0384153080 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0374011960 tx=0x7f0374011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0380ff9640 1 -- 172.21.15.57:0/970947389 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400fa30 con 0x7f036c005190 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0380ff9640 1 -- 172.21.15.57:0/970947389 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400fb90 con 0x7f036c005190 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038415a340 con 0x7f036c005190 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0380ff9640 1 -- 172.21.15.57:0/970947389 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374014440 con 0x7f036c005190 2023-11-24T08:07:27.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038415ab40 con 0x7f036c005190 2023-11-24T08:07:27.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0384067520 con 0x7f036c005190 2023-11-24T08:07:27.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0380ff9640 1 -- 172.21.15.57:0/970947389 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f037401d400 con 0x7f036c005190 2023-11-24T08:07:27.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.243+0000 7f0380ff9640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0370066620 0x7f0370068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.247+0000 7f0380ff9640 1 -- 172.21.15.57:0/970947389 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03740849a0 con 0x7f036c005190 2023-11-24T08:07:27.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.247+0000 7f03837fe640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0370066620 0x7f0370068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.247+0000 7f03837fe640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0370066620 0x7f0370068ae0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0378007d30 tx=0x7f0378000ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.247+0000 7f0380ff9640 1 -- 172.21.15.57:0/970947389 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0374051ba0 con 0x7f036c005190 2023-11-24T08:07:27.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.407+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f038406d8d0 con 0x7f036c005190 2023-11-24T08:07:27.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.407+0000 7f0380ff9640 1 -- 172.21.15.57:0/970947389 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f03740551c0 con 0x7f036c005190 2023-11-24T08:07:27.413 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:27.413 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":60,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:26.096166+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0370066620 msgr2=0x7f0370068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0370066620 0x7f0370068ae0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0378007d30 tx=0x7f0378000ee0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 msgr2=0x7f0384153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f0384153080 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0374011960 tx=0x7f0374011d60 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 shutdown_connections 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0370066620 0x7f0370068ae0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f038413efc0 0x7f038413f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0384155920 0x7f0384155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 --2- 172.21.15.57:0/970947389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f036c005190 0x7f0384153080 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 >> 172.21.15.57:0/970947389 conn(0x7f03840cc330 msgr2=0x7f03841526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 shutdown_connections 2023-11-24T08:07:27.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.411+0000 7f038a291640 1 -- 172.21.15.57:0/970947389 wait complete. 2023-11-24T08:07:27.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.575+0000 7f1b7f565640 1 Processor -- start 2023-11-24T08:07:27.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.575+0000 7f1b7f565640 1 -- start start 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7f565640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b780ae4a0 0x7f1b7815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7f565640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b780ce420 0x7f1b7806c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7f565640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b780b3510 con 0x7f1b780cd850 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7f565640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b780b37f0 con 0x7f1b780ae4a0 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7f565640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b780b3ad0 con 0x7f1b780ce420 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7d301640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b780ae4a0 0x7f1b7815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7cb00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1b780cd850 0x7f1b780cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36468/0 (socket says 172.21.15.57:36468) 2023-11-24T08:07:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7cb00640 1 -- 172.21.15.57:0/1123412478 learned_addr learned my addr 172.21.15.57:0/1123412478 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7db02640 1 --2- 172.21.15.57:0/1123412478 >> v2:172.21.15.132:3300/0 conn(0x7f1b780ce420 0x7f1b7806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7d301640 1 -- 172.21.15.57:0/1123412478 >> v2:172.21.15.132:3300/0 conn(0x7f1b780ce420 msgr2=0x7f1b7806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7d301640 1 --2- 172.21.15.57:0/1123412478 >> v2:172.21.15.132:3300/0 conn(0x7f1b780ce420 0x7f1b7806c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7d301640 1 -- 172.21.15.57:0/1123412478 >> v1:172.21.15.57:6789/0 conn(0x7f1b780cd850 legacy=0x7f1b780cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7d301640 1 -- 172.21.15.57:0/1123412478 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780b3db0 con 0x7f1b780ae4a0 2023-11-24T08:07:27.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b6ffff640 1 -- 172.21.15.57:0/1123412478 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134868128 0 0) 0x7f1b780b3510 con 0x7f1b780cd850 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b7d301640 1 --2- 172.21.15.57:0/1123412478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ae4a0 0x7f1b7815ba00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b45b0 tx=0x7f1b7401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0ad66f44e0e27a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.579+0000 7f1b6ffff640 1 -- 172.21.15.57:0/1123412478 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b740ab650 con 0x7f1b780ae4a0 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b6ffff640 1 -- 172.21.15.57:0/1123412478 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b740ab7b0 con 0x7f1b780ae4a0 2023-11-24T08:07:27.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b6ffff640 1 -- 172.21.15.57:0/1123412478 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b740abb40 con 0x7f1b780ae4a0 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- 172.21.15.57:0/1123412478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ae4a0 msgr2=0x7f1b7815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 --2- 172.21.15.57:0/1123412478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ae4a0 0x7f1b7815ba00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1b780b45b0 tx=0x7f1b7401c430 comp rx=0 tx=0).stop 2023-11-24T08:07:27.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- 172.21.15.57:0/1123412478 shutdown_connections 2023-11-24T08:07:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 --2- 172.21.15.57:0/1123412478 >> v2:172.21.15.132:3300/0 conn(0x7f1b780ce420 0x7f1b7806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 --2- 172.21.15.57:0/1123412478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ae4a0 0x7f1b7815ba00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- 172.21.15.57:0/1123412478 >> 172.21.15.57:0/1123412478 conn(0x7f1b780b0c80 msgr2=0x7f1b780b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- 172.21.15.57:0/1123412478 shutdown_connections 2023-11-24T08:07:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- 172.21.15.57:0/1123412478 wait complete. 2023-11-24T08:07:27.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 Processor -- start 2023-11-24T08:07:27.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- start start 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b780ae4a0 0x7f1b78154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b780cd850 0x7f1b7814ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ce420 0x7f1b780705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7815bd00 con 0x7f1b780ce420 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7815b0f0 con 0x7f1b780cd850 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7f565640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7815b3d0 con 0x7f1b780ae4a0 2023-11-24T08:07:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7db02640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ce420 0x7f1b780705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7db02640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ce420 0x7f1b780705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34058/0 (socket says 172.21.15.57:34058) 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7db02640 1 -- 172.21.15.57:0/183507067 learned_addr learned my addr 172.21.15.57:0/183507067 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7cb00640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b780cd850 0x7f1b7814ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.583+0000 7f1b7d301640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b780ae4a0 0x7f1b78154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7db02640 1 -- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b780ae4a0 msgr2=0x7f1b78154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7db02640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b780ae4a0 0x7f1b78154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7db02640 1 -- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b780cd850 msgr2=0x7f1b7814ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7db02640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b780cd850 0x7f1b7814ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7db02640 1 -- 172.21.15.57:0/183507067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74009420 con 0x7f1b780ce420 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7db02640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ce420 0x7f1b780705e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007e60 tx=0x7f1b7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b6dffb640 1 -- 172.21.15.57:0/183507067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70014420 con 0x7f1b780ce420 2023-11-24T08:07:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b6dffb640 1 -- 172.21.15.57:0/183507067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b700145a0 con 0x7f1b780ce420 2023-11-24T08:07:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7815b6b0 con 0x7f1b780ce420 2023-11-24T08:07:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b6dffb640 1 -- 172.21.15.57:0/183507067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70014950 con 0x7f1b780ce420 2023-11-24T08:07:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b78154b50 con 0x7f1b780ce420 2023-11-24T08:07:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7815be70 con 0x7f1b780ce420 2023-11-24T08:07:27.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b6dffb640 1 -- 172.21.15.57:0/183507067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f1b70014ab0 con 0x7f1b780ce420 2023-11-24T08:07:27.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b6dffb640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1b5c066620 0x7f1b5c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:27.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.587+0000 7f1b6dffb640 1 -- 172.21.15.57:0/183507067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b70084990 con 0x7f1b780ce420 2023-11-24T08:07:27.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.591+0000 7f1b7d301640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1b5c066620 0x7f1b5c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:27.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.591+0000 7f1b7d301640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1b5c066620 0x7f1b5c068ae0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1b740af000 tx=0x7f1b740a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:27.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.591+0000 7f1b6dffb640 1 -- 172.21.15.57:0/183507067 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b70051c40 con 0x7f1b780ce420 2023-11-24T08:07:27.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:27.787+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1b7804e8c0 con 0x7f1b780ce420 2023-11-24T08:07:28.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-24T08:07:28.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-24T08:07:28.672 INFO:tasks.ceph.mds.b.smithi132.stderr:2023-11-24T08:07:28.672+0000 7f57c84f8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:07:28.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.727+0000 7f1b6dffb640 1 -- 172.21.15.57:0/183507067 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1b70055260 con 0x7f1b780ce420 2023-11-24T08:07:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1b5c066620 msgr2=0x7f1b5c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1b5c066620 0x7f1b5c068ae0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1b740af000 tx=0x7f1b740a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ce420 msgr2=0x7f1b780705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ce420 0x7f1b780705e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007e60 tx=0x7f1b7000e4b0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 shutdown_connections 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f1b5c066620 0x7f1b5c068ae0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b780ce420 0x7f1b780705e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b780cd850 0x7f1b7814ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 --2- 172.21.15.57:0/183507067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b780ae4a0 0x7f1b78154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 >> 172.21.15.57:0/183507067 conn(0x7f1b780b0c80 msgr2=0x7f1b780abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 shutdown_connections 2023-11-24T08:07:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.731+0000 7f1b7f565640 1 -- 172.21.15.57:0/183507067 wait complete. 2023-11-24T08:07:28.758 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:07:28.758 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.903+0000 7f72d212a640 1 Processor -- start 2023-11-24T08:07:28.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.903+0000 7f72d212a640 1 -- start start 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72d212a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72cc0ce200 0x7f72cc0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72d212a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72cc0cf300 0x7f72cc06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72d212a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc06c620 con 0x7f72cc15d630 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72d212a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0cf790 con 0x7f72cc0ce200 2023-11-24T08:07:28.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72d212a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc06ba10 con 0x7f72cc0cf300 2023-11-24T08:07:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72caffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72cc0ce200 0x7f72cc0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72caffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72cc0ce200 0x7f72cc0cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34068/0 (socket says 172.21.15.57:34068) 2023-11-24T08:07:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72caffd640 1 -- 172.21.15.57:0/3837546245 learned_addr learned my addr 172.21.15.57:0/3837546245 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72cbfff640 1 --2- 172.21.15.57:0/3837546245 >> v2:172.21.15.132:3300/0 conn(0x7f72cc0cf300 0x7f72cc06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72caffd640 1 -- 172.21.15.57:0/3837546245 >> v2:172.21.15.132:3300/0 conn(0x7f72cc0cf300 msgr2=0x7f72cc06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72caffd640 1 --2- 172.21.15.57:0/3837546245 >> v2:172.21.15.132:3300/0 conn(0x7f72cc0cf300 0x7f72cc06cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72caffd640 1 -- 172.21.15.57:0/3837546245 >> v1:172.21.15.132:6789/0 conn(0x7f72cc15d630 legacy=0x7f72cc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:28.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72caffd640 1 -- 172.21.15.57:0/3837546245 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc06bcf0 con 0x7f72cc0ce200 2023-11-24T08:07:28.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.907+0000 7f72cbfff640 1 --2- 172.21.15.57:0/3837546245 >> v2:172.21.15.132:3300/0 conn(0x7f72cc0cf300 0x7f72cc06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:28.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72caffd640 1 --2- 172.21.15.57:0/3837546245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc0cedc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0cdb90 tx=0x7f72c001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdaf9af43126427 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72ca7fc640 1 -- 172.21.15.57:0/3837546245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00aa5f0 con 0x7f72cc0ce200 2023-11-24T08:07:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72ca7fc640 1 -- 172.21.15.57:0/3837546245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c00aa750 con 0x7f72cc0ce200 2023-11-24T08:07:28.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72ca7fc640 1 -- 172.21.15.57:0/3837546245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00aaae0 con 0x7f72cc0ce200 2023-11-24T08:07:28.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 -- 172.21.15.57:0/3837546245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 msgr2=0x7f72cc0cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 --2- 172.21.15.57:0/3837546245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc0cedc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0cdb90 tx=0x7f72c001c490 comp rx=0 tx=0).stop 2023-11-24T08:07:28.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 -- 172.21.15.57:0/3837546245 shutdown_connections 2023-11-24T08:07:28.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 --2- 172.21.15.57:0/3837546245 >> v2:172.21.15.132:3300/0 conn(0x7f72cc0cf300 0x7f72cc06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 --2- 172.21.15.57:0/3837546245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc0cedc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 -- 172.21.15.57:0/3837546245 >> 172.21.15.57:0/3837546245 conn(0x7f72cc06e860 msgr2=0x7f72cc06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:28.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 -- 172.21.15.57:0/3837546245 shutdown_connections 2023-11-24T08:07:28.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 -- 172.21.15.57:0/3837546245 wait complete. 2023-11-24T08:07:28.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 Processor -- start 2023-11-24T08:07:28.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.911+0000 7f72d212a640 1 -- start start 2023-11-24T08:07:28.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0cf300 0x7f72cc0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72cc15d630 0x7f72cc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0b0ed0 con 0x7f72cc0ce200 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0b11b0 con 0x7f72cc0cf300 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0b1490 con 0x7f72cc15d630 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34082/0 (socket says 172.21.15.57:34082) 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 -- 172.21.15.57:0/3440972469 learned_addr learned my addr 172.21.15.57:0/3440972469 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:28.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72caffd640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0cf300 0x7f72cc0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cbfff640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72cc15d630 0x7f72cc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 -- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72cc15d630 msgr2=0x7f72cc0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72cc15d630 0x7f72cc0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 -- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0cf300 msgr2=0x7f72cc0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0cf300 0x7f72cc0b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 -- 172.21.15.57:0/3440972469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00094d0 con 0x7f72cc0ce200 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cbfff640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72cc15d630 0x7f72cc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72cb7fe640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc158110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00b410 tx=0x7f72bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72b3fff640 1 -- 172.21.15.57:0/3440972469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc004020 con 0x7f72cc0ce200 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72b3fff640 1 -- 172.21.15.57:0/3440972469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc004180 con 0x7f72cc0ce200 2023-11-24T08:07:28.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72b3fff640 1 -- 172.21.15.57:0/3440972469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc011630 con 0x7f72cc0ce200 2023-11-24T08:07:28.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc0b1770 con 0x7f72cc0ce200 2023-11-24T08:07:28.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc15e9f0 con 0x7f72cc0ce200 2023-11-24T08:07:28.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc04e8c0 con 0x7f72cc0ce200 2023-11-24T08:07:28.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.915+0000 7f72b3fff640 1 -- 172.21.15.57:0/3440972469 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f72bc011790 con 0x7f72cc0ce200 2023-11-24T08:07:28.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.919+0000 7f72b3fff640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f72b8066620 0x7f72b8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:28.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.919+0000 7f72b3fff640 1 -- 172.21.15.57:0/3440972469 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72bc083e30 con 0x7f72cc0ce200 2023-11-24T08:07:28.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.919+0000 7f72caffd640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f72b8066620 0x7f72b8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:28.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.919+0000 7f72caffd640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f72b8066620 0x7f72b8068ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f72c00ae000 tx=0x7f72c00b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:28.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:28.923+0000 7f72b3fff640 1 -- 172.21.15.57:0/3440972469 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72bc051020 con 0x7f72cc0ce200 2023-11-24T08:07:29.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.115+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f72cc0b1c20 con 0x7f72cc0ce200 2023-11-24T08:07:29.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.735+0000 7f72b3fff640 1 -- 172.21.15.57:0/3440972469 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72bc0150c0 con 0x7f72cc0ce200 2023-11-24T08:07:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f72b8066620 msgr2=0x7f72b8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f72b8066620 0x7f72b8068ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f72c00ae000 tx=0x7f72c00b5040 comp rx=0 tx=0).stop 2023-11-24T08:07:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 msgr2=0x7f72cc158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc158110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00b410 tx=0x7f72bc00b8d0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 shutdown_connections 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f72b8066620 0x7f72b8068ae0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72cc15d630 0x7f72cc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72cc0cf300 0x7f72cc0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 --2- 172.21.15.57:0/3440972469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72cc0ce200 0x7f72cc158110 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 >> 172.21.15.57:0/3440972469 conn(0x7f72cc06e860 msgr2=0x7f72cc0cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 shutdown_connections 2023-11-24T08:07:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.739+0000 7f72d212a640 1 -- 172.21.15.57:0/3440972469 wait complete. 2023-11-24T08:07:29.765 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:07:29.766 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:29.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.907+0000 7fafb0daa640 1 Processor -- start 2023-11-24T08:07:29.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.907+0000 7fafb0daa640 1 -- start start 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafb0daa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fafac144030 0x7fafac06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafb0daa640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafac09cc20 0x7fafac06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafb0daa640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac06d8b0 con 0x7fafac06e280 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafb0daa640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac145020 con 0x7fafac09cc20 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafb0daa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac09d0a0 con 0x7fafac144030 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafaad9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fafac06e280 0x7fafac0709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36482/0 (socket says 172.21.15.57:36482) 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafaad9d640 1 -- 172.21.15.57:0/3857005462 learned_addr learned my addr 172.21.15.57:0/3857005462 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:29.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafa9d9b640 1 --2- 172.21.15.57:0/3857005462 >> v2:172.21.15.57:3300/0 conn(0x7fafac09cc20 0x7fafac06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafaa59c640 1 --2- 172.21.15.57:0/3857005462 >> v2:172.21.15.132:3300/0 conn(0x7fafac144030 0x7fafac06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafa959a640 1 -- 172.21.15.57:0/3857005462 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687214605 0 0) 0x7fafac06d8b0 con 0x7fafac06e280 2023-11-24T08:07:29.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafa959a640 1 -- 172.21.15.57:0/3857005462 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf94003530 con 0x7fafac06e280 2023-11-24T08:07:29.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafa9d9b640 1 -- 172.21.15.57:0/3857005462 >> v2:172.21.15.132:3300/0 conn(0x7fafac144030 msgr2=0x7fafac06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:29.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafa9d9b640 1 --2- 172.21.15.57:0/3857005462 >> v2:172.21.15.132:3300/0 conn(0x7fafac144030 0x7fafac06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafa9d9b640 1 -- 172.21.15.57:0/3857005462 >> v1:172.21.15.57:6789/0 conn(0x7fafac06e280 legacy=0x7fafac0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafa9d9b640 1 -- 172.21.15.57:0/3857005462 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac06cca0 con 0x7fafac09cc20 2023-11-24T08:07:29.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.911+0000 7fafaa59c640 1 --2- 172.21.15.57:0/3857005462 >> v2:172.21.15.132:3300/0 conn(0x7fafac144030 0x7fafac06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:29.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafa9d9b640 1 --2- 172.21.15.57:0/3857005462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac09cc20 0x7fafac06dd40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fafac06c2f0 tx=0x7fafa001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc2df3826930d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafa959a640 1 -- 172.21.15.57:0/3857005462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00a7070 con 0x7fafac09cc20 2023-11-24T08:07:29.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafa959a640 1 -- 172.21.15.57:0/3857005462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa00ab430 con 0x7fafac09cc20 2023-11-24T08:07:29.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafa959a640 1 -- 172.21.15.57:0/3857005462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00ab7a0 con 0x7fafac09cc20 2023-11-24T08:07:29.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 -- 172.21.15.57:0/3857005462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac09cc20 msgr2=0x7fafac06dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 --2- 172.21.15.57:0/3857005462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac09cc20 0x7fafac06dd40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fafac06c2f0 tx=0x7fafa001c430 comp rx=0 tx=0).stop 2023-11-24T08:07:29.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 -- 172.21.15.57:0/3857005462 shutdown_connections 2023-11-24T08:07:29.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 --2- 172.21.15.57:0/3857005462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac09cc20 0x7fafac06dd40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 --2- 172.21.15.57:0/3857005462 >> v2:172.21.15.132:3300/0 conn(0x7fafac144030 0x7fafac06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 -- 172.21.15.57:0/3857005462 >> 172.21.15.57:0/3857005462 conn(0x7fafac0b0bf0 msgr2=0x7fafac0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:29.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 -- 172.21.15.57:0/3857005462 shutdown_connections 2023-11-24T08:07:29.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 -- 172.21.15.57:0/3857005462 wait complete. 2023-11-24T08:07:29.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.915+0000 7fafb0daa640 1 Processor -- start 2023-11-24T08:07:29.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 -- start start 2023-11-24T08:07:29.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac06e280 0x7fafac138550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafac09cc20 0x7fafac1f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafac144030 0x7fafac0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0cf8a0 con 0x7fafac06e280 2023-11-24T08:07:29.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1f4580 con 0x7fafac09cc20 2023-11-24T08:07:29.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac154cd0 con 0x7fafac144030 2023-11-24T08:07:29.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac06e280 0x7fafac138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac06e280 0x7fafac138550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34114/0 (socket says 172.21.15.57:34114) 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 -- 172.21.15.57:0/620367340 learned_addr learned my addr 172.21.15.57:0/620367340 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafa9d9b640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafac09cc20 0x7fafac1f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaad9d640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafac144030 0x7fafac0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 -- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafac144030 msgr2=0x7fafac0abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafac144030 0x7fafac0abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 -- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafac09cc20 msgr2=0x7fafac1f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafac09cc20 0x7fafac1f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 -- 172.21.15.57:0/620367340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0009420 con 0x7fafac06e280 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafaa59c640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac06e280 0x7fafac138550 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00d800 tx=0x7faf9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7faf9affd640 1 -- 172.21.15.57:0/620367340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00b6c0 con 0x7fafac06e280 2023-11-24T08:07:29.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7faf9affd640 1 -- 172.21.15.57:0/620367340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c00b820 con 0x7fafac06e280 2023-11-24T08:07:29.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac154fb0 con 0x7fafac06e280 2023-11-24T08:07:29.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7faf9affd640 1 -- 172.21.15.57:0/620367340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00bbd0 con 0x7fafac06e280 2023-11-24T08:07:29.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac155570 con 0x7fafac06e280 2023-11-24T08:07:29.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.919+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac067520 con 0x7fafac06e280 2023-11-24T08:07:29.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.923+0000 7faf9affd640 1 -- 172.21.15.57:0/620367340 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7faf9c00bd30 con 0x7fafac06e280 2023-11-24T08:07:29.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.923+0000 7faf9affd640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf8c066620 0x7faf8c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:29.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.923+0000 7faf9affd640 1 -- 172.21.15.57:0/620367340 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf9c084530 con 0x7fafac06e280 2023-11-24T08:07:29.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.923+0000 7fafa9d9b640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf8c066620 0x7faf8c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:29.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.923+0000 7fafa9d9b640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf8c066620 0x7faf8c068ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fafa00af000 tx=0x7fafa00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:29.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:29.927+0000 7faf9affd640 1 -- 172.21.15.57:0/620367340 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf9c0517e0 con 0x7fafac06e280 2023-11-24T08:07:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.115+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafac139fd0 con 0x7fafac06e280 2023-11-24T08:07:30.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.115+0000 7faf9affd640 1 -- 172.21.15.57:0/620367340 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4919 (secure 0 0 0) 0x7faf9c054e00 con 0x7fafac06e280 2023-11-24T08:07:30.121 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:30.121 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/4096569691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4096569691},{"type":"v1","addr":"172.21.15.57:6834","nonce":4096569691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/671957004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":671957004},{"type":"v1","addr":"172.21.15.57:6835","nonce":671957004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6165,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1925156645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1925156645},{"type":"v1","addr":"172.21.15.132:6837","nonce":1925156645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:26.096476+0000","modified":"2023-11-24T08:07:29.117899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55373":{"gid":55373,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1683487539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1683487539},{"type":"v1","addr":"172.21.15.132:6836","nonce":1683487539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:30.121 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 35 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf8c066620 msgr2=0x7faf8c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf8c066620 0x7faf8c068ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fafa00af000 tx=0x7fafa00a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac06e280 msgr2=0x7fafac138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac06e280 0x7fafac138550 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00d800 tx=0x7faf9c00dcc0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 shutdown_connections 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7faf8c066620 0x7faf8c068ae0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafac144030 0x7fafac0abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafac09cc20 0x7fafac1f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 --2- 172.21.15.57:0/620367340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafac06e280 0x7fafac138550 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 >> 172.21.15.57:0/620367340 conn(0x7fafac0b0bf0 msgr2=0x7fafac0723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 shutdown_connections 2023-11-24T08:07:30.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.119+0000 7fafb0daa640 1 -- 172.21.15.57:0/620367340 wait complete. 2023-11-24T08:07:30.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.279+0000 7fb224d94640 1 Processor -- start 2023-11-24T08:07:30.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.279+0000 7fb224d94640 1 -- start start 2023-11-24T08:07:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb224d94640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb22015a320 0x7fb2200b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb224d94640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22015a700 con 0x7fb220070da0 2023-11-24T08:07:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb224d94640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2200b2620 con 0x7fb2200b36c0 2023-11-24T08:07:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb224d94640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2200b2430 con 0x7fb22015a320 2023-11-24T08:07:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21e59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb22015a320 0x7fb2200b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21ed9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb220070da0 0x7fb22015ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36498/0 (socket says 172.21.15.57:36498) 2023-11-24T08:07:30.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21ed9d640 1 -- 172.21.15.57:0/1532449793 learned_addr learned my addr 172.21.15.57:0/1532449793 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21e59c640 1 -- 172.21.15.57:0/1532449793 >> v1:172.21.15.132:6789/0 conn(0x7fb2200b36c0 legacy=0x7fb220070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21e59c640 1 -- 172.21.15.57:0/1532449793 >> v1:172.21.15.57:6789/0 conn(0x7fb220070da0 legacy=0x7fb22015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21dd9b640 1 -- 172.21.15.57:0/1532449793 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238882810 0 0) 0x7fb22015a700 con 0x7fb220070da0 2023-11-24T08:07:30.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21e59c640 1 -- 172.21.15.57:0/1532449793 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200b2900 con 0x7fb22015a320 2023-11-24T08:07:30.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.283+0000 7fb21e59c640 1 --2- 172.21.15.57:0/1532449793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22015a320 0x7fb2200b1ef0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb2100097c0 tx=0x7fb21001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b167fdab7ee11af server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb21dd9b640 1 -- 172.21.15.57:0/1532449793 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100ad660 con 0x7fb22015a320 2023-11-24T08:07:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb21dd9b640 1 -- 172.21.15.57:0/1532449793 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2100ad7c0 con 0x7fb22015a320 2023-11-24T08:07:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb21dd9b640 1 -- 172.21.15.57:0/1532449793 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100adb50 con 0x7fb22015a320 2023-11-24T08:07:30.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- 172.21.15.57:0/1532449793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22015a320 msgr2=0x7fb2200b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 --2- 172.21.15.57:0/1532449793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22015a320 0x7fb2200b1ef0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb2100097c0 tx=0x7fb21001c450 comp rx=0 tx=0).stop 2023-11-24T08:07:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- 172.21.15.57:0/1532449793 shutdown_connections 2023-11-24T08:07:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 --2- 172.21.15.57:0/1532449793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22015a320 0x7fb2200b1ef0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- 172.21.15.57:0/1532449793 >> 172.21.15.57:0/1532449793 conn(0x7fb2200b0bf0 msgr2=0x7fb2200b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- 172.21.15.57:0/1532449793 shutdown_connections 2023-11-24T08:07:30.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- 172.21.15.57:0/1532449793 wait complete. 2023-11-24T08:07:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 Processor -- start 2023-11-24T08:07:30.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- start start 2023-11-24T08:07:30.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb220070da0 0x7fb22014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2200b36c0 0x7fb22015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb22015a320 0x7fb22015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb220163bf0 con 0x7fb220070da0 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2201608b0 con 0x7fb2200b36c0 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb224d94640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb220160b90 con 0x7fb22015a320 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.287+0000 7fb21e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb220070da0 0x7fb22014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb220070da0 0x7fb22014ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34142/0 (socket says 172.21.15.57:34142) 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 -- 172.21.15.57:0/2924417908 learned_addr learned my addr 172.21.15.57:0/2924417908 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 -- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb22015a320 msgr2=0x7fb22015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21ed9d640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb22015a320 0x7fb22015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb217fff640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2200b36c0 0x7fb22015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb22015a320 0x7fb22015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 -- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2200b36c0 msgr2=0x7fb22015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2200b36c0 0x7fb22015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 -- 172.21.15.57:0/2924417908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210009420 con 0x7fb220070da0 2023-11-24T08:07:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21ed9d640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb22015a320 0x7fb22015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb217fff640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2200b36c0 0x7fb22015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:30.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb21e59c640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb220070da0 0x7fb22014ba20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb2100b0040 tx=0x7fb21001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb216ffd640 1 -- 172.21.15.57:0/2924417908 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100b9450 con 0x7fb220070da0 2023-11-24T08:07:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb216ffd640 1 -- 172.21.15.57:0/2924417908 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2100b95b0 con 0x7fb220070da0 2023-11-24T08:07:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb216ffd640 1 -- 172.21.15.57:0/2924417908 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100b9960 con 0x7fb220070da0 2023-11-24T08:07:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb220160e70 con 0x7fb220070da0 2023-11-24T08:07:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22014bf60 con 0x7fb220070da0 2023-11-24T08:07:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb220067520 con 0x7fb220070da0 2023-11-24T08:07:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb216ffd640 1 -- 172.21.15.57:0/2924417908 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fb2100b9ac0 con 0x7fb220070da0 2023-11-24T08:07:30.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb216ffd640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb200066620 0x7fb200068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.291+0000 7fb216ffd640 1 -- 172.21.15.57:0/2924417908 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb21011ed20 con 0x7fb220070da0 2023-11-24T08:07:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.295+0000 7fb217fff640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb200066620 0x7fb200068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.295+0000 7fb217fff640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb200066620 0x7fb200068ae0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb22009c290 tx=0x7fb208009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.295+0000 7fb216ffd640 1 -- 172.21.15.57:0/2924417908 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2100ebe00 con 0x7fb220070da0 2023-11-24T08:07:30.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.455+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2200b1150 con 0x7fb220070da0 2023-11-24T08:07:30.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.455+0000 7fb216ffd640 1 -- 172.21.15.57:0/2924417908 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fb2100ef420 con 0x7fb220070da0 2023-11-24T08:07:30.461 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:30.461 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":61,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:27.714748+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb200066620 msgr2=0x7fb200068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb200066620 0x7fb200068ae0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb22009c290 tx=0x7fb208009040 comp rx=0 tx=0).stop 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb220070da0 msgr2=0x7fb22014ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb220070da0 0x7fb22014ba20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb2100b0040 tx=0x7fb21001ac90 comp rx=0 tx=0).stop 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 shutdown_connections 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb200066620 0x7fb200068ae0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb22015a320 0x7fb22015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2200b36c0 0x7fb22015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 --2- 172.21.15.57:0/2924417908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb220070da0 0x7fb22014ba20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 >> 172.21.15.57:0/2924417908 conn(0x7fb2200b0bf0 msgr2=0x7fb2200b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 shutdown_connections 2023-11-24T08:07:30.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.459+0000 7fb224d94640 1 -- 172.21.15.57:0/2924417908 wait complete. 2023-11-24T08:07:30.482 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:07:30.482 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:30.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.619+0000 7ff91e92a640 1 Processor -- start 2023-11-24T08:07:30.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.619+0000 7ff91e92a640 1 -- start start 2023-11-24T08:07:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91e92a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff91806c650 0x7ff91809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91e92a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9180709c0 0x7ff918070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91e92a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91806d8b0 con 0x7ff918144030 2023-11-24T08:07:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91e92a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff918145020 con 0x7ff9180709c0 2023-11-24T08:07:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91e92a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff918071370 con 0x7ff91806c650 2023-11-24T08:07:30.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff917fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff918144030 0x7ff91806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36500/0 (socket says 172.21.15.57:36500) 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff917fff640 1 -- 172.21.15.57:0/3947159500 learned_addr learned my addr 172.21.15.57:0/3947159500 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91cec7640 1 --2- 172.21.15.57:0/3947159500 >> v2:172.21.15.57:3300/0 conn(0x7ff9180709c0 0x7ff918070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff9177fe640 1 --2- 172.21.15.57:0/3947159500 >> v2:172.21.15.132:3300/0 conn(0x7ff91806c650 0x7ff91809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff916ffd640 1 -- 172.21.15.57:0/3947159500 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488571707 0 0) 0x7ff91806d8b0 con 0x7ff918144030 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff916ffd640 1 -- 172.21.15.57:0/3947159500 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff900003530 con 0x7ff918144030 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91cec7640 1 -- 172.21.15.57:0/3947159500 >> v2:172.21.15.132:3300/0 conn(0x7ff91806c650 msgr2=0x7ff91809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91cec7640 1 --2- 172.21.15.57:0/3947159500 >> v2:172.21.15.132:3300/0 conn(0x7ff91806c650 0x7ff91809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91cec7640 1 -- 172.21.15.57:0/3947159500 >> v1:172.21.15.57:6789/0 conn(0x7ff918144030 legacy=0x7ff91806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.623+0000 7ff91cec7640 1 -- 172.21.15.57:0/3947159500 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91806cca0 con 0x7ff9180709c0 2023-11-24T08:07:30.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91cec7640 1 --2- 172.21.15.57:0/3947159500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918070e30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff9180700a0 tx=0x7ff91001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4fdcd16d165def server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff916ffd640 1 -- 172.21.15.57:0/3947159500 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100a58c0 con 0x7ff9180709c0 2023-11-24T08:07:30.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff916ffd640 1 -- 172.21.15.57:0/3947159500 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9100a5a20 con 0x7ff9180709c0 2023-11-24T08:07:30.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff916ffd640 1 -- 172.21.15.57:0/3947159500 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100a5db0 con 0x7ff9180709c0 2023-11-24T08:07:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 -- 172.21.15.57:0/3947159500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 msgr2=0x7ff918070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3947159500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918070e30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff9180700a0 tx=0x7ff91001c910 comp rx=0 tx=0).stop 2023-11-24T08:07:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 -- 172.21.15.57:0/3947159500 shutdown_connections 2023-11-24T08:07:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3947159500 >> v2:172.21.15.132:3300/0 conn(0x7ff91806c650 0x7ff91809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3947159500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918070e30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 -- 172.21.15.57:0/3947159500 >> 172.21.15.57:0/3947159500 conn(0x7ff9180b0bf0 msgr2=0x7ff9180b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 -- 172.21.15.57:0/3947159500 shutdown_connections 2023-11-24T08:07:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 -- 172.21.15.57:0/3947159500 wait complete. 2023-11-24T08:07:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 Processor -- start 2023-11-24T08:07:30.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.627+0000 7ff91e92a640 1 -- start start 2023-11-24T08:07:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff91806c650 0x7ff918141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff918144030 0x7ff918157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918157c60 con 0x7ff9180709c0 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918142680 con 0x7ff918144030 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180cedb0 con 0x7ff91806c650 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918139220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34168/0 (socket says 172.21.15.57:34168) 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 -- 172.21.15.57:0/3190882151 learned_addr learned my addr 172.21.15.57:0/3190882151 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff917fff640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff91806c650 0x7ff918141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91cec7640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff918144030 0x7ff918157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 -- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff91806c650 msgr2=0x7ff918141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff91806c650 0x7ff918141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 -- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff918144030 msgr2=0x7ff918157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff918144030 0x7ff918157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 -- 172.21.15.57:0/3190882151 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009a70 con 0x7ff9180709c0 2023-11-24T08:07:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91cec7640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff918144030 0x7ff918157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff9177fe640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918139220 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00d5f0 tx=0x7ff90c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff914ff9640 1 -- 172.21.15.57:0/3190882151 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0125f0 con 0x7ff9180709c0 2023-11-24T08:07:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff914ff9640 1 -- 172.21.15.57:0/3190882151 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c012750 con 0x7ff9180709c0 2023-11-24T08:07:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff914ff9640 1 -- 172.21.15.57:0/3190882151 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c012ae0 con 0x7ff9180709c0 2023-11-24T08:07:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9180cf090 con 0x7ff9180709c0 2023-11-24T08:07:30.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180cf650 con 0x7ff9180709c0 2023-11-24T08:07:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9180cf810 con 0x7ff9180709c0 2023-11-24T08:07:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.631+0000 7ff914ff9640 1 -- 172.21.15.57:0/3190882151 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ff90c012c40 con 0x7ff9180709c0 2023-11-24T08:07:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.635+0000 7ff914ff9640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff904066620 0x7ff904068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.635+0000 7ff914ff9640 1 -- 172.21.15.57:0/3190882151 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff90c0845e0 con 0x7ff9180709c0 2023-11-24T08:07:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.635+0000 7ff917fff640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff904066620 0x7ff904068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.635+0000 7ff917fff640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff904066620 0x7ff904068ae0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff9080011f0 tx=0x7ff908009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:30.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.639+0000 7ff914ff9640 1 -- 172.21.15.57:0/3190882151 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff90c051870 con 0x7ff9180709c0 2023-11-24T08:07:30.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.799+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff91806e3f0 con 0x7ff904066620 2023-11-24T08:07:30.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.807+0000 7ff914ff9640 1 -- 172.21.15.57:0/3190882151 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289247 (secure 0 0 0) 0x7ff91806e3f0 con 0x7ff904066620 2023-11-24T08:07:30.814 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:30.816 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff904066620 msgr2=0x7ff904068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff904066620 0x7ff904068ae0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff9080011f0 tx=0x7ff908009040 comp rx=0 tx=0).stop 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 msgr2=0x7ff918139220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918139220 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00d5f0 tx=0x7ff90c00dab0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 shutdown_connections 2023-11-24T08:07:30.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff904066620 0x7ff904068ae0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff918144030 0x7ff918157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9180709c0 0x7ff918139220 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 --2- 172.21.15.57:0/3190882151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff91806c650 0x7ff918141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:30.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 >> 172.21.15.57:0/3190882151 conn(0x7ff9180b0bf0 msgr2=0x7ff9180723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:30.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 shutdown_connections 2023-11-24T08:07:30.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:30.811+0000 7ff91e92a640 1 -- 172.21.15.57:0/3190882151 wait complete. 2023-11-24T08:07:30.835 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-11-24T08:07:30.732470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248032,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726688,"statfs":{"total":773094113280,"available":772840128512,"internally_reserved":0,"allocated":7053312,"data_stored":3589252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002687"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725657+0000","last_change":"2023-11-24T08:07:26.730752+0000","last_active":"2023-11-24T08:07:27.725657+0000","last_peered":"2023-11-24T08:07:27.725657+0000","last_clean":"2023-11-24T08:07:27.725657+0000","last_became_active":"2023-11-24T08:07:26.730095+0000","last_became_peered":"2023-11-24T08:07:26.730095+0000","last_unstale":"2023-11-24T08:07:27.725657+0000","last_undegraded":"2023-11-24T08:07:27.725657+0000","last_fullsized":"2023-11-24T08:07:27.725657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:25.634756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.302057+0000","last_change":"2023-11-24T08:07:26.728394+0000","last_active":"2023-11-24T08:07:28.302057+0000","last_peered":"2023-11-24T08:07:28.302057+0000","last_clean":"2023-11-24T08:07:28.302057+0000","last_became_active":"2023-11-24T08:07:26.728124+0000","last_became_peered":"2023-11-24T08:07:26.728124+0000","last_unstale":"2023-11-24T08:07:28.302057+0000","last_undegraded":"2023-11-24T08:07:28.302057+0000","last_fullsized":"2023-11-24T08:07:28.302057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:32.796693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305476+0000","last_change":"2023-11-24T08:07:26.740778+0000","last_active":"2023-11-24T08:07:28.305476+0000","last_peered":"2023-11-24T08:07:28.305476+0000","last_clean":"2023-11-24T08:07:28.305476+0000","last_became_active":"2023-11-24T08:07:26.739894+0000","last_became_peered":"2023-11-24T08:07:26.739894+0000","last_unstale":"2023-11-24T08:07:28.305476+0000","last_undegraded":"2023-11-24T08:07:28.305476+0000","last_fullsized":"2023-11-24T08:07:28.305476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:39:24.281849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305097+0000","last_change":"2023-11-24T08:07:26.736779+0000","last_active":"2023-11-24T08:07:28.305097+0000","last_peered":"2023-11-24T08:07:28.305097+0000","last_clean":"2023-11-24T08:07:28.305097+0000","last_became_active":"2023-11-24T08:07:26.735670+0000","last_became_peered":"2023-11-24T08:07:26.735670+0000","last_unstale":"2023-11-24T08:07:28.305097+0000","last_undegraded":"2023-11-24T08:07:28.305097+0000","last_fullsized":"2023-11-24T08:07:28.305097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:03.303192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725281+0000","last_change":"2023-11-24T08:07:26.726571+0000","last_active":"2023-11-24T08:07:27.725281+0000","last_peered":"2023-11-24T08:07:27.725281+0000","last_clean":"2023-11-24T08:07:27.725281+0000","last_became_active":"2023-11-24T08:07:26.726304+0000","last_became_peered":"2023-11-24T08:07:26.726304+0000","last_unstale":"2023-11-24T08:07:27.725281+0000","last_undegraded":"2023-11-24T08:07:27.725281+0000","last_fullsized":"2023-11-24T08:07:27.725281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:46:03.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727169+0000","last_change":"2023-11-24T08:07:26.716071+0000","last_active":"2023-11-24T08:07:27.727169+0000","last_peered":"2023-11-24T08:07:27.727169+0000","last_clean":"2023-11-24T08:07:27.727169+0000","last_became_active":"2023-11-24T08:07:26.715776+0000","last_became_peered":"2023-11-24T08:07:26.715776+0000","last_unstale":"2023-11-24T08:07:27.727169+0000","last_undegraded":"2023-11-24T08:07:27.727169+0000","last_fullsized":"2023-11-24T08:07:27.727169+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:06:06.928290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730002+0000","last_change":"2023-11-24T08:07:26.733163+0000","last_active":"2023-11-24T08:07:27.730002+0000","last_peered":"2023-11-24T08:07:27.730002+0000","last_clean":"2023-11-24T08:07:27.730002+0000","last_became_active":"2023-11-24T08:07:26.732828+0000","last_became_peered":"2023-11-24T08:07:26.732828+0000","last_unstale":"2023-11-24T08:07:27.730002+0000","last_undegraded":"2023-11-24T08:07:27.730002+0000","last_fullsized":"2023-11-24T08:07:27.730002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:20.074169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301589+0000","last_change":"2023-11-24T08:07:26.725719+0000","last_active":"2023-11-24T08:07:28.301589+0000","last_peered":"2023-11-24T08:07:28.301589+0000","last_clean":"2023-11-24T08:07:28.301589+0000","last_became_active":"2023-11-24T08:07:26.725429+0000","last_became_peered":"2023-11-24T08:07:26.725429+0000","last_unstale":"2023-11-24T08:07:28.301589+0000","last_undegraded":"2023-11-24T08:07:28.301589+0000","last_fullsized":"2023-11-24T08:07:28.301589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:00.180018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730200+0000","last_change":"2023-11-24T08:07:26.743201+0000","last_active":"2023-11-24T08:07:27.730200+0000","last_peered":"2023-11-24T08:07:27.730200+0000","last_clean":"2023-11-24T08:07:27.730200+0000","last_became_active":"2023-11-24T08:07:26.742883+0000","last_became_peered":"2023-11-24T08:07:26.742883+0000","last_unstale":"2023-11-24T08:07:27.730200+0000","last_undegraded":"2023-11-24T08:07:27.730200+0000","last_fullsized":"2023-11-24T08:07:27.730200+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:05.768501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254079+0000","last_change":"2023-11-24T08:07:26.725564+0000","last_active":"2023-11-24T08:07:28.254079+0000","last_peered":"2023-11-24T08:07:28.254079+0000","last_clean":"2023-11-24T08:07:28.254079+0000","last_became_active":"2023-11-24T08:07:26.725183+0000","last_became_peered":"2023-11-24T08:07:26.725183+0000","last_unstale":"2023-11-24T08:07:28.254079+0000","last_undegraded":"2023-11-24T08:07:28.254079+0000","last_fullsized":"2023-11-24T08:07:28.254079+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:26:51.180517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254081+0000","last_change":"2023-11-24T08:07:26.735310+0000","last_active":"2023-11-24T08:07:28.254081+0000","last_peered":"2023-11-24T08:07:28.254081+0000","last_clean":"2023-11-24T08:07:28.254081+0000","last_became_active":"2023-11-24T08:07:26.735027+0000","last_became_peered":"2023-11-24T08:07:26.735027+0000","last_unstale":"2023-11-24T08:07:28.254081+0000","last_undegraded":"2023-11-24T08:07:28.254081+0000","last_fullsized":"2023-11-24T08:07:28.254081+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:08.485744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305965+0000","last_change":"2023-11-24T08:07:26.737016+0000","last_active":"2023-11-24T08:07:28.305965+0000","last_peered":"2023-11-24T08:07:28.305965+0000","last_clean":"2023-11-24T08:07:28.305965+0000","last_became_active":"2023-11-24T08:07:26.736079+0000","last_became_peered":"2023-11-24T08:07:26.736079+0000","last_unstale":"2023-11-24T08:07:28.305965+0000","last_undegraded":"2023-11-24T08:07:28.305965+0000","last_fullsized":"2023-11-24T08:07:28.305965+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:33.644701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.306390+0000","last_change":"2023-11-24T08:07:26.726470+0000","last_active":"2023-11-24T08:07:28.306390+0000","last_peered":"2023-11-24T08:07:28.306390+0000","last_clean":"2023-11-24T08:07:28.306390+0000","last_became_active":"2023-11-24T08:07:26.725209+0000","last_became_peered":"2023-11-24T08:07:26.725209+0000","last_unstale":"2023-11-24T08:07:28.306390+0000","last_undegraded":"2023-11-24T08:07:28.306390+0000","last_fullsized":"2023-11-24T08:07:28.306390+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:15.881579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730217+0000","last_change":"2023-11-24T08:07:26.732914+0000","last_active":"2023-11-24T08:07:27.730217+0000","last_peered":"2023-11-24T08:07:27.730217+0000","last_clean":"2023-11-24T08:07:27.730217+0000","last_became_active":"2023-11-24T08:07:26.728307+0000","last_became_peered":"2023-11-24T08:07:26.728307+0000","last_unstale":"2023-11-24T08:07:27.730217+0000","last_undegraded":"2023-11-24T08:07:27.730217+0000","last_fullsized":"2023-11-24T08:07:27.730217+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:59.701099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730088+0000","last_change":"2023-11-24T08:07:26.733771+0000","last_active":"2023-11-24T08:07:27.730088+0000","last_peered":"2023-11-24T08:07:27.730088+0000","last_clean":"2023-11-24T08:07:27.730088+0000","last_became_active":"2023-11-24T08:07:26.733454+0000","last_became_peered":"2023-11-24T08:07:26.733454+0000","last_unstale":"2023-11-24T08:07:27.730088+0000","last_undegraded":"2023-11-24T08:07:27.730088+0000","last_fullsized":"2023-11-24T08:07:27.730088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:11.597664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727114+0000","last_change":"2023-11-24T08:07:26.712672+0000","last_active":"2023-11-24T08:07:27.727114+0000","last_peered":"2023-11-24T08:07:27.727114+0000","last_clean":"2023-11-24T08:07:27.727114+0000","last_became_active":"2023-11-24T08:07:26.712170+0000","last_became_peered":"2023-11-24T08:07:26.712170+0000","last_unstale":"2023-11-24T08:07:27.727114+0000","last_undegraded":"2023-11-24T08:07:27.727114+0000","last_fullsized":"2023-11-24T08:07:27.727114+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:29:25.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.302193+0000","last_change":"2023-11-24T08:07:26.722197+0000","last_active":"2023-11-24T08:07:28.302193+0000","last_peered":"2023-11-24T08:07:28.302193+0000","last_clean":"2023-11-24T08:07:28.302193+0000","last_became_active":"2023-11-24T08:07:26.721924+0000","last_became_peered":"2023-11-24T08:07:26.721924+0000","last_unstale":"2023-11-24T08:07:28.302193+0000","last_undegraded":"2023-11-24T08:07:28.302193+0000","last_fullsized":"2023-11-24T08:07:28.302193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:44.631940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305890+0000","last_change":"2023-11-24T08:07:26.739548+0000","last_active":"2023-11-24T08:07:28.305890+0000","last_peered":"2023-11-24T08:07:28.305890+0000","last_clean":"2023-11-24T08:07:28.305890+0000","last_became_active":"2023-11-24T08:07:26.739253+0000","last_became_peered":"2023-11-24T08:07:26.739253+0000","last_unstale":"2023-11-24T08:07:28.305890+0000","last_undegraded":"2023-11-24T08:07:28.305890+0000","last_fullsized":"2023-11-24T08:07:28.305890+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:40.839469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725619+0000","last_change":"2023-11-24T08:07:26.729476+0000","last_active":"2023-11-24T08:07:27.725619+0000","last_peered":"2023-11-24T08:07:27.725619+0000","last_clean":"2023-11-24T08:07:27.725619+0000","last_became_active":"2023-11-24T08:07:26.729174+0000","last_became_peered":"2023-11-24T08:07:26.729174+0000","last_unstale":"2023-11-24T08:07:27.725619+0000","last_undegraded":"2023-11-24T08:07:27.725619+0000","last_fullsized":"2023-11-24T08:07:27.725619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:23:11.945429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301772+0000","last_change":"2023-11-24T08:07:26.724254+0000","last_active":"2023-11-24T08:07:28.301772+0000","last_peered":"2023-11-24T08:07:28.301772+0000","last_clean":"2023-11-24T08:07:28.301772+0000","last_became_active":"2023-11-24T08:07:26.723992+0000","last_became_peered":"2023-11-24T08:07:26.723992+0000","last_unstale":"2023-11-24T08:07:28.301772+0000","last_undegraded":"2023-11-24T08:07:28.301772+0000","last_fullsized":"2023-11-24T08:07:28.301772+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:58.106793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305524+0000","last_change":"2023-11-24T08:07:26.743471+0000","last_active":"2023-11-24T08:07:28.305524+0000","last_peered":"2023-11-24T08:07:28.305524+0000","last_clean":"2023-11-24T08:07:28.305524+0000","last_became_active":"2023-11-24T08:07:26.742182+0000","last_became_peered":"2023-11-24T08:07:26.742182+0000","last_unstale":"2023-11-24T08:07:28.305524+0000","last_undegraded":"2023-11-24T08:07:28.305524+0000","last_fullsized":"2023-11-24T08:07:28.305524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:25.875233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301604+0000","last_change":"2023-11-24T08:07:26.724839+0000","last_active":"2023-11-24T08:07:28.301604+0000","last_peered":"2023-11-24T08:07:28.301604+0000","last_clean":"2023-11-24T08:07:28.301604+0000","last_became_active":"2023-11-24T08:07:26.724522+0000","last_became_peered":"2023-11-24T08:07:26.724522+0000","last_unstale":"2023-11-24T08:07:28.301604+0000","last_undegraded":"2023-11-24T08:07:28.301604+0000","last_fullsized":"2023-11-24T08:07:28.301604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:27:33.663604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.304886+0000","last_change":"2023-11-24T08:07:26.742994+0000","last_active":"2023-11-24T08:07:28.304886+0000","last_peered":"2023-11-24T08:07:28.304886+0000","last_clean":"2023-11-24T08:07:28.304886+0000","last_became_active":"2023-11-24T08:07:26.742687+0000","last_became_peered":"2023-11-24T08:07:26.742687+0000","last_unstale":"2023-11-24T08:07:28.304886+0000","last_undegraded":"2023-11-24T08:07:28.304886+0000","last_fullsized":"2023-11-24T08:07:28.304886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:03.303192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.304923+0000","last_change":"2023-11-24T08:07:26.726101+0000","last_active":"2023-11-24T08:07:28.304923+0000","last_peered":"2023-11-24T08:07:28.304923+0000","last_clean":"2023-11-24T08:07:28.304923+0000","last_became_active":"2023-11-24T08:07:26.725743+0000","last_became_peered":"2023-11-24T08:07:26.725743+0000","last_unstale":"2023-11-24T08:07:28.304923+0000","last_undegraded":"2023-11-24T08:07:28.304923+0000","last_fullsized":"2023-11-24T08:07:28.304923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:11.363421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725720+0000","last_change":"2023-11-24T08:07:26.730147+0000","last_active":"2023-11-24T08:07:27.725720+0000","last_peered":"2023-11-24T08:07:27.725720+0000","last_clean":"2023-11-24T08:07:27.725720+0000","last_became_active":"2023-11-24T08:07:26.729690+0000","last_became_peered":"2023-11-24T08:07:26.729690+0000","last_unstale":"2023-11-24T08:07:27.725720+0000","last_undegraded":"2023-11-24T08:07:27.725720+0000","last_fullsized":"2023-11-24T08:07:27.725720+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:26:53.454034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305428+0000","last_change":"2023-11-24T08:07:26.728390+0000","last_active":"2023-11-24T08:07:28.305428+0000","last_peered":"2023-11-24T08:07:28.305428+0000","last_clean":"2023-11-24T08:07:28.305428+0000","last_became_active":"2023-11-24T08:07:26.728082+0000","last_became_peered":"2023-11-24T08:07:26.728082+0000","last_unstale":"2023-11-24T08:07:28.305428+0000","last_undegraded":"2023-11-24T08:07:28.305428+0000","last_fullsized":"2023-11-24T08:07:28.305428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:39:24.281849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727444+0000","last_change":"2023-11-24T08:07:26.715721+0000","last_active":"2023-11-24T08:07:27.727444+0000","last_peered":"2023-11-24T08:07:27.727444+0000","last_clean":"2023-11-24T08:07:27.727444+0000","last_became_active":"2023-11-24T08:07:26.715397+0000","last_became_peered":"2023-11-24T08:07:26.715397+0000","last_unstale":"2023-11-24T08:07:27.727444+0000","last_undegraded":"2023-11-24T08:07:27.727444+0000","last_fullsized":"2023-11-24T08:07:27.727444+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:12.560634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725480+0000","last_change":"2023-11-24T08:07:26.731970+0000","last_active":"2023-11-24T08:07:27.725480+0000","last_peered":"2023-11-24T08:07:27.725480+0000","last_clean":"2023-11-24T08:07:27.725480+0000","last_became_active":"2023-11-24T08:07:26.731418+0000","last_became_peered":"2023-11-24T08:07:26.731418+0000","last_unstale":"2023-11-24T08:07:27.725480+0000","last_undegraded":"2023-11-24T08:07:27.725480+0000","last_fullsized":"2023-11-24T08:07:27.725480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:51:43.221393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.302016+0000","last_change":"2023-11-24T08:07:26.727807+0000","last_active":"2023-11-24T08:07:28.302016+0000","last_peered":"2023-11-24T08:07:28.302016+0000","last_clean":"2023-11-24T08:07:28.302016+0000","last_became_active":"2023-11-24T08:07:26.726996+0000","last_became_peered":"2023-11-24T08:07:26.726996+0000","last_unstale":"2023-11-24T08:07:28.302016+0000","last_undegraded":"2023-11-24T08:07:28.302016+0000","last_fullsized":"2023-11-24T08:07:28.302016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:44.010926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305249+0000","last_change":"2023-11-24T08:07:26.740477+0000","last_active":"2023-11-24T08:07:28.305249+0000","last_peered":"2023-11-24T08:07:28.305249+0000","last_clean":"2023-11-24T08:07:28.305249+0000","last_became_active":"2023-11-24T08:07:26.740099+0000","last_became_peered":"2023-11-24T08:07:26.740099+0000","last_unstale":"2023-11-24T08:07:28.305249+0000","last_undegraded":"2023-11-24T08:07:28.305249+0000","last_fullsized":"2023-11-24T08:07:28.305249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:04.868895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725183+0000","last_change":"2023-11-24T08:07:26.719107+0000","last_active":"2023-11-24T08:07:27.725183+0000","last_peered":"2023-11-24T08:07:27.725183+0000","last_clean":"2023-11-24T08:07:27.725183+0000","last_became_active":"2023-11-24T08:07:26.718809+0000","last_became_peered":"2023-11-24T08:07:26.718809+0000","last_unstale":"2023-11-24T08:07:27.725183+0000","last_undegraded":"2023-11-24T08:07:27.725183+0000","last_fullsized":"2023-11-24T08:07:27.725183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:28.599602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727035+0000","last_change":"2023-11-24T08:07:26.729696+0000","last_active":"2023-11-24T08:07:27.727035+0000","last_peered":"2023-11-24T08:07:27.727035+0000","last_clean":"2023-11-24T08:07:27.727035+0000","last_became_active":"2023-11-24T08:07:26.729113+0000","last_became_peered":"2023-11-24T08:07:26.729113+0000","last_unstale":"2023-11-24T08:07:27.727035+0000","last_undegraded":"2023-11-24T08:07:27.727035+0000","last_fullsized":"2023-11-24T08:07:27.727035+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:20.620903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727585+0000","last_change":"2023-11-24T08:07:26.730345+0000","last_active":"2023-11-24T08:07:27.727585+0000","last_peered":"2023-11-24T08:07:27.727585+0000","last_clean":"2023-11-24T08:07:27.727585+0000","last_became_active":"2023-11-24T08:07:26.730053+0000","last_became_peered":"2023-11-24T08:07:26.730053+0000","last_unstale":"2023-11-24T08:07:27.727585+0000","last_undegraded":"2023-11-24T08:07:27.727585+0000","last_fullsized":"2023-11-24T08:07:27.727585+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:21.926213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.741340+0000","last_change":"2023-11-24T08:07:25.724481+0000","last_active":"2023-11-24T08:07:26.741340+0000","last_peered":"2023-11-24T08:07:26.741340+0000","last_clean":"2023-11-24T08:07:26.741340+0000","last_became_active":"2023-11-24T08:07:25.722134+0000","last_became_peered":"2023-11-24T08:07:25.722134+0000","last_unstale":"2023-11-24T08:07:26.741340+0000","last_undegraded":"2023-11-24T08:07:26.741340+0000","last_fullsized":"2023-11-24T08:07:26.741340+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:45.221230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254208+0000","last_change":"2023-11-24T08:07:26.726500+0000","last_active":"2023-11-24T08:07:28.254208+0000","last_peered":"2023-11-24T08:07:28.254208+0000","last_clean":"2023-11-24T08:07:28.254208+0000","last_became_active":"2023-11-24T08:07:26.726103+0000","last_became_peered":"2023-11-24T08:07:26.726103+0000","last_unstale":"2023-11-24T08:07:28.254208+0000","last_undegraded":"2023-11-24T08:07:28.254208+0000","last_fullsized":"2023-11-24T08:07:28.254208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:08.718933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.734357+0000","last_change":"2023-11-24T08:07:25.711415+0000","last_active":"2023-11-24T08:07:26.734357+0000","last_peered":"2023-11-24T08:07:26.734357+0000","last_clean":"2023-11-24T08:07:26.734357+0000","last_became_active":"2023-11-24T08:07:25.711091+0000","last_became_peered":"2023-11-24T08:07:25.711091+0000","last_unstale":"2023-11-24T08:07:26.734357+0000","last_undegraded":"2023-11-24T08:07:26.734357+0000","last_fullsized":"2023-11-24T08:07:26.734357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:06:48.140646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727482+0000","last_change":"2023-11-24T08:07:26.729121+0000","last_active":"2023-11-24T08:07:27.727482+0000","last_peered":"2023-11-24T08:07:27.727482+0000","last_clean":"2023-11-24T08:07:27.727482+0000","last_became_active":"2023-11-24T08:07:26.728820+0000","last_became_peered":"2023-11-24T08:07:26.728820+0000","last_unstale":"2023-11-24T08:07:27.727482+0000","last_undegraded":"2023-11-24T08:07:27.727482+0000","last_fullsized":"2023-11-24T08:07:27.727482+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:43.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.735817+0000","last_change":"2023-11-24T08:07:25.723169+0000","last_active":"2023-11-24T08:07:26.735817+0000","last_peered":"2023-11-24T08:07:26.735817+0000","last_clean":"2023-11-24T08:07:26.735817+0000","last_became_active":"2023-11-24T08:07:25.722024+0000","last_became_peered":"2023-11-24T08:07:25.722024+0000","last_unstale":"2023-11-24T08:07:26.735817+0000","last_undegraded":"2023-11-24T08:07:26.735817+0000","last_fullsized":"2023-11-24T08:07:26.735817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:14:35.995270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727669+0000","last_change":"2023-11-24T08:07:26.732495+0000","last_active":"2023-11-24T08:07:27.727669+0000","last_peered":"2023-11-24T08:07:27.727669+0000","last_clean":"2023-11-24T08:07:27.727669+0000","last_became_active":"2023-11-24T08:07:26.732170+0000","last_became_peered":"2023-11-24T08:07:26.732170+0000","last_unstale":"2023-11-24T08:07:27.727669+0000","last_undegraded":"2023-11-24T08:07:27.727669+0000","last_fullsized":"2023-11-24T08:07:27.727669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:10.475615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.738210+0000","last_change":"2023-11-24T08:07:25.726002+0000","last_active":"2023-11-24T08:07:26.738210+0000","last_peered":"2023-11-24T08:07:26.738210+0000","last_clean":"2023-11-24T08:07:26.738210+0000","last_became_active":"2023-11-24T08:07:25.725716+0000","last_became_peered":"2023-11-24T08:07:25.725716+0000","last_unstale":"2023-11-24T08:07:26.738210+0000","last_undegraded":"2023-11-24T08:07:26.738210+0000","last_fullsized":"2023-11-24T08:07:26.738210+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:04.761855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301822+0000","last_change":"2023-11-24T08:07:26.727297+0000","last_active":"2023-11-24T08:07:28.301822+0000","last_peered":"2023-11-24T08:07:28.301822+0000","last_clean":"2023-11-24T08:07:28.301822+0000","last_became_active":"2023-11-24T08:07:26.723317+0000","last_became_peered":"2023-11-24T08:07:26.723317+0000","last_unstale":"2023-11-24T08:07:28.301822+0000","last_undegraded":"2023-11-24T08:07:28.301822+0000","last_fullsized":"2023-11-24T08:07:28.301822+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:33.852238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.738428+0000","last_change":"2023-11-24T08:07:25.728312+0000","last_active":"2023-11-24T08:07:26.738428+0000","last_peered":"2023-11-24T08:07:26.738428+0000","last_clean":"2023-11-24T08:07:26.738428+0000","last_became_active":"2023-11-24T08:07:25.728007+0000","last_became_peered":"2023-11-24T08:07:25.728007+0000","last_unstale":"2023-11-24T08:07:26.738428+0000","last_undegraded":"2023-11-24T08:07:26.738428+0000","last_fullsized":"2023-11-24T08:07:26.738428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:11.041188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301823+0000","last_change":"2023-11-24T08:07:26.728017+0000","last_active":"2023-11-24T08:07:28.301823+0000","last_peered":"2023-11-24T08:07:28.301823+0000","last_clean":"2023-11-24T08:07:28.301823+0000","last_became_active":"2023-11-24T08:07:26.727493+0000","last_became_peered":"2023-11-24T08:07:26.727493+0000","last_unstale":"2023-11-24T08:07:28.301823+0000","last_undegraded":"2023-11-24T08:07:28.301823+0000","last_fullsized":"2023-11-24T08:07:28.301823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:12:44.021501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.734679+0000","last_change":"2023-11-24T08:07:25.714848+0000","last_active":"2023-11-24T08:07:26.734679+0000","last_peered":"2023-11-24T08:07:26.734679+0000","last_clean":"2023-11-24T08:07:26.734679+0000","last_became_active":"2023-11-24T08:07:25.714377+0000","last_became_peered":"2023-11-24T08:07:25.714377+0000","last_unstale":"2023-11-24T08:07:26.734679+0000","last_undegraded":"2023-11-24T08:07:26.734679+0000","last_fullsized":"2023-11-24T08:07:26.734679+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:20:55.281053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.306105+0000","last_change":"2023-11-24T08:07:26.733222+0000","last_active":"2023-11-24T08:07:28.306105+0000","last_peered":"2023-11-24T08:07:28.306105+0000","last_clean":"2023-11-24T08:07:28.306105+0000","last_became_active":"2023-11-24T08:07:26.732485+0000","last_became_peered":"2023-11-24T08:07:26.732485+0000","last_unstale":"2023-11-24T08:07:28.306105+0000","last_undegraded":"2023-11-24T08:07:28.306105+0000","last_fullsized":"2023-11-24T08:07:28.306105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:52.289727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.717882+0000","last_change":"2023-11-24T08:07:25.719062+0000","last_active":"2023-11-24T08:07:26.717882+0000","last_peered":"2023-11-24T08:07:26.717882+0000","last_clean":"2023-11-24T08:07:26.717882+0000","last_became_active":"2023-11-24T08:07:25.718719+0000","last_became_peered":"2023-11-24T08:07:25.718719+0000","last_unstale":"2023-11-24T08:07:26.717882+0000","last_undegraded":"2023-11-24T08:07:26.717882+0000","last_fullsized":"2023-11-24T08:07:26.717882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:18.720409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301979+0000","last_change":"2023-11-24T08:07:26.717994+0000","last_active":"2023-11-24T08:07:28.301979+0000","last_peered":"2023-11-24T08:07:28.301979+0000","last_clean":"2023-11-24T08:07:28.301979+0000","last_became_active":"2023-11-24T08:07:26.717682+0000","last_became_peered":"2023-11-24T08:07:26.717682+0000","last_unstale":"2023-11-24T08:07:28.301979+0000","last_undegraded":"2023-11-24T08:07:28.301979+0000","last_fullsized":"2023-11-24T08:07:28.301979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:07.870400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.711491+0000","last_change":"2023-11-24T08:07:25.724748+0000","last_active":"2023-11-24T08:07:26.711491+0000","last_peered":"2023-11-24T08:07:26.711491+0000","last_clean":"2023-11-24T08:07:26.711491+0000","last_became_active":"2023-11-24T08:07:25.724333+0000","last_became_peered":"2023-11-24T08:07:25.724333+0000","last_unstale":"2023-11-24T08:07:26.711491+0000","last_undegraded":"2023-11-24T08:07:26.711491+0000","last_fullsized":"2023-11-24T08:07:26.711491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:28.554576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730512+0000","last_change":"2023-11-24T08:07:26.735298+0000","last_active":"2023-11-24T08:07:27.730512+0000","last_peered":"2023-11-24T08:07:27.730512+0000","last_clean":"2023-11-24T08:07:27.730512+0000","last_became_active":"2023-11-24T08:07:26.733351+0000","last_became_peered":"2023-11-24T08:07:26.733351+0000","last_unstale":"2023-11-24T08:07:27.730512+0000","last_undegraded":"2023-11-24T08:07:27.730512+0000","last_fullsized":"2023-11-24T08:07:27.730512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:25:25.672382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.722737+0000","last_change":"2023-11-24T08:07:25.719942+0000","last_active":"2023-11-24T08:07:26.722737+0000","last_peered":"2023-11-24T08:07:26.722737+0000","last_clean":"2023-11-24T08:07:26.722737+0000","last_became_active":"2023-11-24T08:07:25.719675+0000","last_became_peered":"2023-11-24T08:07:25.719675+0000","last_unstale":"2023-11-24T08:07:26.722737+0000","last_undegraded":"2023-11-24T08:07:26.722737+0000","last_fullsized":"2023-11-24T08:07:26.722737+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:40.127365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305594+0000","last_change":"2023-11-24T08:07:26.738653+0000","last_active":"2023-11-24T08:07:28.305594+0000","last_peered":"2023-11-24T08:07:28.305594+0000","last_clean":"2023-11-24T08:07:28.305594+0000","last_became_active":"2023-11-24T08:07:26.738240+0000","last_became_peered":"2023-11-24T08:07:26.738240+0000","last_unstale":"2023-11-24T08:07:28.305594+0000","last_undegraded":"2023-11-24T08:07:28.305594+0000","last_fullsized":"2023-11-24T08:07:28.305594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:33:24.906885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.712703+0000","last_change":"2023-11-24T08:07:25.729420+0000","last_active":"2023-11-24T08:07:26.712703+0000","last_peered":"2023-11-24T08:07:26.712703+0000","last_clean":"2023-11-24T08:07:26.712703+0000","last_became_active":"2023-11-24T08:07:25.728317+0000","last_became_peered":"2023-11-24T08:07:25.728317+0000","last_unstale":"2023-11-24T08:07:26.712703+0000","last_undegraded":"2023-11-24T08:07:26.712703+0000","last_fullsized":"2023-11-24T08:07:26.712703+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:29.449913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254009+0000","last_change":"2023-11-24T08:07:26.730030+0000","last_active":"2023-11-24T08:07:28.254009+0000","last_peered":"2023-11-24T08:07:28.254009+0000","last_clean":"2023-11-24T08:07:28.254009+0000","last_became_active":"2023-11-24T08:07:26.729104+0000","last_became_peered":"2023-11-24T08:07:26.729104+0000","last_unstale":"2023-11-24T08:07:28.254009+0000","last_undegraded":"2023-11-24T08:07:28.254009+0000","last_fullsized":"2023-11-24T08:07:28.254009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:51.961579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.743833+0000","last_change":"2023-11-24T08:07:25.728587+0000","last_active":"2023-11-24T08:07:26.743833+0000","last_peered":"2023-11-24T08:07:26.743833+0000","last_clean":"2023-11-24T08:07:26.743833+0000","last_became_active":"2023-11-24T08:07:25.728318+0000","last_became_peered":"2023-11-24T08:07:25.728318+0000","last_unstale":"2023-11-24T08:07:26.743833+0000","last_undegraded":"2023-11-24T08:07:26.743833+0000","last_fullsized":"2023-11-24T08:07:26.743833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:18.720409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305778+0000","last_change":"2023-11-24T08:07:26.741793+0000","last_active":"2023-11-24T08:07:28.305778+0000","last_peered":"2023-11-24T08:07:28.305778+0000","last_clean":"2023-11-24T08:07:28.305778+0000","last_became_active":"2023-11-24T08:07:26.741319+0000","last_became_peered":"2023-11-24T08:07:26.741319+0000","last_unstale":"2023-11-24T08:07:28.305778+0000","last_undegraded":"2023-11-24T08:07:28.305778+0000","last_fullsized":"2023-11-24T08:07:28.305778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:50.640867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.752685+0000","last_change":"2023-11-24T08:07:25.720214+0000","last_active":"2023-11-24T08:07:26.752685+0000","last_peered":"2023-11-24T08:07:26.752685+0000","last_clean":"2023-11-24T08:07:26.752685+0000","last_became_active":"2023-11-24T08:07:25.719935+0000","last_became_peered":"2023-11-24T08:07:25.719935+0000","last_unstale":"2023-11-24T08:07:26.752685+0000","last_undegraded":"2023-11-24T08:07:26.752685+0000","last_fullsized":"2023-11-24T08:07:26.752685+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:04.304413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305281+0000","last_change":"2023-11-24T08:07:26.744211+0000","last_active":"2023-11-24T08:07:28.305281+0000","last_peered":"2023-11-24T08:07:28.305281+0000","last_clean":"2023-11-24T08:07:28.305281+0000","last_became_active":"2023-11-24T08:07:26.742608+0000","last_became_peered":"2023-11-24T08:07:26.742608+0000","last_unstale":"2023-11-24T08:07:28.305281+0000","last_undegraded":"2023-11-24T08:07:28.305281+0000","last_fullsized":"2023-11-24T08:07:28.305281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:04.868895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.735980+0000","last_change":"2023-11-24T08:07:25.728299+0000","last_active":"2023-11-24T08:07:26.735980+0000","last_peered":"2023-11-24T08:07:26.735980+0000","last_clean":"2023-11-24T08:07:26.735980+0000","last_became_active":"2023-11-24T08:07:25.728017+0000","last_became_peered":"2023-11-24T08:07:25.728017+0000","last_unstale":"2023-11-24T08:07:26.735980+0000","last_undegraded":"2023-11-24T08:07:26.735980+0000","last_fullsized":"2023-11-24T08:07:26.735980+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:16:48.366339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305712+0000","last_change":"2023-11-24T08:07:26.745586+0000","last_active":"2023-11-24T08:07:28.305712+0000","last_peered":"2023-11-24T08:07:28.305712+0000","last_clean":"2023-11-24T08:07:28.305712+0000","last_became_active":"2023-11-24T08:07:26.745253+0000","last_became_peered":"2023-11-24T08:07:26.745253+0000","last_unstale":"2023-11-24T08:07:28.305712+0000","last_undegraded":"2023-11-24T08:07:28.305712+0000","last_fullsized":"2023-11-24T08:07:28.305712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:33.644701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.711036+0000","last_change":"2023-11-24T08:07:25.711802+0000","last_active":"2023-11-24T08:07:26.711036+0000","last_peered":"2023-11-24T08:07:26.711036+0000","last_clean":"2023-11-24T08:07:26.711036+0000","last_became_active":"2023-11-24T08:07:25.710562+0000","last_became_peered":"2023-11-24T08:07:25.710562+0000","last_unstale":"2023-11-24T08:07:26.711036+0000","last_undegraded":"2023-11-24T08:07:26.711036+0000","last_fullsized":"2023-11-24T08:07:26.711036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:50.410293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730022+0000","last_change":"2023-11-24T08:07:26.734165+0000","last_active":"2023-11-24T08:07:27.730022+0000","last_peered":"2023-11-24T08:07:27.730022+0000","last_clean":"2023-11-24T08:07:27.730022+0000","last_became_active":"2023-11-24T08:07:26.733902+0000","last_became_peered":"2023-11-24T08:07:26.733902+0000","last_unstale":"2023-11-24T08:07:27.730022+0000","last_undegraded":"2023-11-24T08:07:27.730022+0000","last_fullsized":"2023-11-24T08:07:27.730022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:19.727054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.718013+0000","last_change":"2023-11-24T08:07:25.726151+0000","last_active":"2023-11-24T08:07:26.718013+0000","last_peered":"2023-11-24T08:07:26.718013+0000","last_clean":"2023-11-24T08:07:26.718013+0000","last_became_active":"2023-11-24T08:07:25.725812+0000","last_became_peered":"2023-11-24T08:07:25.725812+0000","last_unstale":"2023-11-24T08:07:26.718013+0000","last_undegraded":"2023-11-24T08:07:26.718013+0000","last_fullsized":"2023-11-24T08:07:26.718013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:10.591018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305031+0000","last_change":"2023-11-24T08:07:26.743086+0000","last_active":"2023-11-24T08:07:28.305031+0000","last_peered":"2023-11-24T08:07:28.305031+0000","last_clean":"2023-11-24T08:07:28.305031+0000","last_became_active":"2023-11-24T08:07:26.742805+0000","last_became_peered":"2023-11-24T08:07:26.742805+0000","last_unstale":"2023-11-24T08:07:28.305031+0000","last_undegraded":"2023-11-24T08:07:28.305031+0000","last_fullsized":"2023-11-24T08:07:28.305031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:02.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.749979+0000","last_change":"2023-11-24T08:07:25.724424+0000","last_active":"2023-11-24T08:07:26.749979+0000","last_peered":"2023-11-24T08:07:26.749979+0000","last_clean":"2023-11-24T08:07:26.749979+0000","last_became_active":"2023-11-24T08:07:25.724150+0000","last_became_peered":"2023-11-24T08:07:25.724150+0000","last_unstale":"2023-11-24T08:07:26.749979+0000","last_undegraded":"2023-11-24T08:07:26.749979+0000","last_fullsized":"2023-11-24T08:07:26.749979+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:28.602797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305780+0000","last_change":"2023-11-24T08:07:26.740593+0000","last_active":"2023-11-24T08:07:28.305780+0000","last_peered":"2023-11-24T08:07:28.305780+0000","last_clean":"2023-11-24T08:07:28.305780+0000","last_became_active":"2023-11-24T08:07:26.740246+0000","last_became_peered":"2023-11-24T08:07:26.740246+0000","last_unstale":"2023-11-24T08:07:28.305780+0000","last_undegraded":"2023-11-24T08:07:28.305780+0000","last_fullsized":"2023-11-24T08:07:28.305780+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:08:26.458363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.736453+0000","last_change":"2023-11-24T08:07:25.728855+0000","last_active":"2023-11-24T08:07:26.736453+0000","last_peered":"2023-11-24T08:07:26.736453+0000","last_clean":"2023-11-24T08:07:26.736453+0000","last_became_active":"2023-11-24T08:07:25.728621+0000","last_became_peered":"2023-11-24T08:07:25.728621+0000","last_unstale":"2023-11-24T08:07:26.736453+0000","last_undegraded":"2023-11-24T08:07:26.736453+0000","last_fullsized":"2023-11-24T08:07:26.736453+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:33.328198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305616+0000","last_change":"2023-11-24T08:07:26.732542+0000","last_active":"2023-11-24T08:07:28.305616+0000","last_peered":"2023-11-24T08:07:28.305616+0000","last_clean":"2023-11-24T08:07:28.305616+0000","last_became_active":"2023-11-24T08:07:26.732100+0000","last_became_peered":"2023-11-24T08:07:26.732100+0000","last_unstale":"2023-11-24T08:07:28.305616+0000","last_undegraded":"2023-11-24T08:07:28.305616+0000","last_fullsized":"2023-11-24T08:07:28.305616+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:33:24.906885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.736234+0000","last_change":"2023-11-24T08:07:25.728438+0000","last_active":"2023-11-24T08:07:26.736234+0000","last_peered":"2023-11-24T08:07:26.736234+0000","last_clean":"2023-11-24T08:07:26.736234+0000","last_became_active":"2023-11-24T08:07:25.728160+0000","last_became_peered":"2023-11-24T08:07:25.728160+0000","last_unstale":"2023-11-24T08:07:26.736234+0000","last_undegraded":"2023-11-24T08:07:26.736234+0000","last_fullsized":"2023-11-24T08:07:26.736234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:02.024163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301820+0000","last_change":"2023-11-24T08:07:26.742841+0000","last_active":"2023-11-24T08:07:28.301820+0000","last_peered":"2023-11-24T08:07:28.301820+0000","last_clean":"2023-11-24T08:07:28.301820+0000","last_became_active":"2023-11-24T08:07:26.742573+0000","last_became_peered":"2023-11-24T08:07:26.742573+0000","last_unstale":"2023-11-24T08:07:28.301820+0000","last_undegraded":"2023-11-24T08:07:28.301820+0000","last_fullsized":"2023-11-24T08:07:28.301820+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:55.176457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.732698+0000","last_change":"2023-11-24T08:07:25.721633+0000","last_active":"2023-11-24T08:07:26.732698+0000","last_peered":"2023-11-24T08:07:26.732698+0000","last_clean":"2023-11-24T08:07:26.732698+0000","last_became_active":"2023-11-24T08:07:25.721342+0000","last_became_peered":"2023-11-24T08:07:25.721342+0000","last_unstale":"2023-11-24T08:07:26.732698+0000","last_undegraded":"2023-11-24T08:07:26.732698+0000","last_fullsized":"2023-11-24T08:07:26.732698+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:19.067524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305631+0000","last_change":"2023-11-24T08:07:26.742000+0000","last_active":"2023-11-24T08:07:28.305631+0000","last_peered":"2023-11-24T08:07:28.305631+0000","last_clean":"2023-11-24T08:07:28.305631+0000","last_became_active":"2023-11-24T08:07:26.741315+0000","last_became_peered":"2023-11-24T08:07:26.741315+0000","last_unstale":"2023-11-24T08:07:28.305631+0000","last_undegraded":"2023-11-24T08:07:28.305631+0000","last_fullsized":"2023-11-24T08:07:28.305631+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:33:40.777900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.707385+0000","last_change":"2023-11-24T08:07:25.722307+0000","last_active":"2023-11-24T08:07:26.707385+0000","last_peered":"2023-11-24T08:07:26.707385+0000","last_clean":"2023-11-24T08:07:26.707385+0000","last_became_active":"2023-11-24T08:07:25.721981+0000","last_became_peered":"2023-11-24T08:07:25.721981+0000","last_unstale":"2023-11-24T08:07:26.707385+0000","last_undegraded":"2023-11-24T08:07:26.707385+0000","last_fullsized":"2023-11-24T08:07:26.707385+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:18.975644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305113+0000","last_change":"2023-11-24T08:07:26.744035+0000","last_active":"2023-11-24T08:07:28.305113+0000","last_peered":"2023-11-24T08:07:28.305113+0000","last_clean":"2023-11-24T08:07:28.305113+0000","last_became_active":"2023-11-24T08:07:26.738605+0000","last_became_peered":"2023-11-24T08:07:26.738605+0000","last_unstale":"2023-11-24T08:07:28.305113+0000","last_undegraded":"2023-11-24T08:07:28.305113+0000","last_fullsized":"2023-11-24T08:07:28.305113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:02.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.737263+0000","last_change":"2023-11-24T08:07:25.717064+0000","last_active":"2023-11-24T08:07:26.737263+0000","last_peered":"2023-11-24T08:07:26.737263+0000","last_clean":"2023-11-24T08:07:26.737263+0000","last_became_active":"2023-11-24T08:07:25.716733+0000","last_became_peered":"2023-11-24T08:07:25.716733+0000","last_unstale":"2023-11-24T08:07:26.737263+0000","last_undegraded":"2023-11-24T08:07:26.737263+0000","last_fullsized":"2023-11-24T08:07:26.737263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:17.205885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727429+0000","last_change":"2023-11-24T08:07:26.716276+0000","last_active":"2023-11-24T08:07:27.727429+0000","last_peered":"2023-11-24T08:07:27.727429+0000","last_clean":"2023-11-24T08:07:27.727429+0000","last_became_active":"2023-11-24T08:07:26.714591+0000","last_became_peered":"2023-11-24T08:07:26.714591+0000","last_unstale":"2023-11-24T08:07:27.727429+0000","last_undegraded":"2023-11-24T08:07:27.727429+0000","last_fullsized":"2023-11-24T08:07:27.727429+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:11.516172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713226+0000","last_change":"2023-11-24T08:07:25.729812+0000","last_active":"2023-11-24T08:07:26.713226+0000","last_peered":"2023-11-24T08:07:26.713226+0000","last_clean":"2023-11-24T08:07:26.713226+0000","last_became_active":"2023-11-24T08:07:25.729496+0000","last_became_peered":"2023-11-24T08:07:25.729496+0000","last_unstale":"2023-11-24T08:07:26.713226+0000","last_undegraded":"2023-11-24T08:07:26.713226+0000","last_fullsized":"2023-11-24T08:07:26.713226+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:51.283081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727134+0000","last_change":"2023-11-24T08:07:26.727023+0000","last_active":"2023-11-24T08:07:27.727134+0000","last_peered":"2023-11-24T08:07:27.727134+0000","last_clean":"2023-11-24T08:07:27.727134+0000","last_became_active":"2023-11-24T08:07:26.724666+0000","last_became_peered":"2023-11-24T08:07:26.724666+0000","last_unstale":"2023-11-24T08:07:27.727134+0000","last_undegraded":"2023-11-24T08:07:27.727134+0000","last_fullsized":"2023-11-24T08:07:27.727134+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:53.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.717763+0000","last_change":"2023-11-24T08:07:25.727022+0000","last_active":"2023-11-24T08:07:26.717763+0000","last_peered":"2023-11-24T08:07:26.717763+0000","last_clean":"2023-11-24T08:07:26.717763+0000","last_became_active":"2023-11-24T08:07:25.726762+0000","last_became_peered":"2023-11-24T08:07:25.726762+0000","last_unstale":"2023-11-24T08:07:26.717763+0000","last_undegraded":"2023-11-24T08:07:26.717763+0000","last_fullsized":"2023-11-24T08:07:26.717763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:49.119520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305558+0000","last_change":"2023-11-24T08:07:26.733988+0000","last_active":"2023-11-24T08:07:28.305558+0000","last_peered":"2023-11-24T08:07:28.305558+0000","last_clean":"2023-11-24T08:07:28.305558+0000","last_became_active":"2023-11-24T08:07:26.733670+0000","last_became_peered":"2023-11-24T08:07:26.733670+0000","last_unstale":"2023-11-24T08:07:28.305558+0000","last_undegraded":"2023-11-24T08:07:28.305558+0000","last_fullsized":"2023-11-24T08:07:28.305558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:25.875233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.739335+0000","last_change":"2023-11-24T08:07:25.728879+0000","last_active":"2023-11-24T08:07:26.739335+0000","last_peered":"2023-11-24T08:07:26.739335+0000","last_clean":"2023-11-24T08:07:26.739335+0000","last_became_active":"2023-11-24T08:07:25.728539+0000","last_became_peered":"2023-11-24T08:07:25.728539+0000","last_unstale":"2023-11-24T08:07:26.739335+0000","last_undegraded":"2023-11-24T08:07:26.739335+0000","last_fullsized":"2023-11-24T08:07:26.739335+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:14.874933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305802+0000","last_change":"2023-11-24T08:07:26.732336+0000","last_active":"2023-11-24T08:07:28.305802+0000","last_peered":"2023-11-24T08:07:28.305802+0000","last_clean":"2023-11-24T08:07:28.305802+0000","last_became_active":"2023-11-24T08:07:26.731761+0000","last_became_peered":"2023-11-24T08:07:26.731761+0000","last_unstale":"2023-11-24T08:07:28.305802+0000","last_undegraded":"2023-11-24T08:07:28.305802+0000","last_fullsized":"2023-11-24T08:07:28.305802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:33:40.777900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.707781+0000","last_change":"2023-11-24T08:07:25.719675+0000","last_active":"2023-11-24T08:07:26.707781+0000","last_peered":"2023-11-24T08:07:26.707781+0000","last_clean":"2023-11-24T08:07:26.707781+0000","last_became_active":"2023-11-24T08:07:25.719326+0000","last_became_peered":"2023-11-24T08:07:25.719326+0000","last_unstale":"2023-11-24T08:07:26.707781+0000","last_undegraded":"2023-11-24T08:07:26.707781+0000","last_fullsized":"2023-11-24T08:07:26.707781+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:16:48.314483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254210+0000","last_change":"2023-11-24T08:07:26.729667+0000","last_active":"2023-11-24T08:07:28.254210+0000","last_peered":"2023-11-24T08:07:28.254210+0000","last_clean":"2023-11-24T08:07:28.254210+0000","last_became_active":"2023-11-24T08:07:26.728717+0000","last_became_peered":"2023-11-24T08:07:26.728717+0000","last_unstale":"2023-11-24T08:07:28.254210+0000","last_undegraded":"2023-11-24T08:07:28.254210+0000","last_fullsized":"2023-11-24T08:07:28.254210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:59:54.748195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.710945+0000","last_change":"2023-11-24T08:07:25.719143+0000","last_active":"2023-11-24T08:07:26.710945+0000","last_peered":"2023-11-24T08:07:26.710945+0000","last_clean":"2023-11-24T08:07:26.710945+0000","last_became_active":"2023-11-24T08:07:25.718859+0000","last_became_peered":"2023-11-24T08:07:25.718859+0000","last_unstale":"2023-11-24T08:07:26.710945+0000","last_undegraded":"2023-11-24T08:07:26.710945+0000","last_fullsized":"2023-11-24T08:07:26.710945+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:32.445778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727570+0000","last_change":"2023-11-24T08:07:26.731995+0000","last_active":"2023-11-24T08:07:27.727570+0000","last_peered":"2023-11-24T08:07:27.727570+0000","last_clean":"2023-11-24T08:07:27.727570+0000","last_became_active":"2023-11-24T08:07:26.731722+0000","last_became_peered":"2023-11-24T08:07:26.731722+0000","last_unstale":"2023-11-24T08:07:27.727570+0000","last_undegraded":"2023-11-24T08:07:27.727570+0000","last_fullsized":"2023-11-24T08:07:27.727570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:33.988906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.718621+0000","last_change":"2023-11-24T08:07:25.726140+0000","last_active":"2023-11-24T08:07:26.718621+0000","last_peered":"2023-11-24T08:07:26.718621+0000","last_clean":"2023-11-24T08:07:26.718621+0000","last_became_active":"2023-11-24T08:07:25.725851+0000","last_became_peered":"2023-11-24T08:07:25.725851+0000","last_unstale":"2023-11-24T08:07:26.718621+0000","last_undegraded":"2023-11-24T08:07:26.718621+0000","last_fullsized":"2023-11-24T08:07:26.718621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:58.694453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301825+0000","last_change":"2023-11-24T08:07:26.732622+0000","last_active":"2023-11-24T08:07:28.301825+0000","last_peered":"2023-11-24T08:07:28.301825+0000","last_clean":"2023-11-24T08:07:28.301825+0000","last_became_active":"2023-11-24T08:07:26.732380+0000","last_became_peered":"2023-11-24T08:07:26.732380+0000","last_unstale":"2023-11-24T08:07:28.301825+0000","last_undegraded":"2023-11-24T08:07:28.301825+0000","last_fullsized":"2023-11-24T08:07:28.301825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:15.090933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713001+0000","last_change":"2023-11-24T08:07:25.721030+0000","last_active":"2023-11-24T08:07:26.713001+0000","last_peered":"2023-11-24T08:07:26.713001+0000","last_clean":"2023-11-24T08:07:26.713001+0000","last_became_active":"2023-11-24T08:07:25.720559+0000","last_became_peered":"2023-11-24T08:07:25.720559+0000","last_unstale":"2023-11-24T08:07:26.713001+0000","last_undegraded":"2023-11-24T08:07:26.713001+0000","last_fullsized":"2023-11-24T08:07:26.713001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:50.410293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305880+0000","last_change":"2023-11-24T08:07:26.741882+0000","last_active":"2023-11-24T08:07:28.305880+0000","last_peered":"2023-11-24T08:07:28.305880+0000","last_clean":"2023-11-24T08:07:28.305880+0000","last_became_active":"2023-11-24T08:07:26.741603+0000","last_became_peered":"2023-11-24T08:07:26.741603+0000","last_unstale":"2023-11-24T08:07:28.305880+0000","last_undegraded":"2023-11-24T08:07:28.305880+0000","last_fullsized":"2023-11-24T08:07:28.305880+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:00.251471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713066+0000","last_change":"2023-11-24T08:07:25.721411+0000","last_active":"2023-11-24T08:07:26.713066+0000","last_peered":"2023-11-24T08:07:26.713066+0000","last_clean":"2023-11-24T08:07:26.713066+0000","last_became_active":"2023-11-24T08:07:25.721043+0000","last_became_peered":"2023-11-24T08:07:25.721043+0000","last_unstale":"2023-11-24T08:07:26.713066+0000","last_undegraded":"2023-11-24T08:07:26.713066+0000","last_fullsized":"2023-11-24T08:07:26.713066+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:40.127365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254138+0000","last_change":"2023-11-24T08:07:26.718244+0000","last_active":"2023-11-24T08:07:28.254138+0000","last_peered":"2023-11-24T08:07:28.254138+0000","last_clean":"2023-11-24T08:07:28.254138+0000","last_became_active":"2023-11-24T08:07:26.717965+0000","last_became_peered":"2023-11-24T08:07:26.717965+0000","last_unstale":"2023-11-24T08:07:28.254138+0000","last_undegraded":"2023-11-24T08:07:28.254138+0000","last_fullsized":"2023-11-24T08:07:28.254138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:29.609443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713067+0000","last_change":"2023-11-24T08:07:25.726032+0000","last_active":"2023-11-24T08:07:26.713067+0000","last_peered":"2023-11-24T08:07:26.713067+0000","last_clean":"2023-11-24T08:07:26.713067+0000","last_became_active":"2023-11-24T08:07:25.725198+0000","last_became_peered":"2023-11-24T08:07:25.725198+0000","last_unstale":"2023-11-24T08:07:26.713067+0000","last_undegraded":"2023-11-24T08:07:26.713067+0000","last_fullsized":"2023-11-24T08:07:26.713067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:10.356775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301666+0000","last_change":"2023-11-24T08:07:26.720977+0000","last_active":"2023-11-24T08:07:28.301666+0000","last_peered":"2023-11-24T08:07:28.301666+0000","last_clean":"2023-11-24T08:07:28.301666+0000","last_became_active":"2023-11-24T08:07:26.720701+0000","last_became_peered":"2023-11-24T08:07:26.720701+0000","last_unstale":"2023-11-24T08:07:28.301666+0000","last_undegraded":"2023-11-24T08:07:28.301666+0000","last_fullsized":"2023-11-24T08:07:28.301666+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:20.699721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.711892+0000","last_change":"2023-11-24T08:07:25.721633+0000","last_active":"2023-11-24T08:07:26.711892+0000","last_peered":"2023-11-24T08:07:26.711892+0000","last_clean":"2023-11-24T08:07:26.711892+0000","last_became_active":"2023-11-24T08:07:25.721110+0000","last_became_peered":"2023-11-24T08:07:25.721110+0000","last_unstale":"2023-11-24T08:07:26.711892+0000","last_undegraded":"2023-11-24T08:07:26.711892+0000","last_fullsized":"2023-11-24T08:07:26.711892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:05.330383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301670+0000","last_change":"2023-11-24T08:07:26.727916+0000","last_active":"2023-11-24T08:07:28.301670+0000","last_peered":"2023-11-24T08:07:28.301670+0000","last_clean":"2023-11-24T08:07:28.301670+0000","last_became_active":"2023-11-24T08:07:26.727587+0000","last_became_peered":"2023-11-24T08:07:26.727587+0000","last_unstale":"2023-11-24T08:07:28.301670+0000","last_undegraded":"2023-11-24T08:07:28.301670+0000","last_fullsized":"2023-11-24T08:07:28.301670+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:16:39.808140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.710897+0000","last_change":"2023-11-24T08:07:25.723527+0000","last_active":"2023-11-24T08:07:26.710897+0000","last_peered":"2023-11-24T08:07:26.710897+0000","last_clean":"2023-11-24T08:07:26.710897+0000","last_became_active":"2023-11-24T08:07:25.723068+0000","last_became_peered":"2023-11-24T08:07:25.723068+0000","last_unstale":"2023-11-24T08:07:26.710897+0000","last_undegraded":"2023-11-24T08:07:26.710897+0000","last_fullsized":"2023-11-24T08:07:26.710897+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:41.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.720888+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:07:26.720888+0000","last_peered":"2023-11-24T08:07:26.720888+0000","last_clean":"2023-11-24T08:07:26.720888+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:07:26.720888+0000","last_undegraded":"2023-11-24T08:07:26.720888+0000","last_fullsized":"2023-11-24T08:07:26.720888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1327104,"data_stored":890990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.87,"15min":0.92100000000000004},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90400000000000003,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91700000000000004,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.51900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96399999999999997,"5min":5.923,"15min":5.923},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.85899999999999999,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.872,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84099999999999997,"15min":0.90000000000000002},"min":{"1min":0.57699999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.61699999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.879,"15min":0.94099999999999995},"min":{"1min":0.629,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.88800000000000001,"15min":0.95099999999999996},"min":{"1min":0.54800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.878}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80500000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.495,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.752,"15min":0.77600000000000002},"min":{"1min":0.54000000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":1.091,"15min":1.091},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.81599999999999995,"15min":0.85599999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.581,"15min":1.581},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89800000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":300462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.64000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.747},"min":{"1min":0.61699999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.95499999999999996,"5min":1.347,"15min":1.347},"last":1.048}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88,"5min":1.982,"15min":1.982},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74099999999999999,"15min":0.70899999999999996},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93200000000000005,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99299999999999999,"5min":3.657,"15min":3.657},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83499999999999996},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90000000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":3.391,"15min":3.391},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.746},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96999999999999997,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.85699999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":733184,"data_stored":301114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95099999999999996,"5min":2.698,"15min":2.698},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.64200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.93899999999999995,"5min":1.794,"15min":1.794},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71899999999999997,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90600000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.57299999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.831,"15min":1.831},"last":0.68400000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.88800000000000001,"15min":0.83799999999999997},"min":{"1min":0.67700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.89100000000000001,"5min":8.2880000000000003,"15min":8.2880000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":1.006,"15min":1.006},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":1.087,"15min":1.087},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.238,"15min":1.238},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73799999999999999,"15min":0.76100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.878,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96899999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95499999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1}]}]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":737280,"data_stored":302074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.59399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.022,"15min":1.022},"last":0.89500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.873}]},{"osd":3,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86599999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66400000000000003,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.98099999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":300518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.625,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.443},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.67600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.498}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.21,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.53000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.054,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1080000000000001,"5min":1.258,"15min":1.258},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.173,"5min":1.272,"15min":1.272},"last":0.621}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.66500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.24,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.155,"15min":1.155},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1319999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.103,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.83599999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":300518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67500000000000004,"15min":0.745},"min":{"1min":0.40999999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75600000000000001,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.71299999999999997,"15min":0.79200000000000004},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61899999999999999,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":5.907,"15min":5.907},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.71699999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0109999999999999,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.64400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.883,"15min":1.883},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.72799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.034,"5min":1.147,"15min":1.147},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.69699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.0609999999999999,"5min":1.923,"15min":1.923},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.78700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.964,"15min":1.964},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1339999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.006}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":300552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.52400000000000002,"15min":0.56799999999999995},"min":{"1min":0.34300000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74299999999999999,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.67300000000000004,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.67100000000000004,"15min":0.73699999999999999},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64400000000000002,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.75600000000000001,"15min":0.84399999999999997},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71999999999999997,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66800000000000004,"15min":0.72599999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81499999999999995,"15min":0.84999999999999998},"min":{"1min":0.52100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.131,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96499999999999997,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89900000000000002,"15min":0.96699999999999997},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.875,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1890000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93500000000000005,"15min":0.99099999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.88},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.60399999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":1.0820000000000001},"min":{"1min":0.64000000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1060000000000001,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.98899999999999999},"min":{"1min":0.56299999999999994,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0329999999999999,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.0229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1335296,"data_stored":893024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.83799999999999997,"15min":1.0229999999999999},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83499999999999996,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.495},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63600000000000001,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.68899999999999995},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81100000000000005,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.71299999999999997,"15min":0.81100000000000005},"min":{"1min":0.379,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.38},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.94599999999999995,"15min":1.1180000000000001},"min":{"1min":0.48199999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.88900000000000001,"15min":0.93700000000000006},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.046,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.0720000000000001},"min":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.98699999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.117,"15min":1.274},"min":{"1min":0.60299999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0780000000000001,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.175,"15min":1.3520000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0149999999999999,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.751}]},{"osd":6,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.002,"15min":1.1040000000000001},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.113,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.0289999999999999,"15min":1.133},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1339999999999999,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88100000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0980000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.052,"15min":1.157},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.04,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.61799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:30.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7eedaa640 1 Processor -- start 2023-11-24T08:07:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7eedaa640 1 -- start start 2023-11-24T08:07:31.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7eedaa640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7e80b36c0 0x7fe7e80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7eedaa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7eedaa640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e815a700 con 0x7fe7e815a320 2023-11-24T08:07:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7eedaa640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e80b2430 con 0x7fe7e80b36c0 2023-11-24T08:07:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7eedaa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e80b2620 con 0x7fe7e8070da0 2023-11-24T08:07:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7e7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7e80b36c0 0x7fe7e80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7ecb46640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe7e815a320 0x7fe7e8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36506/0 (socket says 172.21.15.57:36506) 2023-11-24T08:07:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7ecb46640 1 -- 172.21.15.57:0/2275995071 learned_addr learned my addr 172.21.15.57:0/2275995071 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.015+0000 7fe7ed347640 1 --2- 172.21.15.57:0/2275995071 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e7fff640 1 -- 172.21.15.57:0/2275995071 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 msgr2=0x7fe7e815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e7fff640 1 --2- 172.21.15.57:0/2275995071 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e7fff640 1 -- 172.21.15.57:0/2275995071 >> v1:172.21.15.57:6789/0 conn(0x7fe7e815a320 legacy=0x7fe7e8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e7fff640 1 -- 172.21.15.57:0/2275995071 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e80b2900 con 0x7fe7e80b36c0 2023-11-24T08:07:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e77fe640 1 -- 172.21.15.57:0/2275995071 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665299913 0 0) 0x7fe7e815a700 con 0x7fe7e815a320 2023-11-24T08:07:31.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e7fff640 1 --2- 172.21.15.57:0/2275995071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e80b1ef0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40097c0 tx=0x7fe7d401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6260aebfe99aa6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e77fe640 1 -- 172.21.15.57:0/2275995071 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40ad660 con 0x7fe7e80b36c0 2023-11-24T08:07:31.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e77fe640 1 -- 172.21.15.57:0/2275995071 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d40ad7c0 con 0x7fe7e80b36c0 2023-11-24T08:07:31.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7e77fe640 1 -- 172.21.15.57:0/2275995071 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40adb50 con 0x7fe7e80b36c0 2023-11-24T08:07:31.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 -- 172.21.15.57:0/2275995071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 msgr2=0x7fe7e80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/2275995071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e80b1ef0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40097c0 tx=0x7fe7d401c450 comp rx=0 tx=0).stop 2023-11-24T08:07:31.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 -- 172.21.15.57:0/2275995071 shutdown_connections 2023-11-24T08:07:31.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/2275995071 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/2275995071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e80b1ef0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 -- 172.21.15.57:0/2275995071 >> 172.21.15.57:0/2275995071 conn(0x7fe7e80b0bf0 msgr2=0x7fe7e80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 -- 172.21.15.57:0/2275995071 shutdown_connections 2023-11-24T08:07:31.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.019+0000 7fe7eedaa640 1 -- 172.21.15.57:0/2275995071 wait complete. 2023-11-24T08:07:31.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 Processor -- start 2023-11-24T08:07:31.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 -- start start 2023-11-24T08:07:31.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e814c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7e815a320 0x7fe7e8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814f710 con 0x7fe7e80b36c0 2023-11-24T08:07:31.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8158080 con 0x7fe7e815a320 2023-11-24T08:07:31.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7eedaa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814c860 con 0x7fe7e8070da0 2023-11-24T08:07:31.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e814c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e814c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34196/0 (socket says 172.21.15.57:34196) 2023-11-24T08:07:31.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 -- 172.21.15.57:0/770491410 learned_addr learned my addr 172.21.15.57:0/770491410 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:31.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7ed347640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7e815a320 0x7fe7e8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7ecb46640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 -- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 msgr2=0x7fe7e813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 -- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7e815a320 msgr2=0x7fe7e8152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7e815a320 0x7fe7e8152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 -- 172.21.15.57:0/770491410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4009420 con 0x7fe7e80b36c0 2023-11-24T08:07:31.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7ecb46640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7ed347640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7e815a320 0x7fe7e8152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:31.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.023+0000 7fe7e7fff640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e814c320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40b0040 tx=0x7fe7d401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7e57fa640 1 -- 172.21.15.57:0/770491410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40b9650 con 0x7fe7e80b36c0 2023-11-24T08:07:31.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7e57fa640 1 -- 172.21.15.57:0/770491410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d40b97d0 con 0x7fe7e80b36c0 2023-11-24T08:07:31.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7e57fa640 1 -- 172.21.15.57:0/770491410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40b9b80 con 0x7fe7e80b36c0 2023-11-24T08:07:31.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e814cb00 con 0x7fe7e80b36c0 2023-11-24T08:07:31.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e8157d10 con 0x7fe7e80b36c0 2023-11-24T08:07:31.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e8067520 con 0x7fe7e80b36c0 2023-11-24T08:07:31.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7e57fa640 1 -- 172.21.15.57:0/770491410 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe7d40b9ce0 con 0x7fe7e80b36c0 2023-11-24T08:07:31.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7e57fa640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7cc066650 0x7fe7cc068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7e57fa640 1 -- 172.21.15.57:0/770491410 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7d411ef20 con 0x7fe7e80b36c0 2023-11-24T08:07:31.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.027+0000 7fe7ecb46640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7cc066650 0x7fe7cc068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.031+0000 7fe7ecb46640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7cc066650 0x7fe7cc068b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc000f70 tx=0x7fe7dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.031+0000 7fe7e57fa640 1 -- 172.21.15.57:0/770491410 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7d40ec090 con 0x7fe7e80b36c0 2023-11-24T08:07:31.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.183+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7e80ae4d0 con 0x7fe7cc066650 2023-11-24T08:07:31.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.191+0000 7fe7e57fa640 1 -- 172.21.15.57:0/770491410 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289247 (secure 0 0 0) 0x7fe7e80ae4d0 con 0x7fe7cc066650 2023-11-24T08:07:31.200 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:31.202 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:07:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7cc066650 msgr2=0x7fe7cc068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7cc066650 0x7fe7cc068b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc000f70 tx=0x7fe7dc009040 comp rx=0 tx=0).stop 2023-11-24T08:07:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 msgr2=0x7fe7e814c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e814c320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40b0040 tx=0x7fe7d401ac90 comp rx=0 tx=0).stop 2023-11-24T08:07:31.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 shutdown_connections 2023-11-24T08:07:31.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe7cc066650 0x7fe7cc068b10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7e815a320 0x7fe7e8152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e80b36c0 0x7fe7e814c320 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 --2- 172.21.15.57:0/770491410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7e8070da0 0x7fe7e813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 >> 172.21.15.57:0/770491410 conn(0x7fe7e80b0bf0 msgr2=0x7fe7e8071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 shutdown_connections 2023-11-24T08:07:31.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.195+0000 7fe7eedaa640 1 -- 172.21.15.57:0/770491410 wait complete. 2023-11-24T08:07:31.220 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-11-24T08:07:30.732470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248032,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726688,"statfs":{"total":773094113280,"available":772840128512,"internally_reserved":0,"allocated":7053312,"data_stored":3589252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002687"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725657+0000","last_change":"2023-11-24T08:07:26.730752+0000","last_active":"2023-11-24T08:07:27.725657+0000","last_peered":"2023-11-24T08:07:27.725657+0000","last_clean":"2023-11-24T08:07:27.725657+0000","last_became_active":"2023-11-24T08:07:26.730095+0000","last_became_peered":"2023-11-24T08:07:26.730095+0000","last_unstale":"2023-11-24T08:07:27.725657+0000","last_undegraded":"2023-11-24T08:07:27.725657+0000","last_fullsized":"2023-11-24T08:07:27.725657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:25.634756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.302057+0000","last_change":"2023-11-24T08:07:26.728394+0000","last_active":"2023-11-24T08:07:28.302057+0000","last_peered":"2023-11-24T08:07:28.302057+0000","last_clean":"2023-11-24T08:07:28.302057+0000","last_became_active":"2023-11-24T08:07:26.728124+0000","last_became_peered":"2023-11-24T08:07:26.728124+0000","last_unstale":"2023-11-24T08:07:28.302057+0000","last_undegraded":"2023-11-24T08:07:28.302057+0000","last_fullsized":"2023-11-24T08:07:28.302057+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:32.796693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305476+0000","last_change":"2023-11-24T08:07:26.740778+0000","last_active":"2023-11-24T08:07:28.305476+0000","last_peered":"2023-11-24T08:07:28.305476+0000","last_clean":"2023-11-24T08:07:28.305476+0000","last_became_active":"2023-11-24T08:07:26.739894+0000","last_became_peered":"2023-11-24T08:07:26.739894+0000","last_unstale":"2023-11-24T08:07:28.305476+0000","last_undegraded":"2023-11-24T08:07:28.305476+0000","last_fullsized":"2023-11-24T08:07:28.305476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:39:24.281849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305097+0000","last_change":"2023-11-24T08:07:26.736779+0000","last_active":"2023-11-24T08:07:28.305097+0000","last_peered":"2023-11-24T08:07:28.305097+0000","last_clean":"2023-11-24T08:07:28.305097+0000","last_became_active":"2023-11-24T08:07:26.735670+0000","last_became_peered":"2023-11-24T08:07:26.735670+0000","last_unstale":"2023-11-24T08:07:28.305097+0000","last_undegraded":"2023-11-24T08:07:28.305097+0000","last_fullsized":"2023-11-24T08:07:28.305097+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:03.303192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725281+0000","last_change":"2023-11-24T08:07:26.726571+0000","last_active":"2023-11-24T08:07:27.725281+0000","last_peered":"2023-11-24T08:07:27.725281+0000","last_clean":"2023-11-24T08:07:27.725281+0000","last_became_active":"2023-11-24T08:07:26.726304+0000","last_became_peered":"2023-11-24T08:07:26.726304+0000","last_unstale":"2023-11-24T08:07:27.725281+0000","last_undegraded":"2023-11-24T08:07:27.725281+0000","last_fullsized":"2023-11-24T08:07:27.725281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:46:03.330841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727169+0000","last_change":"2023-11-24T08:07:26.716071+0000","last_active":"2023-11-24T08:07:27.727169+0000","last_peered":"2023-11-24T08:07:27.727169+0000","last_clean":"2023-11-24T08:07:27.727169+0000","last_became_active":"2023-11-24T08:07:26.715776+0000","last_became_peered":"2023-11-24T08:07:26.715776+0000","last_unstale":"2023-11-24T08:07:27.727169+0000","last_undegraded":"2023-11-24T08:07:27.727169+0000","last_fullsized":"2023-11-24T08:07:27.727169+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:06:06.928290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730002+0000","last_change":"2023-11-24T08:07:26.733163+0000","last_active":"2023-11-24T08:07:27.730002+0000","last_peered":"2023-11-24T08:07:27.730002+0000","last_clean":"2023-11-24T08:07:27.730002+0000","last_became_active":"2023-11-24T08:07:26.732828+0000","last_became_peered":"2023-11-24T08:07:26.732828+0000","last_unstale":"2023-11-24T08:07:27.730002+0000","last_undegraded":"2023-11-24T08:07:27.730002+0000","last_fullsized":"2023-11-24T08:07:27.730002+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:20.074169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301589+0000","last_change":"2023-11-24T08:07:26.725719+0000","last_active":"2023-11-24T08:07:28.301589+0000","last_peered":"2023-11-24T08:07:28.301589+0000","last_clean":"2023-11-24T08:07:28.301589+0000","last_became_active":"2023-11-24T08:07:26.725429+0000","last_became_peered":"2023-11-24T08:07:26.725429+0000","last_unstale":"2023-11-24T08:07:28.301589+0000","last_undegraded":"2023-11-24T08:07:28.301589+0000","last_fullsized":"2023-11-24T08:07:28.301589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:40:00.180018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730200+0000","last_change":"2023-11-24T08:07:26.743201+0000","last_active":"2023-11-24T08:07:27.730200+0000","last_peered":"2023-11-24T08:07:27.730200+0000","last_clean":"2023-11-24T08:07:27.730200+0000","last_became_active":"2023-11-24T08:07:26.742883+0000","last_became_peered":"2023-11-24T08:07:26.742883+0000","last_unstale":"2023-11-24T08:07:27.730200+0000","last_undegraded":"2023-11-24T08:07:27.730200+0000","last_fullsized":"2023-11-24T08:07:27.730200+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:05.768501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254079+0000","last_change":"2023-11-24T08:07:26.725564+0000","last_active":"2023-11-24T08:07:28.254079+0000","last_peered":"2023-11-24T08:07:28.254079+0000","last_clean":"2023-11-24T08:07:28.254079+0000","last_became_active":"2023-11-24T08:07:26.725183+0000","last_became_peered":"2023-11-24T08:07:26.725183+0000","last_unstale":"2023-11-24T08:07:28.254079+0000","last_undegraded":"2023-11-24T08:07:28.254079+0000","last_fullsized":"2023-11-24T08:07:28.254079+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:26:51.180517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254081+0000","last_change":"2023-11-24T08:07:26.735310+0000","last_active":"2023-11-24T08:07:28.254081+0000","last_peered":"2023-11-24T08:07:28.254081+0000","last_clean":"2023-11-24T08:07:28.254081+0000","last_became_active":"2023-11-24T08:07:26.735027+0000","last_became_peered":"2023-11-24T08:07:26.735027+0000","last_unstale":"2023-11-24T08:07:28.254081+0000","last_undegraded":"2023-11-24T08:07:28.254081+0000","last_fullsized":"2023-11-24T08:07:28.254081+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:44:08.485744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305965+0000","last_change":"2023-11-24T08:07:26.737016+0000","last_active":"2023-11-24T08:07:28.305965+0000","last_peered":"2023-11-24T08:07:28.305965+0000","last_clean":"2023-11-24T08:07:28.305965+0000","last_became_active":"2023-11-24T08:07:26.736079+0000","last_became_peered":"2023-11-24T08:07:26.736079+0000","last_unstale":"2023-11-24T08:07:28.305965+0000","last_undegraded":"2023-11-24T08:07:28.305965+0000","last_fullsized":"2023-11-24T08:07:28.305965+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:33.644701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.306390+0000","last_change":"2023-11-24T08:07:26.726470+0000","last_active":"2023-11-24T08:07:28.306390+0000","last_peered":"2023-11-24T08:07:28.306390+0000","last_clean":"2023-11-24T08:07:28.306390+0000","last_became_active":"2023-11-24T08:07:26.725209+0000","last_became_peered":"2023-11-24T08:07:26.725209+0000","last_unstale":"2023-11-24T08:07:28.306390+0000","last_undegraded":"2023-11-24T08:07:28.306390+0000","last_fullsized":"2023-11-24T08:07:28.306390+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:15.881579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730217+0000","last_change":"2023-11-24T08:07:26.732914+0000","last_active":"2023-11-24T08:07:27.730217+0000","last_peered":"2023-11-24T08:07:27.730217+0000","last_clean":"2023-11-24T08:07:27.730217+0000","last_became_active":"2023-11-24T08:07:26.728307+0000","last_became_peered":"2023-11-24T08:07:26.728307+0000","last_unstale":"2023-11-24T08:07:27.730217+0000","last_undegraded":"2023-11-24T08:07:27.730217+0000","last_fullsized":"2023-11-24T08:07:27.730217+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:59.701099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730088+0000","last_change":"2023-11-24T08:07:26.733771+0000","last_active":"2023-11-24T08:07:27.730088+0000","last_peered":"2023-11-24T08:07:27.730088+0000","last_clean":"2023-11-24T08:07:27.730088+0000","last_became_active":"2023-11-24T08:07:26.733454+0000","last_became_peered":"2023-11-24T08:07:26.733454+0000","last_unstale":"2023-11-24T08:07:27.730088+0000","last_undegraded":"2023-11-24T08:07:27.730088+0000","last_fullsized":"2023-11-24T08:07:27.730088+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:11.597664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727114+0000","last_change":"2023-11-24T08:07:26.712672+0000","last_active":"2023-11-24T08:07:27.727114+0000","last_peered":"2023-11-24T08:07:27.727114+0000","last_clean":"2023-11-24T08:07:27.727114+0000","last_became_active":"2023-11-24T08:07:26.712170+0000","last_became_peered":"2023-11-24T08:07:26.712170+0000","last_unstale":"2023-11-24T08:07:27.727114+0000","last_undegraded":"2023-11-24T08:07:27.727114+0000","last_fullsized":"2023-11-24T08:07:27.727114+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:29:25.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.302193+0000","last_change":"2023-11-24T08:07:26.722197+0000","last_active":"2023-11-24T08:07:28.302193+0000","last_peered":"2023-11-24T08:07:28.302193+0000","last_clean":"2023-11-24T08:07:28.302193+0000","last_became_active":"2023-11-24T08:07:26.721924+0000","last_became_peered":"2023-11-24T08:07:26.721924+0000","last_unstale":"2023-11-24T08:07:28.302193+0000","last_undegraded":"2023-11-24T08:07:28.302193+0000","last_fullsized":"2023-11-24T08:07:28.302193+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:44.631940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305890+0000","last_change":"2023-11-24T08:07:26.739548+0000","last_active":"2023-11-24T08:07:28.305890+0000","last_peered":"2023-11-24T08:07:28.305890+0000","last_clean":"2023-11-24T08:07:28.305890+0000","last_became_active":"2023-11-24T08:07:26.739253+0000","last_became_peered":"2023-11-24T08:07:26.739253+0000","last_unstale":"2023-11-24T08:07:28.305890+0000","last_undegraded":"2023-11-24T08:07:28.305890+0000","last_fullsized":"2023-11-24T08:07:28.305890+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:40.839469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725619+0000","last_change":"2023-11-24T08:07:26.729476+0000","last_active":"2023-11-24T08:07:27.725619+0000","last_peered":"2023-11-24T08:07:27.725619+0000","last_clean":"2023-11-24T08:07:27.725619+0000","last_became_active":"2023-11-24T08:07:26.729174+0000","last_became_peered":"2023-11-24T08:07:26.729174+0000","last_unstale":"2023-11-24T08:07:27.725619+0000","last_undegraded":"2023-11-24T08:07:27.725619+0000","last_fullsized":"2023-11-24T08:07:27.725619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:23:11.945429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301772+0000","last_change":"2023-11-24T08:07:26.724254+0000","last_active":"2023-11-24T08:07:28.301772+0000","last_peered":"2023-11-24T08:07:28.301772+0000","last_clean":"2023-11-24T08:07:28.301772+0000","last_became_active":"2023-11-24T08:07:26.723992+0000","last_became_peered":"2023-11-24T08:07:26.723992+0000","last_unstale":"2023-11-24T08:07:28.301772+0000","last_undegraded":"2023-11-24T08:07:28.301772+0000","last_fullsized":"2023-11-24T08:07:28.301772+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:43:58.106793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305524+0000","last_change":"2023-11-24T08:07:26.743471+0000","last_active":"2023-11-24T08:07:28.305524+0000","last_peered":"2023-11-24T08:07:28.305524+0000","last_clean":"2023-11-24T08:07:28.305524+0000","last_became_active":"2023-11-24T08:07:26.742182+0000","last_became_peered":"2023-11-24T08:07:26.742182+0000","last_unstale":"2023-11-24T08:07:28.305524+0000","last_undegraded":"2023-11-24T08:07:28.305524+0000","last_fullsized":"2023-11-24T08:07:28.305524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:25.875233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301604+0000","last_change":"2023-11-24T08:07:26.724839+0000","last_active":"2023-11-24T08:07:28.301604+0000","last_peered":"2023-11-24T08:07:28.301604+0000","last_clean":"2023-11-24T08:07:28.301604+0000","last_became_active":"2023-11-24T08:07:26.724522+0000","last_became_peered":"2023-11-24T08:07:26.724522+0000","last_unstale":"2023-11-24T08:07:28.301604+0000","last_undegraded":"2023-11-24T08:07:28.301604+0000","last_fullsized":"2023-11-24T08:07:28.301604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:27:33.663604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.304886+0000","last_change":"2023-11-24T08:07:26.742994+0000","last_active":"2023-11-24T08:07:28.304886+0000","last_peered":"2023-11-24T08:07:28.304886+0000","last_clean":"2023-11-24T08:07:28.304886+0000","last_became_active":"2023-11-24T08:07:26.742687+0000","last_became_peered":"2023-11-24T08:07:26.742687+0000","last_unstale":"2023-11-24T08:07:28.304886+0000","last_undegraded":"2023-11-24T08:07:28.304886+0000","last_fullsized":"2023-11-24T08:07:28.304886+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:03.303192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.304923+0000","last_change":"2023-11-24T08:07:26.726101+0000","last_active":"2023-11-24T08:07:28.304923+0000","last_peered":"2023-11-24T08:07:28.304923+0000","last_clean":"2023-11-24T08:07:28.304923+0000","last_became_active":"2023-11-24T08:07:26.725743+0000","last_became_peered":"2023-11-24T08:07:26.725743+0000","last_unstale":"2023-11-24T08:07:28.304923+0000","last_undegraded":"2023-11-24T08:07:28.304923+0000","last_fullsized":"2023-11-24T08:07:28.304923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:11.363421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725720+0000","last_change":"2023-11-24T08:07:26.730147+0000","last_active":"2023-11-24T08:07:27.725720+0000","last_peered":"2023-11-24T08:07:27.725720+0000","last_clean":"2023-11-24T08:07:27.725720+0000","last_became_active":"2023-11-24T08:07:26.729690+0000","last_became_peered":"2023-11-24T08:07:26.729690+0000","last_unstale":"2023-11-24T08:07:27.725720+0000","last_undegraded":"2023-11-24T08:07:27.725720+0000","last_fullsized":"2023-11-24T08:07:27.725720+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:26:53.454034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305428+0000","last_change":"2023-11-24T08:07:26.728390+0000","last_active":"2023-11-24T08:07:28.305428+0000","last_peered":"2023-11-24T08:07:28.305428+0000","last_clean":"2023-11-24T08:07:28.305428+0000","last_became_active":"2023-11-24T08:07:26.728082+0000","last_became_peered":"2023-11-24T08:07:26.728082+0000","last_unstale":"2023-11-24T08:07:28.305428+0000","last_undegraded":"2023-11-24T08:07:28.305428+0000","last_fullsized":"2023-11-24T08:07:28.305428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:39:24.281849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727444+0000","last_change":"2023-11-24T08:07:26.715721+0000","last_active":"2023-11-24T08:07:27.727444+0000","last_peered":"2023-11-24T08:07:27.727444+0000","last_clean":"2023-11-24T08:07:27.727444+0000","last_became_active":"2023-11-24T08:07:26.715397+0000","last_became_peered":"2023-11-24T08:07:26.715397+0000","last_unstale":"2023-11-24T08:07:27.727444+0000","last_undegraded":"2023-11-24T08:07:27.727444+0000","last_fullsized":"2023-11-24T08:07:27.727444+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:12.560634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725480+0000","last_change":"2023-11-24T08:07:26.731970+0000","last_active":"2023-11-24T08:07:27.725480+0000","last_peered":"2023-11-24T08:07:27.725480+0000","last_clean":"2023-11-24T08:07:27.725480+0000","last_became_active":"2023-11-24T08:07:26.731418+0000","last_became_peered":"2023-11-24T08:07:26.731418+0000","last_unstale":"2023-11-24T08:07:27.725480+0000","last_undegraded":"2023-11-24T08:07:27.725480+0000","last_fullsized":"2023-11-24T08:07:27.725480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:51:43.221393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.302016+0000","last_change":"2023-11-24T08:07:26.727807+0000","last_active":"2023-11-24T08:07:28.302016+0000","last_peered":"2023-11-24T08:07:28.302016+0000","last_clean":"2023-11-24T08:07:28.302016+0000","last_became_active":"2023-11-24T08:07:26.726996+0000","last_became_peered":"2023-11-24T08:07:26.726996+0000","last_unstale":"2023-11-24T08:07:28.302016+0000","last_undegraded":"2023-11-24T08:07:28.302016+0000","last_fullsized":"2023-11-24T08:07:28.302016+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:30:44.010926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305249+0000","last_change":"2023-11-24T08:07:26.740477+0000","last_active":"2023-11-24T08:07:28.305249+0000","last_peered":"2023-11-24T08:07:28.305249+0000","last_clean":"2023-11-24T08:07:28.305249+0000","last_became_active":"2023-11-24T08:07:26.740099+0000","last_became_peered":"2023-11-24T08:07:26.740099+0000","last_unstale":"2023-11-24T08:07:28.305249+0000","last_undegraded":"2023-11-24T08:07:28.305249+0000","last_fullsized":"2023-11-24T08:07:28.305249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:04.868895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.725183+0000","last_change":"2023-11-24T08:07:26.719107+0000","last_active":"2023-11-24T08:07:27.725183+0000","last_peered":"2023-11-24T08:07:27.725183+0000","last_clean":"2023-11-24T08:07:27.725183+0000","last_became_active":"2023-11-24T08:07:26.718809+0000","last_became_peered":"2023-11-24T08:07:26.718809+0000","last_unstale":"2023-11-24T08:07:27.725183+0000","last_undegraded":"2023-11-24T08:07:27.725183+0000","last_fullsized":"2023-11-24T08:07:27.725183+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:22:28.599602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727035+0000","last_change":"2023-11-24T08:07:26.729696+0000","last_active":"2023-11-24T08:07:27.727035+0000","last_peered":"2023-11-24T08:07:27.727035+0000","last_clean":"2023-11-24T08:07:27.727035+0000","last_became_active":"2023-11-24T08:07:26.729113+0000","last_became_peered":"2023-11-24T08:07:26.729113+0000","last_unstale":"2023-11-24T08:07:27.727035+0000","last_undegraded":"2023-11-24T08:07:27.727035+0000","last_fullsized":"2023-11-24T08:07:27.727035+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:20.620903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727585+0000","last_change":"2023-11-24T08:07:26.730345+0000","last_active":"2023-11-24T08:07:27.727585+0000","last_peered":"2023-11-24T08:07:27.727585+0000","last_clean":"2023-11-24T08:07:27.727585+0000","last_became_active":"2023-11-24T08:07:26.730053+0000","last_became_peered":"2023-11-24T08:07:26.730053+0000","last_unstale":"2023-11-24T08:07:27.727585+0000","last_undegraded":"2023-11-24T08:07:27.727585+0000","last_fullsized":"2023-11-24T08:07:27.727585+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:35:21.926213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.741340+0000","last_change":"2023-11-24T08:07:25.724481+0000","last_active":"2023-11-24T08:07:26.741340+0000","last_peered":"2023-11-24T08:07:26.741340+0000","last_clean":"2023-11-24T08:07:26.741340+0000","last_became_active":"2023-11-24T08:07:25.722134+0000","last_became_peered":"2023-11-24T08:07:25.722134+0000","last_unstale":"2023-11-24T08:07:26.741340+0000","last_undegraded":"2023-11-24T08:07:26.741340+0000","last_fullsized":"2023-11-24T08:07:26.741340+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:53:45.221230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254208+0000","last_change":"2023-11-24T08:07:26.726500+0000","last_active":"2023-11-24T08:07:28.254208+0000","last_peered":"2023-11-24T08:07:28.254208+0000","last_clean":"2023-11-24T08:07:28.254208+0000","last_became_active":"2023-11-24T08:07:26.726103+0000","last_became_peered":"2023-11-24T08:07:26.726103+0000","last_unstale":"2023-11-24T08:07:28.254208+0000","last_undegraded":"2023-11-24T08:07:28.254208+0000","last_fullsized":"2023-11-24T08:07:28.254208+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:08.718933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.734357+0000","last_change":"2023-11-24T08:07:25.711415+0000","last_active":"2023-11-24T08:07:26.734357+0000","last_peered":"2023-11-24T08:07:26.734357+0000","last_clean":"2023-11-24T08:07:26.734357+0000","last_became_active":"2023-11-24T08:07:25.711091+0000","last_became_peered":"2023-11-24T08:07:25.711091+0000","last_unstale":"2023-11-24T08:07:26.734357+0000","last_undegraded":"2023-11-24T08:07:26.734357+0000","last_fullsized":"2023-11-24T08:07:26.734357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:06:48.140646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727482+0000","last_change":"2023-11-24T08:07:26.729121+0000","last_active":"2023-11-24T08:07:27.727482+0000","last_peered":"2023-11-24T08:07:27.727482+0000","last_clean":"2023-11-24T08:07:27.727482+0000","last_became_active":"2023-11-24T08:07:26.728820+0000","last_became_peered":"2023-11-24T08:07:26.728820+0000","last_unstale":"2023-11-24T08:07:27.727482+0000","last_undegraded":"2023-11-24T08:07:27.727482+0000","last_fullsized":"2023-11-24T08:07:27.727482+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:33:43.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.735817+0000","last_change":"2023-11-24T08:07:25.723169+0000","last_active":"2023-11-24T08:07:26.735817+0000","last_peered":"2023-11-24T08:07:26.735817+0000","last_clean":"2023-11-24T08:07:26.735817+0000","last_became_active":"2023-11-24T08:07:25.722024+0000","last_became_peered":"2023-11-24T08:07:25.722024+0000","last_unstale":"2023-11-24T08:07:26.735817+0000","last_undegraded":"2023-11-24T08:07:26.735817+0000","last_fullsized":"2023-11-24T08:07:26.735817+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:14:35.995270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727669+0000","last_change":"2023-11-24T08:07:26.732495+0000","last_active":"2023-11-24T08:07:27.727669+0000","last_peered":"2023-11-24T08:07:27.727669+0000","last_clean":"2023-11-24T08:07:27.727669+0000","last_became_active":"2023-11-24T08:07:26.732170+0000","last_became_peered":"2023-11-24T08:07:26.732170+0000","last_unstale":"2023-11-24T08:07:27.727669+0000","last_undegraded":"2023-11-24T08:07:27.727669+0000","last_fullsized":"2023-11-24T08:07:27.727669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:39:10.475615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.738210+0000","last_change":"2023-11-24T08:07:25.726002+0000","last_active":"2023-11-24T08:07:26.738210+0000","last_peered":"2023-11-24T08:07:26.738210+0000","last_clean":"2023-11-24T08:07:26.738210+0000","last_became_active":"2023-11-24T08:07:25.725716+0000","last_became_peered":"2023-11-24T08:07:25.725716+0000","last_unstale":"2023-11-24T08:07:26.738210+0000","last_undegraded":"2023-11-24T08:07:26.738210+0000","last_fullsized":"2023-11-24T08:07:26.738210+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:46:04.761855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301822+0000","last_change":"2023-11-24T08:07:26.727297+0000","last_active":"2023-11-24T08:07:28.301822+0000","last_peered":"2023-11-24T08:07:28.301822+0000","last_clean":"2023-11-24T08:07:28.301822+0000","last_became_active":"2023-11-24T08:07:26.723317+0000","last_became_peered":"2023-11-24T08:07:26.723317+0000","last_unstale":"2023-11-24T08:07:28.301822+0000","last_undegraded":"2023-11-24T08:07:28.301822+0000","last_fullsized":"2023-11-24T08:07:28.301822+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:33.852238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.738428+0000","last_change":"2023-11-24T08:07:25.728312+0000","last_active":"2023-11-24T08:07:26.738428+0000","last_peered":"2023-11-24T08:07:26.738428+0000","last_clean":"2023-11-24T08:07:26.738428+0000","last_became_active":"2023-11-24T08:07:25.728007+0000","last_became_peered":"2023-11-24T08:07:25.728007+0000","last_unstale":"2023-11-24T08:07:26.738428+0000","last_undegraded":"2023-11-24T08:07:26.738428+0000","last_fullsized":"2023-11-24T08:07:26.738428+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:11.041188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301823+0000","last_change":"2023-11-24T08:07:26.728017+0000","last_active":"2023-11-24T08:07:28.301823+0000","last_peered":"2023-11-24T08:07:28.301823+0000","last_clean":"2023-11-24T08:07:28.301823+0000","last_became_active":"2023-11-24T08:07:26.727493+0000","last_became_peered":"2023-11-24T08:07:26.727493+0000","last_unstale":"2023-11-24T08:07:28.301823+0000","last_undegraded":"2023-11-24T08:07:28.301823+0000","last_fullsized":"2023-11-24T08:07:28.301823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:12:44.021501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.734679+0000","last_change":"2023-11-24T08:07:25.714848+0000","last_active":"2023-11-24T08:07:26.734679+0000","last_peered":"2023-11-24T08:07:26.734679+0000","last_clean":"2023-11-24T08:07:26.734679+0000","last_became_active":"2023-11-24T08:07:25.714377+0000","last_became_peered":"2023-11-24T08:07:25.714377+0000","last_unstale":"2023-11-24T08:07:26.734679+0000","last_undegraded":"2023-11-24T08:07:26.734679+0000","last_fullsized":"2023-11-24T08:07:26.734679+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:20:55.281053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.306105+0000","last_change":"2023-11-24T08:07:26.733222+0000","last_active":"2023-11-24T08:07:28.306105+0000","last_peered":"2023-11-24T08:07:28.306105+0000","last_clean":"2023-11-24T08:07:28.306105+0000","last_became_active":"2023-11-24T08:07:26.732485+0000","last_became_peered":"2023-11-24T08:07:26.732485+0000","last_unstale":"2023-11-24T08:07:28.306105+0000","last_undegraded":"2023-11-24T08:07:28.306105+0000","last_fullsized":"2023-11-24T08:07:28.306105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:52.289727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.717882+0000","last_change":"2023-11-24T08:07:25.719062+0000","last_active":"2023-11-24T08:07:26.717882+0000","last_peered":"2023-11-24T08:07:26.717882+0000","last_clean":"2023-11-24T08:07:26.717882+0000","last_became_active":"2023-11-24T08:07:25.718719+0000","last_became_peered":"2023-11-24T08:07:25.718719+0000","last_unstale":"2023-11-24T08:07:26.717882+0000","last_undegraded":"2023-11-24T08:07:26.717882+0000","last_fullsized":"2023-11-24T08:07:26.717882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:18.720409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301979+0000","last_change":"2023-11-24T08:07:26.717994+0000","last_active":"2023-11-24T08:07:28.301979+0000","last_peered":"2023-11-24T08:07:28.301979+0000","last_clean":"2023-11-24T08:07:28.301979+0000","last_became_active":"2023-11-24T08:07:26.717682+0000","last_became_peered":"2023-11-24T08:07:26.717682+0000","last_unstale":"2023-11-24T08:07:28.301979+0000","last_undegraded":"2023-11-24T08:07:28.301979+0000","last_fullsized":"2023-11-24T08:07:28.301979+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:27:07.870400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.711491+0000","last_change":"2023-11-24T08:07:25.724748+0000","last_active":"2023-11-24T08:07:26.711491+0000","last_peered":"2023-11-24T08:07:26.711491+0000","last_clean":"2023-11-24T08:07:26.711491+0000","last_became_active":"2023-11-24T08:07:25.724333+0000","last_became_peered":"2023-11-24T08:07:25.724333+0000","last_unstale":"2023-11-24T08:07:26.711491+0000","last_undegraded":"2023-11-24T08:07:26.711491+0000","last_fullsized":"2023-11-24T08:07:26.711491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:15:28.554576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730512+0000","last_change":"2023-11-24T08:07:26.735298+0000","last_active":"2023-11-24T08:07:27.730512+0000","last_peered":"2023-11-24T08:07:27.730512+0000","last_clean":"2023-11-24T08:07:27.730512+0000","last_became_active":"2023-11-24T08:07:26.733351+0000","last_became_peered":"2023-11-24T08:07:26.733351+0000","last_unstale":"2023-11-24T08:07:27.730512+0000","last_undegraded":"2023-11-24T08:07:27.730512+0000","last_fullsized":"2023-11-24T08:07:27.730512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:25:25.672382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.722737+0000","last_change":"2023-11-24T08:07:25.719942+0000","last_active":"2023-11-24T08:07:26.722737+0000","last_peered":"2023-11-24T08:07:26.722737+0000","last_clean":"2023-11-24T08:07:26.722737+0000","last_became_active":"2023-11-24T08:07:25.719675+0000","last_became_peered":"2023-11-24T08:07:25.719675+0000","last_unstale":"2023-11-24T08:07:26.722737+0000","last_undegraded":"2023-11-24T08:07:26.722737+0000","last_fullsized":"2023-11-24T08:07:26.722737+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:40.127365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305594+0000","last_change":"2023-11-24T08:07:26.738653+0000","last_active":"2023-11-24T08:07:28.305594+0000","last_peered":"2023-11-24T08:07:28.305594+0000","last_clean":"2023-11-24T08:07:28.305594+0000","last_became_active":"2023-11-24T08:07:26.738240+0000","last_became_peered":"2023-11-24T08:07:26.738240+0000","last_unstale":"2023-11-24T08:07:28.305594+0000","last_undegraded":"2023-11-24T08:07:28.305594+0000","last_fullsized":"2023-11-24T08:07:28.305594+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:33:24.906885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.712703+0000","last_change":"2023-11-24T08:07:25.729420+0000","last_active":"2023-11-24T08:07:26.712703+0000","last_peered":"2023-11-24T08:07:26.712703+0000","last_clean":"2023-11-24T08:07:26.712703+0000","last_became_active":"2023-11-24T08:07:25.728317+0000","last_became_peered":"2023-11-24T08:07:25.728317+0000","last_unstale":"2023-11-24T08:07:26.712703+0000","last_undegraded":"2023-11-24T08:07:26.712703+0000","last_fullsized":"2023-11-24T08:07:26.712703+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:29.449913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254009+0000","last_change":"2023-11-24T08:07:26.730030+0000","last_active":"2023-11-24T08:07:28.254009+0000","last_peered":"2023-11-24T08:07:28.254009+0000","last_clean":"2023-11-24T08:07:28.254009+0000","last_became_active":"2023-11-24T08:07:26.729104+0000","last_became_peered":"2023-11-24T08:07:26.729104+0000","last_unstale":"2023-11-24T08:07:28.254009+0000","last_undegraded":"2023-11-24T08:07:28.254009+0000","last_fullsized":"2023-11-24T08:07:28.254009+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:53:51.961579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.743833+0000","last_change":"2023-11-24T08:07:25.728587+0000","last_active":"2023-11-24T08:07:26.743833+0000","last_peered":"2023-11-24T08:07:26.743833+0000","last_clean":"2023-11-24T08:07:26.743833+0000","last_became_active":"2023-11-24T08:07:25.728318+0000","last_became_peered":"2023-11-24T08:07:25.728318+0000","last_unstale":"2023-11-24T08:07:26.743833+0000","last_undegraded":"2023-11-24T08:07:26.743833+0000","last_fullsized":"2023-11-24T08:07:26.743833+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:18.720409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305778+0000","last_change":"2023-11-24T08:07:26.741793+0000","last_active":"2023-11-24T08:07:28.305778+0000","last_peered":"2023-11-24T08:07:28.305778+0000","last_clean":"2023-11-24T08:07:28.305778+0000","last_became_active":"2023-11-24T08:07:26.741319+0000","last_became_peered":"2023-11-24T08:07:26.741319+0000","last_unstale":"2023-11-24T08:07:28.305778+0000","last_undegraded":"2023-11-24T08:07:28.305778+0000","last_fullsized":"2023-11-24T08:07:28.305778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:50.640867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.752685+0000","last_change":"2023-11-24T08:07:25.720214+0000","last_active":"2023-11-24T08:07:26.752685+0000","last_peered":"2023-11-24T08:07:26.752685+0000","last_clean":"2023-11-24T08:07:26.752685+0000","last_became_active":"2023-11-24T08:07:25.719935+0000","last_became_peered":"2023-11-24T08:07:25.719935+0000","last_unstale":"2023-11-24T08:07:26.752685+0000","last_undegraded":"2023-11-24T08:07:26.752685+0000","last_fullsized":"2023-11-24T08:07:26.752685+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:04.304413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305281+0000","last_change":"2023-11-24T08:07:26.744211+0000","last_active":"2023-11-24T08:07:28.305281+0000","last_peered":"2023-11-24T08:07:28.305281+0000","last_clean":"2023-11-24T08:07:28.305281+0000","last_became_active":"2023-11-24T08:07:26.742608+0000","last_became_peered":"2023-11-24T08:07:26.742608+0000","last_unstale":"2023-11-24T08:07:28.305281+0000","last_undegraded":"2023-11-24T08:07:28.305281+0000","last_fullsized":"2023-11-24T08:07:28.305281+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:04.868895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.735980+0000","last_change":"2023-11-24T08:07:25.728299+0000","last_active":"2023-11-24T08:07:26.735980+0000","last_peered":"2023-11-24T08:07:26.735980+0000","last_clean":"2023-11-24T08:07:26.735980+0000","last_became_active":"2023-11-24T08:07:25.728017+0000","last_became_peered":"2023-11-24T08:07:25.728017+0000","last_unstale":"2023-11-24T08:07:26.735980+0000","last_undegraded":"2023-11-24T08:07:26.735980+0000","last_fullsized":"2023-11-24T08:07:26.735980+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:16:48.366339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305712+0000","last_change":"2023-11-24T08:07:26.745586+0000","last_active":"2023-11-24T08:07:28.305712+0000","last_peered":"2023-11-24T08:07:28.305712+0000","last_clean":"2023-11-24T08:07:28.305712+0000","last_became_active":"2023-11-24T08:07:26.745253+0000","last_became_peered":"2023-11-24T08:07:26.745253+0000","last_unstale":"2023-11-24T08:07:28.305712+0000","last_undegraded":"2023-11-24T08:07:28.305712+0000","last_fullsized":"2023-11-24T08:07:28.305712+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:24:33.644701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.711036+0000","last_change":"2023-11-24T08:07:25.711802+0000","last_active":"2023-11-24T08:07:26.711036+0000","last_peered":"2023-11-24T08:07:26.711036+0000","last_clean":"2023-11-24T08:07:26.711036+0000","last_became_active":"2023-11-24T08:07:25.710562+0000","last_became_peered":"2023-11-24T08:07:25.710562+0000","last_unstale":"2023-11-24T08:07:26.711036+0000","last_undegraded":"2023-11-24T08:07:26.711036+0000","last_fullsized":"2023-11-24T08:07:26.711036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:50.410293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.730022+0000","last_change":"2023-11-24T08:07:26.734165+0000","last_active":"2023-11-24T08:07:27.730022+0000","last_peered":"2023-11-24T08:07:27.730022+0000","last_clean":"2023-11-24T08:07:27.730022+0000","last_became_active":"2023-11-24T08:07:26.733902+0000","last_became_peered":"2023-11-24T08:07:26.733902+0000","last_unstale":"2023-11-24T08:07:27.730022+0000","last_undegraded":"2023-11-24T08:07:27.730022+0000","last_fullsized":"2023-11-24T08:07:27.730022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:52:19.727054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.718013+0000","last_change":"2023-11-24T08:07:25.726151+0000","last_active":"2023-11-24T08:07:26.718013+0000","last_peered":"2023-11-24T08:07:26.718013+0000","last_clean":"2023-11-24T08:07:26.718013+0000","last_became_active":"2023-11-24T08:07:25.725812+0000","last_became_peered":"2023-11-24T08:07:25.725812+0000","last_unstale":"2023-11-24T08:07:26.718013+0000","last_undegraded":"2023-11-24T08:07:26.718013+0000","last_fullsized":"2023-11-24T08:07:26.718013+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:10.591018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305031+0000","last_change":"2023-11-24T08:07:26.743086+0000","last_active":"2023-11-24T08:07:28.305031+0000","last_peered":"2023-11-24T08:07:28.305031+0000","last_clean":"2023-11-24T08:07:28.305031+0000","last_became_active":"2023-11-24T08:07:26.742805+0000","last_became_peered":"2023-11-24T08:07:26.742805+0000","last_unstale":"2023-11-24T08:07:28.305031+0000","last_undegraded":"2023-11-24T08:07:28.305031+0000","last_fullsized":"2023-11-24T08:07:28.305031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:02.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.749979+0000","last_change":"2023-11-24T08:07:25.724424+0000","last_active":"2023-11-24T08:07:26.749979+0000","last_peered":"2023-11-24T08:07:26.749979+0000","last_clean":"2023-11-24T08:07:26.749979+0000","last_became_active":"2023-11-24T08:07:25.724150+0000","last_became_peered":"2023-11-24T08:07:25.724150+0000","last_unstale":"2023-11-24T08:07:26.749979+0000","last_undegraded":"2023-11-24T08:07:26.749979+0000","last_fullsized":"2023-11-24T08:07:26.749979+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:28.602797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305780+0000","last_change":"2023-11-24T08:07:26.740593+0000","last_active":"2023-11-24T08:07:28.305780+0000","last_peered":"2023-11-24T08:07:28.305780+0000","last_clean":"2023-11-24T08:07:28.305780+0000","last_became_active":"2023-11-24T08:07:26.740246+0000","last_became_peered":"2023-11-24T08:07:26.740246+0000","last_unstale":"2023-11-24T08:07:28.305780+0000","last_undegraded":"2023-11-24T08:07:28.305780+0000","last_fullsized":"2023-11-24T08:07:28.305780+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:08:26.458363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.736453+0000","last_change":"2023-11-24T08:07:25.728855+0000","last_active":"2023-11-24T08:07:26.736453+0000","last_peered":"2023-11-24T08:07:26.736453+0000","last_clean":"2023-11-24T08:07:26.736453+0000","last_became_active":"2023-11-24T08:07:25.728621+0000","last_became_peered":"2023-11-24T08:07:25.728621+0000","last_unstale":"2023-11-24T08:07:26.736453+0000","last_undegraded":"2023-11-24T08:07:26.736453+0000","last_fullsized":"2023-11-24T08:07:26.736453+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:04:33.328198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305616+0000","last_change":"2023-11-24T08:07:26.732542+0000","last_active":"2023-11-24T08:07:28.305616+0000","last_peered":"2023-11-24T08:07:28.305616+0000","last_clean":"2023-11-24T08:07:28.305616+0000","last_became_active":"2023-11-24T08:07:26.732100+0000","last_became_peered":"2023-11-24T08:07:26.732100+0000","last_unstale":"2023-11-24T08:07:28.305616+0000","last_undegraded":"2023-11-24T08:07:28.305616+0000","last_fullsized":"2023-11-24T08:07:28.305616+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:33:24.906885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.736234+0000","last_change":"2023-11-24T08:07:25.728438+0000","last_active":"2023-11-24T08:07:26.736234+0000","last_peered":"2023-11-24T08:07:26.736234+0000","last_clean":"2023-11-24T08:07:26.736234+0000","last_became_active":"2023-11-24T08:07:25.728160+0000","last_became_peered":"2023-11-24T08:07:25.728160+0000","last_unstale":"2023-11-24T08:07:26.736234+0000","last_undegraded":"2023-11-24T08:07:26.736234+0000","last_fullsized":"2023-11-24T08:07:26.736234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:02.024163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301820+0000","last_change":"2023-11-24T08:07:26.742841+0000","last_active":"2023-11-24T08:07:28.301820+0000","last_peered":"2023-11-24T08:07:28.301820+0000","last_clean":"2023-11-24T08:07:28.301820+0000","last_became_active":"2023-11-24T08:07:26.742573+0000","last_became_peered":"2023-11-24T08:07:26.742573+0000","last_unstale":"2023-11-24T08:07:28.301820+0000","last_undegraded":"2023-11-24T08:07:28.301820+0000","last_fullsized":"2023-11-24T08:07:28.301820+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:39:55.176457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.732698+0000","last_change":"2023-11-24T08:07:25.721633+0000","last_active":"2023-11-24T08:07:26.732698+0000","last_peered":"2023-11-24T08:07:26.732698+0000","last_clean":"2023-11-24T08:07:26.732698+0000","last_became_active":"2023-11-24T08:07:25.721342+0000","last_became_peered":"2023-11-24T08:07:25.721342+0000","last_unstale":"2023-11-24T08:07:26.732698+0000","last_undegraded":"2023-11-24T08:07:26.732698+0000","last_fullsized":"2023-11-24T08:07:26.732698+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:59:19.067524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305631+0000","last_change":"2023-11-24T08:07:26.742000+0000","last_active":"2023-11-24T08:07:28.305631+0000","last_peered":"2023-11-24T08:07:28.305631+0000","last_clean":"2023-11-24T08:07:28.305631+0000","last_became_active":"2023-11-24T08:07:26.741315+0000","last_became_peered":"2023-11-24T08:07:26.741315+0000","last_unstale":"2023-11-24T08:07:28.305631+0000","last_undegraded":"2023-11-24T08:07:28.305631+0000","last_fullsized":"2023-11-24T08:07:28.305631+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:33:40.777900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.707385+0000","last_change":"2023-11-24T08:07:25.722307+0000","last_active":"2023-11-24T08:07:26.707385+0000","last_peered":"2023-11-24T08:07:26.707385+0000","last_clean":"2023-11-24T08:07:26.707385+0000","last_became_active":"2023-11-24T08:07:25.721981+0000","last_became_peered":"2023-11-24T08:07:25.721981+0000","last_unstale":"2023-11-24T08:07:26.707385+0000","last_undegraded":"2023-11-24T08:07:26.707385+0000","last_fullsized":"2023-11-24T08:07:26.707385+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:18.975644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305113+0000","last_change":"2023-11-24T08:07:26.744035+0000","last_active":"2023-11-24T08:07:28.305113+0000","last_peered":"2023-11-24T08:07:28.305113+0000","last_clean":"2023-11-24T08:07:28.305113+0000","last_became_active":"2023-11-24T08:07:26.738605+0000","last_became_peered":"2023-11-24T08:07:26.738605+0000","last_unstale":"2023-11-24T08:07:28.305113+0000","last_undegraded":"2023-11-24T08:07:28.305113+0000","last_fullsized":"2023-11-24T08:07:28.305113+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:49:02.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.737263+0000","last_change":"2023-11-24T08:07:25.717064+0000","last_active":"2023-11-24T08:07:26.737263+0000","last_peered":"2023-11-24T08:07:26.737263+0000","last_clean":"2023-11-24T08:07:26.737263+0000","last_became_active":"2023-11-24T08:07:25.716733+0000","last_became_peered":"2023-11-24T08:07:25.716733+0000","last_unstale":"2023-11-24T08:07:26.737263+0000","last_undegraded":"2023-11-24T08:07:26.737263+0000","last_fullsized":"2023-11-24T08:07:26.737263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:59:17.205885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727429+0000","last_change":"2023-11-24T08:07:26.716276+0000","last_active":"2023-11-24T08:07:27.727429+0000","last_peered":"2023-11-24T08:07:27.727429+0000","last_clean":"2023-11-24T08:07:27.727429+0000","last_became_active":"2023-11-24T08:07:26.714591+0000","last_became_peered":"2023-11-24T08:07:26.714591+0000","last_unstale":"2023-11-24T08:07:27.727429+0000","last_undegraded":"2023-11-24T08:07:27.727429+0000","last_fullsized":"2023-11-24T08:07:27.727429+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:11.516172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713226+0000","last_change":"2023-11-24T08:07:25.729812+0000","last_active":"2023-11-24T08:07:26.713226+0000","last_peered":"2023-11-24T08:07:26.713226+0000","last_clean":"2023-11-24T08:07:26.713226+0000","last_became_active":"2023-11-24T08:07:25.729496+0000","last_became_peered":"2023-11-24T08:07:25.729496+0000","last_unstale":"2023-11-24T08:07:26.713226+0000","last_undegraded":"2023-11-24T08:07:26.713226+0000","last_fullsized":"2023-11-24T08:07:26.713226+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:27:51.283081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727134+0000","last_change":"2023-11-24T08:07:26.727023+0000","last_active":"2023-11-24T08:07:27.727134+0000","last_peered":"2023-11-24T08:07:27.727134+0000","last_clean":"2023-11-24T08:07:27.727134+0000","last_became_active":"2023-11-24T08:07:26.724666+0000","last_became_peered":"2023-11-24T08:07:26.724666+0000","last_unstale":"2023-11-24T08:07:27.727134+0000","last_undegraded":"2023-11-24T08:07:27.727134+0000","last_fullsized":"2023-11-24T08:07:27.727134+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:02:53.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.717763+0000","last_change":"2023-11-24T08:07:25.727022+0000","last_active":"2023-11-24T08:07:26.717763+0000","last_peered":"2023-11-24T08:07:26.717763+0000","last_clean":"2023-11-24T08:07:26.717763+0000","last_became_active":"2023-11-24T08:07:25.726762+0000","last_became_peered":"2023-11-24T08:07:25.726762+0000","last_unstale":"2023-11-24T08:07:26.717763+0000","last_undegraded":"2023-11-24T08:07:26.717763+0000","last_fullsized":"2023-11-24T08:07:26.717763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:49.119520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305558+0000","last_change":"2023-11-24T08:07:26.733988+0000","last_active":"2023-11-24T08:07:28.305558+0000","last_peered":"2023-11-24T08:07:28.305558+0000","last_clean":"2023-11-24T08:07:28.305558+0000","last_became_active":"2023-11-24T08:07:26.733670+0000","last_became_peered":"2023-11-24T08:07:26.733670+0000","last_unstale":"2023-11-24T08:07:28.305558+0000","last_undegraded":"2023-11-24T08:07:28.305558+0000","last_fullsized":"2023-11-24T08:07:28.305558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:21:25.875233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.739335+0000","last_change":"2023-11-24T08:07:25.728879+0000","last_active":"2023-11-24T08:07:26.739335+0000","last_peered":"2023-11-24T08:07:26.739335+0000","last_clean":"2023-11-24T08:07:26.739335+0000","last_became_active":"2023-11-24T08:07:25.728539+0000","last_became_peered":"2023-11-24T08:07:25.728539+0000","last_unstale":"2023-11-24T08:07:26.739335+0000","last_undegraded":"2023-11-24T08:07:26.739335+0000","last_fullsized":"2023-11-24T08:07:26.739335+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:47:14.874933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305802+0000","last_change":"2023-11-24T08:07:26.732336+0000","last_active":"2023-11-24T08:07:28.305802+0000","last_peered":"2023-11-24T08:07:28.305802+0000","last_clean":"2023-11-24T08:07:28.305802+0000","last_became_active":"2023-11-24T08:07:26.731761+0000","last_became_peered":"2023-11-24T08:07:26.731761+0000","last_unstale":"2023-11-24T08:07:28.305802+0000","last_undegraded":"2023-11-24T08:07:28.305802+0000","last_fullsized":"2023-11-24T08:07:28.305802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:33:40.777900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.707781+0000","last_change":"2023-11-24T08:07:25.719675+0000","last_active":"2023-11-24T08:07:26.707781+0000","last_peered":"2023-11-24T08:07:26.707781+0000","last_clean":"2023-11-24T08:07:26.707781+0000","last_became_active":"2023-11-24T08:07:25.719326+0000","last_became_peered":"2023-11-24T08:07:25.719326+0000","last_unstale":"2023-11-24T08:07:26.707781+0000","last_undegraded":"2023-11-24T08:07:26.707781+0000","last_fullsized":"2023-11-24T08:07:26.707781+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:16:48.314483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254210+0000","last_change":"2023-11-24T08:07:26.729667+0000","last_active":"2023-11-24T08:07:28.254210+0000","last_peered":"2023-11-24T08:07:28.254210+0000","last_clean":"2023-11-24T08:07:28.254210+0000","last_became_active":"2023-11-24T08:07:26.728717+0000","last_became_peered":"2023-11-24T08:07:26.728717+0000","last_unstale":"2023-11-24T08:07:28.254210+0000","last_undegraded":"2023-11-24T08:07:28.254210+0000","last_fullsized":"2023-11-24T08:07:28.254210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:59:54.748195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.710945+0000","last_change":"2023-11-24T08:07:25.719143+0000","last_active":"2023-11-24T08:07:26.710945+0000","last_peered":"2023-11-24T08:07:26.710945+0000","last_clean":"2023-11-24T08:07:26.710945+0000","last_became_active":"2023-11-24T08:07:25.718859+0000","last_became_peered":"2023-11-24T08:07:25.718859+0000","last_unstale":"2023-11-24T08:07:26.710945+0000","last_undegraded":"2023-11-24T08:07:26.710945+0000","last_fullsized":"2023-11-24T08:07:26.710945+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:10:32.445778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:27.727570+0000","last_change":"2023-11-24T08:07:26.731995+0000","last_active":"2023-11-24T08:07:27.727570+0000","last_peered":"2023-11-24T08:07:27.727570+0000","last_clean":"2023-11-24T08:07:27.727570+0000","last_became_active":"2023-11-24T08:07:26.731722+0000","last_became_peered":"2023-11-24T08:07:26.731722+0000","last_unstale":"2023-11-24T08:07:27.727570+0000","last_undegraded":"2023-11-24T08:07:27.727570+0000","last_fullsized":"2023-11-24T08:07:27.727570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:00:33.988906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.718621+0000","last_change":"2023-11-24T08:07:25.726140+0000","last_active":"2023-11-24T08:07:26.718621+0000","last_peered":"2023-11-24T08:07:26.718621+0000","last_clean":"2023-11-24T08:07:26.718621+0000","last_became_active":"2023-11-24T08:07:25.725851+0000","last_became_peered":"2023-11-24T08:07:25.725851+0000","last_unstale":"2023-11-24T08:07:26.718621+0000","last_undegraded":"2023-11-24T08:07:26.718621+0000","last_fullsized":"2023-11-24T08:07:26.718621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:58.694453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301825+0000","last_change":"2023-11-24T08:07:26.732622+0000","last_active":"2023-11-24T08:07:28.301825+0000","last_peered":"2023-11-24T08:07:28.301825+0000","last_clean":"2023-11-24T08:07:28.301825+0000","last_became_active":"2023-11-24T08:07:26.732380+0000","last_became_peered":"2023-11-24T08:07:26.732380+0000","last_unstale":"2023-11-24T08:07:28.301825+0000","last_undegraded":"2023-11-24T08:07:28.301825+0000","last_fullsized":"2023-11-24T08:07:28.301825+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:01:15.090933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713001+0000","last_change":"2023-11-24T08:07:25.721030+0000","last_active":"2023-11-24T08:07:26.713001+0000","last_peered":"2023-11-24T08:07:26.713001+0000","last_clean":"2023-11-24T08:07:26.713001+0000","last_became_active":"2023-11-24T08:07:25.720559+0000","last_became_peered":"2023-11-24T08:07:25.720559+0000","last_unstale":"2023-11-24T08:07:26.713001+0000","last_undegraded":"2023-11-24T08:07:26.713001+0000","last_fullsized":"2023-11-24T08:07:26.713001+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:50.410293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.305880+0000","last_change":"2023-11-24T08:07:26.741882+0000","last_active":"2023-11-24T08:07:28.305880+0000","last_peered":"2023-11-24T08:07:28.305880+0000","last_clean":"2023-11-24T08:07:28.305880+0000","last_became_active":"2023-11-24T08:07:26.741603+0000","last_became_peered":"2023-11-24T08:07:26.741603+0000","last_unstale":"2023-11-24T08:07:28.305880+0000","last_undegraded":"2023-11-24T08:07:28.305880+0000","last_fullsized":"2023-11-24T08:07:28.305880+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:45:00.251471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713066+0000","last_change":"2023-11-24T08:07:25.721411+0000","last_active":"2023-11-24T08:07:26.713066+0000","last_peered":"2023-11-24T08:07:26.713066+0000","last_clean":"2023-11-24T08:07:26.713066+0000","last_became_active":"2023-11-24T08:07:25.721043+0000","last_became_peered":"2023-11-24T08:07:25.721043+0000","last_unstale":"2023-11-24T08:07:26.713066+0000","last_undegraded":"2023-11-24T08:07:26.713066+0000","last_fullsized":"2023-11-24T08:07:26.713066+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:35:40.127365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.254138+0000","last_change":"2023-11-24T08:07:26.718244+0000","last_active":"2023-11-24T08:07:28.254138+0000","last_peered":"2023-11-24T08:07:28.254138+0000","last_clean":"2023-11-24T08:07:28.254138+0000","last_became_active":"2023-11-24T08:07:26.717965+0000","last_became_peered":"2023-11-24T08:07:26.717965+0000","last_unstale":"2023-11-24T08:07:28.254138+0000","last_undegraded":"2023-11-24T08:07:28.254138+0000","last_fullsized":"2023-11-24T08:07:28.254138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:32:29.609443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.713067+0000","last_change":"2023-11-24T08:07:25.726032+0000","last_active":"2023-11-24T08:07:26.713067+0000","last_peered":"2023-11-24T08:07:26.713067+0000","last_clean":"2023-11-24T08:07:26.713067+0000","last_became_active":"2023-11-24T08:07:25.725198+0000","last_became_peered":"2023-11-24T08:07:25.725198+0000","last_unstale":"2023-11-24T08:07:26.713067+0000","last_undegraded":"2023-11-24T08:07:26.713067+0000","last_fullsized":"2023-11-24T08:07:26.713067+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:42:10.356775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301666+0000","last_change":"2023-11-24T08:07:26.720977+0000","last_active":"2023-11-24T08:07:28.301666+0000","last_peered":"2023-11-24T08:07:28.301666+0000","last_clean":"2023-11-24T08:07:28.301666+0000","last_became_active":"2023-11-24T08:07:26.720701+0000","last_became_peered":"2023-11-24T08:07:26.720701+0000","last_unstale":"2023-11-24T08:07:28.301666+0000","last_undegraded":"2023-11-24T08:07:28.301666+0000","last_fullsized":"2023-11-24T08:07:28.301666+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:20.699721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.711892+0000","last_change":"2023-11-24T08:07:25.721633+0000","last_active":"2023-11-24T08:07:26.711892+0000","last_peered":"2023-11-24T08:07:26.711892+0000","last_clean":"2023-11-24T08:07:26.711892+0000","last_became_active":"2023-11-24T08:07:25.721110+0000","last_became_peered":"2023-11-24T08:07:25.721110+0000","last_unstale":"2023-11-24T08:07:26.711892+0000","last_undegraded":"2023-11-24T08:07:26.711892+0000","last_fullsized":"2023-11-24T08:07:26.711892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:13:05.330383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.301670+0000","last_change":"2023-11-24T08:07:26.727916+0000","last_active":"2023-11-24T08:07:28.301670+0000","last_peered":"2023-11-24T08:07:28.301670+0000","last_clean":"2023-11-24T08:07:28.301670+0000","last_became_active":"2023-11-24T08:07:26.727587+0000","last_became_peered":"2023-11-24T08:07:26.727587+0000","last_unstale":"2023-11-24T08:07:28.301670+0000","last_undegraded":"2023-11-24T08:07:28.301670+0000","last_fullsized":"2023-11-24T08:07:28.301670+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:25.682957+0000","last_clean_scrub_stamp":"2023-11-24T08:07:25.682957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:16:39.808140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.710897+0000","last_change":"2023-11-24T08:07:25.723527+0000","last_active":"2023-11-24T08:07:26.710897+0000","last_peered":"2023-11-24T08:07:26.710897+0000","last_clean":"2023-11-24T08:07:26.710897+0000","last_became_active":"2023-11-24T08:07:25.723068+0000","last_became_peered":"2023-11-24T08:07:25.723068+0000","last_unstale":"2023-11-24T08:07:26.710897+0000","last_undegraded":"2023-11-24T08:07:26.710897+0000","last_fullsized":"2023-11-24T08:07:26.710897+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:07:24.676311+0000","last_clean_scrub_stamp":"2023-11-24T08:07:24.676311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:01:41.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:07:26.720888+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:07:26.720888+0000","last_peered":"2023-11-24T08:07:26.720888+0000","last_clean":"2023-11-24T08:07:26.720888+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:07:26.720888+0000","last_undegraded":"2023-11-24T08:07:26.720888+0000","last_fullsized":"2023-11-24T08:07:26.720888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1327104,"data_stored":890990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.87,"15min":0.92100000000000004},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90400000000000003,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91700000000000004,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.51900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96399999999999997,"5min":5.923,"15min":5.923},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.85899999999999999,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.872,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84099999999999997,"15min":0.90000000000000002},"min":{"1min":0.57699999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.61699999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.879,"15min":0.94099999999999995},"min":{"1min":0.629,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.88800000000000001,"15min":0.95099999999999996},"min":{"1min":0.54800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.878}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80500000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.495,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.752,"15min":0.77600000000000002},"min":{"1min":0.54000000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":1.091,"15min":1.091},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.81599999999999995,"15min":0.85599999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.581,"15min":1.581},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89800000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":300462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.64000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.747},"min":{"1min":0.61699999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.95499999999999996,"5min":1.347,"15min":1.347},"last":1.048}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88,"5min":1.982,"15min":1.982},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74099999999999999,"15min":0.70899999999999996},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93200000000000005,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99299999999999999,"5min":3.657,"15min":3.657},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83499999999999996},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90000000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":3.391,"15min":3.391},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.746},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96999999999999997,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.85699999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":733184,"data_stored":301114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95099999999999996,"5min":2.698,"15min":2.698},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.64200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.93899999999999995,"5min":1.794,"15min":1.794},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71899999999999997,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90600000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.57299999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.831,"15min":1.831},"last":0.68400000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.88800000000000001,"15min":0.83799999999999997},"min":{"1min":0.67700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.89100000000000001,"5min":8.2880000000000003,"15min":8.2880000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":1.006,"15min":1.006},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":1.087,"15min":1.087},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.238,"15min":1.238},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73799999999999999,"15min":0.76100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.878,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96899999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95499999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1}]}]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":737280,"data_stored":302074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.59399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.022,"15min":1.022},"last":0.89500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.873}]},{"osd":3,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86599999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66400000000000003,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.98099999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":300518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.625,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.443},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.67600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.498}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.21,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.53000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.054,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1080000000000001,"5min":1.258,"15min":1.258},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.173,"5min":1.272,"15min":1.272},"last":0.621}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.66500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.24,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.155,"15min":1.155},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1319999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.103,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.83599999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":300518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67500000000000004,"15min":0.745},"min":{"1min":0.40999999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75600000000000001,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.71299999999999997,"15min":0.79200000000000004},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61899999999999999,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":5.907,"15min":5.907},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.71699999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0109999999999999,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.64400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.883,"15min":1.883},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.72799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.034,"5min":1.147,"15min":1.147},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.69699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.0609999999999999,"5min":1.923,"15min":1.923},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.78700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.964,"15min":1.964},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1339999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.006}]}]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":300552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.52400000000000002,"15min":0.56799999999999995},"min":{"1min":0.34300000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74299999999999999,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.67300000000000004,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.67100000000000004,"15min":0.73699999999999999},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64400000000000002,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.75600000000000001,"15min":0.84399999999999997},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71999999999999997,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66800000000000004,"15min":0.72599999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81499999999999995,"15min":0.84999999999999998},"min":{"1min":0.52100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.131,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96499999999999997,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89900000000000002,"15min":0.96699999999999997},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.875,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1890000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93500000000000005,"15min":0.99099999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.88},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.60399999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":1.0820000000000001},"min":{"1min":0.64000000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1060000000000001,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.98899999999999999},"min":{"1min":0.56299999999999994,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0329999999999999,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.0229999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1335296,"data_stored":893024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.83799999999999997,"15min":1.0229999999999999},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83499999999999996,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.495},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63600000000000001,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.68899999999999995},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81100000000000005,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.71299999999999997,"15min":0.81100000000000005},"min":{"1min":0.379,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.38},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.94599999999999995,"15min":1.1180000000000001},"min":{"1min":0.48199999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.88900000000000001,"15min":0.93700000000000006},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.046,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.0720000000000001},"min":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.98699999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.117,"15min":1.274},"min":{"1min":0.60299999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0780000000000001,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.175,"15min":1.3520000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0149999999999999,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.751}]},{"osd":6,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.002,"15min":1.1040000000000001},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.113,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.0289999999999999,"15min":1.133},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1339999999999999,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88100000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0980000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.052,"15min":1.157},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.04,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.61799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:31.227 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:07:31.227 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:07:31.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70d16f7640 1 Processor -- start 2023-11-24T08:07:31.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70d16f7640 1 -- start start 2023-11-24T08:07:31.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70d16f7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f70cc15a4d0 0x7f70cc0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70d16f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70d16f7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc15a8b0 con 0x7f70cc06d740 2023-11-24T08:07:31.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70d16f7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0c9c30 con 0x7f70cc15a4d0 2023-11-24T08:07:31.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70d16f7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc15ee80 con 0x7f70cc0cad20 2023-11-24T08:07:31.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.407+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70c3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc15e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:47962/0 (socket says 172.21.15.57:47962) 2023-11-24T08:07:31.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70c3fff640 1 -- 172.21.15.57:0/275173915 learned_addr learned my addr 172.21.15.57:0/275173915 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:31.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70caffd640 1 --2- 172.21.15.57:0/275173915 >> v2:172.21.15.132:3300/0 conn(0x7f70cc15a4d0 0x7f70cc0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70ca7fc640 1 -- 172.21.15.57:0/275173915 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932295595 0 0) 0x7f70cc15a8b0 con 0x7f70cc06d740 2023-11-24T08:07:31.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70ca7fc640 1 -- 172.21.15.57:0/275173915 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b8003530 con 0x7f70cc06d740 2023-11-24T08:07:31.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70c3fff640 1 -- 172.21.15.57:0/275173915 >> v2:172.21.15.132:3300/0 conn(0x7f70cc15a4d0 msgr2=0x7f70cc0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70c3fff640 1 --2- 172.21.15.57:0/275173915 >> v2:172.21.15.132:3300/0 conn(0x7f70cc15a4d0 0x7f70cc0c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70c3fff640 1 -- 172.21.15.57:0/275173915 >> v1:172.21.15.132:6789/0 conn(0x7f70cc06d740 legacy=0x7f70cc0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70c3fff640 1 -- 172.21.15.57:0/275173915 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0c9f60 con 0x7f70cc0cad20 2023-11-24T08:07:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70c3fff640 1 --2- 172.21.15.57:0/275173915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc15e940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70b400bb10 tx=0x7f70b401eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d7d3cd01c52a5ac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70ca7fc640 1 -- 172.21.15.57:0/275173915 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40a7c20 con 0x7f70cc0cad20 2023-11-24T08:07:31.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.411+0000 7f70ca7fc640 1 -- 172.21.15.57:0/275173915 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b40a7d80 con 0x7f70cc0cad20 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70ca7fc640 1 -- 172.21.15.57:0/275173915 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40af640 con 0x7f70cc0cad20 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- 172.21.15.57:0/275173915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 msgr2=0x7f70cc15e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 --2- 172.21.15.57:0/275173915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc15e940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70b400bb10 tx=0x7f70b401eb50 comp rx=0 tx=0).stop 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- 172.21.15.57:0/275173915 shutdown_connections 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 --2- 172.21.15.57:0/275173915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc15e940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 --2- 172.21.15.57:0/275173915 >> v2:172.21.15.132:3300/0 conn(0x7f70cc15a4d0 0x7f70cc0c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- 172.21.15.57:0/275173915 >> 172.21.15.57:0/275173915 conn(0x7f70cc0b0bf0 msgr2=0x7f70cc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- 172.21.15.57:0/275173915 shutdown_connections 2023-11-24T08:07:31.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- 172.21.15.57:0/275173915 wait complete. 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 Processor -- start 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- start start 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc06d740 0x7f70cc14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc0c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70cc15a4d0 0x7f70cc0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c50a0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c4800 con 0x7f70cc06d740 2023-11-24T08:07:31.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70d16f7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c4ae0 con 0x7f70cc0cad20 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70cc15a4d0 0x7f70cc0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70cc15a4d0 0x7f70cc0cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34198/0 (socket says 172.21.15.57:34198) 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70cb7fe640 1 -- 172.21.15.57:0/2559871472 learned_addr learned my addr 172.21.15.57:0/2559871472 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70c3fff640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc0c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.415+0000 7f70caffd640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc06d740 0x7f70cc14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70cb7fe640 1 -- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 msgr2=0x7f70cc0c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70cb7fe640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc0c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70cb7fe640 1 -- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc06d740 msgr2=0x7f70cc14d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70cb7fe640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc06d740 0x7f70cc14d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70cb7fe640 1 -- 172.21.15.57:0/2559871472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b400b770 con 0x7f70cc15a4d0 2023-11-24T08:07:31.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70cb7fe640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70cc15a4d0 0x7f70cc0cd700 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c790 tx=0x7f70c400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70c37fe640 1 -- 172.21.15.57:0/2559871472 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400cea0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70c37fe640 1 -- 172.21.15.57:0/2559871472 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4003b80 con 0x7f70cc15a4d0 2023-11-24T08:07:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70c37fe640 1 -- 172.21.15.57:0/2559871472 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400a850 con 0x7f70cc15a4d0 2023-11-24T08:07:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc06e0e0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc1549d0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc154bc0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70c37fe640 1 -- 172.21.15.57:0/2559871472 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f70c400a9b0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70c37fe640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f70ac066620 0x7f70ac068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.419+0000 7f70c37fe640 1 -- 172.21.15.57:0/2559871472 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c4083fb0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.423+0000 7f70caffd640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f70ac066620 0x7f70ac068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.423+0000 7f70caffd640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f70ac066620 0x7f70ac068ae0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009ac0 tx=0x7f70bc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.423+0000 7f70c37fe640 1 -- 172.21.15.57:0/2559871472 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70c40511c0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.635+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f70cc09d250 con 0x7f70cc15a4d0 2023-11-24T08:07:31.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.639+0000 7f70c37fe640 1 -- 172.21.15.57:0/2559871472 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f70c40547e0 con 0x7f70cc15a4d0 2023-11-24T08:07:31.645 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-11-24T08:07:31.645 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCqWGBluIt2OBAAfovL4zEBTPpZp6tuIDhzVg== 2023-11-24T08:07:31.645 INFO:teuthology.orchestra.run.smithi057.stdout: caps mds = "allow" 2023-11-24T08:07:31.645 INFO:teuthology.orchestra.run.smithi057.stdout: caps mon = "allow r" 2023-11-24T08:07:31.645 INFO:teuthology.orchestra.run.smithi057.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:07:31.645 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f70ac066620 msgr2=0x7f70ac068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f70ac066620 0x7f70ac068ae0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009ac0 tx=0x7f70bc009190 comp rx=0 tx=0).stop 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70cc15a4d0 msgr2=0x7f70cc0cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70cc15a4d0 0x7f70cc0cd700 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c790 tx=0x7f70c400cc50 comp rx=0 tx=0).stop 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 shutdown_connections 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f70ac066620 0x7f70ac068ae0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70cc15a4d0 0x7f70cc0cd700 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70cc0cad20 0x7f70cc0c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 --2- 172.21.15.57:0/2559871472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70cc06d740 0x7f70cc14d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 >> 172.21.15.57:0/2559871472 conn(0x7f70cc0b0bf0 msgr2=0x7f70cc0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 shutdown_connections 2023-11-24T08:07:31.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.643+0000 7f70d16f7640 1 -- 172.21.15.57:0/2559871472 wait complete. 2023-11-24T08:07:31.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:31.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.807+0000 7f2ebc92a640 1 Processor -- start 2023-11-24T08:07:31.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.807+0000 7f2ebc92a640 1 -- start start 2023-11-24T08:07:31.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2ebc92a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2eb8144030 0x7f2eb806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2ebc92a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb809cc20 0x7f2eb806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2ebc92a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2eb806e280 0x7f2eb80709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2ebc92a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb8145020 con 0x7f2eb806e280 2023-11-24T08:07:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2ebc92a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb806d8b0 con 0x7f2eb8144030 2023-11-24T08:07:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2ebc92a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb809d0a0 con 0x7f2eb809cc20 2023-11-24T08:07:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2eb806e280 0x7f2eb80709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2eb806e280 0x7f2eb80709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34208/0 (socket says 172.21.15.57:34208) 2023-11-24T08:07:31.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 -- 172.21.15.57:0/2422065075 learned_addr learned my addr 172.21.15.57:0/2422065075 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eaffff640 1 --2- 172.21.15.57:0/2422065075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb809cc20 0x7f2eb806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb659c640 1 --2- 172.21.15.57:0/2422065075 >> v2:172.21.15.132:3300/0 conn(0x7f2eb8144030 0x7f2eb806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 -- 172.21.15.57:0/2422065075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb809cc20 msgr2=0x7f2eb806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 --2- 172.21.15.57:0/2422065075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb809cc20 0x7f2eb806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 -- 172.21.15.57:0/2422065075 >> v2:172.21.15.132:3300/0 conn(0x7f2eb8144030 msgr2=0x7f2eb806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 --2- 172.21.15.57:0/2422065075 >> v2:172.21.15.132:3300/0 conn(0x7f2eb8144030 0x7f2eb806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 -- 172.21.15.57:0/2422065075 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb806cca0 con 0x7f2eb806e280 2023-11-24T08:07:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb659c640 1 --2- 172.21.15.57:0/2422065075 >> v2:172.21.15.132:3300/0 conn(0x7f2eb8144030 0x7f2eb806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.811+0000 7f2eb6d9d640 1 --2- 172.21.15.57:0/2422065075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb806e280 0x7f2eb80709c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2eb806c2f0 tx=0x7f2eb001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94a5accfbf7e119 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2eb5d9b640 1 -- 172.21.15.57:0/2422065075 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00a5820 con 0x7f2eb806e280 2023-11-24T08:07:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2eb5d9b640 1 -- 172.21.15.57:0/2422065075 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00a5980 con 0x7f2eb806e280 2023-11-24T08:07:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2eb5d9b640 1 -- 172.21.15.57:0/2422065075 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00a5d10 con 0x7f2eb806e280 2023-11-24T08:07:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2422065075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb806e280 msgr2=0x7f2eb80709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2422065075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb806e280 0x7f2eb80709c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2eb806c2f0 tx=0x7f2eb001c9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2422065075 shutdown_connections 2023-11-24T08:07:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2422065075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb806e280 0x7f2eb80709c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2422065075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb809cc20 0x7f2eb806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2422065075 >> v2:172.21.15.132:3300/0 conn(0x7f2eb8144030 0x7f2eb806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2422065075 >> 172.21.15.57:0/2422065075 conn(0x7f2eb80b0bf0 msgr2=0x7f2eb80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:31.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2422065075 shutdown_connections 2023-11-24T08:07:31.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2422065075 wait complete. 2023-11-24T08:07:31.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 Processor -- start 2023-11-24T08:07:31.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- start start 2023-11-24T08:07:31.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb806e280 0x7f2eb813a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb809cc20 0x7f2eb80af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eb8144030 0x7f2eb80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81327d0 con 0x7f2eb809cc20 2023-11-24T08:07:31.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb809b5f0 con 0x7f2eb8144030 2023-11-24T08:07:31.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.815+0000 7f2ebc92a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb809b8d0 con 0x7f2eb806e280 2023-11-24T08:07:31.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb809cc20 0x7f2eb80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb809cc20 0x7f2eb80af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34224/0 (socket says 172.21.15.57:34224) 2023-11-24T08:07:31.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 -- 172.21.15.57:0/2385591889 learned_addr learned my addr 172.21.15.57:0/2385591889 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:31.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eb659c640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb806e280 0x7f2eb813a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eb6d9d640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eb8144030 0x7f2eb80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 -- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb806e280 msgr2=0x7f2eb813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb806e280 0x7f2eb813a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 -- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eb8144030 msgr2=0x7f2eb80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:31.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eb8144030 0x7f2eb80afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:31.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 -- 172.21.15.57:0/2385591889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0009b30 con 0x7f2eb809cc20 2023-11-24T08:07:31.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaffff640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb809cc20 0x7f2eb80af720 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000e930 tx=0x7f2ea000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaeffd640 1 -- 172.21.15.57:0/2385591889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0009690 con 0x7f2eb809cc20 2023-11-24T08:07:31.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaeffd640 1 -- 172.21.15.57:0/2385591889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000ca00 con 0x7f2eb809cc20 2023-11-24T08:07:31.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaeffd640 1 -- 172.21.15.57:0/2385591889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000cd70 con 0x7f2eb809cc20 2023-11-24T08:07:31.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb809bbb0 con 0x7f2eb809cc20 2023-11-24T08:07:31.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8143720 con 0x7f2eb809cc20 2023-11-24T08:07:31.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb8067520 con 0x7f2eb809cc20 2023-11-24T08:07:31.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.819+0000 7f2eaeffd640 1 -- 172.21.15.57:0/2385591889 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f2ea0013470 con 0x7f2eb809cc20 2023-11-24T08:07:31.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.823+0000 7f2eaeffd640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2e98066620 0x7f2e98068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:31.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.823+0000 7f2eaeffd640 1 -- 172.21.15.57:0/2385591889 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea0084330 con 0x7f2eb809cc20 2023-11-24T08:07:31.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.823+0000 7f2eb659c640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2e98066620 0x7f2e98068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:31.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.823+0000 7f2eb659c640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2e98066620 0x7f2e98068ae0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2eb81f93d0 tx=0x7f2ea8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:31.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:31.827+0000 7f2eaeffd640 1 -- 172.21.15.57:0/2385591889 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ea00516b0 con 0x7f2eb809cc20 2023-11-24T08:07:32.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.015+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2eb813c380 con 0x7f2eb809cc20 2023-11-24T08:07:32.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.015+0000 7f2eaeffd640 1 -- 172.21.15.57:0/2385591889 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f2ea0054cd0 con 0x7f2eb809cc20 2023-11-24T08:07:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:32.022 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/4096569691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4096569691},{"type":"v1","addr":"172.21.15.57:6834","nonce":4096569691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/671957004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":671957004},{"type":"v1","addr":"172.21.15.57:6835","nonce":671957004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6165,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1925156645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1925156645},{"type":"v1","addr":"172.21.15.132:6837","nonce":1925156645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:26.096476+0000","modified":"2023-11-24T08:07:29.117899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55373":{"gid":55373,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1683487539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1683487539},{"type":"v1","addr":"172.21.15.132:6836","nonce":1683487539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:32.023 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 35 2023-11-24T08:07:32.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2e98066620 msgr2=0x7f2e98068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2e98066620 0x7f2e98068ae0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2eb81f93d0 tx=0x7f2ea8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:32.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb809cc20 msgr2=0x7f2eb80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb809cc20 0x7f2eb80af720 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000e930 tx=0x7f2ea000edf0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 shutdown_connections 2023-11-24T08:07:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2e98066620 0x7f2e98068ae0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eb8144030 0x7f2eb80afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2eb809cc20 0x7f2eb80af720 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 --2- 172.21.15.57:0/2385591889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eb806e280 0x7f2eb813a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 >> 172.21.15.57:0/2385591889 conn(0x7f2eb80b0bf0 msgr2=0x7f2eb80b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 shutdown_connections 2023-11-24T08:07:32.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.019+0000 7f2ebc92a640 1 -- 172.21.15.57:0/2385591889 wait complete. 2023-11-24T08:07:32.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:07:26.096476+0000', 'modified': '2023-11-24T08:07:29.117899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 55373}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_55373': {'gid': 55373, 'name': 'b', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6836/1683487539', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6834', 'nonce': 1683487539}, {'type': 'v1', 'addr': '172.21.15.132:6836', 'nonce': 1683487539}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:07:32.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:07:32.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T08:07:32.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f9c17640 1 Processor -- start 2023-11-24T08:07:32.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f9c17640 1 -- start start 2023-11-24T08:07:32.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f9c17640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1f415d570 0x7fc1f406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f9c17640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc1f40ce8b0 0x7fc1f40ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f9c17640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40d1cc0 con 0x7fc1f40d3020 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f9c17640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40d1fa0 con 0x7fc1f415d570 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f9c17640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40ce0b0 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1f415d570 0x7fc1f406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f2ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc1f40d3020 0x7fc1f40d34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36516/0 (socket says 172.21.15.57:36516) 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f2ffd640 1 -- 172.21.15.57:0/1222046715 learned_addr learned my addr 172.21.15.57:0/1222046715 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/1222046715 >> v2:172.21.15.132:3300/0 conn(0x7fc1f40ce8b0 0x7fc1f40ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f37fe640 1 -- 172.21.15.57:0/1222046715 >> v2:172.21.15.132:3300/0 conn(0x7fc1f40ce8b0 msgr2=0x7fc1f40ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/1222046715 >> v2:172.21.15.132:3300/0 conn(0x7fc1f40ce8b0 0x7fc1f40ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f37fe640 1 -- 172.21.15.57:0/1222046715 >> v1:172.21.15.57:6789/0 conn(0x7fc1f40d3020 legacy=0x7fc1f40d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f37fe640 1 -- 172.21.15.57:0/1222046715 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40ce390 con 0x7fc1f415d570 2023-11-24T08:07:32.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.591+0000 7fc1f27fc640 1 -- 172.21.15.57:0/1222046715 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056343214 0 0) 0x7fc1f40d1cc0 con 0x7fc1f40d3020 2023-11-24T08:07:32.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/1222046715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f415d570 0x7fc1f406b9d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40c6e60 tx=0x7fc1e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9d7474181c08a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f27fc640 1 -- 172.21.15.57:0/1222046715 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40ab650 con 0x7fc1f415d570 2023-11-24T08:07:32.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f27fc640 1 -- 172.21.15.57:0/1222046715 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e40ab7b0 con 0x7fc1f415d570 2023-11-24T08:07:32.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f27fc640 1 -- 172.21.15.57:0/1222046715 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40abb40 con 0x7fc1f415d570 2023-11-24T08:07:32.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 -- 172.21.15.57:0/1222046715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f415d570 msgr2=0x7fc1f406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/1222046715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f415d570 0x7fc1f406b9d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40c6e60 tx=0x7fc1e401c430 comp rx=0 tx=0).stop 2023-11-24T08:07:32.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 -- 172.21.15.57:0/1222046715 shutdown_connections 2023-11-24T08:07:32.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/1222046715 >> v2:172.21.15.132:3300/0 conn(0x7fc1f40ce8b0 0x7fc1f40ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/1222046715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f415d570 0x7fc1f406b9d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 -- 172.21.15.57:0/1222046715 >> 172.21.15.57:0/1222046715 conn(0x7fc1f408ceb0 msgr2=0x7fc1f409c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 -- 172.21.15.57:0/1222046715 shutdown_connections 2023-11-24T08:07:32.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 -- 172.21.15.57:0/1222046715 wait complete. 2023-11-24T08:07:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.595+0000 7fc1f9c17640 1 Processor -- start 2023-11-24T08:07:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 -- start start 2023-11-24T08:07:32.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f40ce8b0 0x7fc1f40b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f40d3020 0x7fc1f40c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f415d570 0x7fc1f40b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c6f30 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b8eb0 con 0x7fc1f415d570 2023-11-24T08:07:32.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c7420 con 0x7fc1f40d3020 2023-11-24T08:07:32.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f40ce8b0 0x7fc1f40b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f40ce8b0 0x7fc1f40b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34240/0 (socket says 172.21.15.57:34240) 2023-11-24T08:07:32.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 -- 172.21.15.57:0/2172167103 learned_addr learned my addr 172.21.15.57:0/2172167103 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:32.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f415d570 0x7fc1f40b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f40d3020 0x7fc1f40c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 -- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f40d3020 msgr2=0x7fc1f40c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f40d3020 0x7fc1f40c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 -- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f415d570 msgr2=0x7fc1f40b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f415d570 0x7fc1f40b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 -- 172.21.15.57:0/2172167103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4009420 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f415d570 0x7fc1f40b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:32.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f40d3020 0x7fc1f40c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:32.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f40ce8b0 0x7fc1f40b0930 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4019040 tx=0x7fc1e401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1dbfff640 1 -- 172.21.15.57:0/2172167103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4004220 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1dbfff640 1 -- 172.21.15.57:0/2172167103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e40b9070 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1dbfff640 1 -- 172.21.15.57:0/2172167103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4003620 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f40b6a10 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.599+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f40b8860 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1dbfff640 1 -- 172.21.15.57:0/2172167103 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc1e4003780 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1dbfff640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc1e0066620 0x7fc1e0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1dbfff640 1 -- 172.21.15.57:0/2172167103 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e40bb070 con 0x7fc1f40ce8b0 2023-11-24T08:07:32.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc1e0066620 0x7fc1e0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 Processor -- start 2023-11-24T08:07:32.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 -- start start 2023-11-24T08:07:32.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc1e0066620 0x7fc1e0068ae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1f408b5a0 tx=0x7fc1e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f21070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106ed6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106ed7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c106d41130 con 0x55c106ed7320 2023-11-24T08:07:32.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c106d2e9a0 con 0x55c106f215b0 2023-11-24T08:07:32.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c106d2bed0 con 0x55c106f20c90 2023-11-24T08:07:32.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106ed7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f21070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106ed6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106ed7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34254/0 (socket says 172.21.15.57:34254) 2023-11-24T08:07:32.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f21070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:48000/0 (socket says 172.21.15.57:48000) 2023-11-24T08:07:32.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f3fff640 1 -- 172.21.15.57:0/391301175 learned_addr learned my addr 172.21.15.57:0/391301175 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:32.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f3fff640 1 -- 172.21.15.57:0/391301175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 msgr2=0x55c106f21070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/391301175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f21070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f3fff640 1 -- 172.21.15.57:0/391301175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 msgr2=0x55c106ed6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.603+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/391301175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106ed6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1f3fff640 1 -- 172.21.15.57:0/391301175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c106a1f890 con 0x55c106ed7320 2023-11-24T08:07:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/391301175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106ed7700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec007430 tx=0x7fc1ec007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300c8431cb44810a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1d97fa640 1 -- 172.21.15.57:0/391301175 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec003db0 con 0x55c106ed7320 2023-11-24T08:07:32.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1d97fa640 1 -- 172.21.15.57:0/391301175 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00f050 con 0x55c106ed7320 2023-11-24T08:07:32.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1d97fa640 1 -- 172.21.15.57:0/391301175 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec004230 con 0x55c106ed7320 2023-11-24T08:07:32.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/391301175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 msgr2=0x55c106ed7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/391301175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106ed7700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec007430 tx=0x7fc1ec007830 comp rx=0 tx=0).stop 2023-11-24T08:07:32.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/391301175 shutdown_connections 2023-11-24T08:07:32.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/391301175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106ed7700 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/391301175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106ed6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/391301175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f21070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/391301175 >> 172.21.15.57:0/391301175 conn(0x55c106ed32d0 msgr2=0x55c106ed56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/391301175 shutdown_connections 2023-11-24T08:07:32.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/391301175 wait complete. 2023-11-24T08:07:32.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- start start 2023-11-24T08:07:32.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 Processor -- start 2023-11-24T08:07:32.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106edbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106edc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106eef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c106d277c0 con 0x55c106f215b0 2023-11-24T08:07:32.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c106cdfbf0 con 0x55c106ed7320 2023-11-24T08:07:32.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c106ce5a90 con 0x55c106f20c90 2023-11-24T08:07:32.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1fcf7a000 10 client.0 _ll_register_callbacks cb 0x55c106ec23c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:07:32.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106eef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106eef910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34262/0 (socket says 172.21.15.57:34262) 2023-11-24T08:07:32.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1407814600 learned_addr learned my addr 172.21.15.57:0/1407814600 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:32.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106edc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.607+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106edbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 msgr2=0x55c106edc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106edc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 msgr2=0x55c106edbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106edbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1407814600 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec009d20 con 0x55c106f215b0 2023-11-24T08:07:32.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106eef910 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec000f90 tx=0x7fc1ec004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1205786202ecc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:07:32.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 1 -- 172.21.15.57:0/1407814600 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec009610 con 0x55c106f215b0 2023-11-24T08:07:32.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 1 -- 172.21.15.57:0/1407814600 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1ec00f7f0 con 0x55c106f215b0 2023-11-24T08:07:32.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c106ce9470 con 0x55c106f215b0 2023-11-24T08:07:32.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 1 -- 172.21.15.57:0/1407814600 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1ec00f9b0 con 0x55c106f215b0 2023-11-24T08:07:32.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 10 client.6300 fetch_fsmap learned FSMap version 35 2023-11-24T08:07:32.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55c106ce8190 con 0x55c106f215b0 2023-11-24T08:07:32.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 1 -- 172.21.15.57:0/1407814600 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00f020 con 0x55c106f215b0 2023-11-24T08:07:32.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 1 -- 172.21.15.57:0/1407814600 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc1ec027020 con 0x55c106f215b0 2023-11-24T08:07:32.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 10 client.6300 fetch_fsmap finished waiting for FSMap version 35 2023-11-24T08:07:32.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 10 client.6300 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:07:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 20 client.6300 populate_metadata read hostname 'smithi057' 2023-11-24T08:07:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106ef0320 0x55c106f32f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 4 client.6300 mds_command: new command op to 55373 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:07:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 --> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c106cecb50 con 0x55c106ef0320 2023-11-24T08:07:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106ef0320 0x55c106f32f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106ef0320 0x55c106f32f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917ae3a77006e5b0 server_cookie=83653fafcadd898d in_seq=0 out_seq=0 2023-11-24T08:07:32.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 10 client.6300 ms_handle_connect on v2:172.21.15.132:6834/1683487539 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 1 -- 172.21.15.57:0/1407814600 <== mds.0 v2:172.21.15.132:6834/1683487539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c106cecb50 con 0x55c106ef0320 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 10 client.6300 handle_command_reply: tid=0 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 client.6300 shutdown 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 msgr2=0x55c106eef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106eef910 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec000f90 tx=0x7fc1ec004ac0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 shutdown_connections 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106ef0320 0x55c106f32f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106eef910 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106edc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1407814600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106edbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1d27fc640 0 client.6300 ms_handle_reset on v2:172.21.15.132:6834/1683487539 2023-11-24T08:07:32.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 >> 172.21.15.57:0/1407814600 conn(0x55c106ed32d0 msgr2=0x55c106ed56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.611+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 shutdown_connections 2023-11-24T08:07:32.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.615+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1407814600 wait complete. 2023-11-24T08:07:32.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.615+0000 7fc1fcf7a000 20 client.6300 trim_cache size 0 max 16384 2023-11-24T08:07:32.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.627+0000 7fc1fcf7a000 1 Processor -- start 2023-11-24T08:07:32.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.627+0000 7fc1fcf7a000 1 -- start start 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106ed8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106ed7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106ed7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1069e0940 con 0x55c106f215b0 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c106d24bc0 con 0x55c106ed7320 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c106d23730 con 0x55c106f20c90 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106ed7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106ed7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34270/0 (socket says 172.21.15.57:34270) 2023-11-24T08:07:32.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1435091396 learned_addr learned my addr 172.21.15.57:0/1435091396 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106ed8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 msgr2=0x55c106ed7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106ed7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 msgr2=0x55c106ed8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106ed8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 -- 172.21.15.57:0/1435091396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c106cce490 con 0x55c106f215b0 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106ed8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:32.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106ed7c40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009b40 tx=0x7fc1ec022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaccefd83dfc9f6b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1d9ffb640 1 -- 172.21.15.57:0/1435091396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0159d0 con 0x55c106f215b0 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1d9ffb640 1 -- 172.21.15.57:0/1435091396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00f050 con 0x55c106f215b0 2023-11-24T08:07:32.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1d9ffb640 1 -- 172.21.15.57:0/1435091396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00f480 con 0x55c106f215b0 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1435091396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 msgr2=0x55c106ed7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106ed7c40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009b40 tx=0x7fc1ec022000 comp rx=0 tx=0).stop 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1435091396 shutdown_connections 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106f215b0 0x55c106ed7c40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106ed7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/1435091396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106ed7320 0x55c106ed8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1435091396 >> 172.21.15.57:0/1435091396 conn(0x55c106ed32d0 msgr2=0x55c106ed56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1435091396 shutdown_connections 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/1435091396 wait complete. 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 -- start start 2023-11-24T08:07:32.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.631+0000 7fc1fcf7a000 1 Processor -- start 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106f352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f33fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106f344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c106cf0910 con 0x55c106ed7320 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c106ed2c70 con 0x55c106f215b0 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1069e0940 con 0x55c106f20c90 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 10 client.0 _ll_register_callbacks cb 0x55c106d75c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:07:32.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106f352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106f352e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34282/0 (socket says 172.21.15.57:34282) 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 -- 172.21.15.57:0/210124397 learned_addr learned my addr 172.21.15.57:0/210124397 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f3fff640 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106f344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f33fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 -- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 msgr2=0x55c106f33fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f33fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 -- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 msgr2=0x55c106f344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106f344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 -- 172.21.15.57:0/210124397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c106ce8190 con 0x55c106ed7320 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f37fe640 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106f352e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4097f20 tx=0x7fc1e40b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37be27cf6b576cf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-11-24T08:07:32.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1d27fc640 1 -- 172.21.15.57:0/210124397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40ef040 con 0x55c106ed7320 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1d27fc640 1 -- 172.21.15.57:0/210124397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e40ef1a0 con 0x55c106ed7320 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c106d26110 con 0x55c106ed7320 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1d27fc640 1 -- 172.21.15.57:0/210124397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1e40f79c0 con 0x55c106ed7320 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 10 client.6306 fetch_fsmap learned FSMap version 35 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55c106a1fcc0 con 0x55c106ed7320 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1d27fc640 1 -- 172.21.15.57:0/210124397 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4111020 con 0x55c106ed7320 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1d27fc640 1 -- 172.21.15.57:0/210124397 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc1e410dd20 con 0x55c106ed7320 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 10 client.6306 fetch_fsmap finished waiting for FSMap version 35 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 10 client.6306 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 20 client.6306 populate_metadata read hostname 'smithi057' 2023-11-24T08:07:32.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106f3ee30 0x55c106f3f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 4 client.6306 mds_command: new command op to 55373 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 --> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c106d559a0 con 0x55c106f3ee30 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106f3ee30 0x55c106f3f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1f2ffd640 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106f3ee30 0x55c106f3f210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1f583b3536b5b2 server_cookie=b3dcbeac7364290c in_seq=0 out_seq=0 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.635+0000 7fc1d27fc640 10 client.6306 ms_handle_connect on v2:172.21.15.132:6834/1683487539 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1d27fc640 1 -- 172.21.15.57:0/210124397 <== mds.0 v2:172.21.15.132:6834/1683487539 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c106d559a0 con 0x55c106f3ee30 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1d27fc640 10 client.6306 handle_command_reply: tid=0 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 client.6306 shutdown 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 msgr2=0x55c106f352e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106f352e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4097f20 tx=0x7fc1e40b7040 comp rx=0 tx=0).stop 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 shutdown_connections 2023-11-24T08:07:32.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:6834/1683487539,v1:172.21.15.132:6836/1683487539] conn(0x55c106f3ee30 0x55c106f3f210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c106f215b0 0x55c106f344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c106f20c90 0x55c106f33fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 --2- 172.21.15.57:0/210124397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c106ed7320 0x55c106f352e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1d27fc640 0 client.6306 ms_handle_reset on v2:172.21.15.132:6834/1683487539 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 >> 172.21.15.57:0/210124397 conn(0x55c106ed32d0 msgr2=0x55c106f2e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 shutdown_connections 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 1 -- 172.21.15.57:0/210124397 wait complete. 2023-11-24T08:07:32.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1fcf7a000 20 client.6306 trim_cache size 0 max 16384 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "445cea61-e72c-4da9-979a-02ade002d7d6", 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 55373, 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 5.9412751520000002, 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 35, 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 61, 2023-11-24T08:07:32.647 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 61, 2023-11-24T08:07:32.648 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 10.81674024 2023-11-24T08:07:32.648 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc1e0066620 msgr2=0x7fc1e0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc1e0066620 0x7fc1e0068ae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1f408b5a0 tx=0x7fc1e8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f40ce8b0 msgr2=0x7fc1f40b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f40ce8b0 0x7fc1f40b0930 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4019040 tx=0x7fc1e401ac70 comp rx=0 tx=0).stop 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 shutdown_connections 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc1e0066620 0x7fc1e0068ae0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f415d570 0x7fc1f40b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1f40d3020 0x7fc1f40c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 --2- 172.21.15.57:0/2172167103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1f40ce8b0 0x7fc1f40b0930 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 >> 172.21.15.57:0/2172167103 conn(0x7fc1f408ceb0 msgr2=0x7fc1f40cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 shutdown_connections 2023-11-24T08:07:32.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.639+0000 7fc1f9c17640 1 -- 172.21.15.57:0/2172167103 wait complete. 2023-11-24T08:07:32.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:32.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe402d2b640 1 Processor -- start 2023-11-24T08:07:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe402d2b640 1 -- start start 2023-11-24T08:07:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe402d2b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc06c660 0x7fe3fc165360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe402d2b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe3fc0b0a80 0x7fe3fc0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe402d2b640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0ae8a0 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe402d2b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0b1410 con 0x7fe3fc0b0a80 2023-11-24T08:07:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe402d2b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc1662e0 con 0x7fe3fc06c660 2023-11-24T08:07:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe401d29640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe3fc14b2b0 0x7fe3fc0b1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36520/0 (socket says 172.21.15.57:36520) 2023-11-24T08:07:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe401d29640 1 -- 172.21.15.57:0/74257119 learned_addr learned my addr 172.21.15.57:0/74257119 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe40252a640 1 --2- 172.21.15.57:0/74257119 >> v2:172.21.15.132:3300/0 conn(0x7fe3fc0b0a80 0x7fe3fc0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe401528640 1 --2- 172.21.15.57:0/74257119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc06c660 0x7fe3fc165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe400d27640 1 -- 172.21.15.57:0/74257119 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248202699 0 0) 0x7fe3fc0ae8a0 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe400d27640 1 -- 172.21.15.57:0/74257119 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e8003530 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe401528640 1 -- 172.21.15.57:0/74257119 >> v2:172.21.15.132:3300/0 conn(0x7fe3fc0b0a80 msgr2=0x7fe3fc0b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe401528640 1 --2- 172.21.15.57:0/74257119 >> v2:172.21.15.132:3300/0 conn(0x7fe3fc0b0a80 0x7fe3fc0b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe401528640 1 -- 172.21.15.57:0/74257119 >> v1:172.21.15.57:6789/0 conn(0x7fe3fc14b2b0 legacy=0x7fe3fc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.803+0000 7fe401528640 1 -- 172.21.15.57:0/74257119 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0b2500 con 0x7fe3fc06c660 2023-11-24T08:07:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe401528640 1 --2- 172.21.15.57:0/74257119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc06c660 0x7fe3fc165360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0097c0 tx=0x7fe3ec01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32df608482f66b48 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe400d27640 1 -- 172.21.15.57:0/74257119 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0ac620 con 0x7fe3fc06c660 2023-11-24T08:07:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe400d27640 1 -- 172.21.15.57:0/74257119 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0ac780 con 0x7fe3fc06c660 2023-11-24T08:07:32.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe400d27640 1 -- 172.21.15.57:0/74257119 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0acb10 con 0x7fe3fc06c660 2023-11-24T08:07:32.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 -- 172.21.15.57:0/74257119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc06c660 msgr2=0x7fe3fc165360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 --2- 172.21.15.57:0/74257119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc06c660 0x7fe3fc165360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0097c0 tx=0x7fe3ec01c3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 -- 172.21.15.57:0/74257119 shutdown_connections 2023-11-24T08:07:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 --2- 172.21.15.57:0/74257119 >> v2:172.21.15.132:3300/0 conn(0x7fe3fc0b0a80 0x7fe3fc0b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 --2- 172.21.15.57:0/74257119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc06c660 0x7fe3fc165360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 -- 172.21.15.57:0/74257119 >> 172.21.15.57:0/74257119 conn(0x7fe3fc0cb840 msgr2=0x7fe3fc0cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 -- 172.21.15.57:0/74257119 shutdown_connections 2023-11-24T08:07:32.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.807+0000 7fe402d2b640 1 -- 172.21.15.57:0/74257119 wait complete. 2023-11-24T08:07:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 Processor -- start 2023-11-24T08:07:32.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 -- start start 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3fc06c660 0x7fe3fc146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc0b0a80 0x7fe3fc1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3fc14b2b0 0x7fe3fc15fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc145840 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc146220 con 0x7fe3fc06c660 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc1648d0 con 0x7fe3fc0b0a80 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3fc14b2b0 0x7fe3fc15fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3fc14b2b0 0x7fe3fc15fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34286/0 (socket says 172.21.15.57:34286) 2023-11-24T08:07:32.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 -- 172.21.15.57:0/2132859485 learned_addr learned my addr 172.21.15.57:0/2132859485 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe401d29640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3fc06c660 0x7fe3fc146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe401528640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc0b0a80 0x7fe3fc1472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 -- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc0b0a80 msgr2=0x7fe3fc1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc0b0a80 0x7fe3fc1472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 -- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3fc06c660 msgr2=0x7fe3fc146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3fc06c660 0x7fe3fc146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 -- 172.21.15.57:0/2132859485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec009420 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe40252a640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3fc14b2b0 0x7fe3fc15fac0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400efc0 tx=0x7fe3f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe3f27fc640 1 -- 172.21.15.57:0/2132859485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4014480 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe3f27fc640 1 -- 172.21.15.57:0/2132859485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400f040 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe3f27fc640 1 -- 172.21.15.57:0/2132859485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4014820 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.811+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc164bb0 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.815+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc145d00 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.815+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc145ef0 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.815+0000 7fe3f27fc640 1 -- 172.21.15.57:0/2132859485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe3f4014980 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.815+0000 7fe3f27fc640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe3e0066620 0x7fe3e0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:32.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.815+0000 7fe3f27fc640 1 -- 172.21.15.57:0/2132859485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3f4084ec0 con 0x7fe3fc14b2b0 2023-11-24T08:07:32.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.815+0000 7fe401d29640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe3e0066620 0x7fe3e0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:32.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.815+0000 7fe401d29640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe3e0066620 0x7fe3e0068ae0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80011f0 tx=0x7fe3f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:32.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:32.819+0000 7fe3f27fc640 1 -- 172.21.15.57:0/2132859485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3f4051f10 con 0x7fe3fc14b2b0 2023-11-24T08:07:33.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.015+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3fc164da0 con 0x7fe3fc14b2b0 2023-11-24T08:07:33.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.015+0000 7fe3f27fc640 1 -- 172.21.15.57:0/2132859485 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3f4018070 con 0x7fe3fc14b2b0 2023-11-24T08:07:33.020 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe3e0066620 msgr2=0x7fe3e0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe3e0066620 0x7fe3e0068ae0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80011f0 tx=0x7fe3f8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3fc14b2b0 msgr2=0x7fe3fc15fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3fc14b2b0 0x7fe3fc15fac0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400efc0 tx=0x7fe3f400c490 comp rx=0 tx=0).stop 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 shutdown_connections 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe3e0066620 0x7fe3e0068ae0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3fc14b2b0 0x7fe3fc15fac0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe3fc0b0a80 0x7fe3fc1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 --2- 172.21.15.57:0/2132859485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3fc06c660 0x7fe3fc146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 >> 172.21.15.57:0/2132859485 conn(0x7fe3fc0cb840 msgr2=0x7fe3fc0b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 shutdown_connections 2023-11-24T08:07:33.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.019+0000 7fe402d2b640 1 -- 172.21.15.57:0/2132859485 wait complete. 2023-11-24T08:07:33.041 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:07:33.041 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:33.041 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-11-24T08:07:33.042 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:07:33.042 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:33.042 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:07:33.042 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:07:33.042 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:33.042 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:33.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.043 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42173sec preferred_lft 42173sec 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-11-24T08:07:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:79:99:46:a7 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.056 INFO:teuthology.orchestra.run.smithi057.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T08:07:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:33.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.057 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:33.117 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-11-24T08:07:33.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.119 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-11-24T08:07:33.175 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-11-24T08:07:33.175 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:33.175 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-24T08:07:33.175 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:07:33.175 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-24T08:07:33.175 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:33.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.176 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-11-24T08:07:33.176 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-11-24T08:07:33.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-24T08:07:33.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-24T08:07:33.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-24T08:07:33.176 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-11-24T08:07:33.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.274 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:07:33.283 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:07:33.283 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:07:33.283 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:33.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-11-24T08:07:33.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:33.350 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:33.402 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:07:33.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:33.403 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:33.453 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-24T08:07:33.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:07:33.548 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:07:33.548 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:07:33.562 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:07:33.563 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:07:33.563 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:07:33.563 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with new device syntax: 0@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:07:33.563 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:07:33.567 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:07:33.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:33.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:33.589 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:07:33.654 INFO:teuthology.orchestra.run.smithi057.stdout:client55475 2023-11-24T08:07:33.655 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:33.655 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:33.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:07:33.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.887+0000 7fca207d1640 1 Processor -- start 2023-11-24T08:07:33.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.887+0000 7fca207d1640 1 -- start start 2023-11-24T08:07:33.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca207d1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca18144030 0x7fca1806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca207d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca18070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca207d1640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1806d8b0 con 0x7fca1809cc20 2023-11-24T08:07:33.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca207d1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca18145020 con 0x7fca18144030 2023-11-24T08:07:33.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca207d1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1809d0a0 con 0x7fca180709c0 2023-11-24T08:07:33.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1e56d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca18144030 0x7fca1806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1dd6c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fca1809cc20 0x7fca1806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36532/0 (socket says 172.21.15.57:36532) 2023-11-24T08:07:33.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1dd6c640 1 -- 172.21.15.57:0/3804744375 learned_addr learned my addr 172.21.15.57:0/3804744375 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:33.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1ed6e640 1 --2- 172.21.15.57:0/3804744375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca18070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1e56d640 1 -- 172.21.15.57:0/3804744375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 msgr2=0x7fca18070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:33.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1e56d640 1 --2- 172.21.15.57:0/3804744375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca18070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1e56d640 1 -- 172.21.15.57:0/3804744375 >> v1:172.21.15.57:6789/0 conn(0x7fca1809cc20 legacy=0x7fca1806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1e56d640 1 -- 172.21.15.57:0/3804744375 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18071390 con 0x7fca18144030 2023-11-24T08:07:33.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1d56b640 1 -- 172.21.15.57:0/3804744375 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681707321 0 0) 0x7fca1806d8b0 con 0x7fca1809cc20 2023-11-24T08:07:33.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.891+0000 7fca1ed6e640 1 --2- 172.21.15.57:0/3804744375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca18070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:33.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca1e56d640 1 --2- 172.21.15.57:0/3804744375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca18144030 0x7fca1806c650 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fca140097c0 tx=0x7fca1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1280fafbd9b7d57a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca1d56b640 1 -- 172.21.15.57:0/3804744375 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140ab650 con 0x7fca18144030 2023-11-24T08:07:33.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca1d56b640 1 -- 172.21.15.57:0/3804744375 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140ab7b0 con 0x7fca18144030 2023-11-24T08:07:33.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca1d56b640 1 -- 172.21.15.57:0/3804744375 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140abb40 con 0x7fca18144030 2023-11-24T08:07:33.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 -- 172.21.15.57:0/3804744375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca18144030 msgr2=0x7fca1806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 --2- 172.21.15.57:0/3804744375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca18144030 0x7fca1806c650 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fca140097c0 tx=0x7fca1401c450 comp rx=0 tx=0).stop 2023-11-24T08:07:33.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 -- 172.21.15.57:0/3804744375 shutdown_connections 2023-11-24T08:07:33.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 --2- 172.21.15.57:0/3804744375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca18070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 --2- 172.21.15.57:0/3804744375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca18144030 0x7fca1806c650 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 -- 172.21.15.57:0/3804744375 >> 172.21.15.57:0/3804744375 conn(0x7fca180b0bf0 msgr2=0x7fca180b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:33.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 -- 172.21.15.57:0/3804744375 shutdown_connections 2023-11-24T08:07:33.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 -- 172.21.15.57:0/3804744375 wait complete. 2023-11-24T08:07:33.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 Processor -- start 2023-11-24T08:07:33.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.895+0000 7fca207d1640 1 -- start start 2023-11-24T08:07:33.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca1813aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca1809cc20 0x7fca1813e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca18144030 0x7fca1813eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca181f6c20 con 0x7fca1809cc20 2023-11-24T08:07:33.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca181f6e70 con 0x7fca18144030 2023-11-24T08:07:33.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca181f7150 con 0x7fca180709c0 2023-11-24T08:07:33.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca1809cc20 0x7fca1813e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca1809cc20 0x7fca1813e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34302/0 (socket says 172.21.15.57:34302) 2023-11-24T08:07:33.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 -- 172.21.15.57:0/2832947620 learned_addr learned my addr 172.21.15.57:0/2832947620 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:33.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1e56d640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca1813aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1ed6e640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca18144030 0x7fca1813eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 -- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 msgr2=0x7fca1813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca1813aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 -- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca18144030 msgr2=0x7fca1813eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:33.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca18144030 0x7fca1813eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:33.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 -- 172.21.15.57:0/2832947620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14009420 con 0x7fca1809cc20 2023-11-24T08:07:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1ed6e640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca18144030 0x7fca1813eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca1dd6c640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca1809cc20 0x7fca1813e650 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fca080011f0 tx=0x7fca0800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca0effd640 1 -- 172.21.15.57:0/2832947620 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080074e0 con 0x7fca1809cc20 2023-11-24T08:07:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca0effd640 1 -- 172.21.15.57:0/2832947620 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08007640 con 0x7fca1809cc20 2023-11-24T08:07:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca0effd640 1 -- 172.21.15.57:0/2832947620 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08004a10 con 0x7fca1809cc20 2023-11-24T08:07:33.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca181f7430 con 0x7fca1809cc20 2023-11-24T08:07:33.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca181f79f0 con 0x7fca1809cc20 2023-11-24T08:07:33.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca18067520 con 0x7fca1809cc20 2023-11-24T08:07:33.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.899+0000 7fca0effd640 1 -- 172.21.15.57:0/2832947620 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fca08004b70 con 0x7fca1809cc20 2023-11-24T08:07:33.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.903+0000 7fca0effd640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc9fc066620 0x7fc9fc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:33.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.903+0000 7fca0effd640 1 -- 172.21.15.57:0/2832947620 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca08083400 con 0x7fca1809cc20 2023-11-24T08:07:33.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.903+0000 7fca1e56d640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc9fc066620 0x7fc9fc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:33.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.903+0000 7fca1e56d640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc9fc066620 0x7fc9fc068ae0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fca140af000 tx=0x7fca140a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:33.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:33.907+0000 7fca0effd640 1 -- 172.21.15.57:0/2832947620 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca080506a0 con 0x7fca1809cc20 2023-11-24T08:07:34.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.095+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca18070e50 con 0x7fca1809cc20 2023-11-24T08:07:34.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca0effd640 1 -- 172.21.15.57:0/2832947620 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca08018070 con 0x7fca1809cc20 2023-11-24T08:07:34.102 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:07:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc9fc066620 msgr2=0x7fc9fc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc9fc066620 0x7fc9fc068ae0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fca140af000 tx=0x7fca140a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca1809cc20 msgr2=0x7fca1813e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca1809cc20 0x7fca1813e650 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fca080011f0 tx=0x7fca0800c9b0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 shutdown_connections 2023-11-24T08:07:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc9fc066620 0x7fc9fc068ae0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca18144030 0x7fca1813eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca1809cc20 0x7fca1813e650 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 --2- 172.21.15.57:0/2832947620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca180709c0 0x7fca1813aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 >> 172.21.15.57:0/2832947620 conn(0x7fca180b0bf0 msgr2=0x7fca180b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 shutdown_connections 2023-11-24T08:07:34.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.099+0000 7fca207d1640 1 -- 172.21.15.57:0/2832947620 wait complete. 2023-11-24T08:07:34.123 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T08:07:34.123 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:07:34.123 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-11-24T08:07:34.123 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:07:34.123 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:34.123 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T08:07:34.123 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T08:07:34.124 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:07:34.124 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:34.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.124 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:07:34.135 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-24T08:07:34.136 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42163sec preferred_lft 42163sec 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 02:42:35:0c:2c:77 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.137 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-24T08:07:34.138 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:07:34.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.139 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:07:34.203 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-11-24T08:07:34.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.205 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-11-24T08:07:34.258 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-11-24T08:07:34.258 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:07:34.258 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-24T08:07:34.258 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:07:34.258 INFO:teuthology.orchestra.run.smithi132.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-24T08:07:34.258 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:07:34.259 INFO:teuthology.orchestra.run.smithi132.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:07:34.259 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:07:34.259 INFO:teuthology.orchestra.run.smithi132.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-24T08:07:34.259 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:07:34.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.259 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-11-24T08:07:34.259 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-11-24T08:07:34.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:07:34.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:07:34.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:07:34.260 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-11-24T08:07:34.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.354 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:07:34.364 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:07:34.365 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:07:34.365 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:34.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.365 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-11-24T08:07:34.428 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:34.429 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:34.479 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:07:34.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:07:34.480 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:34.531 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-11-24T08:07:34.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:07:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:07:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:07:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-24T08:07:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-24T08:07:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-11-24T08:07:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with new device syntax: 1@445cea61-e72c-4da9-979a-02ade002d7d6.cephfs=/ 2023-11-24T08:07:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.57:3300/172.21.15.132:3300/172.21.15.132:3301" will pass to kernel 2023-11-24T08:07:34.647 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T08:07:34.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.647 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:34.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:34.668 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T08:07:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:client6324 2023-11-24T08:07:34.727 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:34.727 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:34.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:07:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.959+0000 7fb3c9db8640 1 Processor -- start 2023-11-24T08:07:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.959+0000 7fb3c9db8640 1 -- start start 2023-11-24T08:07:34.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c9db8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3c415a320 0x7fb3c40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c9db8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3c40b36c0 0x7fb3c4070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c9db8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c4071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c9db8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40b2430 con 0x7fb3c415a320 2023-11-24T08:07:34.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c9db8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c415a700 con 0x7fb3c40b36c0 2023-11-24T08:07:34.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c9db8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40715a0 con 0x7fb3c4070bd0 2023-11-24T08:07:34.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3c415a320 0x7fb3c40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3c415a320 0x7fb3c40b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34312/0 (socket says 172.21.15.57:34312) 2023-11-24T08:07:34.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 -- 172.21.15.57:0/3317896887 learned_addr learned my addr 172.21.15.57:0/3317896887 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:34.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c3fff640 1 --2- 172.21.15.57:0/3317896887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c4071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c2ffd640 1 --2- 172.21.15.57:0/3317896887 >> v2:172.21.15.132:3300/0 conn(0x7fb3c40b36c0 0x7fb3c4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 -- 172.21.15.57:0/3317896887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 msgr2=0x7fb3c4071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 --2- 172.21.15.57:0/3317896887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c4071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 -- 172.21.15.57:0/3317896887 >> v2:172.21.15.132:3300/0 conn(0x7fb3c40b36c0 msgr2=0x7fb3c4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:34.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 --2- 172.21.15.57:0/3317896887 >> v2:172.21.15.132:3300/0 conn(0x7fb3c40b36c0 0x7fb3c4070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.963+0000 7fb3c37fe640 1 -- 172.21.15.57:0/3317896887 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40b2620 con 0x7fb3c415a320 2023-11-24T08:07:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c37fe640 1 --2- 172.21.15.57:0/3317896887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c415a320 0x7fb3c40b1ef0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb3c406c180 tx=0x7fb3b401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c38ceee3a503b0b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c27fc640 1 -- 172.21.15.57:0/3317896887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40a7b30 con 0x7fb3c415a320 2023-11-24T08:07:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c27fc640 1 -- 172.21.15.57:0/3317896887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40a7c90 con 0x7fb3c415a320 2023-11-24T08:07:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c27fc640 1 -- 172.21.15.57:0/3317896887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40af440 con 0x7fb3c415a320 2023-11-24T08:07:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 -- 172.21.15.57:0/3317896887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c415a320 msgr2=0x7fb3c40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/3317896887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c415a320 0x7fb3c40b1ef0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb3c406c180 tx=0x7fb3b401eba0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 -- 172.21.15.57:0/3317896887 shutdown_connections 2023-11-24T08:07:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/3317896887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c4071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/3317896887 >> v2:172.21.15.132:3300/0 conn(0x7fb3c40b36c0 0x7fb3c4070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/3317896887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c415a320 0x7fb3c40b1ef0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 -- 172.21.15.57:0/3317896887 >> 172.21.15.57:0/3317896887 conn(0x7fb3c40b0bf0 msgr2=0x7fb3c40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 -- 172.21.15.57:0/3317896887 shutdown_connections 2023-11-24T08:07:34.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 -- 172.21.15.57:0/3317896887 wait complete. 2023-11-24T08:07:34.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 Processor -- start 2023-11-24T08:07:34.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.967+0000 7fb3c9db8640 1 -- start start 2023-11-24T08:07:34.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c41648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c40b36c0 0x7fb3c4157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c415a320 0x7fb3c415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4164420 con 0x7fb3c40b36c0 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c415edb0 con 0x7fb3c415a320 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4163b70 con 0x7fb3c4070bd0 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c40b36c0 0x7fb3c4157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c40b36c0 0x7fb3c4157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34314/0 (socket says 172.21.15.57:34314) 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 -- 172.21.15.57:0/572712800 learned_addr learned my addr 172.21.15.57:0/572712800 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c37fe640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c41648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c3fff640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c415a320 0x7fb3c415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 -- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 msgr2=0x7fb3c41648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c41648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 -- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c415a320 msgr2=0x7fb3c415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c415a320 0x7fb3c415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 -- 172.21.15.57:0/572712800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b400b770 con 0x7fb3c40b36c0 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c2ffd640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c40b36c0 0x7fb3c4157de0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800e930 tx=0x7fb3b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3abfff640 1 -- 172.21.15.57:0/572712800 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8009690 con 0x7fb3c40b36c0 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3abfff640 1 -- 172.21.15.57:0/572712800 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b800ca00 con 0x7fb3c40b36c0 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3abfff640 1 -- 172.21.15.57:0/572712800 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800cd70 con 0x7fb3c40b36c0 2023-11-24T08:07:34.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c4163e10 con 0x7fb3c40b36c0 2023-11-24T08:07:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c41640b0 con 0x7fb3c40b36c0 2023-11-24T08:07:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c41645d0 con 0x7fb3c40b36c0 2023-11-24T08:07:34.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.971+0000 7fb3abfff640 1 -- 172.21.15.57:0/572712800 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fb3b8013470 con 0x7fb3c40b36c0 2023-11-24T08:07:34.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.975+0000 7fb3abfff640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3b0066620 0x7fb3b0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:34.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.975+0000 7fb3abfff640 1 -- 172.21.15.57:0/572712800 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3b8084710 con 0x7fb3c40b36c0 2023-11-24T08:07:34.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.975+0000 7fb3c37fe640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3b0066620 0x7fb3b0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:34.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.975+0000 7fb3c37fe640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3b0066620 0x7fb3b0068ae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40b1000 tx=0x7fb3b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:34.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:34.979+0000 7fb3abfff640 1 -- 172.21.15.57:0/572712800 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3c41645d0 con 0x7fb3c40b36c0 2023-11-24T08:07:35.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.171+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb3c4067520 con 0x7fb3c40b36c0 2023-11-24T08:07:35.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.779+0000 7fb3abfff640 1 -- 172.21.15.57:0/572712800 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 136+0+0 (secure 0 0 0) 0x7fb3b8051a90 con 0x7fb3c40b36c0 2023-11-24T08:07:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3b0066620 msgr2=0x7fb3b0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3b0066620 0x7fb3b0068ae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40b1000 tx=0x7fb3b4008040 comp rx=0 tx=0).stop 2023-11-24T08:07:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c40b36c0 msgr2=0x7fb3c4157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c40b36c0 0x7fb3c4157de0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800e930 tx=0x7fb3b800edf0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 shutdown_connections 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fb3b0066620 0x7fb3b0068ae0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c415a320 0x7fb3c415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3c40b36c0 0x7fb3c4157de0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 --2- 172.21.15.57:0/572712800 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb3c4070bd0 0x7fb3c41648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 >> 172.21.15.57:0/572712800 conn(0x7fb3c40b0bf0 msgr2=0x7fb3c415c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 shutdown_connections 2023-11-24T08:07:35.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.783+0000 7fb3c9db8640 1 -- 172.21.15.57:0/572712800 wait complete. 2023-11-24T08:07:35.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:07:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fab625640 1 Processor -- start 2023-11-24T08:07:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fab625640 1 -- start start 2023-11-24T08:07:35.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fab625640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fab625640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406b9b0 0x7f6fa415db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fab625640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa40616b0 con 0x7f6fa406f580 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fab625640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa40b4750 con 0x7f6fa415d7b0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fab625640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40b28a0 con 0x7f6fa406b9b0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa93c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa8bc0640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6fa406f580 0x7f6fa406b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51132/0 (socket says 172.21.15.57:51132) 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa93c1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50224/0 (socket says 172.21.15.57:50224) 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa8bc0640 1 -- 172.21.15.57:0/3130320411 learned_addr learned my addr 172.21.15.57:0/3130320411 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa9bc2640 1 --2- 172.21.15.57:0/3130320411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406b9b0 0x7f6fa415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa93c1640 1 -- 172.21.15.57:0/3130320411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406b9b0 msgr2=0x7f6fa415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:35.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa93c1640 1 --2- 172.21.15.57:0/3130320411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406b9b0 0x7f6fa415db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa93c1640 1 -- 172.21.15.57:0/3130320411 >> v1:172.21.15.57:6789/0 conn(0x7f6fa406f580 legacy=0x7f6fa406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa93c1640 1 -- 172.21.15.57:0/3130320411 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa40b2b80 con 0x7f6fa415d7b0 2023-11-24T08:07:35.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.951+0000 7f6fa9bc2640 1 --2- 172.21.15.57:0/3130320411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406b9b0 0x7f6fa415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:35.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fa93c1640 1 --2- 172.21.15.57:0/3130320411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097c0 tx=0x7f6fa001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbf6861bfbfcb8d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6f9bfff640 1 -- 172.21.15.57:0/3130320411 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00ab600 con 0x7f6fa415d7b0 2023-11-24T08:07:35.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6f9bfff640 1 -- 172.21.15.57:0/3130320411 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa00a7050 con 0x7f6fa415d7b0 2023-11-24T08:07:35.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6f9bfff640 1 -- 172.21.15.57:0/3130320411 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00ab980 con 0x7f6fa415d7b0 2023-11-24T08:07:35.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 -- 172.21.15.57:0/3130320411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 msgr2=0x7f6fa406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 --2- 172.21.15.57:0/3130320411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097c0 tx=0x7f6fa001c3f0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 -- 172.21.15.57:0/3130320411 shutdown_connections 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 --2- 172.21.15.57:0/3130320411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406b9b0 0x7f6fa415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 --2- 172.21.15.57:0/3130320411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 -- 172.21.15.57:0/3130320411 >> 172.21.15.57:0/3130320411 conn(0x7f6fa40cc390 msgr2=0x7f6fa40cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 -- 172.21.15.57:0/3130320411 shutdown_connections 2023-11-24T08:07:35.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.955+0000 7f6fab625640 1 -- 172.21.15.57:0/3130320411 wait complete. 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 Processor -- start 2023-11-24T08:07:35.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 -- start start 2023-11-24T08:07:35.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fa406b9b0 0x7f6fa4149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406f580 0x7f6fa4152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa414d050 con 0x7f6fa415d7b0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4149c00 con 0x7f6fa406b9b0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4149ee0 con 0x7f6fa406f580 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50228/0 (socket says 172.21.15.57:50228) 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 -- 172.21.15.57:0/3613143941 learned_addr learned my addr 172.21.15.57:0/3613143941 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa8bc0640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406f580 0x7f6fa4152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa93c1640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fa406b9b0 0x7f6fa4149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 -- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406f580 msgr2=0x7f6fa4152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406f580 0x7f6fa4152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 -- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fa406b9b0 msgr2=0x7f6fa4149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fa406b9b0 0x7f6fa4149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 -- 172.21.15.57:0/3613143941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009420 con 0x7f6fa415d7b0 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fa9bc2640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00cef0 tx=0x7f6f9c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6f99ffb640 1 -- 172.21.15.57:0/3613143941 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00d840 con 0x7f6fa415d7b0 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6f99ffb640 1 -- 172.21.15.57:0/3613143941 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00d9c0 con 0x7f6fa415d7b0 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa414a1c0 con 0x7f6fa415d7b0 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6f99ffb640 1 -- 172.21.15.57:0/3613143941 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00dd70 con 0x7f6fa415d7b0 2023-11-24T08:07:35.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.959+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa414a780 con 0x7f6fa415d7b0 2023-11-24T08:07:35.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.963+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa4072850 con 0x7f6fa415d7b0 2023-11-24T08:07:35.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.963+0000 7f6f99ffb640 1 -- 172.21.15.57:0/3613143941 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f6f9c01e3b0 con 0x7f6fa415d7b0 2023-11-24T08:07:35.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.963+0000 7f6f99ffb640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f88066620 0x7f6f88068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:35.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.963+0000 7f6f99ffb640 1 -- 172.21.15.57:0/3613143941 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f9c084b90 con 0x7f6fa415d7b0 2023-11-24T08:07:35.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.963+0000 7f6fa93c1640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f88066620 0x7f6f88068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:35.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.963+0000 7f6fa93c1640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f88066620 0x7f6f88068ae0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ad000 tx=0x7f6fa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:35.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:35.967+0000 7f6f99ffb640 1 -- 172.21.15.57:0/3613143941 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f9c051f10 con 0x7f6fa415d7b0 2023-11-24T08:07:36.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.143+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa415e8e0 con 0x7f6f88066620 2023-11-24T08:07:36.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6f99ffb640 1 -- 172.21.15.57:0/3613143941 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6fa00ab760 con 0x7f6f88066620 2023-11-24T08:07:36.149 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-11-24T08:07:36.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-11-24T08:07:36.150 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "cephfs" 2023-11-24T08:07:36.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-11-24T08:07:36.150 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-11-24T08:07:36.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f88066620 msgr2=0x7f6f88068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f88066620 0x7f6f88068ae0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00ad000 tx=0x7f6fa0008040 comp rx=0 tx=0).stop 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 msgr2=0x7f6fa406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00cef0 tx=0x7f6f9c00a710 comp rx=0 tx=0).stop 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 shutdown_connections 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6f88066620 0x7f6f88068ae0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa415d7b0 0x7f6fa406cf00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6fa406f580 0x7f6fa4152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 --2- 172.21.15.57:0/3613143941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fa406b9b0 0x7f6fa4149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 >> 172.21.15.57:0/3613143941 conn(0x7f6fa40cc390 msgr2=0x7f6fa40cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 shutdown_connections 2023-11-24T08:07:36.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.147+0000 7f6fab625640 1 -- 172.21.15.57:0/3613143941 wait complete. 2023-11-24T08:07:36.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:07:36.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.311+0000 7f228c72a640 1 Processor -- start 2023-11-24T08:07:36.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.311+0000 7f228c72a640 1 -- start start 2023-11-24T08:07:36.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228c72a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f22840b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228c72a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2284070f00 con 0x7f228415a290 2023-11-24T08:07:36.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228c72a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2284071170 con 0x7f228415ec60 2023-11-24T08:07:36.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228c72a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840cb690 con 0x7f22840b1f80 2023-11-24T08:07:36.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228a4c6640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f228415a290 0x7f22840707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51148/0 (socket says 172.21.15.57:51148) 2023-11-24T08:07:36.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228a4c6640 1 -- 172.21.15.57:0/2508756243 learned_addr learned my addr 172.21.15.57:0/2508756243 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:36.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228acc7640 1 --2- 172.21.15.57:0/2508756243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f22840b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424009951 0 0) 0x7f2284070f00 con 0x7f228415a290 2023-11-24T08:07:36.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2270003530 con 0x7f228415a290 2023-11-24T08:07:36.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076656800 0 0) 0x7f2284071170 con 0x7f228415ec60 2023-11-24T08:07:36.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2284070f00 con 0x7f228415ec60 2023-11-24T08:07:36.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1740230722 0 0) 0x7f2270003530 con 0x7f228415a290 2023-11-24T08:07:36.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228acc7640 1 -- 172.21.15.57:0/2508756243 >> v1:172.21.15.132:6789/0 conn(0x7f228415ec60 legacy=0x7f22840cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228acc7640 1 -- 172.21.15.57:0/2508756243 >> v1:172.21.15.57:6789/0 conn(0x7f228415a290 legacy=0x7f22840707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.315+0000 7f228acc7640 1 -- 172.21.15.57:0/2508756243 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840cb970 con 0x7f22840b1f80 2023-11-24T08:07:36.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228acc7640 1 --2- 172.21.15.57:0/2508756243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f22840b23f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f227c009dc0 tx=0x7f227c01c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51733c0e030be031 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22800016a0 con 0x7f22840b1f80 2023-11-24T08:07:36.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c0a5550 con 0x7f22840b1f80 2023-11-24T08:07:36.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f22894c4640 1 -- 172.21.15.57:0/2508756243 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a58e0 con 0x7f22840b1f80 2023-11-24T08:07:36.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228c72a640 1 -- 172.21.15.57:0/2508756243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 msgr2=0x7f22840b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228c72a640 1 --2- 172.21.15.57:0/2508756243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f22840b23f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f227c009dc0 tx=0x7f227c01c800 comp rx=0 tx=0).stop 2023-11-24T08:07:36.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228c72a640 1 -- 172.21.15.57:0/2508756243 shutdown_connections 2023-11-24T08:07:36.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228c72a640 1 --2- 172.21.15.57:0/2508756243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f22840b23f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228c72a640 1 -- 172.21.15.57:0/2508756243 >> 172.21.15.57:0/2508756243 conn(0x7f22840b0c80 msgr2=0x7f22840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228c72a640 1 -- 172.21.15.57:0/2508756243 shutdown_connections 2023-11-24T08:07:36.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.319+0000 7f228c72a640 1 -- 172.21.15.57:0/2508756243 wait complete. 2023-11-24T08:07:36.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 Processor -- start 2023-11-24T08:07:36.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 -- start start 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f228414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f228415a290 0x7f22840abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f228415ec60 0x7f22840ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228414aab0 con 0x7f228415a290 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284149ea0 con 0x7f228415ec60 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228414a180 con 0x7f22840b1f80 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f2289cc5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f228415a290 0x7f22840abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f228414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f228414b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:43298/0 (socket says 172.21.15.57:43298) 2023-11-24T08:07:36.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 -- 172.21.15.57:0/3145851758 learned_addr learned my addr 172.21.15.57:0/3145851758 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:36.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228acc7640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f228415ec60 0x7f22840ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 -- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f228415ec60 msgr2=0x7f22840ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f228415ec60 0x7f22840ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 -- 172.21.15.57:0/3145851758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f228415a290 msgr2=0x7f22840abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f228415a290 0x7f22840abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 -- 172.21.15.57:0/3145851758 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c009a70 con 0x7f22840b1f80 2023-11-24T08:07:36.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f2289cc5640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f228415a290 0x7f22840abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:36.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228a4c6640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f228414b620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f228000c730 tx=0x7f228000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f227affd640 1 -- 172.21.15.57:0/3145851758 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22800072d0 con 0x7f22840b1f80 2023-11-24T08:07:36.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f227affd640 1 -- 172.21.15.57:0/3145851758 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280007450 con 0x7f22840b1f80 2023-11-24T08:07:36.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f227affd640 1 -- 172.21.15.57:0/3145851758 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22800047f0 con 0x7f22840b1f80 2023-11-24T08:07:36.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228414a460 con 0x7f22840b1f80 2023-11-24T08:07:36.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228415c070 con 0x7f22840b1f80 2023-11-24T08:07:36.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.323+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228414a910 con 0x7f22840b1f80 2023-11-24T08:07:36.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.327+0000 7f227affd640 1 -- 172.21.15.57:0/3145851758 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f2280004b60 con 0x7f22840b1f80 2023-11-24T08:07:36.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.327+0000 7f227affd640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2268066620 0x7f2268068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.327+0000 7f227affd640 1 -- 172.21.15.57:0/3145851758 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2280083890 con 0x7f22840b1f80 2023-11-24T08:07:36.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.327+0000 7f2289cc5640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2268066620 0x7f2268068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.327+0000 7f2289cc5640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2268066620 0x7f2268068ae0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22840b0870 tx=0x7f2274009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.331+0000 7f227affd640 1 -- 172.21.15.57:0/3145851758 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2280050c60 con 0x7f22840b1f80 2023-11-24T08:07:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.487+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f228414a910 con 0x7f22840b1f80 2023-11-24T08:07:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.487+0000 7f227affd640 1 -- 172.21.15.57:0/3145851758 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f228414a910 con 0x7f22840b1f80 2023-11-24T08:07:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2268066620 msgr2=0x7f2268068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2268066620 0x7f2268068ae0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22840b0870 tx=0x7f2274009040 comp rx=0 tx=0).stop 2023-11-24T08:07:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 msgr2=0x7f228414b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f228414b620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f228000c730 tx=0x7f228000cbf0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 shutdown_connections 2023-11-24T08:07:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2268066620 0x7f2268068ae0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f228415ec60 0x7f22840ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f228415a290 0x7f22840abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 --2- 172.21.15.57:0/3145851758 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22840b1f80 0x7f228414b620 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 >> 172.21.15.57:0/3145851758 conn(0x7f22840b0c80 msgr2=0x7f22840b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 shutdown_connections 2023-11-24T08:07:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.491+0000 7f228c72a640 1 -- 172.21.15.57:0/3145851758 wait complete. 2023-11-24T08:07:36.513 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:07:36.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:36.576 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:07:36.641 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:07:36.642 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:36.642 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:36.652 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:36.652 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:36.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.883+0000 7f35625c1640 1 Processor -- start 2023-11-24T08:07:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.883+0000 7f35625c1640 1 -- start start 2023-11-24T08:07:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f35625c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f355c15a320 0x7f355c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f35625c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c0b36c0 0x7f355c070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f35625c1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c15a700 con 0x7f355c070bd0 2023-11-24T08:07:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f35625c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c0b2430 con 0x7f355c15a320 2023-11-24T08:07:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f35625c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0b2620 con 0x7f355c0b36c0 2023-11-24T08:07:36.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c0b36c0 0x7f355c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f355c15a320 0x7f355c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c0b36c0 0x7f355c070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:43310/0 (socket says 172.21.15.57:43310) 2023-11-24T08:07:36.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355b7fe640 1 -- 172.21.15.57:0/1048034097 learned_addr learned my addr 172.21.15.57:0/1048034097 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:36.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355bfff640 1 -- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c0b36c0 msgr2=0x7f355c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:36.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355bfff640 1 --2- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c0b36c0 0x7f355c070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355bfff640 1 -- 172.21.15.57:0/1048034097 >> v1:172.21.15.132:6789/0 conn(0x7f355c070bd0 legacy=0x7f355c0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355bfff640 1 -- 172.21.15.57:0/1048034097 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0b2900 con 0x7f355c15a320 2023-11-24T08:07:36.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.887+0000 7f355b7fe640 1 --2- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c0b36c0 0x7f355c070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:36.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f355bfff640 1 --2- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c15a320 0x7f355c0b1ef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f354c0097c0 tx=0x7f354c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9dc9aa59d24e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f355affd640 1 -- 172.21.15.57:0/1048034097 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0ab680 con 0x7f355c15a320 2023-11-24T08:07:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f355affd640 1 -- 172.21.15.57:0/1048034097 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0ab7e0 con 0x7f355c15a320 2023-11-24T08:07:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f355affd640 1 -- 172.21.15.57:0/1048034097 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0abb70 con 0x7f355c15a320 2023-11-24T08:07:36.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 -- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c15a320 msgr2=0x7f355c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 --2- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c15a320 0x7f355c0b1ef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f354c0097c0 tx=0x7f354c01c480 comp rx=0 tx=0).stop 2023-11-24T08:07:36.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 -- 172.21.15.57:0/1048034097 shutdown_connections 2023-11-24T08:07:36.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 --2- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c0b36c0 0x7f355c070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 --2- 172.21.15.57:0/1048034097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c15a320 0x7f355c0b1ef0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 -- 172.21.15.57:0/1048034097 >> 172.21.15.57:0/1048034097 conn(0x7f355c0b0bf0 msgr2=0x7f355c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:36.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 -- 172.21.15.57:0/1048034097 shutdown_connections 2023-11-24T08:07:36.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.891+0000 7f35625c1640 1 -- 172.21.15.57:0/1048034097 wait complete. 2023-11-24T08:07:36.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 Processor -- start 2023-11-24T08:07:36.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 -- start start 2023-11-24T08:07:36.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c070bd0 0x7f355c152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c0b36c0 0x7f355c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c15a320 0x7f355c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c15afd0 con 0x7f355c15a320 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0cefb0 con 0x7f355c0b36c0 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0cf290 con 0x7f355c070bd0 2023-11-24T08:07:36.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c15a320 0x7f355c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c15a320 0x7f355c1593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50234/0 (socket says 172.21.15.57:50234) 2023-11-24T08:07:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 -- 172.21.15.57:0/2102413315 learned_addr learned my addr 172.21.15.57:0/2102413315 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f355bfff640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c070bd0 0x7f355c152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f355b7fe640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c0b36c0 0x7f355c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 -- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c070bd0 msgr2=0x7f355c152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c070bd0 0x7f355c152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 -- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c0b36c0 msgr2=0x7f355c158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c0b36c0 0x7f355c158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:36.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 -- 172.21.15.57:0/2102413315 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500094d0 con 0x7f355c15a320 2023-11-24T08:07:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3560b5e640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c15a320 0x7f355c1593c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f355400c770 tx=0x7f355400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3558ff9640 1 -- 172.21.15.57:0/2102413315 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554003b80 con 0x7f355c15a320 2023-11-24T08:07:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3558ff9640 1 -- 172.21.15.57:0/2102413315 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554003ce0 con 0x7f355c15a320 2023-11-24T08:07:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c009420 con 0x7f355c15a320 2023-11-24T08:07:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f3558ff9640 1 -- 172.21.15.57:0/2102413315 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400aa90 con 0x7f355c15a320 2023-11-24T08:07:36.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.895+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c15b220 con 0x7f355c15a320 2023-11-24T08:07:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.899+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c15b440 con 0x7f355c15a320 2023-11-24T08:07:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.899+0000 7f3558ff9640 1 -- 172.21.15.57:0/2102413315 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f355400abf0 con 0x7f355c15a320 2023-11-24T08:07:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.899+0000 7f3558ff9640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3548066620 0x7f3548068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:36.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.899+0000 7f3558ff9640 1 -- 172.21.15.57:0/2102413315 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3554083ea0 con 0x7f355c15a320 2023-11-24T08:07:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.899+0000 7f355bfff640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3548066620 0x7f3548068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.899+0000 7f355bfff640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3548066620 0x7f3548068ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f354c0af000 tx=0x7f354c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:36.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:36.903+0000 7f3558ff9640 1 -- 172.21.15.57:0/2102413315 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3554051140 con 0x7f355c15a320 2023-11-24T08:07:37.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.059+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f355c067520 con 0x7f355c15a320 2023-11-24T08:07:37.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.059+0000 7f3558ff9640 1 -- 172.21.15.57:0/2102413315 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f3554054760 con 0x7f355c15a320 2023-11-24T08:07:37.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:37.066 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":61,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:27.714748+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:37.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3548066620 msgr2=0x7f3548068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3548066620 0x7f3548068ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f354c0af000 tx=0x7f354c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c15a320 msgr2=0x7f355c1593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c15a320 0x7f355c1593c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f355400c770 tx=0x7f355400cc30 comp rx=0 tx=0).stop 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 shutdown_connections 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3548066620 0x7f3548068ae0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c15a320 0x7f355c1593c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c0b36c0 0x7f355c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 --2- 172.21.15.57:0/2102413315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f355c070bd0 0x7f355c152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 >> 172.21.15.57:0/2102413315 conn(0x7f355c0b0bf0 msgr2=0x7f355c09bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 shutdown_connections 2023-11-24T08:07:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.063+0000 7f35625c1640 1 -- 172.21.15.57:0/2102413315 wait complete. 2023-11-24T08:07:37.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:07:24.498448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:07:25.096379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:37.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:37.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.231+0000 7f019769a640 1 Processor -- start 2023-11-24T08:07:37.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f019769a640 1 -- start start 2023-11-24T08:07:37.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f019769a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f019015a290 0x7f01900707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f019769a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01900b1f80 0x7f01900b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f019769a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0190071170 con 0x7f019015ec60 2023-11-24T08:07:37.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f019769a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900cb690 con 0x7f019015a290 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f019769a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900cb970 con 0x7f01900b1f80 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195436640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f019015a290 0x7f01900707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195436640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f019015a290 0x7f01900707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50236/0 (socket says 172.21.15.57:50236) 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195436640 1 -- 172.21.15.57:0/332103519 learned_addr learned my addr 172.21.15.57:0/332103519 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195c37640 1 --2- 172.21.15.57:0/332103519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01900b1f80 0x7f01900b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195436640 1 -- 172.21.15.57:0/332103519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01900b1f80 msgr2=0x7f01900b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195436640 1 --2- 172.21.15.57:0/332103519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01900b1f80 0x7f01900b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195436640 1 -- 172.21.15.57:0/332103519 >> v1:172.21.15.132:6789/0 conn(0x7f019015ec60 legacy=0x7f01900cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195436640 1 -- 172.21.15.57:0/332103519 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900cbc50 con 0x7f019015a290 2023-11-24T08:07:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.235+0000 7f0195c37640 1 --2- 172.21.15.57:0/332103519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01900b1f80 0x7f01900b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f0195436640 1 --2- 172.21.15.57:0/332103519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f01900707f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f019006c0d0 tx=0x7f018c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db14da397fb5f255 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f0187fff640 1 -- 172.21.15.57:0/332103519 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0ab600 con 0x7f019015a290 2023-11-24T08:07:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f0187fff640 1 -- 172.21.15.57:0/332103519 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c0a7050 con 0x7f019015a290 2023-11-24T08:07:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f0187fff640 1 -- 172.21.15.57:0/332103519 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0ab980 con 0x7f019015a290 2023-11-24T08:07:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 -- 172.21.15.57:0/332103519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 msgr2=0x7f01900707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 --2- 172.21.15.57:0/332103519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f01900707f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f019006c0d0 tx=0x7f018c01c450 comp rx=0 tx=0).stop 2023-11-24T08:07:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 -- 172.21.15.57:0/332103519 shutdown_connections 2023-11-24T08:07:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 --2- 172.21.15.57:0/332103519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f01900b1f80 0x7f01900b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 --2- 172.21.15.57:0/332103519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f01900707f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 -- 172.21.15.57:0/332103519 >> 172.21.15.57:0/332103519 conn(0x7f01900b0c80 msgr2=0x7f01900b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 -- 172.21.15.57:0/332103519 shutdown_connections 2023-11-24T08:07:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 -- 172.21.15.57:0/332103519 wait complete. 2023-11-24T08:07:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 Processor -- start 2023-11-24T08:07:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.239+0000 7f019769a640 1 -- start start 2023-11-24T08:07:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b1f80 0x7f01900987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f019015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f019015ec60 0x7f0190150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901690e0 con 0x7f019015a290 2023-11-24T08:07:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901638e0 con 0x7f01900b1f80 2023-11-24T08:07:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019015d910 con 0x7f019015ec60 2023-11-24T08:07:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f019015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f019015a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50246/0 (socket says 172.21.15.57:50246) 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 -- 172.21.15.57:0/1975783993 learned_addr learned my addr 172.21.15.57:0/1975783993 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0195436640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b1f80 0x7f01900987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0195c37640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f019015ec60 0x7f0190150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 -- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f019015ec60 msgr2=0x7f0190150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f019015ec60 0x7f0190150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 -- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b1f80 msgr2=0x7f01900987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b1f80 0x7f01900987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 -- 172.21.15.57:0/1975783993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c0094d0 con 0x7f019015a290 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0194c35640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f019015a970 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f018000b3e0 tx=0x7f018000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0185ffb640 1 -- 172.21.15.57:0/1975783993 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180011830 con 0x7f019015a290 2023-11-24T08:07:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0185ffb640 1 -- 172.21.15.57:0/1975783993 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180011990 con 0x7f019015a290 2023-11-24T08:07:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0185ffb640 1 -- 172.21.15.57:0/1975783993 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180011d80 con 0x7f019015a290 2023-11-24T08:07:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0190070f40 con 0x7f019015a290 2023-11-24T08:07:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019015d630 con 0x7f019015a290 2023-11-24T08:07:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190163a70 con 0x7f019015a290 2023-11-24T08:07:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.243+0000 7f0185ffb640 1 -- 172.21.15.57:0/1975783993 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f018001a400 con 0x7f019015a290 2023-11-24T08:07:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.247+0000 7f0185ffb640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0174066620 0x7f0174068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.247+0000 7f0185ffb640 1 -- 172.21.15.57:0/1975783993 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0180083ef0 con 0x7f019015a290 2023-11-24T08:07:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.247+0000 7f0195436640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0174066620 0x7f0174068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.247+0000 7f0195436640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0174066620 0x7f0174068ae0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f018c0ad000 tx=0x7f018c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.251+0000 7f0185ffb640 1 -- 172.21.15.57:0/1975783993 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0180051190 con 0x7f019015a290 2023-11-24T08:07:37.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f019006c5c0 con 0x7f019015a290 2023-11-24T08:07:37.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f0185ffb640 1 -- 172.21.15.57:0/1975783993 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01800547b0 con 0x7f019015a290 2023-11-24T08:07:37.415 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0174066620 msgr2=0x7f0174068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0174066620 0x7f0174068ae0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f018c0ad000 tx=0x7f018c0a6000 comp rx=0 tx=0).stop 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 msgr2=0x7f019015a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f019015a970 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f018000b3e0 tx=0x7f018000b8a0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 shutdown_connections 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0174066620 0x7f0174068ae0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f019015ec60 0x7f0190150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f019015a290 0x7f019015a970 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 --2- 172.21.15.57:0/1975783993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b1f80 0x7f01900987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 >> 172.21.15.57:0/1975783993 conn(0x7f01900b0c80 msgr2=0x7f0190073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 shutdown_connections 2023-11-24T08:07:37.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.411+0000 7f019769a640 1 -- 172.21.15.57:0/1975783993 wait complete. 2023-11-24T08:07:37.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.575+0000 7fe581006640 1 Processor -- start 2023-11-24T08:07:37.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.575+0000 7fe581006640 1 -- start start 2023-11-24T08:07:37.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe581006640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe581006640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe57c06d8f0 0x7fe57c0ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe581006640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c06b460 con 0x7fe57c15d450 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe581006640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57c06dd80 con 0x7fe57c06d8f0 2023-11-24T08:07:37.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe581006640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c06a5b0 con 0x7fe57c06b8f0 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe573fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57b59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe57c06d8f0 0x7fe57c0ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57ad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe57c15d450 0x7fe57c161af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:45974/0 (socket says 172.21.15.57:45974) 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57ad9d640 1 -- 172.21.15.57:0/2620564251 learned_addr learned my addr 172.21.15.57:0/2620564251 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57a59c640 1 -- 172.21.15.57:0/2620564251 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726483601 0 0) 0x7fe57c06b460 con 0x7fe57c15d450 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57a59c640 1 -- 172.21.15.57:0/2620564251 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe568003530 con 0x7fe57c15d450 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57b59e640 1 -- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 msgr2=0x7fe57c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57b59e640 1 --2- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57b59e640 1 -- 172.21.15.57:0/2620564251 >> v1:172.21.15.132:6789/0 conn(0x7fe57c15d450 legacy=0x7fe57c161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe57b59e640 1 -- 172.21.15.57:0/2620564251 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c06a850 con 0x7fe57c06d8f0 2023-11-24T08:07:37.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.579+0000 7fe573fff640 1 --2- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:37.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe57b59e640 1 --2- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 0x7fe57c0ac850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe574009d90 tx=0x7fe57401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c797dacae6de7ce7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe57a59c640 1 -- 172.21.15.57:0/2620564251 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740a59e0 con 0x7fe57c06d8f0 2023-11-24T08:07:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe57a59c640 1 -- 172.21.15.57:0/2620564251 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740a5b40 con 0x7fe57c06d8f0 2023-11-24T08:07:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe57a59c640 1 -- 172.21.15.57:0/2620564251 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740ad440 con 0x7fe57c06d8f0 2023-11-24T08:07:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 -- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 msgr2=0x7fe57c0ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 --2- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 0x7fe57c0ac850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe574009d90 tx=0x7fe57401c920 comp rx=0 tx=0).stop 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 -- 172.21.15.57:0/2620564251 shutdown_connections 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 --2- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 0x7fe57c0ac850 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 --2- 172.21.15.57:0/2620564251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 -- 172.21.15.57:0/2620564251 >> 172.21.15.57:0/2620564251 conn(0x7fe57c0cf8f0 msgr2=0x7fe57c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 -- 172.21.15.57:0/2620564251 shutdown_connections 2023-11-24T08:07:37.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.583+0000 7fe581006640 1 -- 172.21.15.57:0/2620564251 wait complete. 2023-11-24T08:07:37.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 Processor -- start 2023-11-24T08:07:37.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 -- start start 2023-11-24T08:07:37.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 0x7fe57c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe57c15d450 0x7fe57c156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c148980 con 0x7fe57c15d450 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c1497e0 con 0x7fe57c06d8f0 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c148bd0 con 0x7fe57c06b8f0 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57ad9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe57c15d450 0x7fe57c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe573fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 0x7fe57c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe57c15d450 0x7fe57c156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50248/0 (socket says 172.21.15.57:50248) 2023-11-24T08:07:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57ad9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:43348/0 (socket says 172.21.15.57:43348) 2023-11-24T08:07:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 -- 172.21.15.57:0/2501385413 learned_addr learned my addr 172.21.15.57:0/2501385413 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 -- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 msgr2=0x7fe57c148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 -- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 msgr2=0x7fe57c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 0x7fe57c155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 -- 172.21.15.57:0/2501385413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564009420 con 0x7fe57c15d450 2023-11-24T08:07:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe57b59e640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe57c15d450 0x7fe57c156190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe5740b0040 tx=0x7fe5740196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe5737fe640 1 -- 172.21.15.57:0/2501385413 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740adce0 con 0x7fe57c15d450 2023-11-24T08:07:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe5737fe640 1 -- 172.21.15.57:0/2501385413 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740ade40 con 0x7fe57c15d450 2023-11-24T08:07:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe5737fe640 1 -- 172.21.15.57:0/2501385413 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740b7650 con 0x7fe57c15d450 2023-11-24T08:07:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe574009a70 con 0x7fe57c15d450 2023-11-24T08:07:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c149190 con 0x7fe57c15d450 2023-11-24T08:07:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.587+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c149950 con 0x7fe57c15d450 2023-11-24T08:07:37.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.591+0000 7fe5737fe640 1 -- 172.21.15.57:0/2501385413 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe5740b4050 con 0x7fe57c15d450 2023-11-24T08:07:37.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.591+0000 7fe5737fe640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe55c066620 0x7fe55c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.591+0000 7fe5737fe640 1 -- 172.21.15.57:0/2501385413 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe57411f250 con 0x7fe57c15d450 2023-11-24T08:07:37.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.591+0000 7fe57ad9d640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe55c066620 0x7fe55c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.591+0000 7fe57ad9d640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe55c066620 0x7fe55c068ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0011f0 tx=0x7fe56c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.595+0000 7fe5737fe640 1 -- 172.21.15.57:0/2501385413 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5740ec460 con 0x7fe57c15d450 2023-11-24T08:07:37.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.751+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe57c04e8c0 con 0x7fe57c15d450 2023-11-24T08:07:37.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.751+0000 7fe5737fe640 1 -- 172.21.15.57:0/2501385413 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe574009450 con 0x7fe57c15d450 2023-11-24T08:07:37.757 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:07:37.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe55c066620 msgr2=0x7fe55c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe55c066620 0x7fe55c068ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0011f0 tx=0x7fe56c007d40 comp rx=0 tx=0).stop 2023-11-24T08:07:37.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe57c15d450 msgr2=0x7fe57c156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe57c15d450 0x7fe57c156190 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe5740b0040 tx=0x7fe5740196c0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 shutdown_connections 2023-11-24T08:07:37.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe55c066620 0x7fe55c068ae0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe57c15d450 0x7fe57c156190 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe57c06d8f0 0x7fe57c155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 --2- 172.21.15.57:0/2501385413 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe57c06b8f0 0x7fe57c148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 >> 172.21.15.57:0/2501385413 conn(0x7fe57c0cf8f0 msgr2=0x7fe57c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 shutdown_connections 2023-11-24T08:07:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.755+0000 7fe581006640 1 -- 172.21.15.57:0/2501385413 wait complete. 2023-11-24T08:07:37.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.919+0000 7fe20ba9c640 1 Processor -- start 2023-11-24T08:07:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.919+0000 7fe20ba9c640 1 -- start start 2023-11-24T08:07:37.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.919+0000 7fe20ba9c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20415ec60 0x7fe2040cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.919+0000 7fe20ba9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2040cc6b0 0x7fe2040b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.919+0000 7fe20ba9c640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe204070f00 con 0x7fe20415a290 2023-11-24T08:07:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.919+0000 7fe20ba9c640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe204071170 con 0x7fe2040cc6b0 2023-11-24T08:07:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.919+0000 7fe20ba9c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2040cb690 con 0x7fe20415ec60 2023-11-24T08:07:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe209838640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe20415a290 0x7fe2040707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51162/0 (socket says 172.21.15.57:51162) 2023-11-24T08:07:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe209838640 1 -- 172.21.15.57:0/296327716 learned_addr learned my addr 172.21.15.57:0/296327716 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe20a039640 1 --2- 172.21.15.57:0/296327716 >> v2:172.21.15.57:3300/0 conn(0x7fe2040cc6b0 0x7fe2040b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe209037640 1 --2- 172.21.15.57:0/296327716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20415ec60 0x7fe2040cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe20a039640 1 -- 172.21.15.57:0/296327716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20415ec60 msgr2=0x7fe2040cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe20a039640 1 --2- 172.21.15.57:0/296327716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20415ec60 0x7fe2040cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe20a039640 1 -- 172.21.15.57:0/296327716 >> v1:172.21.15.57:6789/0 conn(0x7fe20415a290 legacy=0x7fe2040707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe208836640 1 -- 172.21.15.57:0/296327716 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477385016 0 0) 0x7fe204070f00 con 0x7fe20415a290 2023-11-24T08:07:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe20a039640 1 -- 172.21.15.57:0/296327716 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2040cb970 con 0x7fe2040cc6b0 2023-11-24T08:07:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe209037640 1 --2- 172.21.15.57:0/296327716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20415ec60 0x7fe2040cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe20a039640 1 --2- 172.21.15.57:0/296327716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2040cc6b0 0x7fe2040b1f80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009d90 tx=0x7fe1fc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f88f83ab4c7e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe208836640 1 -- 172.21.15.57:0/296327716 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0a5860 con 0x7fe2040cc6b0 2023-11-24T08:07:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe208836640 1 -- 172.21.15.57:0/296327716 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc0a59c0 con 0x7fe2040cc6b0 2023-11-24T08:07:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.923+0000 7fe208836640 1 -- 172.21.15.57:0/296327716 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0a5d50 con 0x7fe2040cc6b0 2023-11-24T08:07:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- 172.21.15.57:0/296327716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2040cc6b0 msgr2=0x7fe2040b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/296327716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2040cc6b0 0x7fe2040b1f80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009d90 tx=0x7fe1fc01c890 comp rx=0 tx=0).stop 2023-11-24T08:07:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- 172.21.15.57:0/296327716 shutdown_connections 2023-11-24T08:07:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/296327716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20415ec60 0x7fe2040cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/296327716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2040cc6b0 0x7fe2040b1f80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- 172.21.15.57:0/296327716 >> 172.21.15.57:0/296327716 conn(0x7fe2040b0c80 msgr2=0x7fe2040b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:37.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- 172.21.15.57:0/296327716 shutdown_connections 2023-11-24T08:07:37.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- 172.21.15.57:0/296327716 wait complete. 2023-11-24T08:07:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 Processor -- start 2023-11-24T08:07:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- start start 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2040cc6b0 0x7fe204155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe20415a290 0x7fe204154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20415ec60 0x7fe2041f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204154d50 con 0x7fe20415a290 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2041f5f50 con 0x7fe20415ec60 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe20ba9c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2041556e0 con 0x7fe2040cc6b0 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe20415a290 0x7fe204154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe20415a290 0x7fe204154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50260/0 (socket says 172.21.15.57:50260) 2023-11-24T08:07:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 -- 172.21.15.57:0/3795559411 learned_addr learned my addr 172.21.15.57:0/3795559411 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 -- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2040cc6b0 msgr2=0x7fe204155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2040cc6b0 0x7fe204155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 -- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20415ec60 msgr2=0x7fe2041f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20415ec60 0x7fe2041f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.927+0000 7fe209037640 1 -- 172.21.15.57:0/3795559411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc009a70 con 0x7fe20415a290 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe209037640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe20415a290 0x7fe204154810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400c7f0 tx=0x7fe1f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe1fa7fc640 1 -- 172.21.15.57:0/3795559411 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400cea0 con 0x7fe20415a290 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe1fa7fc640 1 -- 172.21.15.57:0/3795559411 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4007a30 con 0x7fe20415a290 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe1fa7fc640 1 -- 172.21.15.57:0/3795559411 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4007dc0 con 0x7fe20415a290 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2041559c0 con 0x7fe20415a290 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe204155f80 con 0x7fe20415a290 2023-11-24T08:07:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe204154ec0 con 0x7fe20415a290 2023-11-24T08:07:37.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe1fa7fc640 1 -- 172.21.15.57:0/3795559411 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe1f40113f0 con 0x7fe20415a290 2023-11-24T08:07:37.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe1fa7fc640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1e8066620 0x7fe1e8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:37.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.931+0000 7fe1fa7fc640 1 -- 172.21.15.57:0/3795559411 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1f40844a0 con 0x7fe20415a290 2023-11-24T08:07:37.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.935+0000 7fe209838640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1e8066620 0x7fe1e8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:37.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.935+0000 7fe209838640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1e8066620 0x7fe1e8068ae0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2000015a0 tx=0x7fe200007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:37.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:37.935+0000 7fe1fa7fc640 1 -- 172.21.15.57:0/3795559411 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1f4051580 con 0x7fe20415a290 2023-11-24T08:07:38.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe20404e8c0 con 0x7fe20415a290 2023-11-24T08:07:38.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe1fa7fc640 1 -- 172.21.15.57:0/3795559411 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1f4054ba0 con 0x7fe20415a290 2023-11-24T08:07:38.099 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:07:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1e8066620 msgr2=0x7fe1e8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1e8066620 0x7fe1e8068ae0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2000015a0 tx=0x7fe200007970 comp rx=0 tx=0).stop 2023-11-24T08:07:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe20415a290 msgr2=0x7fe204154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe20415a290 0x7fe204154810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400c7f0 tx=0x7fe1f400ccb0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 shutdown_connections 2023-11-24T08:07:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1e8066620 0x7fe1e8068ae0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20415ec60 0x7fe2041f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe20415a290 0x7fe204154810 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 --2- 172.21.15.57:0/3795559411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2040cc6b0 0x7fe204155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 >> 172.21.15.57:0/3795559411 conn(0x7fe2040b0c80 msgr2=0x7fe2040cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 shutdown_connections 2023-11-24T08:07:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.095+0000 7fe20ba9c640 1 -- 172.21.15.57:0/3795559411 wait complete. 2023-11-24T08:07:38.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:38.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.259+0000 7f6ce5da1640 1 Processor -- start 2023-11-24T08:07:38.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.259+0000 7f6ce5da1640 1 -- start start 2023-11-24T08:07:38.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6ce5da1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6ce5da1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ce00717c0 0x7f6ce00c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6ce5da1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce00ca270 con 0x7f6ce00c98f0 2023-11-24T08:07:38.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6ce5da1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce00ca770 con 0x7f6ce00717c0 2023-11-24T08:07:38.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6ce5da1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00729d0 con 0x7f6ce00725f0 2023-11-24T08:07:38.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ce00717c0 0x7f6ce00c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ce00717c0 0x7f6ce00c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50262/0 (socket says 172.21.15.57:50262) 2023-11-24T08:07:38.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdffff640 1 -- 172.21.15.57:0/199782739 learned_addr learned my addr 172.21.15.57:0/199782739 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:38.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdf7fe640 1 --2- 172.21.15.57:0/199782739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdffff640 1 -- 172.21.15.57:0/199782739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 msgr2=0x7f6ce006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdffff640 1 --2- 172.21.15.57:0/199782739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdffff640 1 -- 172.21.15.57:0/199782739 >> v1:172.21.15.132:6789/0 conn(0x7f6ce00c98f0 legacy=0x7f6ce00cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.263+0000 7f6cdffff640 1 -- 172.21.15.57:0/199782739 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce006cb70 con 0x7f6ce00717c0 2023-11-24T08:07:38.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6cdffff640 1 --2- 172.21.15.57:0/199782739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00717c0 0x7f6ce00c9d30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009e80 tx=0x7f6cd801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2585601e18be4fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6cde7fc640 1 -- 172.21.15.57:0/199782739 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80af400 con 0x7f6ce00717c0 2023-11-24T08:07:38.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6cde7fc640 1 -- 172.21.15.57:0/199782739 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd80ab050 con 0x7f6ce00717c0 2023-11-24T08:07:38.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6cde7fc640 1 -- 172.21.15.57:0/199782739 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80af780 con 0x7f6ce00717c0 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 -- 172.21.15.57:0/199782739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00717c0 msgr2=0x7f6ce00c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/199782739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00717c0 0x7f6ce00c9d30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009e80 tx=0x7f6cd801f1e0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 -- 172.21.15.57:0/199782739 shutdown_connections 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/199782739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00717c0 0x7f6ce00c9d30 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/199782739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 -- 172.21.15.57:0/199782739 >> 172.21.15.57:0/199782739 conn(0x7f6ce00b0bf0 msgr2=0x7f6ce00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 -- 172.21.15.57:0/199782739 shutdown_connections 2023-11-24T08:07:38.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 -- 172.21.15.57:0/199782739 wait complete. 2023-11-24T08:07:38.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 Processor -- start 2023-11-24T08:07:38.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 -- start start 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce00717c0 0x7f6ce0158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.267+0000 7f6ce5da1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00c98f0 0x7f6ce01590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6ce5da1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00b4af0 con 0x7f6ce00c98f0 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6ce5da1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00b44c0 con 0x7f6ce00717c0 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6ce5da1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce00cece0 con 0x7f6ce00725f0 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00c98f0 0x7f6ce01590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00c98f0 0x7f6ce01590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50264/0 (socket says 172.21.15.57:50264) 2023-11-24T08:07:38.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdeffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 -- 172.21.15.57:0/1595715686 learned_addr learned my addr 172.21.15.57:0/1595715686 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdf7fe640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce00717c0 0x7f6ce0158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 -- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 msgr2=0x7f6ce00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce00ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 -- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce00717c0 msgr2=0x7f6ce0158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce00717c0 0x7f6ce0158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 -- 172.21.15.57:0/1595715686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd8009b30 con 0x7f6ce00c98f0 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cdffff640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00c98f0 0x7f6ce01590a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6cd801d890 tx=0x7f6cd801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cc7fff640 1 -- 172.21.15.57:0/1595715686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8007000 con 0x7f6ce00c98f0 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cc7fff640 1 -- 172.21.15.57:0/1595715686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd80afd90 con 0x7f6ce00c98f0 2023-11-24T08:07:38.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce00c29a0 con 0x7f6ce00c98f0 2023-11-24T08:07:38.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cc7fff640 1 -- 172.21.15.57:0/1595715686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80b9650 con 0x7f6ce00c98f0 2023-11-24T08:07:38.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce00c2f60 con 0x7f6ce00c98f0 2023-11-24T08:07:38.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce00c3150 con 0x7f6ce00c98f0 2023-11-24T08:07:38.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.271+0000 7f6cc7fff640 1 -- 172.21.15.57:0/1595715686 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f6cd80b6050 con 0x7f6ce00c98f0 2023-11-24T08:07:38.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.275+0000 7f6cc7fff640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6ccc066620 0x7f6ccc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.275+0000 7f6cc7fff640 1 -- 172.21.15.57:0/1595715686 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd8122320 con 0x7f6ce00c98f0 2023-11-24T08:07:38.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.275+0000 7f6cdf7fe640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6ccc066620 0x7f6ccc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.275+0000 7f6cdf7fe640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6ccc066620 0x7f6ccc068ae0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009b60 tx=0x7f6cd0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.279+0000 7f6cc7fff640 1 -- 172.21.15.57:0/1595715686 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cd80ef420 con 0x7f6ce00c98f0 2023-11-24T08:07:38.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.451+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ce00b4c30 con 0x7f6ce00c98f0 2023-11-24T08:07:38.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.451+0000 7f6cc7fff640 1 -- 172.21.15.57:0/1595715686 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6cd8009510 con 0x7f6ce00c98f0 2023-11-24T08:07:38.456 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.451+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6ccc066620 msgr2=0x7f6ccc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.451+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6ccc066620 0x7f6ccc068ae0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009b60 tx=0x7f6cd0009190 comp rx=0 tx=0).stop 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.451+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00c98f0 msgr2=0x7f6ce01590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.451+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00c98f0 0x7f6ce01590a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6cd801d890 tx=0x7f6cd801bf80 comp rx=0 tx=0).stop 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 shutdown_connections 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f6ccc066620 0x7f6ccc068ae0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ce00c98f0 0x7f6ce01590a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6ce00725f0 0x7f6ce00ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 --2- 172.21.15.57:0/1595715686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce00717c0 0x7f6ce0158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 >> 172.21.15.57:0/1595715686 conn(0x7f6ce00b0bf0 msgr2=0x7f6ce00ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 shutdown_connections 2023-11-24T08:07:38.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.455+0000 7f6ce5da1640 1 -- 172.21.15.57:0/1595715686 wait complete. 2023-11-24T08:07:38.477 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T08:07:38.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:38.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T08:07:38.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:07:38.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:38.505 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:07:38.559 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:38.559 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:38.570 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:38.570 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:38.624 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.763+0000 7f785231d640 1 Processor -- start 2023-11-24T08:07:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.763+0000 7f785231d640 1 -- start start 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f785231d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f784c06de50 0x7f784c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f785231d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f784c06c650 0x7f784c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f785231d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c0ae950 con 0x7f784c06d020 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f785231d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c159fc0 con 0x7f784c06de50 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f785231d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c0b1ef0 con 0x7f784c06c650 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f784bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f784c06de50 0x7f784c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f78508ba640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f784c06d020 0x7f784c0ac5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51170/0 (socket says 172.21.15.57:51170) 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f78508ba640 1 -- 172.21.15.57:0/470242359 learned_addr learned my addr 172.21.15.57:0/470242359 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f784b7fe640 1 --2- 172.21.15.57:0/470242359 >> v2:172.21.15.132:3300/0 conn(0x7f784c06c650 0x7f784c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f784bfff640 1 -- 172.21.15.57:0/470242359 >> v2:172.21.15.132:3300/0 conn(0x7f784c06c650 msgr2=0x7f784c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f784bfff640 1 --2- 172.21.15.57:0/470242359 >> v2:172.21.15.132:3300/0 conn(0x7f784c06c650 0x7f784c06cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f784bfff640 1 -- 172.21.15.57:0/470242359 >> v1:172.21.15.57:6789/0 conn(0x7f784c06d020 legacy=0x7f784c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.767+0000 7f784bfff640 1 -- 172.21.15.57:0/470242359 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c06e230 con 0x7f784c06de50 2023-11-24T08:07:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f784bfff640 1 --2- 172.21.15.57:0/470242359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06de50 0x7f784c159a80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f784c06c0c0 tx=0x7f783c01e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8994cdc4ee45cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f784affd640 1 -- 172.21.15.57:0/470242359 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0ab620 con 0x7f784c06de50 2023-11-24T08:07:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f784affd640 1 -- 172.21.15.57:0/470242359 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c0ab780 con 0x7f784c06de50 2023-11-24T08:07:38.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f784affd640 1 -- 172.21.15.57:0/470242359 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0abb10 con 0x7f784c06de50 2023-11-24T08:07:38.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 -- 172.21.15.57:0/470242359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06de50 msgr2=0x7f784c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 --2- 172.21.15.57:0/470242359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06de50 0x7f784c159a80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f784c06c0c0 tx=0x7f783c01e640 comp rx=0 tx=0).stop 2023-11-24T08:07:38.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 -- 172.21.15.57:0/470242359 shutdown_connections 2023-11-24T08:07:38.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 --2- 172.21.15.57:0/470242359 >> v2:172.21.15.132:3300/0 conn(0x7f784c06c650 0x7f784c06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 --2- 172.21.15.57:0/470242359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06de50 0x7f784c159a80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 -- 172.21.15.57:0/470242359 >> 172.21.15.57:0/470242359 conn(0x7f784c0b0bf0 msgr2=0x7f784c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 -- 172.21.15.57:0/470242359 shutdown_connections 2023-11-24T08:07:38.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 -- 172.21.15.57:0/470242359 wait complete. 2023-11-24T08:07:38.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 Processor -- start 2023-11-24T08:07:38.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.771+0000 7f785231d640 1 -- start start 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f784c06c650 0x7f784c164050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06d020 0x7f784c13f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f784c06de50 0x7f784c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1649c0 con 0x7f784c06d020 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c09c7e0 con 0x7f784c06c650 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1646e0 con 0x7f784c06de50 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06d020 0x7f784c13f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06d020 0x7f784c13f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50280/0 (socket says 172.21.15.57:50280) 2023-11-24T08:07:38.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 -- 172.21.15.57:0/3539730703 learned_addr learned my addr 172.21.15.57:0/3539730703 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784bfff640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f784c06c650 0x7f784c164050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f78508ba640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f784c06de50 0x7f784c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 -- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f784c06de50 msgr2=0x7f784c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f784c06de50 0x7f784c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 -- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f784c06c650 msgr2=0x7f784c164050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f784c06c650 0x7f784c164050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 -- 172.21.15.57:0/3539730703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c009420 con 0x7f784c06d020 2023-11-24T08:07:38.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f784b7fe640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06d020 0x7f784c13f870 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f784000d800 tx=0x7f784000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f7848ff9640 1 -- 172.21.15.57:0/3539730703 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000b6c0 con 0x7f784c06d020 2023-11-24T08:07:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f7848ff9640 1 -- 172.21.15.57:0/3539730703 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000b820 con 0x7f784c06d020 2023-11-24T08:07:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f7848ff9640 1 -- 172.21.15.57:0/3539730703 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000bb90 con 0x7f784c06d020 2023-11-24T08:07:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c099ca0 con 0x7f784c06d020 2023-11-24T08:07:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c09a260 con 0x7f784c06d020 2023-11-24T08:07:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c09a420 con 0x7f784c06d020 2023-11-24T08:07:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.775+0000 7f7848ff9640 1 -- 172.21.15.57:0/3539730703 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f784000bcf0 con 0x7f784c06d020 2023-11-24T08:07:38.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.779+0000 7f7848ff9640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7838066650 0x7f7838068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.779+0000 7f7848ff9640 1 -- 172.21.15.57:0/3539730703 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78400844e0 con 0x7f784c06d020 2023-11-24T08:07:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.779+0000 7f784bfff640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7838066650 0x7f7838068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:38.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.779+0000 7f784bfff640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7838066650 0x7f7838068b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f783c0b0000 tx=0x7f783c0a9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:38.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.783+0000 7f7848ff9640 1 -- 172.21.15.57:0/3539730703 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7840051820 con 0x7f784c06d020 2023-11-24T08:07:38.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f784c067520 con 0x7f784c06d020 2023-11-24T08:07:38.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f7848ff9640 1 -- 172.21.15.57:0/3539730703 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7840054e40 con 0x7f784c06d020 2023-11-24T08:07:38.947 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:38.947 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":61,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:27.714748+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7838066650 msgr2=0x7f7838068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7838066650 0x7f7838068b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f783c0b0000 tx=0x7f783c0a9000 comp rx=0 tx=0).stop 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06d020 msgr2=0x7f784c13f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06d020 0x7f784c13f870 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f784000d800 tx=0x7f784000dcc0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 shutdown_connections 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7838066650 0x7f7838068b10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f784c06de50 0x7f784c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784c06d020 0x7f784c13f870 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 --2- 172.21.15.57:0/3539730703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f784c06c650 0x7f784c164050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 >> 172.21.15.57:0/3539730703 conn(0x7f784c0b0bf0 msgr2=0x7f784c0b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 shutdown_connections 2023-11-24T08:07:38.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:38.943+0000 7f785231d640 1 -- 172.21.15.57:0/3539730703 wait complete. 2023-11-24T08:07:38.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:07:24.498448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:07:25.096379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:38.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:39.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa2267df640 1 Processor -- start 2023-11-24T08:07:39.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa2267df640 1 -- start start 2023-11-24T08:07:39.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa2267df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22015d7f0 0x7fa2200d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa2267df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa22006cce0 0x7fa22006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa2267df640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2200d3c60 con 0x7fa2200d37e0 2023-11-24T08:07:39.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa2267df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22006b980 con 0x7fa22006cce0 2023-11-24T08:07:39.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa2267df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200b0090 con 0x7fa22015d7f0 2023-11-24T08:07:39.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa21ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22015d7f0 0x7fa2200d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa224d7c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa22006cce0 0x7fa22006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa21f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa2200d37e0 0x7fa2200b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:45994/0 (socket says 172.21.15.57:45994) 2023-11-24T08:07:39.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa21f7fe640 1 -- 172.21.15.57:0/141137105 learned_addr learned my addr 172.21.15.57:0/141137105 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:39.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa21ffff640 1 -- 172.21.15.57:0/141137105 >> v2:172.21.15.132:3300/0 conn(0x7fa22006cce0 msgr2=0x7fa22006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa21ffff640 1 --2- 172.21.15.57:0/141137105 >> v2:172.21.15.132:3300/0 conn(0x7fa22006cce0 0x7fa22006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa21ffff640 1 -- 172.21.15.57:0/141137105 >> v1:172.21.15.132:6789/0 conn(0x7fa2200d37e0 legacy=0x7fa2200b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.119+0000 7fa21ffff640 1 -- 172.21.15.57:0/141137105 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22006d6b0 con 0x7fa22015d7f0 2023-11-24T08:07:39.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa21ffff640 1 --2- 172.21.15.57:0/141137105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22015d7f0 0x7fa2200d32a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2100097c0 tx=0x7fa21001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=517b2431911f24fc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa21effd640 1 -- 172.21.15.57:0/141137105 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100ab600 con 0x7fa22015d7f0 2023-11-24T08:07:39.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa21effd640 1 -- 172.21.15.57:0/141137105 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2100a7050 con 0x7fa22015d7f0 2023-11-24T08:07:39.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa21effd640 1 -- 172.21.15.57:0/141137105 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100ab980 con 0x7fa22015d7f0 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 -- 172.21.15.57:0/141137105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22015d7f0 msgr2=0x7fa2200d32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 --2- 172.21.15.57:0/141137105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22015d7f0 0x7fa2200d32a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2100097c0 tx=0x7fa21001c480 comp rx=0 tx=0).stop 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 -- 172.21.15.57:0/141137105 shutdown_connections 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 --2- 172.21.15.57:0/141137105 >> v2:172.21.15.132:3300/0 conn(0x7fa22006cce0 0x7fa22006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 --2- 172.21.15.57:0/141137105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22015d7f0 0x7fa2200d32a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 -- 172.21.15.57:0/141137105 >> 172.21.15.57:0/141137105 conn(0x7fa22009c790 msgr2=0x7fa22008af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 -- 172.21.15.57:0/141137105 shutdown_connections 2023-11-24T08:07:39.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.123+0000 7fa2267df640 1 -- 172.21.15.57:0/141137105 wait complete. 2023-11-24T08:07:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 Processor -- start 2023-11-24T08:07:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 -- start start 2023-11-24T08:07:39.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22006cce0 0x7fa22014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2200d37e0 0x7fa2200b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22015d7f0 0x7fa2200ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2201f6410 con 0x7fa22015d7f0 2023-11-24T08:07:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200b6350 con 0x7fa2200d37e0 2023-11-24T08:07:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa2267df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2200b6630 con 0x7fa22006cce0 2023-11-24T08:07:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22006cce0 0x7fa22014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa224d7c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22015d7f0 0x7fa2200ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22006cce0 0x7fa22014c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:43406/0 (socket says 172.21.15.57:43406) 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 -- 172.21.15.57:0/254959414 learned_addr learned my addr 172.21.15.57:0/254959414 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21f7fe640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2200d37e0 0x7fa2200b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 -- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2200d37e0 msgr2=0x7fa2200b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2200d37e0 0x7fa2200b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 -- 172.21.15.57:0/254959414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22015d7f0 msgr2=0x7fa2200ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22015d7f0 0x7fa2200ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 -- 172.21.15.57:0/254959414 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa210009420 con 0x7fa22006cce0 2023-11-24T08:07:39.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa224d7c640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22015d7f0 0x7fa2200ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.127+0000 7fa21ffff640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22006cce0 0x7fa22014c3b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa21001a0b0 tx=0x7fa210019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa21cff9640 1 -- 172.21.15.57:0/254959414 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b4410 con 0x7fa22006cce0 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa21cff9640 1 -- 172.21.15.57:0/254959414 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2100b4570 con 0x7fa22006cce0 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa21cff9640 1 -- 172.21.15.57:0/254959414 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b4920 con 0x7fa22006cce0 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2200b6910 con 0x7fa22006cce0 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2200b6ed0 con 0x7fa22006cce0 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2200b70c0 con 0x7fa22006cce0 2023-11-24T08:07:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa21cff9640 1 -- 172.21.15.57:0/254959414 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fa2100b2040 con 0x7fa22006cce0 2023-11-24T08:07:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa21cff9640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa20c066620 0x7fa20c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa21cff9640 1 -- 172.21.15.57:0/254959414 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa21011e890 con 0x7fa22006cce0 2023-11-24T08:07:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.131+0000 7fa21f7fe640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa20c066620 0x7fa20c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.135+0000 7fa21f7fe640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa20c066620 0x7fa20c068ae0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ca400 tx=0x7fa214009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.135+0000 7fa21cff9640 1 -- 172.21.15.57:0/254959414 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2100ebaa0 con 0x7fa22006cce0 2023-11-24T08:07:39.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2200b6770 con 0x7fa22006cce0 2023-11-24T08:07:39.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa21cff9640 1 -- 172.21.15.57:0/254959414 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2200b6770 con 0x7fa22006cce0 2023-11-24T08:07:39.299 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:07:39.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa20c066620 msgr2=0x7fa20c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa20c066620 0x7fa20c068ae0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ca400 tx=0x7fa214009040 comp rx=0 tx=0).stop 2023-11-24T08:07:39.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22006cce0 msgr2=0x7fa22014c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22006cce0 0x7fa22014c3b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa21001a0b0 tx=0x7fa210019220 comp rx=0 tx=0).stop 2023-11-24T08:07:39.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 shutdown_connections 2023-11-24T08:07:39.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa20c066620 0x7fa20c068ae0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22015d7f0 0x7fa2200ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2200d37e0 0x7fa2200b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 --2- 172.21.15.57:0/254959414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa22006cce0 0x7fa22014c3b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.295+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 >> 172.21.15.57:0/254959414 conn(0x7fa22009c790 msgr2=0x7fa2200d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.299+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 shutdown_connections 2023-11-24T08:07:39.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.299+0000 7fa2267df640 1 -- 172.21.15.57:0/254959414 wait complete. 2023-11-24T08:07:39.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:39.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.463+0000 7f87c7bc1640 1 Processor -- start 2023-11-24T08:07:39.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.463+0000 7f87c7bc1640 1 -- start start 2023-11-24T08:07:39.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c7bc1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c006d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c7bc1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87c0072010 0x7f87c00cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c7bc1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c006d9f0 con 0x7f87c006d590 2023-11-24T08:07:39.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c7bc1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00cd400 con 0x7f87c0072010 2023-11-24T08:07:39.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c7bc1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0072860 con 0x7f87c015d540 2023-11-24T08:07:39.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c595d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c006d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c615e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87c0072010 0x7f87c00cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c515c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f87c006d590 0x7f87c0071900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:46004/0 (socket says 172.21.15.57:46004) 2023-11-24T08:07:39.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c515c640 1 -- 172.21.15.57:0/148234939 learned_addr learned my addr 172.21.15.57:0/148234939 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:39.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c615e640 1 -- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 msgr2=0x7f87c006d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c615e640 1 --2- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c006d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c615e640 1 -- 172.21.15.57:0/148234939 >> v1:172.21.15.132:6789/0 conn(0x7f87c006d590 legacy=0x7f87c0071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c615e640 1 -- 172.21.15.57:0/148234939 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c006dc30 con 0x7f87c0072010 2023-11-24T08:07:39.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.467+0000 7f87c595d640 1 --2- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c006d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:39.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c615e640 1 --2- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c00cd890 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009d90 tx=0x7f87b801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b89e04f83b44cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c495b640 1 -- 172.21.15.57:0/148234939 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a5900 con 0x7f87c0072010 2023-11-24T08:07:39.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c495b640 1 -- 172.21.15.57:0/148234939 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80a5a60 con 0x7f87c0072010 2023-11-24T08:07:39.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c495b640 1 -- 172.21.15.57:0/148234939 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a5df0 con 0x7f87c0072010 2023-11-24T08:07:39.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 -- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 msgr2=0x7f87c00cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c00cd890 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009d90 tx=0x7f87b801c950 comp rx=0 tx=0).stop 2023-11-24T08:07:39.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 -- 172.21.15.57:0/148234939 shutdown_connections 2023-11-24T08:07:39.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c00cd890 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/148234939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c006d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 -- 172.21.15.57:0/148234939 >> 172.21.15.57:0/148234939 conn(0x7f87c00b0c80 msgr2=0x7f87c00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 -- 172.21.15.57:0/148234939 shutdown_connections 2023-11-24T08:07:39.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 -- 172.21.15.57:0/148234939 wait complete. 2023-11-24T08:07:39.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 Processor -- start 2023-11-24T08:07:39.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.471+0000 7f87c7bc1640 1 -- start start 2023-11-24T08:07:39.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87c006d590 0x7f87c00b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c0149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c0153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00b2be0 con 0x7f87c006d590 2023-11-24T08:07:39.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01fac90 con 0x7f87c0072010 2023-11-24T08:07:39.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01faf70 con 0x7f87c015d540 2023-11-24T08:07:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87c006d590 0x7f87c00b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87c006d590 0x7f87c00b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50296/0 (socket says 172.21.15.57:50296) 2023-11-24T08:07:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 -- 172.21.15.57:0/140938261 learned_addr learned my addr 172.21.15.57:0/140938261 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c615e640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c0153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c515c640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 -- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 msgr2=0x7f87c0153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c0153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 -- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 msgr2=0x7f87c0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c0149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 -- 172.21.15.57:0/140938261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc009420 con 0x7f87c006d590 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c515c640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c595d640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87c006d590 0x7f87c00b37b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00ebe0 tx=0x7f87bc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87b67fc640 1 -- 172.21.15.57:0/140938261 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00eee0 con 0x7f87c006d590 2023-11-24T08:07:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87b67fc640 1 -- 172.21.15.57:0/140938261 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc00cc30 con 0x7f87c006d590 2023-11-24T08:07:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b8009a70 con 0x7f87c006d590 2023-11-24T08:07:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87b67fc640 1 -- 172.21.15.57:0/140938261 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc013470 con 0x7f87c006d590 2023-11-24T08:07:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c0148840 con 0x7f87c006d590 2023-11-24T08:07:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c004e8c0 con 0x7f87c006d590 2023-11-24T08:07:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.475+0000 7f87b67fc640 1 -- 172.21.15.57:0/140938261 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f87bc0135d0 con 0x7f87c006d590 2023-11-24T08:07:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.479+0000 7f87b67fc640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f87a4066620 0x7f87a4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.479+0000 7f87b67fc640 1 -- 172.21.15.57:0/140938261 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87bc084400 con 0x7f87c006d590 2023-11-24T08:07:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.479+0000 7f87c515c640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f87a4066620 0x7f87a4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.479+0000 7f87c515c640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f87a4066620 0x7f87a4068ae0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f87c014cdc0 tx=0x7f87b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.479+0000 7f87b67fc640 1 -- 172.21.15.57:0/140938261 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87bc0516a0 con 0x7f87c006d590 2023-11-24T08:07:39.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87c00cdb50 con 0x7f87c006d590 2023-11-24T08:07:39.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87b67fc640 1 -- 172.21.15.57:0/140938261 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87bc054cc0 con 0x7f87c006d590 2023-11-24T08:07:39.643 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:07:39.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f87a4066620 msgr2=0x7f87a4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f87a4066620 0x7f87a4068ae0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f87c014cdc0 tx=0x7f87b0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:39.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87c006d590 msgr2=0x7f87c00b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87c006d590 0x7f87c00b37b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00ebe0 tx=0x7f87bc00c520 comp rx=0 tx=0).stop 2023-11-24T08:07:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 shutdown_connections 2023-11-24T08:07:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f87a4066620 0x7f87a4068ae0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87c015d540 0x7f87c0153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87c0072010 0x7f87c0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 --2- 172.21.15.57:0/140938261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87c006d590 0x7f87c00b37b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 >> 172.21.15.57:0/140938261 conn(0x7f87c00b0c80 msgr2=0x7f87c0156650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 shutdown_connections 2023-11-24T08:07:39.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.639+0000 7f87c7bc1640 1 -- 172.21.15.57:0/140938261 wait complete. 2023-11-24T08:07:39.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3d046640 1 Processor -- start 2023-11-24T08:07:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3d046640 1 -- start start 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3d046640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f3806d760 0x7f3f38071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3d046640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f38071e40 0x7f3f380cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3d046640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380cd400 con 0x7f3f3815d540 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3d046640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f38072860 con 0x7f3f38071e40 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3d046640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3806dc30 con 0x7f3f3806d760 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f36d9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3f3815d540 0x7f3f3806d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51172/0 (socket says 172.21.15.57:51172) 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f36d9d640 1 -- 172.21.15.57:0/715790146 learned_addr learned my addr 172.21.15.57:0/715790146 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3759e640 1 --2- 172.21.15.57:0/715790146 >> v2:172.21.15.132:3300/0 conn(0x7f3f38071e40 0x7f3f380cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f2ffff640 1 --2- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f3806d760 0x7f3f38071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3659c640 1 -- 172.21.15.57:0/715790146 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873236733 0 0) 0x7f3f380cd400 con 0x7f3f3815d540 2023-11-24T08:07:39.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3659c640 1 -- 172.21.15.57:0/715790146 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f24003530 con 0x7f3f3815d540 2023-11-24T08:07:39.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3759e640 1 -- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f3806d760 msgr2=0x7f3f38071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:39.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3759e640 1 --2- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f3806d760 0x7f3f38071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3759e640 1 -- 172.21.15.57:0/715790146 >> v1:172.21.15.57:6789/0 conn(0x7f3f3815d540 legacy=0x7f3f3806d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f3759e640 1 -- 172.21.15.57:0/715790146 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3806df10 con 0x7f3f38071e40 2023-11-24T08:07:39.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.807+0000 7f3f2ffff640 1 --2- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f3806d760 0x7f3f38071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:39.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3759e640 1 --2- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f38071e40 0x7f3f380cd890 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009d90 tx=0x7f3f3001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f3c500be47d828 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3659c640 1 -- 172.21.15.57:0/715790146 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300a5890 con 0x7f3f38071e40 2023-11-24T08:07:39.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3659c640 1 -- 172.21.15.57:0/715790146 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300a59f0 con 0x7f3f38071e40 2023-11-24T08:07:39.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3659c640 1 -- 172.21.15.57:0/715790146 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300a5d80 con 0x7f3f38071e40 2023-11-24T08:07:39.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 -- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f38071e40 msgr2=0x7f3f380cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 --2- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f38071e40 0x7f3f380cd890 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009d90 tx=0x7f3f3001c950 comp rx=0 tx=0).stop 2023-11-24T08:07:39.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 -- 172.21.15.57:0/715790146 shutdown_connections 2023-11-24T08:07:39.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 --2- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f38071e40 0x7f3f380cd890 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 --2- 172.21.15.57:0/715790146 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f3806d760 0x7f3f38071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 -- 172.21.15.57:0/715790146 >> 172.21.15.57:0/715790146 conn(0x7f3f380b0c80 msgr2=0x7f3f380b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 -- 172.21.15.57:0/715790146 shutdown_connections 2023-11-24T08:07:39.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.811+0000 7f3f3d046640 1 -- 172.21.15.57:0/715790146 wait complete. 2023-11-24T08:07:39.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 Processor -- start 2023-11-24T08:07:39.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 -- start start 2023-11-24T08:07:39.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3806d760 0x7f3f38154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f38071e40 0x7f3f3815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d540 0x7f3f38155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38155370 con 0x7f3f3806d760 2023-11-24T08:07:39.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3815f050 con 0x7f3f3815d540 2023-11-24T08:07:39.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f381546f0 con 0x7f3f38071e40 2023-11-24T08:07:39.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3806d760 0x7f3f38154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3806d760 0x7f3f38154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50300/0 (socket says 172.21.15.57:50300) 2023-11-24T08:07:39.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 -- 172.21.15.57:0/1557568147 learned_addr learned my addr 172.21.15.57:0/1557568147 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 -- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f38071e40 msgr2=0x7f3f3815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f38071e40 0x7f3f3815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 -- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d540 msgr2=0x7f3f38155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d540 0x7f3f38155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 -- 172.21.15.57:0/1557568147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009420 con 0x7f3f3806d760 2023-11-24T08:07:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f36d9d640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3806d760 0x7f3f38154080 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c4d0 tx=0x7f3f2800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f2f7fe640 1 -- 172.21.15.57:0/1557568147 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28005cf0 con 0x7f3f3806d760 2023-11-24T08:07:39.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f2f7fe640 1 -- 172.21.15.57:0/1557568147 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28005e50 con 0x7f3f3806d760 2023-11-24T08:07:39.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f2f7fe640 1 -- 172.21.15.57:0/1557568147 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28007270 con 0x7f3f3806d760 2023-11-24T08:07:39.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f30009a70 con 0x7f3f3806d760 2023-11-24T08:07:39.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.815+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f38154cb0 con 0x7f3f3806d760 2023-11-24T08:07:39.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.819+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f381554b0 con 0x7f3f3806d760 2023-11-24T08:07:39.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.819+0000 7f3f2f7fe640 1 -- 172.21.15.57:0/1557568147 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f3f280073d0 con 0x7f3f3806d760 2023-11-24T08:07:39.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.819+0000 7f3f2f7fe640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3f18066620 0x7f3f18068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:39.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.819+0000 7f3f2f7fe640 1 -- 172.21.15.57:0/1557568147 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f280836d0 con 0x7f3f3806d760 2023-11-24T08:07:39.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.819+0000 7f3f2ffff640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3f18066620 0x7f3f18068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:39.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.819+0000 7f3f2ffff640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3f18066620 0x7f3f18068ae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3f20006e90 tx=0x7f3f20006de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:39.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.823+0000 7f3f2f7fe640 1 -- 172.21.15.57:0/1557568147 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f28050970 con 0x7f3f3806d760 2023-11-24T08:07:39.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.979+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f3804e8c0 con 0x7f3f3806d760 2023-11-24T08:07:39.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.979+0000 7f3f2f7fe640 1 -- 172.21.15.57:0/1557568147 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f28053f90 con 0x7f3f3806d760 2023-11-24T08:07:39.985 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:07:39.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3f18066620 msgr2=0x7f3f18068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3f18066620 0x7f3f18068ae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3f20006e90 tx=0x7f3f20006de0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3806d760 msgr2=0x7f3f38154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:39.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3806d760 0x7f3f38154080 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c4d0 tx=0x7f3f2800c990 comp rx=0 tx=0).stop 2023-11-24T08:07:39.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 shutdown_connections 2023-11-24T08:07:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3f18066620 0x7f3f18068ae0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d540 0x7f3f38155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3f38071e40 0x7f3f3815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 --2- 172.21.15.57:0/1557568147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f3806d760 0x7f3f38154080 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:39.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 >> 172.21.15.57:0/1557568147 conn(0x7f3f380b0c80 msgr2=0x7f3f3815c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:39.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 shutdown_connections 2023-11-24T08:07:39.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:39.983+0000 7f3f3d046640 1 -- 172.21.15.57:0/1557568147 wait complete. 2023-11-24T08:07:40.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:07:40.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25496ad640 1 Processor -- start 2023-11-24T08:07:40.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25496ad640 1 -- start start 2023-11-24T08:07:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25496ad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25440cad20 0x7f25440c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25496ad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f254406d740 0x7f254406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25496ad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254406e0d0 con 0x7f254415a4d0 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25496ad640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254415a8b0 con 0x7f25440cad20 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25496ad640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25440c9c30 con 0x7f254406d740 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f2542ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f254415a4d0 0x7f254415e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51182/0 (socket says 172.21.15.57:51182) 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f2542ffd640 1 -- 172.21.15.57:0/1061625204 learned_addr learned my addr 172.21.15.57:0/1061625204 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25427fc640 1 --2- 172.21.15.57:0/1061625204 >> v2:172.21.15.132:3300/0 conn(0x7f25440cad20 0x7f25440c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25437fe640 1 --2- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f254406d740 0x7f254406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f2541ffb640 1 -- 172.21.15.57:0/1061625204 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927557308 0 0) 0x7f2534001120 con 0x7f254415a4d0 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f2541ffb640 1 -- 172.21.15.57:0/1061625204 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f252c005740 con 0x7f254415a4d0 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25427fc640 1 -- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f254406d740 msgr2=0x7f254406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25427fc640 1 --2- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f254406d740 0x7f254406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25427fc640 1 -- 172.21.15.57:0/1061625204 >> v1:172.21.15.57:6789/0 conn(0x7f254415a4d0 legacy=0x7f254415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.147+0000 7f25427fc640 1 -- 172.21.15.57:0/1061625204 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25440c9f60 con 0x7f25440cad20 2023-11-24T08:07:40.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25427fc640 1 --2- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25440cad20 0x7f25440c9650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25380097c0 tx=0x7f253801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921db4336fced2cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f2541ffb640 1 -- 172.21.15.57:0/1061625204 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25380ac620 con 0x7f25440cad20 2023-11-24T08:07:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f2541ffb640 1 -- 172.21.15.57:0/1061625204 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25380ac780 con 0x7f25440cad20 2023-11-24T08:07:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f2541ffb640 1 -- 172.21.15.57:0/1061625204 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25380acb10 con 0x7f25440cad20 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 -- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25440cad20 msgr2=0x7f25440c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 --2- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25440cad20 0x7f25440c9650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25380097c0 tx=0x7f253801c3c0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 -- 172.21.15.57:0/1061625204 shutdown_connections 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 --2- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f254406d740 0x7f254406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 --2- 172.21.15.57:0/1061625204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25440cad20 0x7f25440c9650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 -- 172.21.15.57:0/1061625204 >> 172.21.15.57:0/1061625204 conn(0x7f25440b0bf0 msgr2=0x7f25440b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 -- 172.21.15.57:0/1061625204 shutdown_connections 2023-11-24T08:07:40.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.151+0000 7f25496ad640 1 -- 172.21.15.57:0/1061625204 wait complete. 2023-11-24T08:07:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 Processor -- start 2023-11-24T08:07:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 -- start start 2023-11-24T08:07:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f254406d740 0x7f25440b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25440cad20 0x7f25441516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f254415a4d0 0x7f25440c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25440b2f80 con 0x7f254415a4d0 2023-11-24T08:07:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25440b2300 con 0x7f254406d740 2023-11-24T08:07:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25440b25e0 con 0x7f25440cad20 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f254415a4d0 0x7f25440c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f254415a4d0 0x7f25440c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50308/0 (socket says 172.21.15.57:50308) 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 -- 172.21.15.57:0/78761339 learned_addr learned my addr 172.21.15.57:0/78761339 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f2542ffd640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f254406d740 0x7f25440b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25427fc640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25440cad20 0x7f25441516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 -- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25440cad20 msgr2=0x7f25441516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25440cad20 0x7f25441516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 -- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f254406d740 msgr2=0x7f25440b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f254406d740 0x7f25440b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 -- 172.21.15.57:0/78761339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538009420 con 0x7f254415a4d0 2023-11-24T08:07:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25437fe640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f254415a4d0 0x7f25440c6c90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f253c00efc0 tx=0x7f253c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f252b7fe640 1 -- 172.21.15.57:0/78761339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c014480 con 0x7f254415a4d0 2023-11-24T08:07:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f252b7fe640 1 -- 172.21.15.57:0/78761339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c00f040 con 0x7f254415a4d0 2023-11-24T08:07:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f252b7fe640 1 -- 172.21.15.57:0/78761339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c014820 con 0x7f254415a4d0 2023-11-24T08:07:40.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25440b28c0 con 0x7f254415a4d0 2023-11-24T08:07:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2544151c10 con 0x7f254415a4d0 2023-11-24T08:07:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.155+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25440b30c0 con 0x7f254415a4d0 2023-11-24T08:07:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.159+0000 7f252b7fe640 1 -- 172.21.15.57:0/78761339 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f253c014980 con 0x7f254415a4d0 2023-11-24T08:07:40.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.159+0000 7f252b7fe640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2530066620 0x7f2530068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.159+0000 7f252b7fe640 1 -- 172.21.15.57:0/78761339 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f253c084c20 con 0x7f254415a4d0 2023-11-24T08:07:40.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.159+0000 7f2542ffd640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2530066620 0x7f2530068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.159+0000 7f2542ffd640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2530066620 0x7f2530068ae0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2534001280 tx=0x7f2534007bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.163+0000 7f252b7fe640 1 -- 172.21.15.57:0/78761339 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25440b30c0 con 0x7f254415a4d0 2023-11-24T08:07:40.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25440b30c0 con 0x7f254415a4d0 2023-11-24T08:07:40.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f252b7fe640 1 -- 172.21.15.57:0/78761339 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25440b30c0 con 0x7f254415a4d0 2023-11-24T08:07:40.339 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2023-11-24T08:07:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2530066620 msgr2=0x7f2530068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2530066620 0x7f2530068ae0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2534001280 tx=0x7f2534007bc0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f254415a4d0 msgr2=0x7f25440c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f254415a4d0 0x7f25440c6c90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f253c00efc0 tx=0x7f253c00c490 comp rx=0 tx=0).stop 2023-11-24T08:07:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 shutdown_connections 2023-11-24T08:07:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f2530066620 0x7f2530068ae0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f254415a4d0 0x7f25440c6c90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25440cad20 0x7f25441516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 --2- 172.21.15.57:0/78761339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f254406d740 0x7f25440b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 >> 172.21.15.57:0/78761339 conn(0x7f25440b0bf0 msgr2=0x7f25440af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 shutdown_connections 2023-11-24T08:07:40.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.335+0000 7f25496ad640 1 -- 172.21.15.57:0/78761339 wait complete. 2023-11-24T08:07:40.361 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T08:07:40.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:40.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T08:07:40.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:07:40.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:40.391 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:07:40.444 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:40.444 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:40.453 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:07:40.454 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:40.454 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:40.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:07:40.496 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:40.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.635+0000 7f137b59e640 1 Processor -- start 2023-11-24T08:07:40.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.635+0000 7f137b59e640 1 -- start start 2023-11-24T08:07:40.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137b59e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f137c144a10 0x7f137c06c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137b59e640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c144800 con 0x7f137c0b1190 2023-11-24T08:07:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137b59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c0ceb80 con 0x7f137c144420 2023-11-24T08:07:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137b59e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c06ccf0 con 0x7f137c144a10 2023-11-24T08:07:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f1379d9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f137c0b1190 0x7f137c0b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51186/0 (socket says 172.21.15.57:51186) 2023-11-24T08:07:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f1379d9b640 1 -- 172.21.15.57:0/3747356366 learned_addr learned my addr 172.21.15.57:0/3747356366 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137ad9d640 1 --2- 172.21.15.57:0/3747356366 >> v2:172.21.15.57:3300/0 conn(0x7f137c144a10 0x7f137c06c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137959a640 1 -- 172.21.15.57:0/3747356366 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572098922 0 0) 0x7f137c144800 con 0x7f137c0b1190 2023-11-24T08:07:40.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137959a640 1 -- 172.21.15.57:0/3747356366 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1364003530 con 0x7f137c0b1190 2023-11-24T08:07:40.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137959a640 1 -- 172.21.15.57:0/3747356366 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809344281 0 0) 0x7f137c0ceb80 con 0x7f137c144420 2023-11-24T08:07:40.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137ad9d640 1 -- 172.21.15.57:0/3747356366 >> v1:172.21.15.132:6789/0 conn(0x7f137c144420 legacy=0x7f137c0b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137ad9d640 1 -- 172.21.15.57:0/3747356366 >> v1:172.21.15.57:6789/0 conn(0x7f137c0b1190 legacy=0x7f137c0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.639+0000 7f137ad9d640 1 -- 172.21.15.57:0/3747356366 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c06cfd0 con 0x7f137c144a10 2023-11-24T08:07:40.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137ad9d640 1 --2- 172.21.15.57:0/3747356366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144a10 0x7f137c06c660 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d90 tx=0x7f137401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59ad6d8bab6f3cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137959a640 1 -- 172.21.15.57:0/3747356366 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740a5810 con 0x7f137c144a10 2023-11-24T08:07:40.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137959a640 1 -- 172.21.15.57:0/3747356366 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740a5970 con 0x7f137c144a10 2023-11-24T08:07:40.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137959a640 1 -- 172.21.15.57:0/3747356366 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740a5d00 con 0x7f137c144a10 2023-11-24T08:07:40.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 -- 172.21.15.57:0/3747356366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144a10 msgr2=0x7f137c06c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 --2- 172.21.15.57:0/3747356366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144a10 0x7f137c06c660 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d90 tx=0x7f137401c950 comp rx=0 tx=0).stop 2023-11-24T08:07:40.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 -- 172.21.15.57:0/3747356366 shutdown_connections 2023-11-24T08:07:40.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 --2- 172.21.15.57:0/3747356366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144a10 0x7f137c06c660 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 -- 172.21.15.57:0/3747356366 >> 172.21.15.57:0/3747356366 conn(0x7f137c0cb840 msgr2=0x7f137c0cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 -- 172.21.15.57:0/3747356366 shutdown_connections 2023-11-24T08:07:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 -- 172.21.15.57:0/3747356366 wait complete. 2023-11-24T08:07:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 Processor -- start 2023-11-24T08:07:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.643+0000 7f137b59e640 1 -- start start 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f137c0b1190 0x7f137c1379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144420 0x7f137c141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137c144a10 0x7f137c0cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c141960 con 0x7f137c144420 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c9060 con 0x7f137c144a10 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c9340 con 0x7f137c0b1190 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144420 0x7f137c141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144420 0x7f137c141df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50316/0 (socket says 172.21.15.57:50316) 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 -- 172.21.15.57:0/4245487179 learned_addr learned my addr 172.21.15.57:0/4245487179 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137ad9d640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137c144a10 0x7f137c0cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137a59c640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f137c0b1190 0x7f137c1379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 -- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f137c0b1190 msgr2=0x7f137c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f137c0b1190 0x7f137c1379f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 -- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137c144a10 msgr2=0x7f137c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137c144a10 0x7f137c0cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 -- 172.21.15.57:0/4245487179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009a70 con 0x7f137c144420 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f1379d9b640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144420 0x7f137c141df0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f137000c450 tx=0x7f137000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f136affd640 1 -- 172.21.15.57:0/4245487179 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370005cf0 con 0x7f137c144420 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f136affd640 1 -- 172.21.15.57:0/4245487179 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370005e50 con 0x7f137c144420 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f136affd640 1 -- 172.21.15.57:0/4245487179 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370007290 con 0x7f137c144420 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c0c9620 con 0x7f137c144420 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c15ad80 con 0x7f137c144420 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.647+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c04e850 con 0x7f137c144420 2023-11-24T08:07:40.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.651+0000 7f136affd640 1 -- 172.21.15.57:0/4245487179 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f13700073f0 con 0x7f137c144420 2023-11-24T08:07:40.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.651+0000 7f136affd640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f135c066620 0x7f135c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:40.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.651+0000 7f136affd640 1 -- 172.21.15.57:0/4245487179 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1370083800 con 0x7f137c144420 2023-11-24T08:07:40.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.651+0000 7f137a59c640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f135c066620 0x7f135c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:40.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.651+0000 7f137a59c640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f135c066620 0x7f135c068ae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f136c000f70 tx=0x7f136c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:40.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.655+0000 7f136affd640 1 -- 172.21.15.57:0/4245487179 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1370050960 con 0x7f137c144420 2023-11-24T08:07:40.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f137c06d890 con 0x7f137c144420 2023-11-24T08:07:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f136affd640 1 -- 172.21.15.57:0/4245487179 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f1370017020 con 0x7f137c144420 2023-11-24T08:07:40.855 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:40.855 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/4096569691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4096569691},{"type":"v1","addr":"172.21.15.57:6834","nonce":4096569691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/671957004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":671957004},{"type":"v1","addr":"172.21.15.57:6835","nonce":671957004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6165,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1925156645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1925156645},{"type":"v1","addr":"172.21.15.132:6837","nonce":1925156645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:26.096476+0000","modified":"2023-11-24T08:07:29.117899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55373":{"gid":55373,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1683487539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1683487539},{"type":"v1","addr":"172.21.15.132:6836","nonce":1683487539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2023-11-24T08:07:40.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f135c066620 msgr2=0x7f135c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f135c066620 0x7f135c068ae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f136c000f70 tx=0x7f136c009040 comp rx=0 tx=0).stop 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144420 msgr2=0x7f137c141df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144420 0x7f137c141df0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f137000c450 tx=0x7f137000c910 comp rx=0 tx=0).stop 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 shutdown_connections 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f135c066620 0x7f135c068ae0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f137c144a10 0x7f137c0cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f137c144420 0x7f137c141df0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 --2- 172.21.15.57:0/4245487179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f137c0b1190 0x7f137c1379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.851+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 >> 172.21.15.57:0/4245487179 conn(0x7f137c0cb840 msgr2=0x7f137c0b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.855+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 shutdown_connections 2023-11-24T08:07:40.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:40.855+0000 7f137b59e640 1 -- 172.21.15.57:0/4245487179 wait complete. 2023-11-24T08:07:40.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:41.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 Processor -- start 2023-11-24T08:07:41.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 -- start start 2023-11-24T08:07:41.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc158a50 0x7efdfc06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efdfc06e340 0x7efdfc0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efdfc06cb90 0x7efdfc070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc06e0b0 con 0x7efdfc06e340 2023-11-24T08:07:41.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc06dc20 con 0x7efdfc06cb90 2023-11-24T08:07:41.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.015+0000 7efe03701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0b3620 con 0x7efdfc158a50 2023-11-24T08:07:41.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efdfc06e340 0x7efdfc0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efdfc06e340 0x7efdfc0707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50320/0 (socket says 172.21.15.57:50320) 2023-11-24T08:07:41.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 -- 172.21.15.57:0/1405777212 learned_addr learned my addr 172.21.15.57:0/1405777212 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:41.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe01c9e640 1 --2- 172.21.15.57:0/1405777212 >> v2:172.21.15.132:3300/0 conn(0x7efdfc06cb90 0x7efdfc070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe0149d640 1 --2- 172.21.15.57:0/1405777212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc158a50 0x7efdfc06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 -- 172.21.15.57:0/1405777212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc158a50 msgr2=0x7efdfc06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 --2- 172.21.15.57:0/1405777212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc158a50 0x7efdfc06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 -- 172.21.15.57:0/1405777212 >> v2:172.21.15.132:3300/0 conn(0x7efdfc06cb90 msgr2=0x7efdfc070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 --2- 172.21.15.57:0/1405777212 >> v2:172.21.15.132:3300/0 conn(0x7efdfc06cb90 0x7efdfc070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 -- 172.21.15.57:0/1405777212 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc158e30 con 0x7efdfc06e340 2023-11-24T08:07:41.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe01c9e640 1 --2- 172.21.15.57:0/1405777212 >> v2:172.21.15.132:3300/0 conn(0x7efdfc06cb90 0x7efdfc070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe0149d640 1 --2- 172.21.15.57:0/1405777212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc158a50 0x7efdfc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efe00c9c640 1 --2- 172.21.15.57:0/1405777212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc06e340 0x7efdfc0707b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efdfc06b5e0 tx=0x7efdec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994e3ddeda496842 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efdf3fff640 1 -- 172.21.15.57:0/1405777212 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0aa5f0 con 0x7efdfc06e340 2023-11-24T08:07:41.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efdf3fff640 1 -- 172.21.15.57:0/1405777212 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec0aa750 con 0x7efdfc06e340 2023-11-24T08:07:41.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.019+0000 7efdf3fff640 1 -- 172.21.15.57:0/1405777212 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0aaae0 con 0x7efdfc06e340 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- 172.21.15.57:0/1405777212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc06e340 msgr2=0x7efdfc0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 --2- 172.21.15.57:0/1405777212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc06e340 0x7efdfc0707b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efdfc06b5e0 tx=0x7efdec01c4d0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- 172.21.15.57:0/1405777212 shutdown_connections 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 --2- 172.21.15.57:0/1405777212 >> v2:172.21.15.132:3300/0 conn(0x7efdfc06cb90 0x7efdfc070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 --2- 172.21.15.57:0/1405777212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc06e340 0x7efdfc0707b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 --2- 172.21.15.57:0/1405777212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc158a50 0x7efdfc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- 172.21.15.57:0/1405777212 >> 172.21.15.57:0/1405777212 conn(0x7efdfc0b0bf0 msgr2=0x7efdfc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- 172.21.15.57:0/1405777212 shutdown_connections 2023-11-24T08:07:41.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- 172.21.15.57:0/1405777212 wait complete. 2023-11-24T08:07:41.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 Processor -- start 2023-11-24T08:07:41.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- start start 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdfc06cb90 0x7efdfc0ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc06e340 0x7efdfc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc158a50 0x7efdfc153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0ad710 con 0x7efdfc158a50 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1615f0 con 0x7efdfc06cb90 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe03701640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc152a90 con 0x7efdfc06e340 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc158a50 0x7efdfc153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc158a50 0x7efdfc153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50328/0 (socket says 172.21.15.57:50328) 2023-11-24T08:07:41.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 -- 172.21.15.57:0/1423164873 learned_addr learned my addr 172.21.15.57:0/1423164873 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe0149d640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdfc06cb90 0x7efdfc0ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe00c9c640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc06e340 0x7efdfc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 -- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc06e340 msgr2=0x7efdfc152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc06e340 0x7efdfc152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 -- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdfc06cb90 msgr2=0x7efdfc0ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdfc06cb90 0x7efdfc0ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe01c9e640 1 -- 172.21.15.57:0/1423164873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0094d0 con 0x7efdfc158a50 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe0149d640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdfc06cb90 0x7efdfc0ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.023+0000 7efe00c9c640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc06e340 0x7efdfc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efe01c9e640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc158a50 0x7efdfc153f90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efdf400ccd0 tx=0x7efdf400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efdf1ffb640 1 -- 172.21.15.57:0/1423164873 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400f680 con 0x7efdfc158a50 2023-11-24T08:07:41.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efdf1ffb640 1 -- 172.21.15.57:0/1423164873 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400f800 con 0x7efdfc158a50 2023-11-24T08:07:41.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efdf1ffb640 1 -- 172.21.15.57:0/1423164873 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400fbb0 con 0x7efdfc158a50 2023-11-24T08:07:41.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc1544d0 con 0x7efdfc158a50 2023-11-24T08:07:41.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc1539d0 con 0x7efdfc158a50 2023-11-24T08:07:41.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc15c610 con 0x7efdfc158a50 2023-11-24T08:07:41.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efdf1ffb640 1 -- 172.21.15.57:0/1423164873 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7efdf400b040 con 0x7efdfc158a50 2023-11-24T08:07:41.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efdf1ffb640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efde0066670 0x7efde0068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efdf1ffb640 1 -- 172.21.15.57:0/1423164873 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdf4084c10 con 0x7efdfc158a50 2023-11-24T08:07:41.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.027+0000 7efe0149d640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efde0066670 0x7efde0068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.031+0000 7efe0149d640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efde0066670 0x7efde0068b30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efdf8006fd0 tx=0x7efdf8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.031+0000 7efdf1ffb640 1 -- 172.21.15.57:0/1423164873 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efdfc15c610 con 0x7efdfc158a50 2023-11-24T08:07:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.191+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdfc15c610 con 0x7efdfc158a50 2023-11-24T08:07:41.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.191+0000 7efdf1ffb640 1 -- 172.21.15.57:0/1423164873 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16505 (secure 0 0 0) 0x7efdfc15c610 con 0x7efdfc158a50 2023-11-24T08:07:41.195 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:41.195 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":61,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:27.714748+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efde0066670 msgr2=0x7efde0068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efde0066670 0x7efde0068b30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efdf8006fd0 tx=0x7efdf8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc158a50 msgr2=0x7efdfc153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc158a50 0x7efdfc153f90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efdf400ccd0 tx=0x7efdf400a650 comp rx=0 tx=0).stop 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 shutdown_connections 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7efde0066670 0x7efde0068b30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdfc158a50 0x7efdfc153f90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdfc06e340 0x7efdfc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 --2- 172.21.15.57:0/1423164873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdfc06cb90 0x7efdfc0ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 >> 172.21.15.57:0/1423164873 conn(0x7efdfc0b0bf0 msgr2=0x7efdfc163060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 shutdown_connections 2023-11-24T08:07:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.195+0000 7efe03701640 1 -- 172.21.15.57:0/1423164873 wait complete. 2023-11-24T08:07:41.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:03:46.767172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:07:24.498448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:07:25.096379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:07:41.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:07:41.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb28246640 1 Processor -- start 2023-11-24T08:07:41.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb28246640 1 -- start start 2023-11-24T08:07:41.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb28246640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb2015a290 0x7fbb200707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb28246640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb200b1f80 0x7fbb200b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb28246640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb20071170 con 0x7fbb2015ec60 2023-11-24T08:07:41.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb28246640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200cb690 con 0x7fbb2015a290 2023-11-24T08:07:41.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb28246640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200cb970 con 0x7fbb200b1f80 2023-11-24T08:07:41.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb267e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb200b1f80 0x7fbb200b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb267e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb200b1f80 0x7fbb200b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:43498/0 (socket says 172.21.15.57:43498) 2023-11-24T08:07:41.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb267e3640 1 -- 172.21.15.57:0/3676255905 learned_addr learned my addr 172.21.15.57:0/3676255905 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:41.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb257e1640 1 --1- 172.21.15.57:0/3676255905 >> v1:172.21.15.132:6789/0 conn(0x7fbb2015ec60 0x7fbb200cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:46014/0 (socket says 172.21.15.57:46014) 2023-11-24T08:07:41.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.359+0000 7fbb25fe2640 1 --2- 172.21.15.57:0/3676255905 >> v2:172.21.15.132:3300/0 conn(0x7fbb2015a290 0x7fbb200707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb24fe0640 1 -- 172.21.15.57:0/3676255905 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482787848 0 0) 0x7fbb20071170 con 0x7fbb2015ec60 2023-11-24T08:07:41.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb24fe0640 1 -- 172.21.15.57:0/3676255905 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb0c003530 con 0x7fbb2015ec60 2023-11-24T08:07:41.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb267e3640 1 -- 172.21.15.57:0/3676255905 >> v2:172.21.15.132:3300/0 conn(0x7fbb2015a290 msgr2=0x7fbb200707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb267e3640 1 --2- 172.21.15.57:0/3676255905 >> v2:172.21.15.132:3300/0 conn(0x7fbb2015a290 0x7fbb200707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb267e3640 1 -- 172.21.15.57:0/3676255905 >> v1:172.21.15.132:6789/0 conn(0x7fbb2015ec60 legacy=0x7fbb200cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb267e3640 1 -- 172.21.15.57:0/3676255905 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200cbc50 con 0x7fbb200b1f80 2023-11-24T08:07:41.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb25fe2640 1 --2- 172.21.15.57:0/3676255905 >> v2:172.21.15.132:3300/0 conn(0x7fbb2015a290 0x7fbb200707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:41.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb267e3640 1 --2- 172.21.15.57:0/3676255905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb200b1f80 0x7fbb200b23f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009e50 tx=0x7fbb1801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ad2af5cf0c5aff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb24fe0640 1 -- 172.21.15.57:0/3676255905 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180a5750 con 0x7fbb200b1f80 2023-11-24T08:07:41.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb24fe0640 1 -- 172.21.15.57:0/3676255905 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb180a58b0 con 0x7fbb200b1f80 2023-11-24T08:07:41.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.363+0000 7fbb24fe0640 1 -- 172.21.15.57:0/3676255905 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180a5c20 con 0x7fbb200b1f80 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- 172.21.15.57:0/3676255905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb200b1f80 msgr2=0x7fbb200b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 --2- 172.21.15.57:0/3676255905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb200b1f80 0x7fbb200b23f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009e50 tx=0x7fbb1801c980 comp rx=0 tx=0).stop 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- 172.21.15.57:0/3676255905 shutdown_connections 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 --2- 172.21.15.57:0/3676255905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb200b1f80 0x7fbb200b23f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 --2- 172.21.15.57:0/3676255905 >> v2:172.21.15.132:3300/0 conn(0x7fbb2015a290 0x7fbb200707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- 172.21.15.57:0/3676255905 >> 172.21.15.57:0/3676255905 conn(0x7fbb200b0c80 msgr2=0x7fbb200b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- 172.21.15.57:0/3676255905 shutdown_connections 2023-11-24T08:07:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- 172.21.15.57:0/3676255905 wait complete. 2023-11-24T08:07:41.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 Processor -- start 2023-11-24T08:07:41.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- start start 2023-11-24T08:07:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb200b1f80 0x7fbb200988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb2015a290 0x7fbb20155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb2015ec60 0x7fbb20157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20154be0 con 0x7fbb200b1f80 2023-11-24T08:07:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20158a50 con 0x7fbb2015a290 2023-11-24T08:07:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb28246640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20154590 con 0x7fbb2015ec60 2023-11-24T08:07:41.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb25fe2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb200b1f80 0x7fbb200988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb25fe2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb200b1f80 0x7fbb200988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50338/0 (socket says 172.21.15.57:50338) 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.367+0000 7fbb25fe2640 1 -- 172.21.15.57:0/3924850765 learned_addr learned my addr 172.21.15.57:0/3924850765 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb267e3640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb2015ec60 0x7fbb20157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb257e1640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb2015a290 0x7fbb20155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb25fe2640 1 -- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb2015ec60 msgr2=0x7fbb20157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb25fe2640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb2015ec60 0x7fbb20157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb25fe2640 1 -- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb2015a290 msgr2=0x7fbb20155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb25fe2640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb2015a290 0x7fbb20155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb25fe2640 1 -- 172.21.15.57:0/3924850765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c00b6c0 con 0x7fbb200b1f80 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb267e3640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb2015ec60 0x7fbb20157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb257e1640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb2015a290 0x7fbb20155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb25fe2640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb200b1f80 0x7fbb200988b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00ed40 tx=0x7fbb1c00d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb167fc640 1 -- 172.21.15.57:0/3924850765 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c010850 con 0x7fbb200b1f80 2023-11-24T08:07:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb167fc640 1 -- 172.21.15.57:0/3924850765 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0109b0 con 0x7fbb200b1f80 2023-11-24T08:07:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb18009b30 con 0x7fbb200b1f80 2023-11-24T08:07:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb167fc640 1 -- 172.21.15.57:0/3924850765 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c010d20 con 0x7fbb200b1f80 2023-11-24T08:07:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb20070f40 con 0x7fbb200b1f80 2023-11-24T08:07:41.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2004e8c0 con 0x7fbb200b1f80 2023-11-24T08:07:41.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb167fc640 1 -- 172.21.15.57:0/3924850765 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fbb1c00f3d0 con 0x7fbb200b1f80 2023-11-24T08:07:41.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb167fc640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb04066620 0x7fbb04068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.371+0000 7fbb167fc640 1 -- 172.21.15.57:0/3924850765 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb1c084d60 con 0x7fbb200b1f80 2023-11-24T08:07:41.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.375+0000 7fbb257e1640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb04066620 0x7fbb04068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.375+0000 7fbb257e1640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb04066620 0x7fbb04068ae0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbb200cb260 tx=0x7fbb10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.375+0000 7fbb167fc640 1 -- 172.21.15.57:0/3924850765 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb1c051f00 con 0x7fbb200b1f80 2023-11-24T08:07:41.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb2015e130 con 0x7fbb200b1f80 2023-11-24T08:07:41.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb167fc640 1 -- 172.21.15.57:0/3924850765 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb1c055520 con 0x7fbb200b1f80 2023-11-24T08:07:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-11-24T08:07:41.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb04066620 msgr2=0x7fbb04068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb04066620 0x7fbb04068ae0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbb200cb260 tx=0x7fbb10009040 comp rx=0 tx=0).stop 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb200b1f80 msgr2=0x7fbb200988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb200b1f80 0x7fbb200988b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00ed40 tx=0x7fbb1c00d720 comp rx=0 tx=0).stop 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 shutdown_connections 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbb04066620 0x7fbb04068ae0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb2015ec60 0x7fbb20157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb2015a290 0x7fbb20155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 --2- 172.21.15.57:0/3924850765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb200b1f80 0x7fbb200988b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.535+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 >> 172.21.15.57:0/3924850765 conn(0x7fbb200b0c80 msgr2=0x7fbb200b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.539+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 shutdown_connections 2023-11-24T08:07:41.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.539+0000 7fbb28246640 1 -- 172.21.15.57:0/3924850765 wait complete. 2023-11-24T08:07:41.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:07:41.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 Processor -- start 2023-11-24T08:07:41.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 -- start start 2023-11-24T08:07:41.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14b815d540 0x7f14b806d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b8071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14b8071e40 0x7f14b81611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b806d9f0 con 0x7f14b815d540 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80cd400 con 0x7f14b8071e40 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14be50f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8072860 con 0x7f14b806d590 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14b815d540 0x7f14b806d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14b815d540 0x7f14b806d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50354/0 (socket says 172.21.15.57:50354) 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 -- 172.21.15.57:0/2622351764 learned_addr learned my addr 172.21.15.57:0/2622351764 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14bcaac640 1 --2- 172.21.15.57:0/2622351764 >> v2:172.21.15.132:3300/0 conn(0x7f14b8071e40 0x7f14b81611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b77fe640 1 --2- 172.21.15.57:0/2622351764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 -- 172.21.15.57:0/2622351764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 msgr2=0x7f14b8071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 --2- 172.21.15.57:0/2622351764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b8071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 -- 172.21.15.57:0/2622351764 >> v2:172.21.15.132:3300/0 conn(0x7f14b8071e40 msgr2=0x7f14b81611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:41.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 --2- 172.21.15.57:0/2622351764 >> v2:172.21.15.132:3300/0 conn(0x7f14b8071e40 0x7f14b81611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.703+0000 7f14b7fff640 1 -- 172.21.15.57:0/2622351764 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b806dc30 con 0x7f14b815d540 2023-11-24T08:07:41.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14b7fff640 1 --2- 172.21.15.57:0/2622351764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b815d540 0x7f14b806d050 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f14b806e520 tx=0x7f14a801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479b0876882665cd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14b6ffd640 1 -- 172.21.15.57:0/2622351764 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80ab600 con 0x7f14b815d540 2023-11-24T08:07:41.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14b6ffd640 1 -- 172.21.15.57:0/2622351764 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a80a7050 con 0x7f14b815d540 2023-11-24T08:07:41.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14b6ffd640 1 -- 172.21.15.57:0/2622351764 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80ab980 con 0x7f14b815d540 2023-11-24T08:07:41.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 -- 172.21.15.57:0/2622351764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b815d540 msgr2=0x7f14b806d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 --2- 172.21.15.57:0/2622351764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b815d540 0x7f14b806d050 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f14b806e520 tx=0x7f14a801c240 comp rx=0 tx=0).stop 2023-11-24T08:07:41.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 -- 172.21.15.57:0/2622351764 shutdown_connections 2023-11-24T08:07:41.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 --2- 172.21.15.57:0/2622351764 >> v2:172.21.15.132:3300/0 conn(0x7f14b8071e40 0x7f14b81611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 --2- 172.21.15.57:0/2622351764 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b8071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 --2- 172.21.15.57:0/2622351764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b815d540 0x7f14b806d050 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 -- 172.21.15.57:0/2622351764 >> 172.21.15.57:0/2622351764 conn(0x7f14b80b0c80 msgr2=0x7f14b80b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 -- 172.21.15.57:0/2622351764 shutdown_connections 2023-11-24T08:07:41.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.707+0000 7f14be50f640 1 -- 172.21.15.57:0/2622351764 wait complete. 2023-11-24T08:07:41.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 Processor -- start 2023-11-24T08:07:41.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 -- start start 2023-11-24T08:07:41.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b8071e40 0x7f14b8160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b815d540 0x7f14b815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8147d50 con 0x7f14b8071e40 2023-11-24T08:07:41.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8151ef0 con 0x7f14b815d540 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b81512e0 con 0x7f14b806d590 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b8071e40 0x7f14b8160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b8071e40 0x7f14b8160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50368/0 (socket says 172.21.15.57:50368) 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 -- 172.21.15.57:0/4273235877 learned_addr learned my addr 172.21.15.57:0/4273235877 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b7fff640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14bcaac640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b815d540 0x7f14b815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 -- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 msgr2=0x7f14b815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 -- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b815d540 msgr2=0x7f14b815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b815d540 0x7f14b815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 -- 172.21.15.57:0/4273235877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80094d0 con 0x7f14b8071e40 2023-11-24T08:07:41.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14bcaac640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b815d540 0x7f14b815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:41.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b7fff640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:41.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b77fe640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b8071e40 0x7f14b8160460 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00d800 tx=0x7f14ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b4ff9640 1 -- 172.21.15.57:0/4273235877 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0096a0 con 0x7f14b8071e40 2023-11-24T08:07:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b4ff9640 1 -- 172.21.15.57:0/4273235877 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac009800 con 0x7f14b8071e40 2023-11-24T08:07:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14b4ff9640 1 -- 172.21.15.57:0/4273235877 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac009b70 con 0x7f14b8071e40 2023-11-24T08:07:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b81515c0 con 0x7f14b8071e40 2023-11-24T08:07:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.711+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b8151b80 con 0x7f14b8071e40 2023-11-24T08:07:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.715+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b80cd870 con 0x7f14b8071e40 2023-11-24T08:07:41.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.715+0000 7f14b4ff9640 1 -- 172.21.15.57:0/4273235877 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f14ac009cd0 con 0x7f14b8071e40 2023-11-24T08:07:41.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.715+0000 7f14b4ff9640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14a4066620 0x7f14a4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:41.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.715+0000 7f14b4ff9640 1 -- 172.21.15.57:0/4273235877 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14ac084880 con 0x7f14b8071e40 2023-11-24T08:07:41.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.715+0000 7f14b7fff640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14a4066620 0x7f14a4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:41.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.719+0000 7f14b7fff640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14a4066620 0x7f14a4068ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14a80ad000 tx=0x7f14a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:41.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.719+0000 7f14b4ff9640 1 -- 172.21.15.57:0/4273235877 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14b80cd870 con 0x7f14b8071e40 2023-11-24T08:07:41.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.879+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14b80cd870 con 0x7f14b8071e40 2023-11-24T08:07:41.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.879+0000 7f14b4ff9640 1 -- 172.21.15.57:0/4273235877 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14b80cd870 con 0x7f14b8071e40 2023-11-24T08:07:41.884 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14a4066620 msgr2=0x7f14a4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14a4066620 0x7f14a4068ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14a80ad000 tx=0x7f14a8008040 comp rx=0 tx=0).stop 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b8071e40 msgr2=0x7f14b8160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b8071e40 0x7f14b8160460 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00d800 tx=0x7f14ac00dcc0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 shutdown_connections 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14a4066620 0x7f14a4068ae0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b815d540 0x7f14b815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14b8071e40 0x7f14b8160460 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 --2- 172.21.15.57:0/4273235877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14b806d590 0x7f14b815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 >> 172.21.15.57:0/4273235877 conn(0x7f14b80b0c80 msgr2=0x7f14b80ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 shutdown_connections 2023-11-24T08:07:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:41.883+0000 7f14be50f640 1 -- 172.21.15.57:0/4273235877 wait complete. 2023-11-24T08:07:41.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:07:42.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b8ae79640 1 Processor -- start 2023-11-24T08:07:42.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b8ae79640 1 -- start start 2023-11-24T08:07:42.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b8ae79640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b840ae4a0 0x7f3b8415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b8ae79640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b840b3510 con 0x7f3b840cd850 2023-11-24T08:07:42.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b8ae79640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b840b37f0 con 0x7f3b840ce420 2023-11-24T08:07:42.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b8ae79640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840b3ad0 con 0x7f3b840ae4a0 2023-11-24T08:07:42.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b83fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3b840cd850 0x7f3b840cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51196/0 (socket says 172.21.15.57:51196) 2023-11-24T08:07:42.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b83fff640 1 -- 172.21.15.57:0/502774154 learned_addr learned my addr 172.21.15.57:0/502774154 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:42.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.047+0000 7f3b88c15640 1 --2- 172.21.15.57:0/502774154 >> v2:172.21.15.132:3300/0 conn(0x7f3b840ae4a0 0x7f3b8415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041478702 0 0) 0x7f3b840b3510 con 0x7f3b840cd850 2023-11-24T08:07:42.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b74003530 con 0x7f3b840cd850 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146896355 0 0) 0x7f3b840b37f0 con 0x7f3b840ce420 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b840b3510 con 0x7f3b840ce420 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018042813 0 0) 0x7f3b74003530 con 0x7f3b840cd850 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 >> v2:172.21.15.132:3300/0 conn(0x7f3b840ae4a0 msgr2=0x7f3b8415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 --2- 172.21.15.57:0/502774154 >> v2:172.21.15.132:3300/0 conn(0x7f3b840ae4a0 0x7f3b8415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 >> v1:172.21.15.132:6789/0 conn(0x7f3b840ce420 legacy=0x7f3b8406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840b3db0 con 0x7f3b840cd850 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f3b70001680 con 0x7f3b840cd850 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b88c15640 1 --2- 172.21.15.57:0/502774154 >> v2:172.21.15.132:3300/0 conn(0x7f3b840ae4a0 0x7f3b8415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 >> v1:172.21.15.57:6789/0 conn(0x7f3b840cd850 legacy=0x7f3b840cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b74003b10 0x7f3b74003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b74004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b74005190 0x7f3b7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840b3ad0 con 0x7f3b740047d0 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7400c010 con 0x7f3b74003b10 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7400c1d0 con 0x7f3b74005190 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b83fff640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b74004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b88c15640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b74003b10 0x7f3b74003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b89416640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b74005190 0x7f3b7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b83fff640 1 -- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b74005190 msgr2=0x7f3b7400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b83fff640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b74005190 0x7f3b7400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b83fff640 1 -- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b74003b10 msgr2=0x7f3b74003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b83fff640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b74003b10 0x7f3b74003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b83fff640 1 -- 172.21.15.57:0/502774154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74003530 con 0x7f3b740047d0 2023-11-24T08:07:42.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.051+0000 7f3b89416640 1 -- 172.21.15.57:0/502774154 reap_dead start 2023-11-24T08:07:42.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b83fff640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b74004c50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3b840cdcc0 tx=0x7f3b7001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529bc79118283e3f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700058e0 con 0x7f3b740047d0 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b70005a60 con 0x7f3b740047d0 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b837fe640 1 -- 172.21.15.57:0/502774154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70005e50 con 0x7f3b740047d0 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- 172.21.15.57:0/502774154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 msgr2=0x7f3b74004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b74004c50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3b840cdcc0 tx=0x7f3b7001cb40 comp rx=0 tx=0).stop 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- 172.21.15.57:0/502774154 shutdown_connections 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/502774154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b74004c50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- 172.21.15.57:0/502774154 >> 172.21.15.57:0/502774154 conn(0x7f3b840b0c80 msgr2=0x7f3b840b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- 172.21.15.57:0/502774154 shutdown_connections 2023-11-24T08:07:42.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- 172.21.15.57:0/502774154 wait complete. 2023-11-24T08:07:42.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 Processor -- start 2023-11-24T08:07:42.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- start start 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b8415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b8413fd10 0x7f3b841542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b84154830 0x7f3b841517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8415c980 con 0x7f3b740047d0 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8415cc60 con 0x7f3b8413fd10 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.055+0000 7f3b8ae79640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8415cf40 con 0x7f3b84154830 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b8415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b8415dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50392/0 (socket says 172.21.15.57:50392) 2023-11-24T08:07:42.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 -- 172.21.15.57:0/3017180905 learned_addr learned my addr 172.21.15.57:0/3017180905 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b83fff640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b8413fd10 0x7f3b841542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b89416640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b84154830 0x7f3b841517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 -- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b84154830 msgr2=0x7f3b841517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b84154830 0x7f3b841517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 -- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b8413fd10 msgr2=0x7f3b841542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b8413fd10 0x7f3b841542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 -- 172.21.15.57:0/3017180905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8415d220 con 0x7f3b740047d0 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b89416640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b84154830 0x7f3b841517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:42.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b88c15640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b8415dd00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3b78011cd0 tx=0x7f3b7800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b817fa640 1 -- 172.21.15.57:0/3017180905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78011e80 con 0x7f3b740047d0 2023-11-24T08:07:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b817fa640 1 -- 172.21.15.57:0/3017180905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78004020 con 0x7f3b740047d0 2023-11-24T08:07:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8415d500 con 0x7f3b740047d0 2023-11-24T08:07:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b817fa640 1 -- 172.21.15.57:0/3017180905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780043b0 con 0x7f3b740047d0 2023-11-24T08:07:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8415e240 con 0x7f3b740047d0 2023-11-24T08:07:42.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8404e8c0 con 0x7f3b740047d0 2023-11-24T08:07:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.059+0000 7f3b817fa640 1 -- 172.21.15.57:0/3017180905 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f3b78003620 con 0x7f3b740047d0 2023-11-24T08:07:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.063+0000 7f3b817fa640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3b68066650 0x7f3b68068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.063+0000 7f3b817fa640 1 -- 172.21.15.57:0/3017180905 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b780848d0 con 0x7f3b740047d0 2023-11-24T08:07:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.063+0000 7f3b83fff640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3b68066650 0x7f3b68068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.063+0000 7f3b83fff640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3b68066650 0x7f3b68068b10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3b700aa000 tx=0x7f3b70001a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.063+0000 7f3b817fa640 1 -- 172.21.15.57:0/3017180905 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b78051b70 con 0x7f3b740047d0 2023-11-24T08:07:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b840adf70 con 0x7f3b740047d0 2023-11-24T08:07:42.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b817fa640 1 -- 172.21.15.57:0/3017180905 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b78022070 con 0x7f3b740047d0 2023-11-24T08:07:42.227 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3b68066650 msgr2=0x7f3b68068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3b68066650 0x7f3b68068b10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3b700aa000 tx=0x7f3b70001a00 comp rx=0 tx=0).stop 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 msgr2=0x7f3b8415dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b8415dd00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3b78011cd0 tx=0x7f3b7800f610 comp rx=0 tx=0).stop 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 shutdown_connections 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3b68066650 0x7f3b68068b10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b84154830 0x7f3b841517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b8413fd10 0x7f3b841542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 --2- 172.21.15.57:0/3017180905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b740047d0 0x7f3b8415dd00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 >> 172.21.15.57:0/3017180905 conn(0x7f3b840b0c80 msgr2=0x7f3b840b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 shutdown_connections 2023-11-24T08:07:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.223+0000 7f3b8ae79640 1 -- 172.21.15.57:0/3017180905 wait complete. 2023-11-24T08:07:42.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:42.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.387+0000 7fea7d4fe640 1 Processor -- start 2023-11-24T08:07:42.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.387+0000 7fea7d4fe640 1 -- start start 2023-11-24T08:07:42.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.387+0000 7fea7d4fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea780aef40 0x7fea780b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.387+0000 7fea7d4fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea780b40f0 0x7fea780afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.387+0000 7fea7d4fe640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7815a880 con 0x7fea7815a4a0 2023-11-24T08:07:42.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.387+0000 7fea7d4fe640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea780af3a0 con 0x7fea780aef40 2023-11-24T08:07:42.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.387+0000 7fea7d4fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea780b4580 con 0x7fea780b40f0 2023-11-24T08:07:42.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea6ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea780aef40 0x7fea780b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea76ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fea7815a4a0 0x7fea780ad760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51212/0 (socket says 172.21.15.57:51212) 2023-11-24T08:07:42.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea76ffd640 1 -- 172.21.15.57:0/3618131189 learned_addr learned my addr 172.21.15.57:0/3618131189 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:42.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea777fe640 1 --2- 172.21.15.57:0/3618131189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea780b40f0 0x7fea780afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea767fc640 1 -- 172.21.15.57:0/3618131189 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998134232 0 0) 0x7fea7815a880 con 0x7fea7815a4a0 2023-11-24T08:07:42.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea767fc640 1 -- 172.21.15.57:0/3618131189 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea64003530 con 0x7fea7815a4a0 2023-11-24T08:07:42.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea6ffff640 1 -- 172.21.15.57:0/3618131189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea780b40f0 msgr2=0x7fea780afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:42.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea6ffff640 1 --2- 172.21.15.57:0/3618131189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea780b40f0 0x7fea780afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea6ffff640 1 -- 172.21.15.57:0/3618131189 >> v1:172.21.15.57:6789/0 conn(0x7fea7815a4a0 legacy=0x7fea780ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea6ffff640 1 -- 172.21.15.57:0/3618131189 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780adf60 con 0x7fea780aef40 2023-11-24T08:07:42.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea6ffff640 1 --2- 172.21.15.57:0/3618131189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780aef40 0x7fea780b3bb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fea600097c0 tx=0x7fea6001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ace1b603798b5bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea767fc640 1 -- 172.21.15.57:0/3618131189 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600ab650 con 0x7fea780aef40 2023-11-24T08:07:42.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea767fc640 1 -- 172.21.15.57:0/3618131189 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea600ab7b0 con 0x7fea780aef40 2023-11-24T08:07:42.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.391+0000 7fea767fc640 1 -- 172.21.15.57:0/3618131189 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600abb40 con 0x7fea780aef40 2023-11-24T08:07:42.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- 172.21.15.57:0/3618131189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780aef40 msgr2=0x7fea780b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/3618131189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780aef40 0x7fea780b3bb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fea600097c0 tx=0x7fea6001c450 comp rx=0 tx=0).stop 2023-11-24T08:07:42.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- 172.21.15.57:0/3618131189 shutdown_connections 2023-11-24T08:07:42.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/3618131189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea780b40f0 0x7fea780afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/3618131189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780aef40 0x7fea780b3bb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- 172.21.15.57:0/3618131189 >> 172.21.15.57:0/3618131189 conn(0x7fea780b55c0 msgr2=0x7fea780b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- 172.21.15.57:0/3618131189 shutdown_connections 2023-11-24T08:07:42.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- 172.21.15.57:0/3618131189 wait complete. 2023-11-24T08:07:42.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 Processor -- start 2023-11-24T08:07:42.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- start start 2023-11-24T08:07:42.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea780aef40 0x7fea780d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780b40f0 0x7fea7814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea7815a4a0 0x7fea781495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7806b1a0 con 0x7fea780b40f0 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7814c1c0 con 0x7fea780aef40 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea7d4fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7806aec0 con 0x7fea7815a4a0 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780b40f0 0x7fea7814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780b40f0 0x7fea7814bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50404/0 (socket says 172.21.15.57:50404) 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 -- 172.21.15.57:0/493425505 learned_addr learned my addr 172.21.15.57:0/493425505 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea777fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea7815a4a0 0x7fea781495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea76ffd640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea780aef40 0x7fea780d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 -- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea7815a4a0 msgr2=0x7fea781495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea7815a4a0 0x7fea781495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 -- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea780aef40 msgr2=0x7fea780d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea780aef40 0x7fea780d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea6ffff640 1 -- 172.21.15.57:0/493425505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60009420 con 0x7fea780b40f0 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.395+0000 7fea76ffd640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea780aef40 0x7fea780d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea6ffff640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780b40f0 0x7fea7814bc80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fea600ad040 tx=0x7fea6001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea6f7fe640 1 -- 172.21.15.57:0/493425505 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600bf610 con 0x7fea780b40f0 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea6f7fe640 1 -- 172.21.15.57:0/493425505 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea600bf7b0 con 0x7fea780b40f0 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea6f7fe640 1 -- 172.21.15.57:0/493425505 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600bfb60 con 0x7fea780b40f0 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7814b1a0 con 0x7fea780b40f0 2023-11-24T08:07:42.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7814b760 con 0x7fea780b40f0 2023-11-24T08:07:42.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7814b000 con 0x7fea780b40f0 2023-11-24T08:07:42.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea6f7fe640 1 -- 172.21.15.57:0/493425505 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fea600b5400 con 0x7fea780b40f0 2023-11-24T08:07:42.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea6f7fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fea58066620 0x7fea58068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea6f7fe640 1 -- 172.21.15.57:0/493425505 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea6011ebb0 con 0x7fea780b40f0 2023-11-24T08:07:42.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.399+0000 7fea76ffd640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fea58066620 0x7fea58068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.403+0000 7fea76ffd640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fea58066620 0x7fea58068ae0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fea680011f0 tx=0x7fea68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.403+0000 7fea6f7fe640 1 -- 172.21.15.57:0/493425505 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea7814b000 con 0x7fea780b40f0 2023-11-24T08:07:42.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.591+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea7814b000 con 0x7fea780b40f0 2023-11-24T08:07:42.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.591+0000 7fea6f7fe640 1 -- 172.21.15.57:0/493425505 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fea7814b000 con 0x7fea780b40f0 2023-11-24T08:07:42.597 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:42.598 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/4096569691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4096569691},{"type":"v1","addr":"172.21.15.57:6834","nonce":4096569691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/671957004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":671957004},{"type":"v1","addr":"172.21.15.57:6835","nonce":671957004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6165,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1925156645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1925156645},{"type":"v1","addr":"172.21.15.132:6837","nonce":1925156645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:26.096476+0000","modified":"2023-11-24T08:07:29.117899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55373":{"gid":55373,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1683487539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1683487539},{"type":"v1","addr":"172.21.15.132:6836","nonce":1683487539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:42.602 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fea58066620 msgr2=0x7fea58068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fea58066620 0x7fea58068ae0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fea680011f0 tx=0x7fea68009040 comp rx=0 tx=0).stop 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780b40f0 msgr2=0x7fea7814bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780b40f0 0x7fea7814bc80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fea600ad040 tx=0x7fea6001ac90 comp rx=0 tx=0).stop 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 shutdown_connections 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fea58066620 0x7fea58068ae0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea7815a4a0 0x7fea781495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea780b40f0 0x7fea7814bc80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 --2- 172.21.15.57:0/493425505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea780aef40 0x7fea780d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 >> 172.21.15.57:0/493425505 conn(0x7fea780b55c0 msgr2=0x7fea7806ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 shutdown_connections 2023-11-24T08:07:42.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.595+0000 7fea7d4fe640 1 -- 172.21.15.57:0/493425505 wait complete. 2023-11-24T08:07:42.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:42.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.759+0000 7fc321f55640 1 Processor -- start 2023-11-24T08:07:42.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.759+0000 7fc321f55640 1 -- start start 2023-11-24T08:07:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc321f55640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc31c144030 0x7fc31c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc321f55640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c06d8b0 con 0x7fc31c0709c0 2023-11-24T08:07:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc321f55640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c09d0a0 con 0x7fc31c09cc20 2023-11-24T08:07:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc321f55640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c145020 con 0x7fc31c144030 2023-11-24T08:07:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc31c0709c0 0x7fc31c070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51226/0 (socket says 172.21.15.57:51226) 2023-11-24T08:07:42.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31bfff640 1 -- 172.21.15.57:0/1151232156 learned_addr learned my addr 172.21.15.57:0/1151232156 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31b7fe640 1 --2- 172.21.15.57:0/1151232156 >> v2:172.21.15.132:3300/0 conn(0x7fc31c144030 0x7fc31c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976156149 0 0) 0x7fc31c06d8b0 con 0x7fc31c0709c0 2023-11-24T08:07:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc304003530 con 0x7fc31c0709c0 2023-11-24T08:07:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264642948 0 0) 0x7fc31c09d0a0 con 0x7fc31c09cc20 2023-11-24T08:07:42.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc31c06d8b0 con 0x7fc31c09cc20 2023-11-24T08:07:42.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 581096584 0 0) 0x7fc304003530 con 0x7fc31c0709c0 2023-11-24T08:07:42.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31b7fe640 1 -- 172.21.15.57:0/1151232156 >> v1:172.21.15.132:6789/0 conn(0x7fc31c09cc20 legacy=0x7fc31c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31b7fe640 1 -- 172.21.15.57:0/1151232156 >> v1:172.21.15.57:6789/0 conn(0x7fc31c0709c0 legacy=0x7fc31c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.763+0000 7fc31b7fe640 1 -- 172.21.15.57:0/1151232156 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c06cca0 con 0x7fc31c144030 2023-11-24T08:07:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc31b7fe640 1 --2- 172.21.15.57:0/1151232156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 0x7fc31c06c650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0097c0 tx=0x7fc30c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d8f37ce351b941 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314001a00 con 0x7fc31c144030 2023-11-24T08:07:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c0a7050 con 0x7fc31c144030 2023-11-24T08:07:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc31a7fc640 1 -- 172.21.15.57:0/1151232156 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0ab620 con 0x7fc31c144030 2023-11-24T08:07:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 -- 172.21.15.57:0/1151232156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 msgr2=0x7fc31c06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 --2- 172.21.15.57:0/1151232156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 0x7fc31c06c650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0097c0 tx=0x7fc30c01c370 comp rx=0 tx=0).stop 2023-11-24T08:07:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 -- 172.21.15.57:0/1151232156 shutdown_connections 2023-11-24T08:07:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 --2- 172.21.15.57:0/1151232156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 0x7fc31c06c650 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 -- 172.21.15.57:0/1151232156 >> 172.21.15.57:0/1151232156 conn(0x7fc31c0b0bf0 msgr2=0x7fc31c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 -- 172.21.15.57:0/1151232156 shutdown_connections 2023-11-24T08:07:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 -- 172.21.15.57:0/1151232156 wait complete. 2023-11-24T08:07:42.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 Processor -- start 2023-11-24T08:07:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.767+0000 7fc321f55640 1 -- start start 2023-11-24T08:07:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc31c0709c0 0x7fc31c13cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc31c09cc20 0x7fc31c139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 0x7fc31c09ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c13bd20 con 0x7fc31c09cc20 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c13cb40 con 0x7fc31c144030 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c139c20 con 0x7fc31c0709c0 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc31c09cc20 0x7fc31c139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc31c09cc20 0x7fc31c139080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50420/0 (socket says 172.21.15.57:50420) 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 -- 172.21.15.57:0/1860634601 learned_addr learned my addr 172.21.15.57:0/1860634601 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31b7fe640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc31c0709c0 0x7fc31c13cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31bfff640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 0x7fc31c09ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 -- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc31c0709c0 msgr2=0x7fc31c13cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc31c0709c0 0x7fc31c13cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 -- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 msgr2=0x7fc31c09ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 0x7fc31c09ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 -- 172.21.15.57:0/1860634601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c009420 con 0x7fc31c09cc20 2023-11-24T08:07:42.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc31affd640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc31c09cc20 0x7fc31c139080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c490 tx=0x7fc31000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc303fff640 1 -- 172.21.15.57:0/1860634601 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100052d0 con 0x7fc31c09cc20 2023-11-24T08:07:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc303fff640 1 -- 172.21.15.57:0/1860634601 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310005430 con 0x7fc31c09cc20 2023-11-24T08:07:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc303fff640 1 -- 172.21.15.57:0/1860634601 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310012870 con 0x7fc31c09cc20 2023-11-24T08:07:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c13bf30 con 0x7fc31c09cc20 2023-11-24T08:07:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c13c4f0 con 0x7fc31c09cc20 2023-11-24T08:07:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c13ccd0 con 0x7fc31c09cc20 2023-11-24T08:07:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.771+0000 7fc303fff640 1 -- 172.21.15.57:0/1860634601 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fc3100129d0 con 0x7fc31c09cc20 2023-11-24T08:07:42.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.775+0000 7fc303fff640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc308066620 0x7fc308068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:42.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.775+0000 7fc303fff640 1 -- 172.21.15.57:0/1860634601 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc310083cd0 con 0x7fc31c09cc20 2023-11-24T08:07:42.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.775+0000 7fc31b7fe640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc308066620 0x7fc308068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:42.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.775+0000 7fc31b7fe640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc308066620 0x7fc308068ae0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0ad000 tx=0x7fc30c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:42.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.779+0000 7fc303fff640 1 -- 172.21.15.57:0/1860634601 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc310050ec0 con 0x7fc31c09cc20 2023-11-24T08:07:42.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.935+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc31c067520 con 0x7fc31c09cc20 2023-11-24T08:07:42.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.935+0000 7fc303fff640 1 -- 172.21.15.57:0/1860634601 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fc3100544e0 con 0x7fc31c09cc20 2023-11-24T08:07:42.942 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:42.942 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":61,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:27.714748+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc308066620 msgr2=0x7fc308068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc308066620 0x7fc308068ae0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0ad000 tx=0x7fc30c0a6000 comp rx=0 tx=0).stop 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc31c09cc20 msgr2=0x7fc31c139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc31c09cc20 0x7fc31c139080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c490 tx=0x7fc31000c950 comp rx=0 tx=0).stop 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 shutdown_connections 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fc308066620 0x7fc308068ae0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc31c144030 0x7fc31c09ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc31c09cc20 0x7fc31c139080 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 --2- 172.21.15.57:0/1860634601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc31c0709c0 0x7fc31c13cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:42.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 >> 172.21.15.57:0/1860634601 conn(0x7fc31c0b0bf0 msgr2=0x7fc31c0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:42.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 shutdown_connections 2023-11-24T08:07:42.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:42.939+0000 7fc321f55640 1 -- 172.21.15.57:0/1860634601 wait complete. 2023-11-24T08:07:42.963 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:07:42.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:43.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4794606640 1 Processor -- start 2023-11-24T08:07:43.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4794606640 1 -- start start 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4794606640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4794606640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f478c0709c0 0x7f478c070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4794606640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478c06d8b0 con 0x7f478c144030 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4794606640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c145020 con 0x7f478c0709c0 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4794606640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c071390 con 0x7f478c06c650 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f4792ba3640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f478c0709c0 0x7f478c070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f47923a2640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f478c144030 0x7f478c06dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51242/0 (socket says 172.21.15.57:51242) 2023-11-24T08:07:43.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.103+0000 7f47923a2640 1 -- 172.21.15.57:0/1747905897 learned_addr learned my addr 172.21.15.57:0/1747905897 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4791ba1640 1 --2- 172.21.15.57:0/1747905897 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4792ba3640 1 -- 172.21.15.57:0/1747905897 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 msgr2=0x7f478c09cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4792ba3640 1 --2- 172.21.15.57:0/1747905897 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c09cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4792ba3640 1 -- 172.21.15.57:0/1747905897 >> v1:172.21.15.57:6789/0 conn(0x7f478c144030 legacy=0x7f478c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4792ba3640 1 -- 172.21.15.57:0/1747905897 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c06cca0 con 0x7f478c0709c0 2023-11-24T08:07:43.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f47913a0640 1 -- 172.21.15.57:0/1747905897 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931729939 0 0) 0x7f478c06d8b0 con 0x7f478c144030 2023-11-24T08:07:43.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4792ba3640 1 --2- 172.21.15.57:0/1747905897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c070e50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4784009d90 tx=0x7f478401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c790c4e2449bec85 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f47913a0640 1 -- 172.21.15.57:0/1747905897 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840a5900 con 0x7f478c0709c0 2023-11-24T08:07:43.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f47913a0640 1 -- 172.21.15.57:0/1747905897 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840a5a60 con 0x7f478c0709c0 2023-11-24T08:07:43.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f47913a0640 1 -- 172.21.15.57:0/1747905897 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840a5df0 con 0x7f478c0709c0 2023-11-24T08:07:43.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4794606640 1 -- 172.21.15.57:0/1747905897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 msgr2=0x7f478c070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.107+0000 7f4794606640 1 --2- 172.21.15.57:0/1747905897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c070e50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4784009d90 tx=0x7f478401c950 comp rx=0 tx=0).stop 2023-11-24T08:07:43.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- 172.21.15.57:0/1747905897 shutdown_connections 2023-11-24T08:07:43.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 --2- 172.21.15.57:0/1747905897 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c09cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 --2- 172.21.15.57:0/1747905897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c070e50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- 172.21.15.57:0/1747905897 >> 172.21.15.57:0/1747905897 conn(0x7f478c0b0bf0 msgr2=0x7f478c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- 172.21.15.57:0/1747905897 shutdown_connections 2023-11-24T08:07:43.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- 172.21.15.57:0/1747905897 wait complete. 2023-11-24T08:07:43.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 Processor -- start 2023-11-24T08:07:43.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- start start 2023-11-24T08:07:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c0ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f478c144030 0x7f478c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c15a280 con 0x7f478c0709c0 2023-11-24T08:07:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c158d40 con 0x7f478c144030 2023-11-24T08:07:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4794606640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c159020 con 0x7f478c06c650 2023-11-24T08:07:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c15a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50440/0 (socket says 172.21.15.57:50440) 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 -- 172.21.15.57:0/2009175242 learned_addr learned my addr 172.21.15.57:0/2009175242 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f47923a2640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c0ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4792ba3640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f478c144030 0x7f478c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 -- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 msgr2=0x7f478c0ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c0ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 -- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f478c144030 msgr2=0x7f478c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f478c144030 0x7f478c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.111+0000 7f4791ba1640 1 -- 172.21.15.57:0/2009175242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009a70 con 0x7f478c0709c0 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4791ba1640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c15a560 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f477c00d5f0 tx=0x7f477c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4782ffd640 1 -- 172.21.15.57:0/2009175242 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0125f0 con 0x7f478c0709c0 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4782ffd640 1 -- 172.21.15.57:0/2009175242 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c012750 con 0x7f478c0709c0 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c159300 con 0x7f478c0709c0 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4782ffd640 1 -- 172.21.15.57:0/2009175242 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c012ae0 con 0x7f478c0709c0 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c1598c0 con 0x7f478c0709c0 2023-11-24T08:07:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c159a80 con 0x7f478c0709c0 2023-11-24T08:07:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4782ffd640 1 -- 172.21.15.57:0/2009175242 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f477c012c40 con 0x7f478c0709c0 2023-11-24T08:07:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4782ffd640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4770066620 0x7f4770068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f4782ffd640 1 -- 172.21.15.57:0/2009175242 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f477c084490 con 0x7f478c0709c0 2023-11-24T08:07:43.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.115+0000 7f47923a2640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4770066620 0x7f4770068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.119+0000 7f47923a2640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4770066620 0x7f4770068ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4788007fd0 tx=0x7f4788007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.119+0000 7f4782ffd640 1 -- 172.21.15.57:0/2009175242 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f477c0517d0 con 0x7f478c0709c0 2023-11-24T08:07:43.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.311+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f478c067520 con 0x7f478c0709c0 2023-11-24T08:07:43.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.311+0000 7f4782ffd640 1 -- 172.21.15.57:0/2009175242 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f477c054df0 con 0x7f478c0709c0 2023-11-24T08:07:43.316 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:43.316 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/4096569691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4096569691},{"type":"v1","addr":"172.21.15.57:6834","nonce":4096569691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/671957004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":671957004},{"type":"v1","addr":"172.21.15.57:6835","nonce":671957004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6165,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1925156645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1925156645},{"type":"v1","addr":"172.21.15.132:6837","nonce":1925156645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:26.096476+0000","modified":"2023-11-24T08:07:29.117899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55373":{"gid":55373,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1683487539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1683487539},{"type":"v1","addr":"172.21.15.132:6836","nonce":1683487539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:43.316 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4770066620 msgr2=0x7f4770068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4770066620 0x7f4770068ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4788007fd0 tx=0x7f4788007d60 comp rx=0 tx=0).stop 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 msgr2=0x7f478c15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c15a560 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f477c00d5f0 tx=0x7f477c00dab0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 shutdown_connections 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4770066620 0x7f4770068ae0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f478c144030 0x7f478c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f478c0709c0 0x7f478c15a560 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 --2- 172.21.15.57:0/2009175242 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f478c06c650 0x7f478c0ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 >> 172.21.15.57:0/2009175242 conn(0x7f478c0b0bf0 msgr2=0x7f478c0abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 shutdown_connections 2023-11-24T08:07:43.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.315+0000 7f4794606640 1 -- 172.21.15.57:0/2009175242 wait complete. 2023-11-24T08:07:43.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:07:43.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d2e416640 1 Processor -- start 2023-11-24T08:07:43.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d2e416640 1 -- start start 2023-11-24T08:07:43.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d2e416640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2815d570 0x7f5d2806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d2e416640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d280d3020 0x7f5d280d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d2e416640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d280d39c0 con 0x7f5d280ce8b0 2023-11-24T08:07:43.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d2e416640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280d1cc0 con 0x7f5d280d3020 2023-11-24T08:07:43.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d2e416640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d280d1fa0 con 0x7f5d2815d570 2023-11-24T08:07:43.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d277fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d280d3020 0x7f5d280d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d277fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d280d3020 0x7f5d280d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50452/0 (socket says 172.21.15.57:50452) 2023-11-24T08:07:43.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d277fe640 1 -- 172.21.15.57:0/3496460517 learned_addr learned my addr 172.21.15.57:0/3496460517 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:43.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d27fff640 1 --2- 172.21.15.57:0/3496460517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2815d570 0x7f5d2806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d277fe640 1 -- 172.21.15.57:0/3496460517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2815d570 msgr2=0x7f5d2806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d277fe640 1 --2- 172.21.15.57:0/3496460517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2815d570 0x7f5d2806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d277fe640 1 -- 172.21.15.57:0/3496460517 >> v1:172.21.15.132:6789/0 conn(0x7f5d280ce8b0 legacy=0x7f5d280ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d277fe640 1 -- 172.21.15.57:0/3496460517 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280ce0b0 con 0x7f5d280d3020 2023-11-24T08:07:43.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.479+0000 7f5d27fff640 1 --2- 172.21.15.57:0/3496460517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2815d570 0x7f5d2806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:43.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d277fe640 1 --2- 172.21.15.57:0/3496460517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d280d3480 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009870 tx=0x7f5d1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16de3a1ad3f8f5ea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d26ffd640 1 -- 172.21.15.57:0/3496460517 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0a6040 con 0x7f5d280d3020 2023-11-24T08:07:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d26ffd640 1 -- 172.21.15.57:0/3496460517 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0aa600 con 0x7f5d280d3020 2023-11-24T08:07:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d26ffd640 1 -- 172.21.15.57:0/3496460517 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0aa990 con 0x7f5d280d3020 2023-11-24T08:07:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 -- 172.21.15.57:0/3496460517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 msgr2=0x7f5d280d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 --2- 172.21.15.57:0/3496460517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d280d3480 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009870 tx=0x7f5d1c01c480 comp rx=0 tx=0).stop 2023-11-24T08:07:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 -- 172.21.15.57:0/3496460517 shutdown_connections 2023-11-24T08:07:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 --2- 172.21.15.57:0/3496460517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d280d3480 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 --2- 172.21.15.57:0/3496460517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2815d570 0x7f5d2806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 -- 172.21.15.57:0/3496460517 >> 172.21.15.57:0/3496460517 conn(0x7f5d2808ceb0 msgr2=0x7f5d2809c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 -- 172.21.15.57:0/3496460517 shutdown_connections 2023-11-24T08:07:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 -- 172.21.15.57:0/3496460517 wait complete. 2023-11-24T08:07:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.483+0000 7f5d2e416640 1 Processor -- start 2023-11-24T08:07:43.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 -- start start 2023-11-24T08:07:43.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d280ce8b0 0x7f5d281554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d2806c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d2815d570 0x7f5d2806c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815b1d0 con 0x7f5d280d3020 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814cde0 con 0x7f5d2815d570 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815a8a0 con 0x7f5d280ce8b0 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d2806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d27fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d280ce8b0 0x7f5d281554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d2806c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50454/0 (socket says 172.21.15.57:50454) 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d27fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d280ce8b0 0x7f5d281554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:43616/0 (socket says 172.21.15.57:43616) 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 -- 172.21.15.57:0/431129246 learned_addr learned my addr 172.21.15.57:0/431129246 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:43.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2c9b3640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d2815d570 0x7f5d2806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 -- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d280ce8b0 msgr2=0x7f5d281554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d280ce8b0 0x7f5d281554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 -- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d2815d570 msgr2=0x7f5d2806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d2815d570 0x7f5d2806c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 -- 172.21.15.57:0/431129246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0094d0 con 0x7f5d280d3020 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d277fe640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d2806c210 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c01a0b0 tx=0x7f5d1c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d24ff9640 1 -- 172.21.15.57:0/431129246 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0b3800 con 0x7f5d280d3020 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d24ff9640 1 -- 172.21.15.57:0/431129246 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0b3980 con 0x7f5d280d3020 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d24ff9640 1 -- 172.21.15.57:0/431129246 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0b3d30 con 0x7f5d280d3020 2023-11-24T08:07:43.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2815ab80 con 0x7f5d280d3020 2023-11-24T08:07:43.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2815b660 con 0x7f5d280d3020 2023-11-24T08:07:43.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.487+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2815b340 con 0x7f5d280d3020 2023-11-24T08:07:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.491+0000 7f5d24ff9640 1 -- 172.21.15.57:0/431129246 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5d1c0b2380 con 0x7f5d280d3020 2023-11-24T08:07:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.491+0000 7f5d24ff9640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5d14066620 0x7f5d14068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.491+0000 7f5d24ff9640 1 -- 172.21.15.57:0/431129246 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d1c11e550 con 0x7f5d280d3020 2023-11-24T08:07:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.491+0000 7f5d27fff640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5d14066620 0x7f5d14068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.491+0000 7f5d27fff640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5d14066620 0x7f5d14068ae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5d280cd700 tx=0x7f5d18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.495+0000 7f5d24ff9640 1 -- 172.21.15.57:0/431129246 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d1c0eb790 con 0x7f5d280d3020 2023-11-24T08:07:43.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d28067520 con 0x7f5d280d3020 2023-11-24T08:07:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d24ff9640 1 -- 172.21.15.57:0/431129246 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f5d1c0eedb0 con 0x7f5d280d3020 2023-11-24T08:07:43.692 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:43.693 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/4096569691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4096569691},{"type":"v1","addr":"172.21.15.57:6834","nonce":4096569691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/671957004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":671957004},{"type":"v1","addr":"172.21.15.57:6835","nonce":671957004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6165,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1925156645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1925156645},{"type":"v1","addr":"172.21.15.132:6837","nonce":1925156645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:07:26.096476+0000","modified":"2023-11-24T08:07:29.117899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":55373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55373":{"gid":55373,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1683487539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1683487539},{"type":"v1","addr":"172.21.15.132:6836","nonce":1683487539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:07:43.695 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 36 2023-11-24T08:07:43.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5d14066620 msgr2=0x7f5d14068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5d14066620 0x7f5d14068ae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5d280cd700 tx=0x7f5d18008040 comp rx=0 tx=0).stop 2023-11-24T08:07:43.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 msgr2=0x7f5d2806c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d2806c210 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c01a0b0 tx=0x7f5d1c01acc0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 shutdown_connections 2023-11-24T08:07:43.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5d14066620 0x7f5d14068ae0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d2815d570 0x7f5d2806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d280d3020 0x7f5d2806c210 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 --2- 172.21.15.57:0/431129246 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d280ce8b0 0x7f5d281554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 >> 172.21.15.57:0/431129246 conn(0x7f5d2808ceb0 msgr2=0x7f5d28159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 shutdown_connections 2023-11-24T08:07:43.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.687+0000 7f5d2e416640 1 -- 172.21.15.57:0/431129246 wait complete. 2023-11-24T08:07:43.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:43.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.851+0000 7fd4332c9640 1 Processor -- start 2023-11-24T08:07:43.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.851+0000 7fd4332c9640 1 -- start start 2023-11-24T08:07:43.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd4332c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd4332c9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd42c0d0150 0x7fd42c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd4332c9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0cee60 con 0x7fd42c0d05d0 2023-11-24T08:07:43.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd4332c9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0cf0b0 con 0x7fd42c0d0150 2023-11-24T08:07:43.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd4332c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0cf390 con 0x7fd42c147020 2023-11-24T08:07:43.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd430864640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd42c0d0150 0x7fd42c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd430864640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd42c0d0150 0x7fd42c06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50468/0 (socket says 172.21.15.57:50468) 2023-11-24T08:07:43.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd430864640 1 -- 172.21.15.57:0/795538492 learned_addr learned my addr 172.21.15.57:0/795538492 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:43.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd431065640 1 --2- 172.21.15.57:0/795538492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd430864640 1 -- 172.21.15.57:0/795538492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 msgr2=0x7fd42c0d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd430864640 1 --2- 172.21.15.57:0/795538492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c0d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd430864640 1 -- 172.21.15.57:0/795538492 >> v1:172.21.15.132:6789/0 conn(0x7fd42c0d05d0 legacy=0x7fd42c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:43.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd430864640 1 -- 172.21.15.57:0/795538492 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0cf670 con 0x7fd42c0d0150 2023-11-24T08:07:43.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.855+0000 7fd431065640 1 --2- 172.21.15.57:0/795538492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c0d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:43.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd430864640 1 --2- 172.21.15.57:0/795538492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c06b6c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009870 tx=0x7fd41c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ddf7bd9df0f2ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd423fff640 1 -- 172.21.15.57:0/795538492 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0aa670 con 0x7fd42c0d0150 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd423fff640 1 -- 172.21.15.57:0/795538492 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c0aa7d0 con 0x7fd42c0d0150 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd423fff640 1 -- 172.21.15.57:0/795538492 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0aab60 con 0x7fd42c0d0150 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- 172.21.15.57:0/795538492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 msgr2=0x7fd42c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 --2- 172.21.15.57:0/795538492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c06b6c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009870 tx=0x7fd41c01c510 comp rx=0 tx=0).stop 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- 172.21.15.57:0/795538492 shutdown_connections 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 --2- 172.21.15.57:0/795538492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c06b6c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 --2- 172.21.15.57:0/795538492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c0d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- 172.21.15.57:0/795538492 >> 172.21.15.57:0/795538492 conn(0x7fd42c060fd0 msgr2=0x7fd42c0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:43.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- 172.21.15.57:0/795538492 shutdown_connections 2023-11-24T08:07:43.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- 172.21.15.57:0/795538492 wait complete. 2023-11-24T08:07:43.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 Processor -- start 2023-11-24T08:07:43.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- start start 2023-11-24T08:07:43.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c0d05d0 0x7fd42c15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c141d90 con 0x7fd42c0d0150 2023-11-24T08:07:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c15d5a0 con 0x7fd42c0d05d0 2023-11-24T08:07:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd4332c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c141430 con 0x7fd42c147020 2023-11-24T08:07:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.859+0000 7fd431065640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c13fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50480/0 (socket says 172.21.15.57:50480) 2023-11-24T08:07:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 -- 172.21.15.57:0/2265595721 learned_addr learned my addr 172.21.15.57:0/2265595721 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd430864640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c0d05d0 0x7fd42c15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431866640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 -- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 msgr2=0x7fd42c142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 -- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c0d05d0 msgr2=0x7fd42c15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c0d05d0 0x7fd42c15d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:43.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 -- 172.21.15.57:0/2265595721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0094d0 con 0x7fd42c0d0150 2023-11-24T08:07:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431866640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd431065640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c13fc90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd42800c7c0 tx=0x7fd42800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd421ffb640 1 -- 172.21.15.57:0/2265595721 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428007a30 con 0x7fd42c0d0150 2023-11-24T08:07:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd421ffb640 1 -- 172.21.15.57:0/2265595721 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd428007b90 con 0x7fd42c0d0150 2023-11-24T08:07:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd421ffb640 1 -- 172.21.15.57:0/2265595721 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800ce70 con 0x7fd42c0d0150 2023-11-24T08:07:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c143970 con 0x7fd42c0d0150 2023-11-24T08:07:43.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c1419b0 con 0x7fd42c0d0150 2023-11-24T08:07:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c141ed0 con 0x7fd42c0d0150 2023-11-24T08:07:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd421ffb640 1 -- 172.21.15.57:0/2265595721 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fd4280113f0 con 0x7fd42c0d0150 2023-11-24T08:07:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.863+0000 7fd421ffb640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd410066620 0x7fd410068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:43.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.867+0000 7fd421ffb640 1 -- 172.21.15.57:0/2265595721 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd428084690 con 0x7fd42c0d0150 2023-11-24T08:07:43.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.867+0000 7fd430864640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd410066620 0x7fd410068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:43.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.867+0000 7fd430864640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd410066620 0x7fd410068ae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0ae000 tx=0x7fd41c0b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:43.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:43.867+0000 7fd421ffb640 1 -- 172.21.15.57:0/2265595721 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd428051820 con 0x7fd42c0d0150 2023-11-24T08:07:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.027+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd42c067520 con 0x7fd42c0d0150 2023-11-24T08:07:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.027+0000 7fd421ffb640 1 -- 172.21.15.57:0/2265595721 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fd428054e40 con 0x7fd42c0d0150 2023-11-24T08:07:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:44.033 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":61,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:27.714748+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:07:24.498448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:07:25.096379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd410066620 msgr2=0x7fd410068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd410066620 0x7fd410068ae0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0ae000 tx=0x7fd41c0b5040 comp rx=0 tx=0).stop 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 msgr2=0x7fd42c13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c13fc90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd42800c7c0 tx=0x7fd42800cc80 comp rx=0 tx=0).stop 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 shutdown_connections 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd410066620 0x7fd410068ae0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd42c147020 0x7fd42c142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c0d05d0 0x7fd42c15d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 --2- 172.21.15.57:0/2265595721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42c0d0150 0x7fd42c13fc90 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 >> 172.21.15.57:0/2265595721 conn(0x7fd42c060fd0 msgr2=0x7fd42c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 shutdown_connections 2023-11-24T08:07:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.031+0000 7fd4332c9640 1 -- 172.21.15.57:0/2265595721 wait complete. 2023-11-24T08:07:44.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:07:44.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.195+0000 7f8a10f1d640 1 Processor -- start 2023-11-24T08:07:44.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.195+0000 7f8a10f1d640 1 -- start start 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.195+0000 7f8a10f1d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8a0c15a4d0 0x7f8a0c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.195+0000 7f8a10f1d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a0c06d740 0x7f8a0c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.195+0000 7f8a10f1d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c15a8b0 con 0x7f8a0c0cad20 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.195+0000 7f8a10f1d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c9c30 con 0x7f8a0c15a4d0 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.195+0000 7f8a10f1d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c06e090 con 0x7f8a0c06d740 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8a0c15a4d0 0x7f8a0c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8a0c15a4d0 0x7f8a0c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50482/0 (socket says 172.21.15.57:50482) 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3473576175 learned_addr learned my addr 172.21.15.57:0/3473576175 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:44.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0ad9d640 1 --2- 172.21.15.57:0/3473576175 >> v2:172.21.15.132:3300/0 conn(0x7f8a0c06d740 0x7f8a0c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3473576175 >> v2:172.21.15.132:3300/0 conn(0x7f8a0c06d740 msgr2=0x7f8a0c06db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 --2- 172.21.15.57:0/3473576175 >> v2:172.21.15.132:3300/0 conn(0x7f8a0c06d740 0x7f8a0c06db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3473576175 >> v1:172.21.15.132:6789/0 conn(0x7f8a0c0cad20 legacy=0x7f8a0c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3473576175 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0c9f60 con 0x7f8a0c15a4d0 2023-11-24T08:07:44.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a0a59c640 1 --2- 172.21.15.57:0/3473576175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c15a4d0 0x7f8a0c0c9650 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c15dea0 tx=0x7f89fc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b3a362148a1e3a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a09d9b640 1 -- 172.21.15.57:0/3473576175 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0ab640 con 0x7f8a0c15a4d0 2023-11-24T08:07:44.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a09d9b640 1 -- 172.21.15.57:0/3473576175 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0a7070 con 0x7f8a0c15a4d0 2023-11-24T08:07:44.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.199+0000 7f8a09d9b640 1 -- 172.21.15.57:0/3473576175 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0ab9c0 con 0x7f8a0c15a4d0 2023-11-24T08:07:44.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3473576175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c15a4d0 msgr2=0x7f8a0c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3473576175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c15a4d0 0x7f8a0c0c9650 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c15dea0 tx=0x7f89fc01c440 comp rx=0 tx=0).stop 2023-11-24T08:07:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3473576175 shutdown_connections 2023-11-24T08:07:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3473576175 >> v2:172.21.15.132:3300/0 conn(0x7f8a0c06d740 0x7f8a0c06db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3473576175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c15a4d0 0x7f8a0c0c9650 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3473576175 >> 172.21.15.57:0/3473576175 conn(0x7f8a0c0b0bf0 msgr2=0x7f8a0c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3473576175 shutdown_connections 2023-11-24T08:07:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3473576175 wait complete. 2023-11-24T08:07:44.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 Processor -- start 2023-11-24T08:07:44.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- start start 2023-11-24T08:07:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c06d740 0x7f8a0c164250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a0c0cad20 0x7f8a0c09c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0c15a4d0 0x7f8a0c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c09c570 con 0x7f8a0c06d740 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c164fe0 con 0x7f8a0c15a4d0 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a10f1d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0b01d0 con 0x7f8a0c0cad20 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a0a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c06d740 0x7f8a0c164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a0a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c06d740 0x7f8a0c164250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50496/0 (socket says 172.21.15.57:50496) 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3463998833 learned_addr learned my addr 172.21.15.57:0/3463998833 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a03fff640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a0c0cad20 0x7f8a0c09c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a0ad9d640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0c15a4d0 0x7f8a0c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.203+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a0c0cad20 msgr2=0x7f8a0c09c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a0a59c640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a0c0cad20 0x7f8a0c09c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0c15a4d0 msgr2=0x7f8a0c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a0a59c640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0c15a4d0 0x7f8a0c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a0a59c640 1 -- 172.21.15.57:0/3463998833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0094d0 con 0x7f8a0c06d740 2023-11-24T08:07:44.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a0a59c640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c06d740 0x7f8a0c164250 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f89fc019050 tx=0x7f89fc01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a02ffd640 1 -- 172.21.15.57:0/3463998833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0be3f0 con 0x7f8a0c06d740 2023-11-24T08:07:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a02ffd640 1 -- 172.21.15.57:0/3463998833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0be550 con 0x7f8a0c06d740 2023-11-24T08:07:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a02ffd640 1 -- 172.21.15.57:0/3463998833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0be900 con 0x7f8a0c06d740 2023-11-24T08:07:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0afef0 con 0x7f8a0c06d740 2023-11-24T08:07:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c09bb10 con 0x7f8a0c06d740 2023-11-24T08:07:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c09d250 con 0x7f8a0c06d740 2023-11-24T08:07:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a02ffd640 1 -- 172.21.15.57:0/3463998833 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f89fc0c7440 con 0x7f8a0c06d740 2023-11-24T08:07:44.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a02ffd640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89ec066620 0x7f89ec068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a02ffd640 1 -- 172.21.15.57:0/3463998833 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89fc11e9f0 con 0x7f8a0c06d740 2023-11-24T08:07:44.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.207+0000 7f8a03fff640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89ec066620 0x7f89ec068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.211+0000 7f8a03fff640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89ec066620 0x7f89ec068ae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c1651b0 tx=0x7f89f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.211+0000 7f8a02ffd640 1 -- 172.21.15.57:0/3463998833 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89fc0ebc30 con 0x7f8a0c06d740 2023-11-24T08:07:44.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.399+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8a0c04e930 con 0x7f8a0c06d740 2023-11-24T08:07:44.405 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-11-24T08:07:44.403+0000 7f305c7a3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:07:44.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.403+0000 7f8a02ffd640 1 -- 172.21.15.57:0/3463998833 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f89fc0ef250 con 0x7f8a0c06d740 2023-11-24T08:07:44.408 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:07:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89ec066620 msgr2=0x7f89ec068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89ec066620 0x7f89ec068ae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c1651b0 tx=0x7f89f4009040 comp rx=0 tx=0).stop 2023-11-24T08:07:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c06d740 msgr2=0x7f8a0c164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c06d740 0x7f8a0c164250 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f89fc019050 tx=0x7f89fc01ac80 comp rx=0 tx=0).stop 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 shutdown_connections 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f89ec066620 0x7f89ec068ae0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0c15a4d0 0x7f8a0c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a0c0cad20 0x7f8a0c09c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 --2- 172.21.15.57:0/3463998833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0c06d740 0x7f8a0c164250 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 >> 172.21.15.57:0/3463998833 conn(0x7f8a0c0b0bf0 msgr2=0x7f8a0c0acbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 shutdown_connections 2023-11-24T08:07:44.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.407+0000 7f8a10f1d640 1 -- 172.21.15.57:0/3463998833 wait complete. 2023-11-24T08:07:44.417 INFO:tasks.ceph.mds.b.smithi132.stderr: -2041> 2023-11-24T08:07:28.672+0000 7f57c84f8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:07:44.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:07:44.464 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-11-24T08:07:44.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680fbc4640 1 Processor -- start 2023-11-24T08:07:44.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680fbc4640 1 -- start start 2023-11-24T08:07:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680fbc4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f680815a270 0x7f680815a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680fbc4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b1610 0x7f680815c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680fbc4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680815af70 con 0x7f68080b3fb0 2023-11-24T08:07:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680fbc4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680815b250 con 0x7f680815a270 2023-11-24T08:07:44.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680fbc4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680815b530 con 0x7f68080b1610 2023-11-24T08:07:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680e161640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b1610 0x7f680815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680e161640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b1610 0x7f680815c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:43654/0 (socket says 172.21.15.57:43654) 2023-11-24T08:07:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680e161640 1 -- 172.21.15.57:0/350055345 learned_addr learned my addr 172.21.15.57:0/350055345 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680d960640 1 --2- 172.21.15.57:0/350055345 >> v2:172.21.15.132:3300/0 conn(0x7f680815a270 0x7f680815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680e161640 1 -- 172.21.15.57:0/350055345 >> v2:172.21.15.132:3300/0 conn(0x7f680815a270 msgr2=0x7f680815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680e161640 1 --2- 172.21.15.57:0/350055345 >> v2:172.21.15.132:3300/0 conn(0x7f680815a270 0x7f680815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680e161640 1 -- 172.21.15.57:0/350055345 >> v1:172.21.15.132:6789/0 conn(0x7f68080b3fb0 legacy=0x7f68080b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.575+0000 7f680e161640 1 -- 172.21.15.57:0/350055345 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680815b810 con 0x7f68080b1610 2023-11-24T08:07:44.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680e161640 1 --2- 172.21.15.57:0/350055345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b1610 0x7f680815c010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e50 tx=0x7f680001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59133d5897f5670c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680c95e640 1 -- 172.21.15.57:0/350055345 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000a5830 con 0x7f68080b1610 2023-11-24T08:07:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680c95e640 1 -- 172.21.15.57:0/350055345 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000a5990 con 0x7f68080b1610 2023-11-24T08:07:44.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680c95e640 1 -- 172.21.15.57:0/350055345 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000a5d20 con 0x7f68080b1610 2023-11-24T08:07:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 -- 172.21.15.57:0/350055345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b1610 msgr2=0x7f680815c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 --2- 172.21.15.57:0/350055345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b1610 0x7f680815c010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e50 tx=0x7f680001c950 comp rx=0 tx=0).stop 2023-11-24T08:07:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 -- 172.21.15.57:0/350055345 shutdown_connections 2023-11-24T08:07:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 --2- 172.21.15.57:0/350055345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b1610 0x7f680815c010 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 --2- 172.21.15.57:0/350055345 >> v2:172.21.15.132:3300/0 conn(0x7f680815a270 0x7f680815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 -- 172.21.15.57:0/350055345 >> 172.21.15.57:0/350055345 conn(0x7f68080b5590 msgr2=0x7f68080b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:44.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 -- 172.21.15.57:0/350055345 shutdown_connections 2023-11-24T08:07:44.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.579+0000 7f680fbc4640 1 -- 172.21.15.57:0/350055345 wait complete. 2023-11-24T08:07:44.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 Processor -- start 2023-11-24T08:07:44.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 -- start start 2023-11-24T08:07:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080b1610 0x7f68080b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b3fb0 0x7f6808141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680815a270 0x7f680809d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68080af890 con 0x7f68080b1610 2023-11-24T08:07:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6808141670 con 0x7f680815a270 2023-11-24T08:07:44.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68080afb30 con 0x7f68080b3fb0 2023-11-24T08:07:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080b1610 0x7f68080b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080b1610 0x7f68080b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50506/0 (socket says 172.21.15.57:50506) 2023-11-24T08:07:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 -- 172.21.15.57:0/2601003377 learned_addr learned my addr 172.21.15.57:0/2601003377 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d15f640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b3fb0 0x7f6808141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680e161640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680815a270 0x7f680809d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 -- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b3fb0 msgr2=0x7f6808141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b3fb0 0x7f6808141130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 -- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680815a270 msgr2=0x7f680809d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680815a270 0x7f680809d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 -- 172.21.15.57:0/2601003377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009b30 con 0x7f68080b1610 2023-11-24T08:07:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680e161640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680815a270 0x7f680809d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:44.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d15f640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b3fb0 0x7f6808141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:44.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680d960640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080b1610 0x7f68080b08f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f680400e930 tx=0x7f680400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f67fe7fc640 1 -- 172.21.15.57:0/2601003377 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6804009690 con 0x7f68080b1610 2023-11-24T08:07:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f67fe7fc640 1 -- 172.21.15.57:0/2601003377 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680400ca00 con 0x7f68080b1610 2023-11-24T08:07:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f67fe7fc640 1 -- 172.21.15.57:0/2601003377 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400cd70 con 0x7f68080b1610 2023-11-24T08:07:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68080afe10 con 0x7f68080b1610 2023-11-24T08:07:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68080b03d0 con 0x7f68080b1610 2023-11-24T08:07:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.583+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680804e8c0 con 0x7f68080b1610 2023-11-24T08:07:44.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.587+0000 7f67fe7fc640 1 -- 172.21.15.57:0/2601003377 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f6804013470 con 0x7f68080b1610 2023-11-24T08:07:44.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.587+0000 7f67fe7fc640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67ec066620 0x7f67ec068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:44.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.587+0000 7f67fe7fc640 1 -- 172.21.15.57:0/2601003377 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f68040844e0 con 0x7f68080b1610 2023-11-24T08:07:44.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.587+0000 7f680d15f640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67ec066620 0x7f67ec068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:44.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.587+0000 7f680d15f640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67ec066620 0x7f67ec068ae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67f8000f70 tx=0x7f67f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:44.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.591+0000 7f67fe7fc640 1 -- 172.21.15.57:0/2601003377 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6804051730 con 0x7f68080b1610 2023-11-24T08:07:44.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:44.783+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f680815e900 con 0x7f68080b1610 2023-11-24T08:07:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.411+0000 7f67fe7fc640 1 -- 172.21.15.57:0/2601003377 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6804054d50 con 0x7f68080b1610 2023-11-24T08:07:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67ec066620 msgr2=0x7f67ec068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67ec066620 0x7f67ec068ae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67f8000f70 tx=0x7f67f8009040 comp rx=0 tx=0).stop 2023-11-24T08:07:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080b1610 msgr2=0x7f68080b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080b1610 0x7f68080b08f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f680400e930 tx=0x7f680400edf0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 shutdown_connections 2023-11-24T08:07:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f67ec066620 0x7f67ec068ae0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f680815a270 0x7f680809d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f68080b3fb0 0x7f6808141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 --2- 172.21.15.57:0/2601003377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080b1610 0x7f68080b08f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 >> 172.21.15.57:0/2601003377 conn(0x7f68080b5590 msgr2=0x7f680815df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 shutdown_connections 2023-11-24T08:07:45.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.415+0000 7f680fbc4640 1 -- 172.21.15.57:0/2601003377 wait complete. 2023-11-24T08:07:45.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:07:45.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 Processor -- start 2023-11-24T08:07:45.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 -- start start 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4143ad0 0x7f5ef40cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ef4070400 0x7f5ef40b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ef40b3860 0x7f5ef40b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40b3cf0 con 0x7f5ef40b3860 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40cdc40 con 0x7f5ef4070400 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef9357640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef4143eb0 con 0x7f5ef4143ad0 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ef40b3860 0x7f5ef40b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ef40b3860 0x7f5ef40b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50514/0 (socket says 172.21.15.57:50514) 2023-11-24T08:07:45.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 -- 172.21.15.57:0/1423414682 learned_addr learned my addr 172.21.15.57:0/1423414682 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:45.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef2ffd640 1 --2- 172.21.15.57:0/1423414682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4143ad0 0x7f5ef40cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5eebfff640 1 --2- 172.21.15.57:0/1423414682 >> v2:172.21.15.132:3300/0 conn(0x7f5ef4070400 0x7f5ef40b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 -- 172.21.15.57:0/1423414682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4143ad0 msgr2=0x7f5ef40cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 --2- 172.21.15.57:0/1423414682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4143ad0 0x7f5ef40cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 -- 172.21.15.57:0/1423414682 >> v2:172.21.15.132:3300/0 conn(0x7f5ef4070400 msgr2=0x7f5ef40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:45.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 --2- 172.21.15.57:0/1423414682 >> v2:172.21.15.132:3300/0 conn(0x7f5ef4070400 0x7f5ef40b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.591+0000 7f5ef37fe640 1 -- 172.21.15.57:0/1423414682 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40cd030 con 0x7f5ef40b3860 2023-11-24T08:07:45.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef37fe640 1 --2- 172.21.15.57:0/1423414682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef40b3860 0x7f5ef40b1ed0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406e650 tx=0x7f5eec01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0d00c3d729f8ea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef27fc640 1 -- 172.21.15.57:0/1423414682 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0a5590 con 0x7f5ef40b3860 2023-11-24T08:07:45.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef27fc640 1 -- 172.21.15.57:0/1423414682 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec0a56f0 con 0x7f5ef40b3860 2023-11-24T08:07:45.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef27fc640 1 -- 172.21.15.57:0/1423414682 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0a5a80 con 0x7f5ef40b3860 2023-11-24T08:07:45.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 -- 172.21.15.57:0/1423414682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef40b3860 msgr2=0x7f5ef40b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 --2- 172.21.15.57:0/1423414682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef40b3860 0x7f5ef40b1ed0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406e650 tx=0x7f5eec01c710 comp rx=0 tx=0).stop 2023-11-24T08:07:45.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 -- 172.21.15.57:0/1423414682 shutdown_connections 2023-11-24T08:07:45.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 --2- 172.21.15.57:0/1423414682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef40b3860 0x7f5ef40b1ed0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 --2- 172.21.15.57:0/1423414682 >> v2:172.21.15.132:3300/0 conn(0x7f5ef4070400 0x7f5ef40b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 --2- 172.21.15.57:0/1423414682 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4143ad0 0x7f5ef40cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 -- 172.21.15.57:0/1423414682 >> 172.21.15.57:0/1423414682 conn(0x7f5ef406dcc0 msgr2=0x7f5ef406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:45.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 -- 172.21.15.57:0/1423414682 shutdown_connections 2023-11-24T08:07:45.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.595+0000 7f5ef9357640 1 -- 172.21.15.57:0/1423414682 wait complete. 2023-11-24T08:07:45.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 Processor -- start 2023-11-24T08:07:45.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 -- start start 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4070400 0x7f5ef4141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ef40b3860 0x7f5ef4139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef4143ad0 0x7f5ef4161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef413a200 con 0x7f5ef4143ad0 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef4141020 con 0x7f5ef40b3860 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef413c650 con 0x7f5ef4070400 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef4143ad0 0x7f5ef4161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef4143ad0 0x7f5ef4161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50522/0 (socket says 172.21.15.57:50522) 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 -- 172.21.15.57:0/3053476571 learned_addr learned my addr 172.21.15.57:0/3053476571 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:45.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5eebfff640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ef40b3860 0x7f5ef4139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef2ffd640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4070400 0x7f5ef4141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 -- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4070400 msgr2=0x7f5ef4141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4070400 0x7f5ef4141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 -- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ef40b3860 msgr2=0x7f5ef4139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ef40b3860 0x7f5ef4139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 -- 172.21.15.57:0/3053476571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009b30 con 0x7f5ef4143ad0 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef2ffd640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4070400 0x7f5ef4141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:45.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef37fe640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef4143ad0 0x7f5ef4161fe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0af040 tx=0x7f5eec0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5eeb7fe640 1 -- 172.21.15.57:0/3053476571 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0b8670 con 0x7f5ef4143ad0 2023-11-24T08:07:45.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5eeb7fe640 1 -- 172.21.15.57:0/3053476571 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec0b87d0 con 0x7f5ef4143ad0 2023-11-24T08:07:45.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5eeb7fe640 1 -- 172.21.15.57:0/3053476571 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0b8b80 con 0x7f5ef4143ad0 2023-11-24T08:07:45.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef41412c0 con 0x7f5ef4143ad0 2023-11-24T08:07:45.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.599+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef4141880 con 0x7f5ef4143ad0 2023-11-24T08:07:45.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.603+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef4141a70 con 0x7f5ef4143ad0 2023-11-24T08:07:45.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.603+0000 7f5eeb7fe640 1 -- 172.21.15.57:0/3053476571 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5eec0b8ce0 con 0x7f5ef4143ad0 2023-11-24T08:07:45.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.603+0000 7f5eeb7fe640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5ed4066670 0x7f5ed4068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:45.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.603+0000 7f5eeb7fe640 1 -- 172.21.15.57:0/3053476571 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5eec11f490 con 0x7f5ef4143ad0 2023-11-24T08:07:45.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.603+0000 7f5ef2ffd640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5ed4066670 0x7f5ed4068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:45.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.603+0000 7f5ef2ffd640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5ed4066670 0x7f5ed4068b30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400b9f0 tx=0x7f5ee4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:45.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.607+0000 7f5eeb7fe640 1 -- 172.21.15.57:0/3053476571 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5eec0ec6e0 con 0x7f5ef4143ad0 2023-11-24T08:07:45.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:45.767+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ef404e850 con 0x7f5ef4143ad0 2023-11-24T08:07:46.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.415+0000 7f5eeb7fe640 1 -- 172.21.15.57:0/3053476571 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5eec009510 con 0x7f5ef4143ad0 2023-11-24T08:07:46.419 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:07:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5ed4066670 msgr2=0x7f5ed4068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5ed4066670 0x7f5ed4068b30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400b9f0 tx=0x7f5ee4008040 comp rx=0 tx=0).stop 2023-11-24T08:07:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef4143ad0 msgr2=0x7f5ef4161fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef4143ad0 0x7f5ef4161fe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0af040 tx=0x7f5eec0194b0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 shutdown_connections 2023-11-24T08:07:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5ed4066670 0x7f5ed4068b30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef4143ad0 0x7f5ef4161fe0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ef40b3860 0x7f5ef4139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 --2- 172.21.15.57:0/3053476571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5ef4070400 0x7f5ef4141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 >> 172.21.15.57:0/3053476571 conn(0x7f5ef406dcc0 msgr2=0x7f5ef40ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 shutdown_connections 2023-11-24T08:07:46.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.419+0000 7f5ef9357640 1 -- 172.21.15.57:0/3053476571 wait complete. 2023-11-24T08:07:46.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:07:46.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffaead72640 1 Processor -- start 2023-11-24T08:07:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffaead72640 1 -- start start 2023-11-24T08:07:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffaead72640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffae406d5f0 0x7ffae406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffaead72640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae40ae950 con 0x7ffae4159a80 2023-11-24T08:07:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffaead72640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae40b1ef0 con 0x7ffae40b3670 2023-11-24T08:07:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffaead72640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae40adca0 con 0x7ffae406d5f0 2023-11-24T08:07:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffae3fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffae406d5f0 0x7ffae406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffae8b0e640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffae4159a80 0x7ffae406cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58488/0 (socket says 172.21.15.57:58488) 2023-11-24T08:07:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffae8b0e640 1 -- 172.21.15.57:0/1478257478 learned_addr learned my addr 172.21.15.57:0/1478257478 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffae3fff640 1 -- 172.21.15.57:0/1478257478 >> v1:172.21.15.132:6789/0 conn(0x7ffae40b3670 legacy=0x7ffae40ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:46.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffae3fff640 1 -- 172.21.15.57:0/1478257478 >> v1:172.21.15.57:6789/0 conn(0x7ffae4159a80 legacy=0x7ffae406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffae3fff640 1 -- 172.21.15.57:0/1478257478 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae40adf80 con 0x7ffae406d5f0 2023-11-24T08:07:46.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.599+0000 7ffae37fe640 1 -- 172.21.15.57:0/1478257478 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987287942 0 0) 0x7ffae40ae950 con 0x7ffae4159a80 2023-11-24T08:07:46.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffae3fff640 1 --2- 172.21.15.57:0/1478257478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae406d5f0 0x7ffae406de50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffad00097c0 tx=0x7ffad001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1ecdb8582f3e28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffae37fe640 1 -- 172.21.15.57:0/1478257478 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad00ab600 con 0x7ffae406d5f0 2023-11-24T08:07:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffae37fe640 1 -- 172.21.15.57:0/1478257478 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad00a7050 con 0x7ffae406d5f0 2023-11-24T08:07:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffae37fe640 1 -- 172.21.15.57:0/1478257478 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad00ab980 con 0x7ffae406d5f0 2023-11-24T08:07:46.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffaead72640 1 -- 172.21.15.57:0/1478257478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae406d5f0 msgr2=0x7ffae406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffaead72640 1 --2- 172.21.15.57:0/1478257478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae406d5f0 0x7ffae406de50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffad00097c0 tx=0x7ffad001c380 comp rx=0 tx=0).stop 2023-11-24T08:07:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffaead72640 1 -- 172.21.15.57:0/1478257478 shutdown_connections 2023-11-24T08:07:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffaead72640 1 --2- 172.21.15.57:0/1478257478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae406d5f0 0x7ffae406de50 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffaead72640 1 -- 172.21.15.57:0/1478257478 >> 172.21.15.57:0/1478257478 conn(0x7ffae40b0bf0 msgr2=0x7ffae40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffaead72640 1 -- 172.21.15.57:0/1478257478 shutdown_connections 2023-11-24T08:07:46.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.603+0000 7ffaead72640 1 -- 172.21.15.57:0/1478257478 wait complete. 2023-11-24T08:07:46.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 Processor -- start 2023-11-24T08:07:46.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 -- start start 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffae406d5f0 0x7ffae409ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffae40b3670 0x7ffae4163870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae4159a80 0x7ffae41481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae415aa70 con 0x7ffae4159a80 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae41648c0 con 0x7ffae40b3670 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae4163f00 con 0x7ffae406d5f0 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae4159a80 0x7ffae41481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae4159a80 0x7ffae41481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38778/0 (socket says 172.21.15.57:38778) 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 -- 172.21.15.57:0/3473184179 learned_addr learned my addr 172.21.15.57:0/3473184179 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae3fff640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffae40b3670 0x7ffae4163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae8b0e640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffae406d5f0 0x7ffae409ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 -- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffae406d5f0 msgr2=0x7ffae409ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffae406d5f0 0x7ffae409ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 -- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffae40b3670 msgr2=0x7ffae4163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffae40b3670 0x7ffae4163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 -- 172.21.15.57:0/3473184179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0009420 con 0x7ffae4159a80 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae8b0e640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffae406d5f0 0x7ffae409ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae930f640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae4159a80 0x7ffae41481c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c780 tx=0x7ffadc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae17fa640 1 -- 172.21.15.57:0/3473184179 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc004b70 con 0x7ffae4159a80 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae17fa640 1 -- 172.21.15.57:0/3473184179 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc00ce90 con 0x7ffae4159a80 2023-11-24T08:07:46.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae415a140 con 0x7ffae4159a80 2023-11-24T08:07:46.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffae17fa640 1 -- 172.21.15.57:0/3473184179 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00a850 con 0x7ffae4159a80 2023-11-24T08:07:46.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.607+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae415a700 con 0x7ffae4159a80 2023-11-24T08:07:46.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.611+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae415abe0 con 0x7ffae4159a80 2023-11-24T08:07:46.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.611+0000 7ffae17fa640 1 -- 172.21.15.57:0/3473184179 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ffadc00a9b0 con 0x7ffae4159a80 2023-11-24T08:07:46.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.611+0000 7ffae17fa640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffac8066650 0x7ffac8068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:46.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.611+0000 7ffae17fa640 1 -- 172.21.15.57:0/3473184179 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5357+0+0 (secure 0 0 0) 0x7ffadc084100 con 0x7ffae4159a80 2023-11-24T08:07:46.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.611+0000 7ffae8b0e640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffac8066650 0x7ffac8068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:46.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.611+0000 7ffae8b0e640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffac8066650 0x7ffac8068b10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffad8000f70 tx=0x7ffad8007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:46.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.615+0000 7ffae17fa640 1 -- 172.21.15.57:0/3473184179 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffadc051440 con 0x7ffae4159a80 2023-11-24T08:07:46.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:46.775+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffae4067520 con 0x7ffae4159a80 2023-11-24T08:07:47.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.423+0000 7ffae17fa640 1 -- 172.21.15.57:0/3473184179 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffadc054a60 con 0x7ffae4159a80 2023-11-24T08:07:47.429 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-11-24T08:07:47.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffac8066650 msgr2=0x7ffac8068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffac8066650 0x7ffac8068b10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffad8000f70 tx=0x7ffad8007cb0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae4159a80 msgr2=0x7ffae41481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae4159a80 0x7ffae41481c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c780 tx=0x7ffadc00cc40 comp rx=0 tx=0).stop 2023-11-24T08:07:47.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 shutdown_connections 2023-11-24T08:07:47.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ffac8066650 0x7ffac8068b10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffae4159a80 0x7ffae41481c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffae40b3670 0x7ffae4163870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 --2- 172.21.15.57:0/3473184179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffae406d5f0 0x7ffae409ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 >> 172.21.15.57:0/3473184179 conn(0x7ffae40b0bf0 msgr2=0x7ffae40ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 shutdown_connections 2023-11-24T08:07:47.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.427+0000 7ffaead72640 1 -- 172.21.15.57:0/3473184179 wait complete. 2023-11-24T08:07:47.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:07:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.603+0000 7f9d638c9640 1 Processor -- start 2023-11-24T08:07:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.603+0000 7f9d638c9640 1 -- start start 2023-11-24T08:07:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d638c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d5c15d450 0x7f9d5c161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d638c9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9d5c06dac0 0x7f9d5c0ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d638c9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c06b460 con 0x7f9d5c06b8f0 2023-11-24T08:07:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d638c9640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c06a5b0 con 0x7f9d5c06dac0 2023-11-24T08:07:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d638c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c162030 con 0x7f9d5c15d450 2023-11-24T08:07:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d61e66640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9d5c06dac0 0x7f9d5c0ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d60e64640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9d5c06b8f0 0x7f9d5c06d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58498/0 (socket says 172.21.15.57:58498) 2023-11-24T08:07:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d60e64640 1 -- 172.21.15.57:0/3880840293 learned_addr learned my addr 172.21.15.57:0/3880840293 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d61665640 1 --2- 172.21.15.57:0/3880840293 >> v2:172.21.15.132:3300/0 conn(0x7f9d5c15d450 0x7f9d5c161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d61e66640 1 -- 172.21.15.57:0/3880840293 >> v2:172.21.15.132:3300/0 conn(0x7f9d5c15d450 msgr2=0x7f9d5c161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d61e66640 1 --2- 172.21.15.57:0/3880840293 >> v2:172.21.15.132:3300/0 conn(0x7f9d5c15d450 0x7f9d5c161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d61e66640 1 -- 172.21.15.57:0/3880840293 >> v1:172.21.15.57:6789/0 conn(0x7f9d5c06b8f0 legacy=0x7f9d5c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d61e66640 1 -- 172.21.15.57:0/3880840293 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c06a850 con 0x7f9d5c06dac0 2023-11-24T08:07:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d53fff640 1 -- 172.21.15.57:0/3880840293 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936528567 0 0) 0x7f9d5c06b460 con 0x7f9d5c06b8f0 2023-11-24T08:07:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.607+0000 7f9d61665640 1 --2- 172.21.15.57:0/3880840293 >> v2:172.21.15.132:3300/0 conn(0x7f9d5c15d450 0x7f9d5c161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:47.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d61e66640 1 --2- 172.21.15.57:0/3880840293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c0ac850 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0b4db0 tx=0x7f9d5401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82867c050c58b9e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d53fff640 1 -- 172.21.15.57:0/3880840293 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540a59a0 con 0x7f9d5c06dac0 2023-11-24T08:07:47.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d53fff640 1 -- 172.21.15.57:0/3880840293 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540a5b00 con 0x7f9d5c06dac0 2023-11-24T08:07:47.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d53fff640 1 -- 172.21.15.57:0/3880840293 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540a5e90 con 0x7f9d5c06dac0 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- 172.21.15.57:0/3880840293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 msgr2=0x7f9d5c0ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 --2- 172.21.15.57:0/3880840293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c0ac850 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0b4db0 tx=0x7f9d5401c8e0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- 172.21.15.57:0/3880840293 shutdown_connections 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 --2- 172.21.15.57:0/3880840293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c0ac850 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 --2- 172.21.15.57:0/3880840293 >> v2:172.21.15.132:3300/0 conn(0x7f9d5c15d450 0x7f9d5c161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- 172.21.15.57:0/3880840293 >> 172.21.15.57:0/3880840293 conn(0x7f9d5c0cf8f0 msgr2=0x7f9d5c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- 172.21.15.57:0/3880840293 shutdown_connections 2023-11-24T08:07:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- 172.21.15.57:0/3880840293 wait complete. 2023-11-24T08:07:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 Processor -- start 2023-11-24T08:07:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- start start 2023-11-24T08:07:47.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c06b8f0 0x7f9d5c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d5c15d450 0x7f9d5c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c153e00 con 0x7f9d5c06dac0 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1595b0 con 0x7f9d5c06b8f0 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.611+0000 7f9d638c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c159890 con 0x7f9d5c15d450 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38796/0 (socket says 172.21.15.57:38796) 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 -- 172.21.15.57:0/4106994382 learned_addr learned my addr 172.21.15.57:0/4106994382 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d61e66640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d5c15d450 0x7f9d5c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d61665640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c06b8f0 0x7f9d5c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 -- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d5c15d450 msgr2=0x7f9d5c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d5c15d450 0x7f9d5c14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 -- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c06b8f0 msgr2=0x7f9d5c0ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c06b8f0 0x7f9d5c0ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 -- 172.21.15.57:0/4106994382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009a70 con 0x7f9d5c06dac0 2023-11-24T08:07:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d60e64640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c155850 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0011f0 tx=0x7f9d4c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d51ffb640 1 -- 172.21.15.57:0/4106994382 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0074e0 con 0x7f9d5c06dac0 2023-11-24T08:07:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d51ffb640 1 -- 172.21.15.57:0/4106994382 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c007640 con 0x7f9d5c06dac0 2023-11-24T08:07:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d51ffb640 1 -- 172.21.15.57:0/4106994382 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c004a10 con 0x7f9d5c06dac0 2023-11-24T08:07:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c159b70 con 0x7f9d5c06dac0 2023-11-24T08:07:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0adf40 con 0x7f9d5c06dac0 2023-11-24T08:07:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c159d60 con 0x7f9d5c06dac0 2023-11-24T08:07:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.615+0000 7f9d51ffb640 1 -- 172.21.15.57:0/4106994382 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f9d4c004b70 con 0x7f9d5c06dac0 2023-11-24T08:07:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.619+0000 7f9d51ffb640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d40066620 0x7f9d40068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.619+0000 7f9d51ffb640 1 -- 172.21.15.57:0/4106994382 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d4c083240 con 0x7f9d5c06dac0 2023-11-24T08:07:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.619+0000 7f9d61665640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d40066620 0x7f9d40068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.619+0000 7f9d61665640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d40066620 0x7f9d40068ae0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800ba10 tx=0x7f9d58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.623+0000 7f9d51ffb640 1 -- 172.21.15.57:0/4106994382 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d4c0506a0 con 0x7f9d5c06dac0 2023-11-24T08:07:47.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.783+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9d5c04e8c0 con 0x7f9d5c06dac0 2023-11-24T08:07:47.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d51ffb640 1 -- 172.21.15.57:0/4106994382 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9d4c053cc0 con 0x7f9d5c06dac0 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d40066620 msgr2=0x7f9d40068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d40066620 0x7f9d40068ae0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800ba10 tx=0x7f9d58008040 comp rx=0 tx=0).stop 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 msgr2=0x7f9d5c155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c155850 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0011f0 tx=0x7f9d4c00c9b0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 shutdown_connections 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9d40066620 0x7f9d40068ae0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d5c15d450 0x7f9d5c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d5c06dac0 0x7f9d5c155850 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 --2- 172.21.15.57:0/4106994382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d5c06b8f0 0x7f9d5c0ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 >> 172.21.15.57:0/4106994382 conn(0x7f9d5c0cf8f0 msgr2=0x7f9d5c0af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 shutdown_connections 2023-11-24T08:07:47.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.787+0000 7f9d638c9640 1 -- 172.21.15.57:0/4106994382 wait complete. 2023-11-24T08:07:47.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:07:47.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.951+0000 7f9b5189a640 1 Processor -- start 2023-11-24T08:07:47.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.951+0000 7f9b5189a640 1 -- start start 2023-11-24T08:07:47.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b5189a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b4c144030 0x7f9b4c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b5189a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b4c09cc20 0x7f9b4c06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b5189a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c06d8b0 con 0x7f9b4c06e280 2023-11-24T08:07:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b5189a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c145020 con 0x7f9b4c144030 2023-11-24T08:07:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b5189a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c09d0a0 con 0x7f9b4c09cc20 2023-11-24T08:07:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b4c144030 0x7f9b4c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4b7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9b4c06e280 0x7f9b4c0709c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58500/0 (socket says 172.21.15.57:58500) 2023-11-24T08:07:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4b7fe640 1 -- 172.21.15.57:0/123236857 learned_addr learned my addr 172.21.15.57:0/123236857 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b43fff640 1 --2- 172.21.15.57:0/123236857 >> v2:172.21.15.132:3300/0 conn(0x7f9b4c09cc20 0x7f9b4c06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4affd640 1 -- 172.21.15.57:0/123236857 >> v2:172.21.15.132:3300/0 conn(0x7f9b4c09cc20 msgr2=0x7f9b4c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4affd640 1 --2- 172.21.15.57:0/123236857 >> v2:172.21.15.132:3300/0 conn(0x7f9b4c09cc20 0x7f9b4c06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4affd640 1 -- 172.21.15.57:0/123236857 >> v1:172.21.15.57:6789/0 conn(0x7f9b4c06e280 legacy=0x7f9b4c0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4affd640 1 -- 172.21.15.57:0/123236857 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c06cca0 con 0x7f9b4c144030 2023-11-24T08:07:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b43fff640 1 --2- 172.21.15.57:0/123236857 >> v2:172.21.15.132:3300/0 conn(0x7f9b4c09cc20 0x7f9b4c06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4a7fc640 1 -- 172.21.15.57:0/123236857 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824334389 0 0) 0x7f9b4c06d8b0 con 0x7f9b4c06e280 2023-11-24T08:07:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.955+0000 7f9b4affd640 1 --2- 172.21.15.57:0/123236857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c144030 0x7f9b4c06c650 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0700a0 tx=0x7f9b3c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365877987ac656a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b4a7fc640 1 -- 172.21.15.57:0/123236857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0a7070 con 0x7f9b4c144030 2023-11-24T08:07:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b4a7fc640 1 -- 172.21.15.57:0/123236857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0ab430 con 0x7f9b4c144030 2023-11-24T08:07:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b4a7fc640 1 -- 172.21.15.57:0/123236857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0ab7c0 con 0x7f9b4c144030 2023-11-24T08:07:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- 172.21.15.57:0/123236857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c144030 msgr2=0x7f9b4c06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 --2- 172.21.15.57:0/123236857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c144030 0x7f9b4c06c650 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0700a0 tx=0x7f9b3c01c430 comp rx=0 tx=0).stop 2023-11-24T08:07:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- 172.21.15.57:0/123236857 shutdown_connections 2023-11-24T08:07:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 --2- 172.21.15.57:0/123236857 >> v2:172.21.15.132:3300/0 conn(0x7f9b4c09cc20 0x7f9b4c06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 --2- 172.21.15.57:0/123236857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c144030 0x7f9b4c06c650 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- 172.21.15.57:0/123236857 >> 172.21.15.57:0/123236857 conn(0x7f9b4c0b0bf0 msgr2=0x7f9b4c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- 172.21.15.57:0/123236857 shutdown_connections 2023-11-24T08:07:47.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- 172.21.15.57:0/123236857 wait complete. 2023-11-24T08:07:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 Processor -- start 2023-11-24T08:07:47.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- start start 2023-11-24T08:07:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b4c06e280 0x7f9b4c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c09cc20 0x7f9b4c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b4c144030 0x7f9b4c1f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1599f0 con 0x7f9b4c09cc20 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1f4b10 con 0x7f9b4c144030 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b5189a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1f4df0 con 0x7f9b4c06e280 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c09cc20 0x7f9b4c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c09cc20 0x7f9b4c1590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38818/0 (socket says 172.21.15.57:38818) 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b43fff640 1 -- 172.21.15.57:0/402464986 learned_addr learned my addr 172.21.15.57:0/402464986 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b4b7fe640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b4c144030 0x7f9b4c1f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.959+0000 7f9b4affd640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b4c06e280 0x7f9b4c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b43fff640 1 -- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b4c06e280 msgr2=0x7f9b4c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b43fff640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b4c06e280 0x7f9b4c0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b43fff640 1 -- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b4c144030 msgr2=0x7f9b4c1f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b43fff640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b4c144030 0x7f9b4c1f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b43fff640 1 -- 172.21.15.57:0/402464986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009420 con 0x7f9b4c09cc20 2023-11-24T08:07:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b4affd640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b4c06e280 0x7f9b4c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b43fff640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c09cc20 0x7f9b4c1590a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c7c0 tx=0x7f9b3400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b48ff9640 1 -- 172.21.15.57:0/402464986 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34007a30 con 0x7f9b4c09cc20 2023-11-24T08:07:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b48ff9640 1 -- 172.21.15.57:0/402464986 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34007b90 con 0x7f9b4c09cc20 2023-11-24T08:07:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b48ff9640 1 -- 172.21.15.57:0/402464986 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400ce70 con 0x7f9b4c09cc20 2023-11-24T08:07:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c159c90 con 0x7f9b4c09cc20 2023-11-24T08:07:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c0ce180 con 0x7f9b4c09cc20 2023-11-24T08:07:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c159ed0 con 0x7f9b4c09cc20 2023-11-24T08:07:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.963+0000 7f9b48ff9640 1 -- 172.21.15.57:0/402464986 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f9b340113f0 con 0x7f9b4c09cc20 2023-11-24T08:07:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.967+0000 7f9b48ff9640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9b2c066670 0x7f9b2c068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.967+0000 7f9b48ff9640 1 -- 172.21.15.57:0/402464986 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b340842b0 con 0x7f9b4c09cc20 2023-11-24T08:07:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.967+0000 7f9b4affd640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9b2c066670 0x7f9b2c068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:47.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.967+0000 7f9b4affd640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9b2c066670 0x7f9b2c068b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0af000 tx=0x7f9b3c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:47.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:47.967+0000 7f9b48ff9640 1 -- 172.21.15.57:0/402464986 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b4c159ed0 con 0x7f9b4c09cc20 2023-11-24T08:07:48.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.187+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f9b4c159ed0 con 0x7f9b4c09cc20 2023-11-24T08:07:48.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b48ff9640 1 -- 172.21.15.57:0/402464986 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v211) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9b4c159ed0 con 0x7f9b4c09cc20 2023-11-24T08:07:48.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9b2c066670 msgr2=0x7f9b2c068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9b2c066670 0x7f9b2c068b30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0af000 tx=0x7f9b3c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:48.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c09cc20 msgr2=0x7f9b4c1590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:48.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c09cc20 0x7f9b4c1590a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c7c0 tx=0x7f9b3400cc80 comp rx=0 tx=0).stop 2023-11-24T08:07:48.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 shutdown_connections 2023-11-24T08:07:48.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f9b2c066670 0x7f9b2c068b30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b4c144030 0x7f9b4c1f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b4c09cc20 0x7f9b4c1590a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 --2- 172.21.15.57:0/402464986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b4c06e280 0x7f9b4c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:48.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.427+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 >> 172.21.15.57:0/402464986 conn(0x7f9b4c0b0bf0 msgr2=0x7f9b4c0abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:48.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.431+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 shutdown_connections 2023-11-24T08:07:48.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:48.431+0000 7f9b5189a640 1 -- 172.21.15.57:0/402464986 wait complete. 2023-11-24T08:07:48.455 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ERROR 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 7874, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:07:48.456 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:Ran 3 tests in 201.669s 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 7874, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:07:48.457 INFO:tasks.cephfs_test_runner: 2023-11-24T08:07:48.458 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:48.523 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a2d6d13da75b44518c63bc788c0732cf Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:07:48.524 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T08:07:48.534 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-24T08:07:48.549 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T08:07:48.549 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:48.550 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:48.562 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:07:48.562 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-11-24T08:07:48.563 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:48.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9350 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:07:48.614 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:48.614 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:48.624 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:07:48.624 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-11-24T08:07:48.624 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:07:48.675 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=870 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:07:48.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:48.676 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:07:48.685 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:07:48.685 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:07:48.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:48.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:07:48.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:48.752 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:07:48.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:48.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-11-24T08:07:49.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.048 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-11-24T08:07:49.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-11-24T08:07:49.124 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-11-24T08:07:49.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:07:49.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.127 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:07:49.138 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:07:49.138 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:07:49.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:07:49.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:07:49.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-11-24T08:07:49.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.470 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-11-24T08:07:49.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:07:49.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-11-24T08:07:49.549 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2023-11-24T08:07:49.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:07:49.551 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T08:07:49.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:07:49.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.703+0000 7faff88fe640 1 Processor -- start 2023-11-24T08:07:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.703+0000 7faff88fe640 1 -- start start 2023-11-24T08:07:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.703+0000 7faff88fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff406d5f0 0x7faff406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.703+0000 7faff88fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faff40b3670 0x7faff40ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.703+0000 7faff88fe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40ae950 con 0x7faff4159a80 2023-11-24T08:07:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.703+0000 7faff88fe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40b1ef0 con 0x7faff40b3670 2023-11-24T08:07:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.703+0000 7faff88fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff40adca0 con 0x7faff406d5f0 2023-11-24T08:07:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7fafebfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff406d5f0 0x7faff406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7faff259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faff4159a80 0x7faff406cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:48582/0 (socket says 172.21.15.57:48582) 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7faff259c640 1 -- 172.21.15.57:0/2077845093 learned_addr learned my addr 172.21.15.57:0/2077845093 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7faff2d9d640 1 --2- 172.21.15.57:0/2077845093 >> v2:172.21.15.132:3300/0 conn(0x7faff40b3670 0x7faff40ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7faff1d9b640 1 -- 172.21.15.57:0/2077845093 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281614726 0 0) 0x7faff40ae950 con 0x7faff4159a80 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7faff1d9b640 1 -- 172.21.15.57:0/2077845093 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe0003530 con 0x7faff4159a80 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7fafebfff640 1 -- 172.21.15.57:0/2077845093 >> v2:172.21.15.132:3300/0 conn(0x7faff40b3670 msgr2=0x7faff40ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7fafebfff640 1 --2- 172.21.15.57:0/2077845093 >> v2:172.21.15.132:3300/0 conn(0x7faff40b3670 0x7faff40ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7fafebfff640 1 -- 172.21.15.57:0/2077845093 >> v1:172.21.15.132:6789/0 conn(0x7faff4159a80 legacy=0x7faff406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7fafebfff640 1 -- 172.21.15.57:0/2077845093 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40adf80 con 0x7faff406d5f0 2023-11-24T08:07:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.707+0000 7fafebfff640 1 --2- 172.21.15.57:0/2077845093 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff406d5f0 0x7faff406de50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097c0 tx=0x7fafdc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73eb10b84b82fdfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff1d9b640 1 -- 172.21.15.57:0/2077845093 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0ac630 con 0x7faff406d5f0 2023-11-24T08:07:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff1d9b640 1 -- 172.21.15.57:0/2077845093 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc0ac790 con 0x7faff406d5f0 2023-11-24T08:07:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff1d9b640 1 -- 172.21.15.57:0/2077845093 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0acb20 con 0x7faff406d5f0 2023-11-24T08:07:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- 172.21.15.57:0/2077845093 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff406d5f0 msgr2=0x7faff406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 --2- 172.21.15.57:0/2077845093 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff406d5f0 0x7faff406de50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097c0 tx=0x7fafdc01c450 comp rx=0 tx=0).stop 2023-11-24T08:07:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- 172.21.15.57:0/2077845093 shutdown_connections 2023-11-24T08:07:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 --2- 172.21.15.57:0/2077845093 >> v2:172.21.15.132:3300/0 conn(0x7faff40b3670 0x7faff40ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 --2- 172.21.15.57:0/2077845093 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff406d5f0 0x7faff406de50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- 172.21.15.57:0/2077845093 >> 172.21.15.57:0/2077845093 conn(0x7faff40b0bf0 msgr2=0x7faff40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- 172.21.15.57:0/2077845093 shutdown_connections 2023-11-24T08:07:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- 172.21.15.57:0/2077845093 wait complete. 2023-11-24T08:07:49.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 Processor -- start 2023-11-24T08:07:49.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- start start 2023-11-24T08:07:49.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff406d5f0 0x7faff4148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff40b3670 0x7faff4166ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff4159a80 0x7faff414d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff4148d80 con 0x7faff406d5f0 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff4148b90 con 0x7faff4159a80 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff88fe640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff4148fd0 con 0x7faff40b3670 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff406d5f0 0x7faff4148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff406d5f0 0x7faff4148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38830/0 (socket says 172.21.15.57:38830) 2023-11-24T08:07:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.711+0000 7faff259c640 1 -- 172.21.15.57:0/1360546747 learned_addr learned my addr 172.21.15.57:0/1360546747 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7fafebfff640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff40b3670 0x7faff4166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff2d9d640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff4159a80 0x7faff414d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff259c640 1 -- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff40b3670 msgr2=0x7faff4166ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff259c640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff40b3670 0x7faff4166ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff259c640 1 -- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff4159a80 msgr2=0x7faff414d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff259c640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff4159a80 0x7faff414d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff259c640 1 -- 172.21.15.57:0/1360546747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009420 con 0x7faff406d5f0 2023-11-24T08:07:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff2d9d640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff4159a80 0x7faff414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff259c640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff406d5f0 0x7faff4148650 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fafe400c450 tx=0x7fafe400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7fafeaffd640 1 -- 172.21.15.57:0/1360546747 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4005cf0 con 0x7faff406d5f0 2023-11-24T08:07:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7fafeaffd640 1 -- 172.21.15.57:0/1360546747 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe4005e50 con 0x7faff406d5f0 2023-11-24T08:07:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7fafeaffd640 1 -- 172.21.15.57:0/1360546747 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4007270 con 0x7faff406d5f0 2023-11-24T08:07:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff41492b0 con 0x7faff406d5f0 2023-11-24T08:07:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff4149870 con 0x7faff406d5f0 2023-11-24T08:07:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff406e310 con 0x7faff406d5f0 2023-11-24T08:07:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7fafeaffd640 1 -- 172.21.15.57:0/1360546747 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fafe40073d0 con 0x7faff406d5f0 2023-11-24T08:07:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7fafeaffd640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fafd4066620 0x7fafd4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.715+0000 7fafeaffd640 1 -- 172.21.15.57:0/1360546747 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fafe40831d0 con 0x7faff406d5f0 2023-11-24T08:07:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.719+0000 7fafebfff640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fafd4066620 0x7fafd4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.719+0000 7fafebfff640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fafd4066620 0x7fafd4068ae0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0ae000 tx=0x7fafdc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:49.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.719+0000 7fafeaffd640 1 -- 172.21.15.57:0/1360546747 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafe4050820 con 0x7faff406d5f0 2023-11-24T08:07:49.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.875+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faff4067520 con 0x7fafd4066620 2023-11-24T08:07:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7fafeaffd640 1 -- 172.21.15.57:0/1360546747 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50859 (secure 0 0 0) 0x7faff4067520 con 0x7fafd4066620 2023-11-24T08:07:49.883 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:49.884 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:07:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fafd4066620 msgr2=0x7fafd4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fafd4066620 0x7fafd4068ae0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0ae000 tx=0x7fafdc008040 comp rx=0 tx=0).stop 2023-11-24T08:07:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff406d5f0 msgr2=0x7faff4148650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff406d5f0 0x7faff4148650 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fafe400c450 tx=0x7fafe400c910 comp rx=0 tx=0).stop 2023-11-24T08:07:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 shutdown_connections 2023-11-24T08:07:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fafd4066620 0x7fafd4068ae0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faff4159a80 0x7faff414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faff40b3670 0x7faff4166ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 --2- 172.21.15.57:0/1360546747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff406d5f0 0x7faff4148650 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:49.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 >> 172.21.15.57:0/1360546747 conn(0x7faff40b0bf0 msgr2=0x7faff40cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:49.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 shutdown_connections 2023-11-24T08:07:49.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:49.879+0000 7faff88fe640 1 -- 172.21.15.57:0/1360546747 wait complete. 2023-11-24T08:07:49.905 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-11-24T08:07:48.736782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248104,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726616,"statfs":{"total":773094113280,"available":772840054784,"internally_reserved":0,"allocated":7151616,"data_stored":3641454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4187,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001440"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":197,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.304862+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:07:28.304862+0000","last_peered":"2023-11-24T08:07:28.304862+0000","last_clean":"2023-11-24T08:07:28.304862+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:07:28.304862+0000","last_undegraded":"2023-11-24T08:07:28.304862+0000","last_fullsized":"2023-11-24T08:07:28.304862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1339392,"data_stored":897071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.87,"15min":0.92100000000000004},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90400000000000003,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91700000000000004,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.51900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96399999999999997,"5min":5.923,"15min":5.923},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.85899999999999999,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.872,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84099999999999997,"15min":0.90000000000000002},"min":{"1min":0.57699999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.61699999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.621}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.879,"15min":0.94099999999999995},"min":{"1min":0.629,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.88800000000000001,"15min":0.95099999999999996},"min":{"1min":0.54800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80500000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.872},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.495,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.752,"15min":0.77600000000000002},"min":{"1min":0.54000000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":1.091,"15min":1.091},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.81599999999999995,"15min":0.85599999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.581,"15min":1.581},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76500000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":306543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.64000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.747},"min":{"1min":0.61699999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.95499999999999996,"5min":1.347,"15min":1.347},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88,"5min":1.982,"15min":1.982},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74099999999999999,"15min":0.70899999999999996},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93200000000000005,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99299999999999999,"5min":3.657,"15min":3.657},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83499999999999996},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90000000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":3.391,"15min":3.391},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.746},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96999999999999997,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.77300000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":307195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95099999999999996,"5min":2.698,"15min":2.698},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.64200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.93899999999999995,"5min":1.794,"15min":1.794},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71899999999999997,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90600000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.57299999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.831,"15min":1.831},"last":0.754}]},{"osd":3,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.88800000000000001,"15min":0.83799999999999997},"min":{"1min":0.67700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.89100000000000001,"5min":8.2880000000000003,"15min":8.2880000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":1.006,"15min":1.006},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":1.087,"15min":1.087},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.238,"15min":1.238},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73799999999999999,"15min":0.76100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.878,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96899999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95499999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.80200000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":309932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.59399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.022,"15min":1.022},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.755},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86599999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66400000000000003,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.98099999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.88800000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":306599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.625,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.67600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.21,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.53000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.054,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1080000000000001,"5min":1.258,"15min":1.258},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.173,"5min":1.272,"15min":1.272},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.66500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.24,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.155,"15min":1.155},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1319999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.103,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72999999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":306599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.44},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67500000000000004,"15min":0.745},"min":{"1min":0.40999999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75600000000000001,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.71299999999999997,"15min":0.79200000000000004},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61899999999999999,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":5.907,"15min":5.907},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.71699999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0109999999999999,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.64400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.883,"15min":1.883},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.72799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.034,"5min":1.147,"15min":1.147},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.69699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.0609999999999999,"5min":1.923,"15min":1.923},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.78700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.964,"15min":1.964},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1339999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":306633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.52400000000000002,"15min":0.56799999999999995},"min":{"1min":0.34300000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74299999999999999,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.67300000000000004,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.67100000000000004,"15min":0.73699999999999999},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64400000000000002,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.75600000000000001,"15min":0.84399999999999997},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71999999999999997,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66800000000000004,"15min":0.72599999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81499999999999995,"15min":0.84999999999999998},"min":{"1min":0.52100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.131,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96499999999999997,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89900000000000002,"15min":0.96699999999999997},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.875,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1890000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93500000000000005,"15min":0.99099999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.60399999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":1.0820000000000001},"min":{"1min":0.64000000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1060000000000001,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.98899999999999999},"min":{"1min":0.56299999999999994,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0329999999999999,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.91800000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1347584,"data_stored":900882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.83799999999999997,"15min":1.0229999999999999},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83499999999999996,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63600000000000001,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.435}]},{"osd":2,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.68899999999999995},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81100000000000005,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.71299999999999997,"15min":0.81100000000000005},"min":{"1min":0.379,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.94599999999999995,"15min":1.1180000000000001},"min":{"1min":0.48199999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.88900000000000001,"15min":0.93700000000000006},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.046,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.0720000000000001},"min":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.98699999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.117,"15min":1.274},"min":{"1min":0.60299999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0780000000000001,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.175,"15min":1.3520000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0149999999999999,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.002,"15min":1.1040000000000001},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.113,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.87},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.0289999999999999,"15min":1.133},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1339999999999999,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88100000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0980000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.052,"15min":1.157},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.04,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.91900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:49.907 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bee46640 1 Processor -- start 2023-11-24T08:07:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bee46640 1 -- start start 2023-11-24T08:07:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bee46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23b80b36c0 0x7f23b80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bee46640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bee46640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b815a700 con 0x7f23b815a320 2023-11-24T08:07:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bee46640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80b2430 con 0x7f23b80b36c0 2023-11-24T08:07:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bee46640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80b2620 con 0x7f23b8070da0 2023-11-24T08:07:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bcbe2640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f23b815a320 0x7f23b8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58514/0 (socket says 172.21.15.57:58514) 2023-11-24T08:07:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bcbe2640 1 -- 172.21.15.57:0/1684194208 learned_addr learned my addr 172.21.15.57:0/1684194208 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23bd3e3640 1 --2- 172.21.15.57:0/1684194208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.047+0000 7f23b7fff640 1 --2- 172.21.15.57:0/1684194208 >> v2:172.21.15.132:3300/0 conn(0x7f23b80b36c0 0x7f23b80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23b77fe640 1 -- 172.21.15.57:0/1684194208 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767125832 0 0) 0x7f23b815a700 con 0x7f23b815a320 2023-11-24T08:07:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23b77fe640 1 -- 172.21.15.57:0/1684194208 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a8003530 con 0x7f23b815a320 2023-11-24T08:07:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23bd3e3640 1 -- 172.21.15.57:0/1684194208 >> v2:172.21.15.132:3300/0 conn(0x7f23b80b36c0 msgr2=0x7f23b80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23bd3e3640 1 --2- 172.21.15.57:0/1684194208 >> v2:172.21.15.132:3300/0 conn(0x7f23b80b36c0 0x7f23b80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23bd3e3640 1 -- 172.21.15.57:0/1684194208 >> v1:172.21.15.57:6789/0 conn(0x7f23b815a320 legacy=0x7f23b8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23bd3e3640 1 -- 172.21.15.57:0/1684194208 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80b2900 con 0x7f23b8070da0 2023-11-24T08:07:50.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23bd3e3640 1 --2- 172.21.15.57:0/1684194208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b815ddd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009e10 tx=0x7f23b001cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c0781e951c1037 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23b77fe640 1 -- 172.21.15.57:0/1684194208 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00a5c80 con 0x7f23b8070da0 2023-11-24T08:07:50.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23b77fe640 1 -- 172.21.15.57:0/1684194208 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b00a5de0 con 0x7f23b8070da0 2023-11-24T08:07:50.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.051+0000 7f23b77fe640 1 -- 172.21.15.57:0/1684194208 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00ad640 con 0x7f23b8070da0 2023-11-24T08:07:50.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- 172.21.15.57:0/1684194208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 msgr2=0x7f23b815ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 --2- 172.21.15.57:0/1684194208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b815ddd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009e10 tx=0x7f23b001cbb0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- 172.21.15.57:0/1684194208 shutdown_connections 2023-11-24T08:07:50.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 --2- 172.21.15.57:0/1684194208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b815ddd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 --2- 172.21.15.57:0/1684194208 >> v2:172.21.15.132:3300/0 conn(0x7f23b80b36c0 0x7f23b80b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- 172.21.15.57:0/1684194208 >> 172.21.15.57:0/1684194208 conn(0x7f23b80b0bf0 msgr2=0x7f23b80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- 172.21.15.57:0/1684194208 shutdown_connections 2023-11-24T08:07:50.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- 172.21.15.57:0/1684194208 wait complete. 2023-11-24T08:07:50.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 Processor -- start 2023-11-24T08:07:50.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- start start 2023-11-24T08:07:50.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b80b36c0 0x7f23b8155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b815a320 0x7f23b8155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81355c0 con 0x7f23b815a320 2023-11-24T08:07:50.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81349b0 con 0x7f23b80b36c0 2023-11-24T08:07:50.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bee46640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8134c90 con 0x7f23b8070da0 2023-11-24T08:07:50.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b815a320 0x7f23b8155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b815a320 0x7f23b8155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38846/0 (socket says 172.21.15.57:38846) 2023-11-24T08:07:50.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 -- 172.21.15.57:0/1901836340 learned_addr learned my addr 172.21.15.57:0/1901836340 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:50.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bcbe2640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23b7fff640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b80b36c0 0x7f23b8155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 -- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 msgr2=0x7f23b814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b814eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 -- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b80b36c0 msgr2=0x7f23b8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b80b36c0 0x7f23b8155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23bd3e3640 1 -- 172.21.15.57:0/1901836340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009a70 con 0x7f23b815a320 2023-11-24T08:07:50.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.055+0000 7f23b7fff640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b80b36c0 0x7f23b8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:50.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23bd3e3640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b815a320 0x7f23b8155a60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f23b001b260 tx=0x7f23b0019950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23b57fa640 1 -- 172.21.15.57:0/1901836340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00aed50 con 0x7f23b815a320 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23b57fa640 1 -- 172.21.15.57:0/1901836340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0009450 con 0x7f23b815a320 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23b57fa640 1 -- 172.21.15.57:0/1901836340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00b7630 con 0x7f23b815a320 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b8134f70 con 0x7f23b815a320 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b8134640 con 0x7f23b815a320 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8067520 con 0x7f23b815a320 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23b57fa640 1 -- 172.21.15.57:0/1901836340 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f23b00b4050 con 0x7f23b815a320 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23b57fa640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f239c066650 0x7f239c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23b57fa640 1 -- 172.21.15.57:0/1901836340 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f23b011eed0 con 0x7f23b815a320 2023-11-24T08:07:50.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.059+0000 7f23bcbe2640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f239c066650 0x7f239c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.063+0000 7f23bcbe2640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f239c066650 0x7f239c068b10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f23ac007fd0 tx=0x7f23ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.068 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:50.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.063+0000 7f23b57fa640 1 -- 172.21.15.57:0/1901836340 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23b00ec3e0 con 0x7f23b815a320 2023-11-24T08:07:50.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:07:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.219+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23b8135420 con 0x7f239c066650 2023-11-24T08:07:50.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23b57fa640 1 -- 172.21.15.57:0/1901836340 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50859 (secure 0 0 0) 0x7f23ac001480 con 0x7f239c066650 2023-11-24T08:07:50.228 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:50.228 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:07:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f239c066650 msgr2=0x7f239c068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f239c066650 0x7f239c068b10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f23ac007fd0 tx=0x7f23ac009040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b815a320 msgr2=0x7f23b8155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b815a320 0x7f23b8155a60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f23b001b260 tx=0x7f23b0019950 comp rx=0 tx=0).stop 2023-11-24T08:07:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 shutdown_connections 2023-11-24T08:07:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f239c066650 0x7f239c068b10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b815a320 0x7f23b8155a60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b80b36c0 0x7f23b8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 --2- 172.21.15.57:0/1901836340 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23b8070da0 0x7f23b814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.223+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 >> 172.21.15.57:0/1901836340 conn(0x7f23b80b0bf0 msgr2=0x7f23b80b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.227+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 shutdown_connections 2023-11-24T08:07:50.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.227+0000 7f23bee46640 1 -- 172.21.15.57:0/1901836340 wait complete. 2023-11-24T08:07:50.249 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-11-24T08:07:48.736782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248104,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726616,"statfs":{"total":773094113280,"available":772840054784,"internally_reserved":0,"allocated":7151616,"data_stored":3641454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4187,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001440"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":197,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.304862+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:07:28.304862+0000","last_peered":"2023-11-24T08:07:28.304862+0000","last_clean":"2023-11-24T08:07:28.304862+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:07:28.304862+0000","last_undegraded":"2023-11-24T08:07:28.304862+0000","last_fullsized":"2023-11-24T08:07:28.304862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1339392,"data_stored":897071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.87,"15min":0.92100000000000004},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90400000000000003,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91700000000000004,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.51900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96399999999999997,"5min":5.923,"15min":5.923},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.85899999999999999,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.872,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84099999999999997,"15min":0.90000000000000002},"min":{"1min":0.57699999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.61699999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.621}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.879,"15min":0.94099999999999995},"min":{"1min":0.629,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.88800000000000001,"15min":0.95099999999999996},"min":{"1min":0.54800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80500000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.872},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.495,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.752,"15min":0.77600000000000002},"min":{"1min":0.54000000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":1.091,"15min":1.091},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.81599999999999995,"15min":0.85599999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.581,"15min":1.581},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76500000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":306543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.64000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.747},"min":{"1min":0.61699999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.95499999999999996,"5min":1.347,"15min":1.347},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88,"5min":1.982,"15min":1.982},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74099999999999999,"15min":0.70899999999999996},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93200000000000005,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99299999999999999,"5min":3.657,"15min":3.657},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83499999999999996},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90000000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":3.391,"15min":3.391},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.746},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96999999999999997,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.77300000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":307195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95099999999999996,"5min":2.698,"15min":2.698},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.64200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.93899999999999995,"5min":1.794,"15min":1.794},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71899999999999997,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90600000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.57299999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.831,"15min":1.831},"last":0.754}]},{"osd":3,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.88800000000000001,"15min":0.83799999999999997},"min":{"1min":0.67700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.89100000000000001,"5min":8.2880000000000003,"15min":8.2880000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":1.006,"15min":1.006},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":1.087,"15min":1.087},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.238,"15min":1.238},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73799999999999999,"15min":0.76100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.878,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96899999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95499999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.80200000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":309932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.59399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.022,"15min":1.022},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.755},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86599999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66400000000000003,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.98099999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.88800000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":306599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.625,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.67600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.21,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.53000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.054,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1080000000000001,"5min":1.258,"15min":1.258},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.173,"5min":1.272,"15min":1.272},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.66500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.24,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.155,"15min":1.155},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1319999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.103,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72999999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":306599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.44},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67500000000000004,"15min":0.745},"min":{"1min":0.40999999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75600000000000001,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.71299999999999997,"15min":0.79200000000000004},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61899999999999999,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":5.907,"15min":5.907},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.71699999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0109999999999999,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.64400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.883,"15min":1.883},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.72799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.034,"5min":1.147,"15min":1.147},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.69699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.0609999999999999,"5min":1.923,"15min":1.923},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.78700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.964,"15min":1.964},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1339999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":306633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.52400000000000002,"15min":0.56799999999999995},"min":{"1min":0.34300000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74299999999999999,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.67300000000000004,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.67100000000000004,"15min":0.73699999999999999},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64400000000000002,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.75600000000000001,"15min":0.84399999999999997},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71999999999999997,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66800000000000004,"15min":0.72599999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81499999999999995,"15min":0.84999999999999998},"min":{"1min":0.52100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.131,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96499999999999997,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89900000000000002,"15min":0.96699999999999997},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.875,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1890000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93500000000000005,"15min":0.99099999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.60399999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":1.0820000000000001},"min":{"1min":0.64000000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1060000000000001,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.98899999999999999},"min":{"1min":0.56299999999999994,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0329999999999999,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.91800000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1347584,"data_stored":900882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.83799999999999997,"15min":1.0229999999999999},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83499999999999996,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63600000000000001,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.435}]},{"osd":2,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.68899999999999995},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81100000000000005,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.71299999999999997,"15min":0.81100000000000005},"min":{"1min":0.379,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.94599999999999995,"15min":1.1180000000000001},"min":{"1min":0.48199999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.88900000000000001,"15min":0.93700000000000006},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.046,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.0720000000000001},"min":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.98699999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.117,"15min":1.274},"min":{"1min":0.60299999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0780000000000001,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.175,"15min":1.3520000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0149999999999999,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.002,"15min":1.1040000000000001},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.113,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.87},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.0289999999999999,"15min":1.133},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1339999999999999,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88100000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0980000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.052,"15min":1.157},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.04,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.91900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:50.251 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:07:50.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:50.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6c91d640 1 Processor -- start 2023-11-24T08:07:50.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6c91d640 1 -- start start 2023-11-24T08:07:50.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6c91d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d680710d0 0x7f3d6809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6c91d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6806d8b0 con 0x7f3d68144030 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6c91d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6806cca0 con 0x7f3d6806c650 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6c91d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d68145020 con 0x7f3d680710d0 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6659c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d68144030 0x7f3d6806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58526/0 (socket says 172.21.15.57:58526) 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d6659c640 1 -- 172.21.15.57:0/3304873200 learned_addr learned my addr 172.21.15.57:0/3304873200 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:50.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d66d9d640 1 --2- 172.21.15.57:0/3304873200 >> v2:172.21.15.132:3300/0 conn(0x7f3d680710d0 0x7f3d6809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635373575 0 0) 0x7f3d6806d8b0 con 0x7f3d68144030 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d54003530 con 0x7f3d68144030 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317394069 0 0) 0x7f3d54003530 con 0x7f3d68144030 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 >> v2:172.21.15.132:3300/0 conn(0x7f3d680710d0 msgr2=0x7f3d6809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 --2- 172.21.15.57:0/3304873200 >> v2:172.21.15.132:3300/0 conn(0x7f3d680710d0 0x7f3d6809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 >> v1:172.21.15.132:6789/0 conn(0x7f3d6806c650 legacy=0x7f3d680709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6806cf80 con 0x7f3d68144030 2023-11-24T08:07:50.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f3d58001680 con 0x7f3d68144030 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 >> v1:172.21.15.57:6789/0 conn(0x7f3d68144030 legacy=0x7f3d6806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d54003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d54005190 0x7f3d5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400bfb0 con 0x7f3d54003980 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400c120 con 0x7f3d540047d0 2023-11-24T08:07:50.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.391+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400c2e0 con 0x7f3d54005190 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d6659c640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d54003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d5ffff640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d66d9d640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d54005190 0x7f3d5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d6659c640 1 -- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d54005190 msgr2=0x7f3d5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d6659c640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d54005190 0x7f3d5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d6659c640 1 -- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d540047d0 msgr2=0x7f3d54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d6659c640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d6659c640 1 -- 172.21.15.57:0/3304873200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54003530 con 0x7f3d54003980 2023-11-24T08:07:50.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d66d9d640 1 -- 172.21.15.57:0/3304873200 reap_dead start 2023-11-24T08:07:50.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d6659c640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d54003d60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c190 tx=0x7f3d5801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdeff248b06c279 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58005ae0 con 0x7f3d54003980 2023-11-24T08:07:50.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d58005c40 con 0x7f3d54003980 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.395+0000 7f3d65d9b640 1 -- 172.21.15.57:0/3304873200 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580a5790 con 0x7f3d54003980 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- 172.21.15.57:0/3304873200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 msgr2=0x7f3d54003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d54003d60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c190 tx=0x7f3d5801cba0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- 172.21.15.57:0/3304873200 shutdown_connections 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/3304873200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d54003d60 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- 172.21.15.57:0/3304873200 >> 172.21.15.57:0/3304873200 conn(0x7f3d680b0bf0 msgr2=0x7f3d680b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- 172.21.15.57:0/3304873200 shutdown_connections 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- 172.21.15.57:0/3304873200 wait complete. 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 Processor -- start 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- start start 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d68137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680b28c0 0x7f3d680b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d681f8e70 0x7f3d681f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d681f56c0 con 0x7f3d54003980 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d681f9be0 con 0x7f3d680b28c0 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6c91d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680b3280 con 0x7f3d681f8e70 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d68137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d68137860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38872/0 (socket says 172.21.15.57:38872) 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d6659c640 1 -- 172.21.15.57:0/1167538036 learned_addr learned my addr 172.21.15.57:0/1167538036 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d5ffff640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680b28c0 0x7f3d680b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.399+0000 7f3d66d9d640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d681f8e70 0x7f3d681f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6659c640 1 -- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d681f8e70 msgr2=0x7f3d681f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6659c640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d681f8e70 0x7f3d681f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6659c640 1 -- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680b28c0 msgr2=0x7f3d680b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6659c640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680b28c0 0x7f3d680b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6659c640 1 -- 172.21.15.57:0/1167538036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d681f58d0 con 0x7f3d54003980 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6659c640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d68137860 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c190 tx=0x7f3d54005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d5effd640 1 -- 172.21.15.57:0/1167538036 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580b4070 con 0x7f3d54003980 2023-11-24T08:07:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d5effd640 1 -- 172.21.15.57:0/1167538036 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580a5790 con 0x7f3d54003980 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d5effd640 1 -- 172.21.15.57:0/1167538036 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580a5b40 con 0x7f3d54003980 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d681f5bb0 con 0x7f3d54003980 2023-11-24T08:07:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d681f6170 con 0x7f3d54003980 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d68067520 con 0x7f3d54003980 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d5effd640 1 -- 172.21.15.57:0/1167538036 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f3d580a5ca0 con 0x7f3d54003980 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d5effd640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3d48066650 0x7f3d48068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d5effd640 1 -- 172.21.15.57:0/1167538036 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3d5811dcb0 con 0x7f3d54003980 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.403+0000 7f3d5ffff640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3d48066650 0x7f3d48068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.407+0000 7f3d5ffff640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3d48066650 0x7f3d48068b10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d6815a600 tx=0x7f3d50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.407+0000 7f3d5effd640 1 -- 172.21.15.57:0/1167538036 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d580eb1c0 con 0x7f3d54003980 2023-11-24T08:07:50.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.567+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d6806d540 con 0x7f3d48066650 2023-11-24T08:07:50.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.567+0000 7f3d5effd640 1 -- 172.21.15.57:0/1167538036 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50859 (secure 0 0 0) 0x7f3d50012810 con 0x7f3d48066650 2023-11-24T08:07:50.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:50.573 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:07:50.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3d48066650 msgr2=0x7f3d48068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3d48066650 0x7f3d48068b10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d6815a600 tx=0x7f3d50009040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 msgr2=0x7f3d68137860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d68137860 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c190 tx=0x7f3d54005800 comp rx=0 tx=0).stop 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 shutdown_connections 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f3d48066650 0x7f3d48068b10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d681f8e70 0x7f3d681f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680b28c0 0x7f3d680b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 --2- 172.21.15.57:0/1167538036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d54003980 0x7f3d68137860 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 >> 172.21.15.57:0/1167538036 conn(0x7f3d680b0bf0 msgr2=0x7f3d680ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 shutdown_connections 2023-11-24T08:07:50.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.571+0000 7f3d6c91d640 1 -- 172.21.15.57:0/1167538036 wait complete. 2023-11-24T08:07:50.594 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-11-24T08:07:48.736782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248104,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726616,"statfs":{"total":773094113280,"available":772840054784,"internally_reserved":0,"allocated":7151616,"data_stored":3641454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4187,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001440"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":197,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-24T08:07:28.304862+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:07:28.304862+0000","last_peered":"2023-11-24T08:07:28.304862+0000","last_clean":"2023-11-24T08:07:28.304862+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:07:28.304862+0000","last_undegraded":"2023-11-24T08:07:28.304862+0000","last_fullsized":"2023-11-24T08:07:28.304862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1339392,"data_stored":897071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.87,"15min":0.92100000000000004},"min":{"1min":0.55000000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90400000000000003,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.60599999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.91700000000000004,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.51900000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96399999999999997,"5min":5.923,"15min":5.923},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.85899999999999999,"15min":0.93100000000000005},"min":{"1min":0.52100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.872,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.84099999999999997,"15min":0.90000000000000002},"min":{"1min":0.57699999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95599999999999996,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.96799999999999997},"min":{"1min":0.61699999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.621}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.879,"15min":0.94099999999999995},"min":{"1min":0.629,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.88800000000000001,"15min":0.95099999999999996},"min":{"1min":0.54800000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80500000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.872},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.495,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.997,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.752,"15min":0.77600000000000002},"min":{"1min":0.54000000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.83899999999999997,"5min":1.091,"15min":1.091},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.81599999999999995,"15min":0.85599999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.581,"15min":1.581},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0529999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76500000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":306543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.64000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.747},"min":{"1min":0.61699999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.95499999999999996,"5min":1.347,"15min":1.347},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88,"5min":1.982,"15min":1.982},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74099999999999999,"15min":0.70899999999999996},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93200000000000005,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99299999999999999,"5min":3.657,"15min":3.657},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83499999999999996},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90000000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":3.391,"15min":3.391},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.746},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96999999999999997,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.77300000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":307195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95099999999999996,"5min":2.698,"15min":2.698},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.64200000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.93899999999999995,"5min":1.794,"15min":1.794},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71899999999999997,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90600000000000003,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.57299999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88700000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.831,"15min":1.831},"last":0.754}]},{"osd":3,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.88800000000000001,"15min":0.83799999999999997},"min":{"1min":0.67700000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.89100000000000001,"5min":8.2880000000000003,"15min":8.2880000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84199999999999997,"5min":1.006,"15min":1.006},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81699999999999995,"5min":1.087,"15min":1.087},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.238,"15min":1.238},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73799999999999999,"15min":0.76100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.878,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96899999999999997,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95499999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.80200000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":309932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.59399999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95999999999999996,"5min":1.022,"15min":1.022},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.50600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97199999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.755},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.77100000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86599999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66400000000000003,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.98099999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.88800000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":306599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.625,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.67600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.21,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.53000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.054,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1080000000000001,"5min":1.258,"15min":1.258},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.173,"5min":1.272,"15min":1.272},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.66500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.24,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.155,"15min":1.155},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1319999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.103,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72999999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":306599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.44},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67500000000000004,"15min":0.745},"min":{"1min":0.40999999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75600000000000001,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.71299999999999997,"15min":0.79200000000000004},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61899999999999999,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":5.907,"15min":5.907},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.71699999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0109999999999999,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.64400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.883,"15min":1.883},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.72799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.034,"5min":1.147,"15min":1.147},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.69699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.0609999999999999,"5min":1.923,"15min":1.923},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.78700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.964,"15min":1.964},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1339999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":306633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.52400000000000002,"15min":0.56799999999999995},"min":{"1min":0.34300000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74299999999999999,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.67300000000000004,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.67100000000000004,"15min":0.73699999999999999},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64400000000000002,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.75600000000000001,"15min":0.84399999999999997},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71999999999999997,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66800000000000004,"15min":0.72599999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81499999999999995,"15min":0.84999999999999998},"min":{"1min":0.52100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.131,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0549999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96499999999999997,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89900000000000002,"15min":0.96699999999999997},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.875,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1890000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93500000000000005,"15min":0.99099999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0049999999999999,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.874,"15min":0.92100000000000004},"min":{"1min":0.60399999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0469999999999999,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":1.0820000000000001},"min":{"1min":0.64000000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1060000000000001,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.98899999999999999},"min":{"1min":0.56299999999999994,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0329999999999999,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.91800000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1347584,"data_stored":900882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.83799999999999997,"15min":1.0229999999999999},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83499999999999996,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63600000000000001,"15min":0.69899999999999995},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73999999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.435}]},{"osd":2,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.63300000000000001,"15min":0.68899999999999995},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81100000000000005,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.71299999999999997,"15min":0.81100000000000005},"min":{"1min":0.379,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.74299999999999999,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.94599999999999995,"15min":1.1180000000000001},"min":{"1min":0.48199999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.76700000000000002,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.88900000000000001,"15min":0.93700000000000006},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.046,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.97599999999999998,"15min":1.0720000000000001},"min":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.98699999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":1.117,"15min":1.274},"min":{"1min":0.60299999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0780000000000001,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.175,"15min":1.3520000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0149999999999999,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.002,"15min":1.1040000000000001},"min":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.113,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.87},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.0289999999999999,"15min":1.133},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1339999999999999,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Nov 24 08:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88100000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0980000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.052,"15min":1.157},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.04,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.91900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:50.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:07:50.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0d6668640 1 Processor -- start 2023-11-24T08:07:50.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0d6668640 1 -- start start 2023-11-24T08:07:50.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0d6668640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0d015d570 0x7ff0d006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0d6668640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00d1cc0 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0d6668640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00d1fa0 con 0x7ff0d00d3020 2023-11-24T08:07:50.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0d6668640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00ce0b0 con 0x7ff0d015d570 2023-11-24T08:07:50.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0cffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0d015d570 0x7ff0d006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0cffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0d015d570 0x7ff0d006b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38876/0 (socket says 172.21.15.57:38876) 2023-11-24T08:07:50.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.735+0000 7ff0cffff640 1 -- 172.21.15.57:0/459257290 learned_addr learned my addr 172.21.15.57:0/459257290 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:50.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0cffff640 1 -- 172.21.15.57:0/459257290 >> v1:172.21.15.132:6789/0 conn(0x7ff0d00d3020 legacy=0x7ff0d00d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:50.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0cffff640 1 -- 172.21.15.57:0/459257290 >> v1:172.21.15.57:6789/0 conn(0x7ff0d00ce8b0 legacy=0x7ff0d00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0cffff640 1 -- 172.21.15.57:0/459257290 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00ce390 con 0x7ff0d015d570 2023-11-24T08:07:50.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0cffff640 1 --2- 172.21.15.57:0/459257290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d015d570 0x7ff0d006b9d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009870 tx=0x7ff0c001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80efc313f623adef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0ceffd640 1 -- 172.21.15.57:0/459257290 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00ab610 con 0x7ff0d015d570 2023-11-24T08:07:50.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0ceffd640 1 -- 172.21.15.57:0/459257290 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00ab770 con 0x7ff0d015d570 2023-11-24T08:07:50.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0ceffd640 1 -- 172.21.15.57:0/459257290 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00abb00 con 0x7ff0d015d570 2023-11-24T08:07:50.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0d6668640 1 -- 172.21.15.57:0/459257290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d015d570 msgr2=0x7ff0d006b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0d6668640 1 --2- 172.21.15.57:0/459257290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d015d570 0x7ff0d006b9d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009870 tx=0x7ff0c001c500 comp rx=0 tx=0).stop 2023-11-24T08:07:50.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0d6668640 1 -- 172.21.15.57:0/459257290 shutdown_connections 2023-11-24T08:07:50.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0d6668640 1 --2- 172.21.15.57:0/459257290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d015d570 0x7ff0d006b9d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.739+0000 7ff0d6668640 1 -- 172.21.15.57:0/459257290 >> 172.21.15.57:0/459257290 conn(0x7ff0d008ceb0 msgr2=0x7ff0d009c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 -- 172.21.15.57:0/459257290 shutdown_connections 2023-11-24T08:07:50.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 -- 172.21.15.57:0/459257290 wait complete. 2023-11-24T08:07:50.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 Processor -- start 2023-11-24T08:07:50.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 -- start start 2023-11-24T08:07:50.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d00ce8b0 0x7ff0d014bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d00d3020 0x7ff0d015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d015d570 0x7ff0d00c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0160570 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d015f8f0 con 0x7ff0d00d3020 2023-11-24T08:07:50.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d6668640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d015fbd0 con 0x7ff0d015d570 2023-11-24T08:07:50.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d00ce8b0 0x7ff0d014bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d00ce8b0 0x7ff0d014bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38886/0 (socket says 172.21.15.57:38886) 2023-11-24T08:07:50.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 -- 172.21.15.57:0/4195506497 learned_addr learned my addr 172.21.15.57:0/4195506497 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:50.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cf7fe640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d00d3020 0x7ff0d015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0d4c05640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d015d570 0x7ff0d00c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 -- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d015d570 msgr2=0x7ff0d00c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d015d570 0x7ff0d00c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 -- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d00d3020 msgr2=0x7ff0d015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d00d3020 0x7ff0d015ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 -- 172.21.15.57:0/4195506497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00094d0 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cf7fe640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d00d3020 0x7ff0d015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:50.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.743+0000 7ff0cffff640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d00ce8b0 0x7ff0d014bc30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00ad040 tx=0x7ff0c001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0ccff9640 1 -- 172.21.15.57:0/4195506497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00b4800 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0ccff9640 1 -- 172.21.15.57:0/4195506497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00b4980 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d015feb0 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0ccff9640 1 -- 172.21.15.57:0/4195506497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00b4d30 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d014c170 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d0067520 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0ccff9640 1 -- 172.21.15.57:0/4195506497 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ff0c00c7390 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0ccff9640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0bc066620 0x7ff0bc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:50.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0ccff9640 1 -- 172.21.15.57:0/4195506497 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff0c011ea50 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.747+0000 7ff0cf7fe640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0bc066620 0x7ff0bc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:50.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.751+0000 7ff0cf7fe640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0bc066620 0x7ff0bc068ae0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b92f0 tx=0x7ff0c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:50.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.751+0000 7ff0ccff9640 1 -- 172.21.15.57:0/4195506497 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0c00ebd10 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.911+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0d006b7b0 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.911+0000 7ff0ccff9640 1 -- 172.21.15.57:0/4195506497 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12928 (secure 0 0 0) 0x7ff0c00ef330 con 0x7ff0d00ce8b0 2023-11-24T08:07:50.917 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:50.917 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":64,"fsid":"445cea61-e72c-4da9-979a-02ade002d7d6","created":"2023-11-24T08:03:33.575159+0000","modified":"2023-11-24T08:07:47.419237+0000","last_up_change":"2023-11-24T08:03:45.475537+0000","last_in_change":"2023-11-24T08:03:36.140062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:03:46.767172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9469d9a-bc14-483d-a1f7-149f4309d247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6801","nonce":1902011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6803","nonce":1902011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6807","nonce":1902011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1902011},{"type":"v1","addr":"172.21.15.57:6805","nonce":1902011}]},"public_addr":"172.21.15.57:6801/1902011","cluster_addr":"172.21.15.57:6803/1902011","heartbeat_back_addr":"172.21.15.57:6807/1902011","heartbeat_front_addr":"172.21.15.57:6805/1902011","state":["exists","up"]},{"osd":1,"uuid":"85a7cd2d-3305-4aa2-8142-9f569374ee37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6809","nonce":197014629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6811","nonce":197014629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6815","nonce":197014629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":197014629},{"type":"v1","addr":"172.21.15.57:6813","nonce":197014629}]},"public_addr":"172.21.15.57:6809/197014629","cluster_addr":"172.21.15.57:6811/197014629","heartbeat_back_addr":"172.21.15.57:6815/197014629","heartbeat_front_addr":"172.21.15.57:6813/197014629","state":["exists","up"]},{"osd":2,"uuid":"00ddbc4b-5fda-41d5-b7d4-64dff86f7b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6825","nonce":3141659691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6827","nonce":3141659691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6831","nonce":3141659691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3141659691},{"type":"v1","addr":"172.21.15.57:6829","nonce":3141659691}]},"public_addr":"172.21.15.57:6825/3141659691","cluster_addr":"172.21.15.57:6827/3141659691","heartbeat_back_addr":"172.21.15.57:6831/3141659691","heartbeat_front_addr":"172.21.15.57:6829/3141659691","state":["exists","up"]},{"osd":3,"uuid":"3611d22c-11a0-481b-8be3-1cd71bea97a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6817","nonce":1395957383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6819","nonce":1395957383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6823","nonce":1395957383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":1395957383},{"type":"v1","addr":"172.21.15.57:6821","nonce":1395957383}]},"public_addr":"172.21.15.57:6817/1395957383","cluster_addr":"172.21.15.57:6819/1395957383","heartbeat_back_addr":"172.21.15.57:6823/1395957383","heartbeat_front_addr":"172.21.15.57:6821/1395957383","state":["exists","up"]},{"osd":4,"uuid":"6fe4fb2a-c549-44c7-b3c3-8a2ba6d93190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6801","nonce":2592632531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6803","nonce":2592632531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6807","nonce":2592632531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2592632531},{"type":"v1","addr":"172.21.15.132:6805","nonce":2592632531}]},"public_addr":"172.21.15.132:6801/2592632531","cluster_addr":"172.21.15.132:6803/2592632531","heartbeat_back_addr":"172.21.15.132:6807/2592632531","heartbeat_front_addr":"172.21.15.132:6805/2592632531","state":["exists","up"]},{"osd":5,"uuid":"60484af5-12a5-4267-b118-17b87225c38a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6809","nonce":774342191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6811","nonce":774342191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6815","nonce":774342191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":774342191},{"type":"v1","addr":"172.21.15.132:6813","nonce":774342191}]},"public_addr":"172.21.15.132:6809/774342191","cluster_addr":"172.21.15.132:6811/774342191","heartbeat_back_addr":"172.21.15.132:6815/774342191","heartbeat_front_addr":"172.21.15.132:6813/774342191","state":["exists","up"]},{"osd":6,"uuid":"12154951-8b72-4730-bc4b-1fb6d04c075a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6825","nonce":4052258235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6827","nonce":4052258235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6831","nonce":4052258235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4052258235},{"type":"v1","addr":"172.21.15.132:6829","nonce":4052258235}]},"public_addr":"172.21.15.132:6825/4052258235","cluster_addr":"172.21.15.132:6827/4052258235","heartbeat_back_addr":"172.21.15.132:6831/4052258235","heartbeat_front_addr":"172.21.15.132:6829/4052258235","state":["exists","up"]},{"osd":7,"uuid":"42e706a8-a315-4cbe-bf0d-20ff30f3719a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6817","nonce":786338062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6819","nonce":786338062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6823","nonce":786338062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":786338062},{"type":"v1","addr":"172.21.15.132:6821","nonce":786338062}]},"public_addr":"172.21.15.132:6817/786338062","cluster_addr":"172.21.15.132:6819/786338062","heartbeat_back_addr":"172.21.15.132:6823/786338062","heartbeat_front_addr":"172.21.15.132:6821/786338062","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.618520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:42.003606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.893937+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.700505+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.705900+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.720850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.823275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:03:41.912456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6836/1683487539":"2023-11-25T08:07:44.404859+0000","172.21.15.132:6834/1683487539":"2023-11-25T08:07:44.404859+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:07:50.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0bc066620 msgr2=0x7ff0bc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0bc066620 0x7ff0bc068ae0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b92f0 tx=0x7ff0c4009040 comp rx=0 tx=0).stop 2023-11-24T08:07:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d00ce8b0 msgr2=0x7ff0d014bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d00ce8b0 0x7ff0d014bc30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00ad040 tx=0x7ff0c001ad40 comp rx=0 tx=0).stop 2023-11-24T08:07:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 shutdown_connections 2023-11-24T08:07:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff0bc066620 0x7ff0bc068ae0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0d015d570 0x7ff0d00c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d00d3020 0x7ff0d015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 --2- 172.21.15.57:0/4195506497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0d00ce8b0 0x7ff0d014bc30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 >> 172.21.15.57:0/4195506497 conn(0x7ff0d008ceb0 msgr2=0x7ff0d00b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 shutdown_connections 2023-11-24T08:07:50.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:50.915+0000 7ff0d6668640 1 -- 172.21.15.57:0/4195506497 wait complete. 2023-11-24T08:07:51.939 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T08:07:51.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:52.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5ce1e9a640 1 Processor -- start 2023-11-24T08:07:52.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5ce1e9a640 1 -- start start 2023-11-24T08:07:52.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5ce1e9a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5ce1e9a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5cdc0b36c0 0x7f5cdc070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5ce1e9a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc15a700 con 0x7f5cdc070bd0 2023-11-24T08:07:52.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5ce1e9a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b2430 con 0x7f5cdc0b36c0 2023-11-24T08:07:52.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5ce1e9a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b2620 con 0x7f5cdc15a320 2023-11-24T08:07:52.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:56150/0 (socket says 172.21.15.57:56150) 2023-11-24T08:07:52.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdb7fe640 1 -- 172.21.15.57:0/2871167431 learned_addr learned my addr 172.21.15.57:0/2871167431 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:52.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdaffd640 1 --2- 172.21.15.57:0/2871167431 >> v2:172.21.15.132:3300/0 conn(0x7f5cdc0b36c0 0x7f5cdc070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cda7fc640 1 -- 172.21.15.57:0/2871167431 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770405535 0 0) 0x7f5cdc15a700 con 0x7f5cdc070bd0 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cda7fc640 1 -- 172.21.15.57:0/2871167431 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc4003530 con 0x7f5cdc070bd0 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdaffd640 1 -- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 msgr2=0x7f5cdc0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdaffd640 1 --2- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdaffd640 1 -- 172.21.15.57:0/2871167431 >> v1:172.21.15.132:6789/0 conn(0x7f5cdc070bd0 legacy=0x7f5cdc0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdaffd640 1 -- 172.21.15.57:0/2871167431 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0b2900 con 0x7f5cdc0b36c0 2023-11-24T08:07:52.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.095+0000 7f5cdb7fe640 1 --2- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:52.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5cdaffd640 1 --2- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 0x7f5cdc070690 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00097c0 tx=0x7f5cd001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdabc7d2baeb8bbd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5cda7fc640 1 -- 172.21.15.57:0/2871167431 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00ab680 con 0x7f5cdc0b36c0 2023-11-24T08:07:52.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5cda7fc640 1 -- 172.21.15.57:0/2871167431 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd00ab7e0 con 0x7f5cdc0b36c0 2023-11-24T08:07:52.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5cda7fc640 1 -- 172.21.15.57:0/2871167431 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00abb70 con 0x7f5cdc0b36c0 2023-11-24T08:07:52.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 msgr2=0x7f5cdc070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 --2- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 0x7f5cdc070690 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00097c0 tx=0x7f5cd001c480 comp rx=0 tx=0).stop 2023-11-24T08:07:52.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/2871167431 shutdown_connections 2023-11-24T08:07:52.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 --2- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 0x7f5cdc070690 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 --2- 172.21.15.57:0/2871167431 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/2871167431 >> 172.21.15.57:0/2871167431 conn(0x7f5cdc0b0bf0 msgr2=0x7f5cdc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/2871167431 shutdown_connections 2023-11-24T08:07:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.099+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/2871167431 wait complete. 2023-11-24T08:07:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 Processor -- start 2023-11-24T08:07:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 -- start start 2023-11-24T08:07:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cdc070bd0 0x7f5cdc153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 0x7f5cdc166920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc155ce0 con 0x7f5cdc070bd0 2023-11-24T08:07:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc1541a0 con 0x7f5cdc0b36c0 2023-11-24T08:07:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc155060 con 0x7f5cdc15a320 2023-11-24T08:07:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cdc070bd0 0x7f5cdc153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cdc070bd0 0x7f5cdc153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38898/0 (socket says 172.21.15.57:38898) 2023-11-24T08:07:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 -- 172.21.15.57:0/1046691212 learned_addr learned my addr 172.21.15.57:0/1046691212 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdaffd640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 0x7f5cdc166920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdbfff640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 -- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 msgr2=0x7f5cdc166e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cdc15a320 0x7f5cdc166e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 -- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 msgr2=0x7f5cdc166920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cdc0b36c0 0x7f5cdc166920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 -- 172.21.15.57:0/1046691212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0094d0 con 0x7f5cdc070bd0 2023-11-24T08:07:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cdb7fe640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cdc070bd0 0x7f5cdc153c60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00e960 tx=0x7f5ccc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00ca00 con 0x7f5cdc070bd0 2023-11-24T08:07:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00cb60 con 0x7f5cdc070bd0 2023-11-24T08:07:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00ced0 con 0x7f5cdc070bd0 2023-11-24T08:07:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd0009420 con 0x7f5cdc070bd0 2023-11-24T08:07:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.103+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc155620 con 0x7f5cdc070bd0 2023-11-24T08:07:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cdc067520 con 0x7f5cdc070bd0 2023-11-24T08:07:52.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5ccc013470 con 0x7f5cdc070bd0 2023-11-24T08:07:52.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cc3fff640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc8066620 0x7f5cc8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5ccc084470 con 0x7f5cdc070bd0 2023-11-24T08:07:52.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cc3fff640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f5cc806c310 0x7f5cc806e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 --> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cc806ede0 con 0x7f5cc806c310 2023-11-24T08:07:52.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ccc0848c0 con 0x7f5cdc070bd0 2023-11-24T08:07:52.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cdaffd640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc8066620 0x7f5cc8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cdbfff640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f5cc806c310 0x7f5cc806e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cdbfff640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f5cc806c310 0x7f5cc806e730 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.107+0000 7f5cdaffd640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc8066620 0x7f5cc8068ae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00af000 tx=0x7f5cd00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.111+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== osd.0 v2:172.21.15.57:6800/1902011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5cc806ede0 con 0x7f5cc806c310 2023-11-24T08:07:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 --> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5cdc15bcd0 con 0x7f5cc806c310 2023-11-24T08:07:52.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5cc3fff640 1 -- 172.21.15.57:0/1046691212 <== osd.0 v2:172.21.15.57:6800/1902011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5cdc15bcd0 con 0x7f5cc806c310 2023-11-24T08:07:52.127 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:52.127 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:52.128 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f5cc806c310 msgr2=0x7f5cc806e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:6800/1902011,v1:172.21.15.57:6801/1902011] conn(0x7f5cc806c310 0x7f5cc806e730 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc8066620 msgr2=0x7f5cc8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5cc8066620 0x7f5cc8068ae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00af000 tx=0x7f5cd00a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cdc070bd0 msgr2=0x7f5cdc153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 --2- 172.21.15.57:0/1046691212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cdc070bd0 0x7f5cdc153c60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00e960 tx=0x7f5ccc00ee20 comp rx=0 tx=0).stop 2023-11-24T08:07:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5cdbfff640 1 -- 172.21.15.57:0/1046691212 reap_dead start 2023-11-24T08:07:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 shutdown_connections 2023-11-24T08:07:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 >> 172.21.15.57:0/1046691212 conn(0x7f5cdc0b0bf0 msgr2=0x7f5cdc0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 shutdown_connections 2023-11-24T08:07:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.123+0000 7f5ce1e9a640 1 -- 172.21.15.57:0/1046691212 wait complete. 2023-11-24T08:07:52.145 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T08:07:52.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.283+0000 7f55831a1640 1 Processor -- start 2023-11-24T08:07:52.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.283+0000 7f55831a1640 1 -- start start 2023-11-24T08:07:52.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f55831a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f557c0725f0 0x7f557c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f55831a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0ca000 0x7f557c0717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f55831a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c06cb70 con 0x7f557c0cba80 2023-11-24T08:07:52.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f55831a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c0ca770 con 0x7f557c0725f0 2023-11-24T08:07:52.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f55831a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0729d0 con 0x7f557c0ca000 2023-11-24T08:07:52.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f558173e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0ca000 0x7f557c0717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f5580f3d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f557c0725f0 0x7f557c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f557bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f557c0cba80 0x7f557c0c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:48610/0 (socket says 172.21.15.57:48610) 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f558173e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0ca000 0x7f557c0717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.57:56182/0 (socket says 172.21.15.57:56182) 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f557bfff640 1 -- 172.21.15.57:0/213012543 learned_addr learned my addr 172.21.15.57:0/213012543 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f5580f3d640 1 -- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0ca000 msgr2=0x7f557c0717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f5580f3d640 1 --2- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0ca000 0x7f557c0717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f5580f3d640 1 -- 172.21.15.57:0/213012543 >> v1:172.21.15.132:6789/0 conn(0x7f557c0cba80 legacy=0x7f557c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f5580f3d640 1 -- 172.21.15.57:0/213012543 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c06ce10 con 0x7f557c0725f0 2023-11-24T08:07:52.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f557b7fe640 1 -- 172.21.15.57:0/213012543 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393279325 0 0) 0x7f557c06cb70 con 0x7f557c0cba80 2023-11-24T08:07:52.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.287+0000 7f558173e640 1 --2- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0ca000 0x7f557c0717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:07:52.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f5580f3d640 1 --2- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0725f0 0x7f557c06c630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f55700097f0 tx=0x7f557001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f58f58415673bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f557b7fe640 1 -- 172.21.15.57:0/213012543 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700a8970 con 0x7f557c0725f0 2023-11-24T08:07:52.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f557b7fe640 1 -- 172.21.15.57:0/213012543 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700a8ad0 con 0x7f557c0725f0 2023-11-24T08:07:52.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f557b7fe640 1 -- 172.21.15.57:0/213012543 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700a8e60 con 0x7f557c0725f0 2023-11-24T08:07:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 -- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0725f0 msgr2=0x7f557c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 --2- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0725f0 0x7f557c06c630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f55700097f0 tx=0x7f557001ec70 comp rx=0 tx=0).stop 2023-11-24T08:07:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 -- 172.21.15.57:0/213012543 shutdown_connections 2023-11-24T08:07:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 --2- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0ca000 0x7f557c0717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 --2- 172.21.15.57:0/213012543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0725f0 0x7f557c06c630 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 -- 172.21.15.57:0/213012543 >> 172.21.15.57:0/213012543 conn(0x7f557c0b0bf0 msgr2=0x7f557c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 -- 172.21.15.57:0/213012543 shutdown_connections 2023-11-24T08:07:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.291+0000 7f55831a1640 1 -- 172.21.15.57:0/213012543 wait complete. 2023-11-24T08:07:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 Processor -- start 2023-11-24T08:07:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 -- start start 2023-11-24T08:07:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0725f0 0x7f557c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f557c0ca000 0x7f557c0c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0cba80 0x7f557c0c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c15ae10 con 0x7f557c0ca000 2023-11-24T08:07:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c15a1d0 con 0x7f557c0cba80 2023-11-24T08:07:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c15a470 con 0x7f557c0725f0 2023-11-24T08:07:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f557c0ca000 0x7f557c0c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f557c0ca000 0x7f557c0c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38904/0 (socket says 172.21.15.57:38904) 2023-11-24T08:07:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 -- 172.21.15.57:0/3069812957 learned_addr learned my addr 172.21.15.57:0/3069812957 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f5580f3d640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0725f0 0x7f557c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f558173e640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0cba80 0x7f557c0c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 -- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0725f0 msgr2=0x7f557c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0725f0 0x7f557c157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 -- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0cba80 msgr2=0x7f557c0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0cba80 0x7f557c0c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 -- 172.21.15.57:0/3069812957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574009a70 con 0x7f557c0ca000 2023-11-24T08:07:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f557bfff640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f557c0ca000 0x7f557c0c1910 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f556800c480 tx=0x7f556800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55797fa640 1 -- 172.21.15.57:0/3069812957 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55680074e0 con 0x7f557c0ca000 2023-11-24T08:07:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55797fa640 1 -- 172.21.15.57:0/3069812957 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568007660 con 0x7f557c0ca000 2023-11-24T08:07:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5570009420 con 0x7f557c0ca000 2023-11-24T08:07:52.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55797fa640 1 -- 172.21.15.57:0/3069812957 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568004a30 con 0x7f557c0ca000 2023-11-24T08:07:52.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c0c2390 con 0x7f557c0ca000 2023-11-24T08:07:52.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.295+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c09d250 con 0x7f557c0ca000 2023-11-24T08:07:52.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.299+0000 7f55797fa640 1 -- 172.21.15.57:0/3069812957 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5568004b90 con 0x7f557c0ca000 2023-11-24T08:07:52.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.299+0000 7f55797fa640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5560066620 0x7f5560068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.299+0000 7f55797fa640 1 -- 172.21.15.57:0/3069812957 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5568083b90 con 0x7f557c0ca000 2023-11-24T08:07:52.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.299+0000 7f5580f3d640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5560066620 0x7f5560068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.299+0000 7f5580f3d640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5560066620 0x7f5560068ae0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f55700b2000 tx=0x7f55700aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.303+0000 7f55797fa640 1 -- 172.21.15.57:0/3069812957 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5568051080 con 0x7f557c0ca000 2023-11-24T08:07:52.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.459+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f557c06d6b0 con 0x7f5560066620 2023-11-24T08:07:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.459+0000 7f55797fa640 1 -- 172.21.15.57:0/3069812957 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5570004040 con 0x7f5560066620 2023-11-24T08:07:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T08:07:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5560066620 msgr2=0x7f5560068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5560066620 0x7f5560068ae0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f55700b2000 tx=0x7f55700aa070 comp rx=0 tx=0).stop 2023-11-24T08:07:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f557c0ca000 msgr2=0x7f557c0c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f557c0ca000 0x7f557c0c1910 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f556800c480 tx=0x7f556800c880 comp rx=0 tx=0).stop 2023-11-24T08:07:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 shutdown_connections 2023-11-24T08:07:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5560066620 0x7f5560068ae0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f557c0cba80 0x7f557c0c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f557c0ca000 0x7f557c0c1910 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 --2- 172.21.15.57:0/3069812957 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f557c0725f0 0x7f557c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 >> 172.21.15.57:0/3069812957 conn(0x7f557c0b0bf0 msgr2=0x7f557c071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 shutdown_connections 2023-11-24T08:07:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.463+0000 7f55831a1640 1 -- 172.21.15.57:0/3069812957 wait complete. 2023-11-24T08:07:52.487 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T08:07:52.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:52.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe2149e7640 1 Processor -- start 2023-11-24T08:07:52.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe2149e7640 1 -- start start 2023-11-24T08:07:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe2149e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2100b36c0 0x7fe2100b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe2149e7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe210070da0 0x7fe2100711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe2149e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21015a700 con 0x7fe21015a320 2023-11-24T08:07:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe2149e7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2100b2430 con 0x7fe210070da0 2023-11-24T08:07:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe2149e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2100b2620 con 0x7fe2100b36c0 2023-11-24T08:07:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe20ed9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe210070da0 0x7fe2100711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe20ed9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe210070da0 0x7fe2100711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38918/0 (socket says 172.21.15.57:38918) 2023-11-24T08:07:52.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe20ed9d640 1 -- 172.21.15.57:0/3380165136 learned_addr learned my addr 172.21.15.57:0/3380165136 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:52.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe207fff640 1 --2- 172.21.15.57:0/3380165136 >> v2:172.21.15.132:3300/0 conn(0x7fe2100b36c0 0x7fe2100b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe20ed9d640 1 -- 172.21.15.57:0/3380165136 >> v2:172.21.15.132:3300/0 conn(0x7fe2100b36c0 msgr2=0x7fe2100b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe20ed9d640 1 --2- 172.21.15.57:0/3380165136 >> v2:172.21.15.132:3300/0 conn(0x7fe2100b36c0 0x7fe2100b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe20ed9d640 1 -- 172.21.15.57:0/3380165136 >> v1:172.21.15.132:6789/0 conn(0x7fe21015a320 legacy=0x7fe210070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.631+0000 7fe20ed9d640 1 -- 172.21.15.57:0/3380165136 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100b2900 con 0x7fe210070da0 2023-11-24T08:07:52.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe20ed9d640 1 --2- 172.21.15.57:0/3380165136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2100711f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe21006c180 tx=0x7fe20801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1376040d84306a04 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe20dd9b640 1 -- 172.21.15.57:0/3380165136 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080a5860 con 0x7fe210070da0 2023-11-24T08:07:52.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe20dd9b640 1 -- 172.21.15.57:0/3380165136 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2080a59c0 con 0x7fe210070da0 2023-11-24T08:07:52.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe20dd9b640 1 -- 172.21.15.57:0/3380165136 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080a5d50 con 0x7fe210070da0 2023-11-24T08:07:52.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 -- 172.21.15.57:0/3380165136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 msgr2=0x7fe2100711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 --2- 172.21.15.57:0/3380165136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2100711f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe21006c180 tx=0x7fe20801c9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 -- 172.21.15.57:0/3380165136 shutdown_connections 2023-11-24T08:07:52.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 --2- 172.21.15.57:0/3380165136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2100711f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 --2- 172.21.15.57:0/3380165136 >> v2:172.21.15.132:3300/0 conn(0x7fe2100b36c0 0x7fe2100b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 -- 172.21.15.57:0/3380165136 >> 172.21.15.57:0/3380165136 conn(0x7fe2100b0bf0 msgr2=0x7fe2100b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 -- 172.21.15.57:0/3380165136 shutdown_connections 2023-11-24T08:07:52.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.635+0000 7fe2149e7640 1 -- 172.21.15.57:0/3380165136 wait complete. 2023-11-24T08:07:52.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 Processor -- start 2023-11-24T08:07:52.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 -- start start 2023-11-24T08:07:52.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2101506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2100b36c0 0x7fe2100af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe21015a320 0x7fe21009afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101515d0 con 0x7fe210070da0 2023-11-24T08:07:52.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe210150d30 con 0x7fe2100b36c0 2023-11-24T08:07:52.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe210151010 con 0x7fe21015a320 2023-11-24T08:07:52.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2101506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2101506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38926/0 (socket says 172.21.15.57:38926) 2023-11-24T08:07:52.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 -- 172.21.15.57:0/518641707 learned_addr learned my addr 172.21.15.57:0/518641707 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:52.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe207fff640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2100b36c0 0x7fe2100af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20ed9d640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe21015a320 0x7fe21009afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 -- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe21015a320 msgr2=0x7fe21009afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe21015a320 0x7fe21009afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 -- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2100b36c0 msgr2=0x7fe2100af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2100b36c0 0x7fe2100af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 -- 172.21.15.57:0/518641707 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208009b30 con 0x7fe210070da0 2023-11-24T08:07:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe20e59c640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2101506a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c3c0 tx=0x7fe20000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2000052d0 con 0x7fe210070da0 2023-11-24T08:07:52.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200005430 con 0x7fe210070da0 2023-11-24T08:07:52.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200003840 con 0x7fe210070da0 2023-11-24T08:07:52.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2101512f0 con 0x7fe210070da0 2023-11-24T08:07:52.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.639+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21014ee10 con 0x7fe210070da0 2023-11-24T08:07:52.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe210067520 con 0x7fe210070da0 2023-11-24T08:07:52.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe2000039a0 con 0x7fe210070da0 2023-11-24T08:07:52.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe206ffd640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1f0066620 0x7fe1f0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe200083200 con 0x7fe210070da0 2023-11-24T08:07:52.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe206ffd640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7fe1f006c480 0x7fe1f006e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 --> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1f006ef50 con 0x7fe1f006c480 2023-11-24T08:07:52.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2000858a0 con 0x7fe210070da0 2023-11-24T08:07:52.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe207fff640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1f0066620 0x7fe1f0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe20ed9d640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7fe1f006c480 0x7fe1f006e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe20ed9d640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7fe1f006c480 0x7fe1f006e8a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.643+0000 7fe207fff640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1f0066620 0x7fe1f0068ae0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe2100b2080 tx=0x7fe1f8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.647+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== osd.1 v2:172.21.15.57:6808/197014629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe1f006ef50 con 0x7fe1f006c480 2023-11-24T08:07:52.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 --> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe21014f6a0 con 0x7fe1f006c480 2023-11-24T08:07:52.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe206ffd640 1 -- 172.21.15.57:0/518641707 <== osd.1 v2:172.21.15.57:6808/197014629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe21014f6a0 con 0x7fe1f006c480 2023-11-24T08:07:52.664 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:52.665 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:52.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7fe1f006c480 msgr2=0x7fe1f006e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:6808/197014629,v1:172.21.15.57:6809/197014629] conn(0x7fe1f006c480 0x7fe1f006e8a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1f0066620 msgr2=0x7fe1f0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fe1f0066620 0x7fe1f0068ae0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe2100b2080 tx=0x7fe1f8009190 comp rx=0 tx=0).stop 2023-11-24T08:07:52.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 msgr2=0x7fe2101506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 --2- 172.21.15.57:0/518641707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210070da0 0x7fe2101506a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c3c0 tx=0x7fe20000c880 comp rx=0 tx=0).stop 2023-11-24T08:07:52.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe20ed9d640 1 -- 172.21.15.57:0/518641707 reap_dead start 2023-11-24T08:07:52.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 shutdown_connections 2023-11-24T08:07:52.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 >> 172.21.15.57:0/518641707 conn(0x7fe2100b0bf0 msgr2=0x7fe2100b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 shutdown_connections 2023-11-24T08:07:52.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.659+0000 7fe2149e7640 1 -- 172.21.15.57:0/518641707 wait complete. 2023-11-24T08:07:52.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T08:07:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.823+0000 7f8c0325a640 1 Processor -- start 2023-11-24T08:07:52.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.823+0000 7f8c0325a640 1 -- start start 2023-11-24T08:07:52.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c0325a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8bfc06a5b0 0x7f8bfc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c0325a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bfc0c6520 0x7f8bfc0c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c0325a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc06b150 con 0x7f8bfc15b660 2023-11-24T08:07:52.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c0325a640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0b1c00 con 0x7f8bfc0c6520 2023-11-24T08:07:52.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c0325a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0c6e90 con 0x7f8bfc06a5b0 2023-11-24T08:07:52.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c017f7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bfc0c6520 0x7f8bfc0c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c017f7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bfc0c6520 0x7f8bfc0c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38940/0 (socket says 172.21.15.57:38940) 2023-11-24T08:07:52.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c017f7640 1 -- 172.21.15.57:0/3067761441 learned_addr learned my addr 172.21.15.57:0/3067761441 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:52.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8bfbfff640 1 --2- 172.21.15.57:0/3067761441 >> v2:172.21.15.132:3300/0 conn(0x7f8bfc06a5b0 0x7f8bfc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c017f7640 1 -- 172.21.15.57:0/3067761441 >> v2:172.21.15.132:3300/0 conn(0x7f8bfc06a5b0 msgr2=0x7f8bfc15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:52.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c017f7640 1 --2- 172.21.15.57:0/3067761441 >> v2:172.21.15.132:3300/0 conn(0x7f8bfc06a5b0 0x7f8bfc15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c017f7640 1 -- 172.21.15.57:0/3067761441 >> v1:172.21.15.132:6789/0 conn(0x7f8bfc15b660 legacy=0x7f8bfc0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.827+0000 7f8c017f7640 1 -- 172.21.15.57:0/3067761441 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc06ab90 con 0x7f8bfc0c6520 2023-11-24T08:07:52.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c017f7640 1 --2- 172.21.15.57:0/3067761441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0c6950 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0c7150 tx=0x7f8bf401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592e640604995dcf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8bfb7fe640 1 -- 172.21.15.57:0/3067761441 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40a5770 con 0x7f8bfc0c6520 2023-11-24T08:07:52.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8bfb7fe640 1 -- 172.21.15.57:0/3067761441 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40a58d0 con 0x7f8bfc0c6520 2023-11-24T08:07:52.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8bfb7fe640 1 -- 172.21.15.57:0/3067761441 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40a5c60 con 0x7f8bfc0c6520 2023-11-24T08:07:52.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 -- 172.21.15.57:0/3067761441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 msgr2=0x7f8bfc0c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 --2- 172.21.15.57:0/3067761441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0c6950 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0c7150 tx=0x7f8bf401c9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 -- 172.21.15.57:0/3067761441 shutdown_connections 2023-11-24T08:07:52.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 --2- 172.21.15.57:0/3067761441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0c6950 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 --2- 172.21.15.57:0/3067761441 >> v2:172.21.15.132:3300/0 conn(0x7f8bfc06a5b0 0x7f8bfc15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 -- 172.21.15.57:0/3067761441 >> 172.21.15.57:0/3067761441 conn(0x7f8bfc071ce0 msgr2=0x7f8bfc0b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:52.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 -- 172.21.15.57:0/3067761441 shutdown_connections 2023-11-24T08:07:52.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 -- 172.21.15.57:0/3067761441 wait complete. 2023-11-24T08:07:52.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 Processor -- start 2023-11-24T08:07:52.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.831+0000 7f8c0325a640 1 -- start start 2023-11-24T08:07:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bfc06a5b0 0x7f8bfc1f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8bfc15b660 0x7f8bfc13ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc14d2f0 con 0x7f8bfc0c6520 2023-11-24T08:07:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0d0ec0 con 0x7f8bfc06a5b0 2023-11-24T08:07:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc150d40 con 0x7f8bfc15b660 2023-11-24T08:07:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38954/0 (socket says 172.21.15.57:38954) 2023-11-24T08:07:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 -- 172.21.15.57:0/2146327969 learned_addr learned my addr 172.21.15.57:0/2146327969 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:52.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c017f7640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8bfc15b660 0x7f8bfc13ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c00ff6640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bfc06a5b0 0x7f8bfc1f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 -- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8bfc15b660 msgr2=0x7f8bfc13ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8bfc15b660 0x7f8bfc13ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 -- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bfc06a5b0 msgr2=0x7f8bfc1f9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bfc06a5b0 0x7f8bfc1f9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 -- 172.21.15.57:0/2146327969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4009b30 con 0x7f8bfc0c6520 2023-11-24T08:07:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bfbfff640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0d0980 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d800 tx=0x7f8be800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bf97fa640 1 -- 172.21.15.57:0/2146327969 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800b6c0 con 0x7f8bfc0c6520 2023-11-24T08:07:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bf97fa640 1 -- 172.21.15.57:0/2146327969 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800b820 con 0x7f8bfc0c6520 2023-11-24T08:07:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bf97fa640 1 -- 172.21.15.57:0/2146327969 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800bb90 con 0x7f8bfc0c6520 2023-11-24T08:07:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc1fa2e0 con 0x7f8bfc0c6520 2023-11-24T08:07:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc1fa8a0 con 0x7f8bfc0c6520 2023-11-24T08:07:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc067a40 con 0x7f8bfc0c6520 2023-11-24T08:07:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.835+0000 7f8bf97fa640 1 -- 172.21.15.57:0/2146327969 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f8be800bcf0 con 0x7f8bfc0c6520 2023-11-24T08:07:52.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.839+0000 7f8bf97fa640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8be0066620 0x7f8be0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:52.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.839+0000 7f8bf97fa640 1 -- 172.21.15.57:0/2146327969 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8be8084470 con 0x7f8bfc0c6520 2023-11-24T08:07:52.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.839+0000 7f8c00ff6640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8be0066620 0x7f8be0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:52.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.839+0000 7f8c00ff6640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8be0066620 0x7f8be0068ae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0000f70 tx=0x7f8bf0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:52.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.843+0000 7f8bf97fa640 1 -- 172.21.15.57:0/2146327969 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8be80518d0 con 0x7f8bfc0c6520 2023-11-24T08:07:53.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.999+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bfc15c920 con 0x7f8be0066620 2023-11-24T08:07:53.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:52.999+0000 7f8bf97fa640 1 -- 172.21.15.57:0/2146327969 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8bf0001380 con 0x7f8be0066620 2023-11-24T08:07:53.004 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T08:07:53.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8be0066620 msgr2=0x7f8be0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8be0066620 0x7f8be0068ae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0000f70 tx=0x7f8bf0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 msgr2=0x7f8bfc0d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0d0980 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8be800d800 tx=0x7f8be800dcc0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 shutdown_connections 2023-11-24T08:07:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8be0066620 0x7f8be0068ae0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8bfc15b660 0x7f8bfc13ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bfc0c6520 0x7f8bfc0d0980 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 --2- 172.21.15.57:0/2146327969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bfc06a5b0 0x7f8bfc1f9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 >> 172.21.15.57:0/2146327969 conn(0x7f8bfc071ce0 msgr2=0x7f8bfc0af380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 shutdown_connections 2023-11-24T08:07:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.003+0000 7f8c0325a640 1 -- 172.21.15.57:0/2146327969 wait complete. 2023-11-24T08:07:53.026 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T08:07:53.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.167+0000 7feba61d1640 1 Processor -- start 2023-11-24T08:07:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feba61d1640 1 -- start start 2023-11-24T08:07:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feba61d1640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feba006e8a0 0x7feba015da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feba61d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba00aefd0 0x7feba006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feba61d1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba006d030 con 0x7feba0070ea0 2023-11-24T08:07:53.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feba61d1640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba0157f10 con 0x7feba006e8a0 2023-11-24T08:07:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feba61d1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba006ec80 con 0x7feba00aefd0 2023-11-24T08:07:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feb9f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feba006e8a0 0x7feba015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feb9f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feba006e8a0 0x7feba015da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38968/0 (socket says 172.21.15.57:38968) 2023-11-24T08:07:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feb9f7fe640 1 -- 172.21.15.57:0/4008062186 learned_addr learned my addr 172.21.15.57:0/4008062186 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feb9f7fe640 1 -- 172.21.15.57:0/4008062186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba00aefd0 msgr2=0x7feba006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feb9f7fe640 1 --2- 172.21.15.57:0/4008062186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba00aefd0 0x7feba006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feb9f7fe640 1 -- 172.21.15.57:0/4008062186 >> v1:172.21.15.132:6789/0 conn(0x7feba0070ea0 legacy=0x7feba00ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:53.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.171+0000 7feb9f7fe640 1 -- 172.21.15.57:0/4008062186 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba015e2f0 con 0x7feba006e8a0 2023-11-24T08:07:53.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feb9f7fe640 1 --2- 172.21.15.57:0/4008062186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba006e8a0 0x7feba015da30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7feb90009870 tx=0x7feb9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cbc4f9aab5602f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feb9e7fc640 1 -- 172.21.15.57:0/4008062186 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900ac600 con 0x7feba006e8a0 2023-11-24T08:07:53.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feb9e7fc640 1 -- 172.21.15.57:0/4008062186 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb900a8050 con 0x7feba006e8a0 2023-11-24T08:07:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feb9e7fc640 1 -- 172.21.15.57:0/4008062186 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900ac980 con 0x7feba006e8a0 2023-11-24T08:07:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 -- 172.21.15.57:0/4008062186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba006e8a0 msgr2=0x7feba015da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 --2- 172.21.15.57:0/4008062186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba006e8a0 0x7feba015da30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7feb90009870 tx=0x7feb9001c4d0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 -- 172.21.15.57:0/4008062186 shutdown_connections 2023-11-24T08:07:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 --2- 172.21.15.57:0/4008062186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba00aefd0 0x7feba006d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 --2- 172.21.15.57:0/4008062186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba006e8a0 0x7feba015da30 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 -- 172.21.15.57:0/4008062186 >> 172.21.15.57:0/4008062186 conn(0x7feba00cc330 msgr2=0x7feba00cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 -- 172.21.15.57:0/4008062186 shutdown_connections 2023-11-24T08:07:53.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 -- 172.21.15.57:0/4008062186 wait complete. 2023-11-24T08:07:53.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 Processor -- start 2023-11-24T08:07:53.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.175+0000 7feba61d1640 1 -- start start 2023-11-24T08:07:53.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba006e8a0 0x7feba014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba0070ea0 0x7feba00ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba00aefd0 0x7feba00adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01553c0 con 0x7feba00aefd0 2023-11-24T08:07:53.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0151920 con 0x7feba006e8a0 2023-11-24T08:07:53.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba014fe30 con 0x7feba0070ea0 2023-11-24T08:07:53.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba00aefd0 0x7feba00adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba00aefd0 0x7feba00adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38972/0 (socket says 172.21.15.57:38972) 2023-11-24T08:07:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 -- 172.21.15.57:0/779526546 learned_addr learned my addr 172.21.15.57:0/779526546 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9f7fe640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba006e8a0 0x7feba014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9effd640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba0070ea0 0x7feba00ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 -- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba0070ea0 msgr2=0x7feba00ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feba0070ea0 0x7feba00ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 -- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba006e8a0 msgr2=0x7feba014f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba006e8a0 0x7feba014f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 -- 172.21.15.57:0/779526546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900094d0 con 0x7feba00aefd0 2023-11-24T08:07:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb9ffff640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba00aefd0 0x7feba00adde0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c7b0 tx=0x7feb9800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98003d90 con 0x7feba00aefd0 2023-11-24T08:07:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98005070 con 0x7feba00aefd0 2023-11-24T08:07:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba01555d0 con 0x7feba00aefd0 2023-11-24T08:07:53.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98005420 con 0x7feba00aefd0 2023-11-24T08:07:53.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba0155b90 con 0x7feba00aefd0 2023-11-24T08:07:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.179+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feba015df70 con 0x7feba00aefd0 2023-11-24T08:07:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7feb98005580 con 0x7feba00aefd0 2023-11-24T08:07:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb87fff640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb8c066620 0x7feb8c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb98083590 con 0x7feba00aefd0 2023-11-24T08:07:53.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb87fff640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7feb8c06c480 0x7feb8c06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 --> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb8c06ef50 con 0x7feb8c06c480 2023-11-24T08:07:53.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb98085b70 con 0x7feba00aefd0 2023-11-24T08:07:53.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb9f7fe640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb8c066620 0x7feb8c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb9effd640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7feb8c06c480 0x7feb8c06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb9effd640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7feb8c06c480 0x7feb8c06e8a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb9f7fe640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb8c066620 0x7feb8c068ae0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb900ae000 tx=0x7feb900a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.183+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== osd.2 v2:172.21.15.57:6824/3141659691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feb8c06ef50 con 0x7feb8c06c480 2023-11-24T08:07:53.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.195+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 --> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feba0071720 con 0x7feb8c06c480 2023-11-24T08:07:53.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feb87fff640 1 -- 172.21.15.57:0/779526546 <== osd.2 v2:172.21.15.57:6824/3141659691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feb94009a20 con 0x7feb8c06c480 2023-11-24T08:07:53.202 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:53.202 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:53.203 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:53.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7feb8c06c480 msgr2=0x7feb8c06e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:6824/3141659691,v1:172.21.15.57:6825/3141659691] conn(0x7feb8c06c480 0x7feb8c06e8a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb8c066620 msgr2=0x7feb8c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7feb8c066620 0x7feb8c068ae0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb900ae000 tx=0x7feb900a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba00aefd0 msgr2=0x7feba00adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 --2- 172.21.15.57:0/779526546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feba00aefd0 0x7feba00adde0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c7b0 tx=0x7feb9800cc70 comp rx=0 tx=0).stop 2023-11-24T08:07:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feb9ffff640 1 -- 172.21.15.57:0/779526546 reap_dead start 2023-11-24T08:07:53.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 shutdown_connections 2023-11-24T08:07:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 >> 172.21.15.57:0/779526546 conn(0x7feba00cc330 msgr2=0x7feba006a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 shutdown_connections 2023-11-24T08:07:53.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.199+0000 7feba61d1640 1 -- 172.21.15.57:0/779526546 wait complete. 2023-11-24T08:07:53.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T08:07:53.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a383aa640 1 Processor -- start 2023-11-24T08:07:53.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a383aa640 1 -- start start 2023-11-24T08:07:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a383aa640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4a3015b220 0x7f4a300cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a383aa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a3015b600 0x7f4a3006d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a383aa640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300abed0 con 0x7f4a300c9650 2023-11-24T08:07:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a383aa640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a30072710 con 0x7f4a3015b220 2023-11-24T08:07:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a383aa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30072370 con 0x7f4a3015b600 2023-11-24T08:07:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a36146640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4a3015b220 0x7f4a300cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a36947640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4a300c9650 0x7f4a3015efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58540/0 (socket says 172.21.15.57:58540) 2023-11-24T08:07:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a36947640 1 -- 172.21.15.57:0/66290223 learned_addr learned my addr 172.21.15.57:0/66290223 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.359+0000 7f4a35945640 1 --2- 172.21.15.57:0/66290223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a3015b600 0x7f4a3006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a36146640 1 -- 172.21.15.57:0/66290223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a3015b600 msgr2=0x7f4a3006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a36146640 1 --2- 172.21.15.57:0/66290223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a3015b600 0x7f4a3006d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a36146640 1 -- 172.21.15.57:0/66290223 >> v1:172.21.15.57:6789/0 conn(0x7f4a300c9650 legacy=0x7f4a3015efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a36146640 1 -- 172.21.15.57:0/66290223 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3006d580 con 0x7f4a3015b220 2023-11-24T08:07:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a35144640 1 -- 172.21.15.57:0/66290223 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145447235 0 0) 0x7f4a300abed0 con 0x7f4a300c9650 2023-11-24T08:07:53.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a36146640 1 --2- 172.21.15.57:0/66290223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a300cada0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097c0 tx=0x7f4a2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224cd0f0b9201d80 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a35144640 1 -- 172.21.15.57:0/66290223 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0ab650 con 0x7f4a3015b220 2023-11-24T08:07:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a35144640 1 -- 172.21.15.57:0/66290223 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0ab7b0 con 0x7f4a3015b220 2023-11-24T08:07:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a35144640 1 -- 172.21.15.57:0/66290223 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0abb40 con 0x7f4a3015b220 2023-11-24T08:07:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a383aa640 1 -- 172.21.15.57:0/66290223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 msgr2=0x7f4a300cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.363+0000 7f4a383aa640 1 --2- 172.21.15.57:0/66290223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a300cada0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097c0 tx=0x7f4a2c01c450 comp rx=0 tx=0).stop 2023-11-24T08:07:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- 172.21.15.57:0/66290223 shutdown_connections 2023-11-24T08:07:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 --2- 172.21.15.57:0/66290223 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a3015b600 0x7f4a3006d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 --2- 172.21.15.57:0/66290223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a300cada0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- 172.21.15.57:0/66290223 >> 172.21.15.57:0/66290223 conn(0x7f4a300b0bf0 msgr2=0x7f4a300b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- 172.21.15.57:0/66290223 shutdown_connections 2023-11-24T08:07:53.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- 172.21.15.57:0/66290223 wait complete. 2023-11-24T08:07:53.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 Processor -- start 2023-11-24T08:07:53.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- start start 2023-11-24T08:07:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a300c9650 0x7f4a300b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a30156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a3015b600 0x7f4a3009b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30156790 con 0x7f4a3015b220 2023-11-24T08:07:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30154ed0 con 0x7f4a3015b600 2023-11-24T08:07:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a383aa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301551b0 con 0x7f4a300c9650 2023-11-24T08:07:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a30156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a30156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38986/0 (socket says 172.21.15.57:38986) 2023-11-24T08:07:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 -- 172.21.15.57:0/3189928935 learned_addr learned my addr 172.21.15.57:0/3189928935 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a36947640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a3015b600 0x7f4a3009b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a36146640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a300c9650 0x7f4a300b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 -- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a300c9650 msgr2=0x7f4a300b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a300c9650 0x7f4a300b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 -- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a3015b600 msgr2=0x7f4a3009b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a3015b600 0x7f4a3009b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 -- 172.21.15.57:0/3189928935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c009420 con 0x7f4a3015b220 2023-11-24T08:07:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a36947640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a3015b600 0x7f4a3009b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.367+0000 7f4a35945640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a30156250 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000e930 tx=0x7f4a2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a26ffd640 1 -- 172.21.15.57:0/3189928935 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20009690 con 0x7f4a3015b220 2023-11-24T08:07:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a26ffd640 1 -- 172.21.15.57:0/3189928935 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2000ca00 con 0x7f4a3015b220 2023-11-24T08:07:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a26ffd640 1 -- 172.21.15.57:0/3189928935 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000cd70 con 0x7f4a3015b220 2023-11-24T08:07:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300c9ff0 con 0x7f4a3015b220 2023-11-24T08:07:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a30155770 con 0x7f4a3015b220 2023-11-24T08:07:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a30073cd0 con 0x7f4a3015b220 2023-11-24T08:07:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a26ffd640 1 -- 172.21.15.57:0/3189928935 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f4a20013470 con 0x7f4a3015b220 2023-11-24T08:07:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a26ffd640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a14066650 0x7f4a14068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a26ffd640 1 -- 172.21.15.57:0/3189928935 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4a200840e0 con 0x7f4a3015b220 2023-11-24T08:07:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.371+0000 7f4a36146640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a14066650 0x7f4a14068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.375+0000 7f4a36146640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a14066650 0x7f4a14068b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0af000 tx=0x7f4a2c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.375+0000 7f4a26ffd640 1 -- 172.21.15.57:0/3189928935 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a20051690 con 0x7f4a3015b220 2023-11-24T08:07:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.535+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a300c9e70 con 0x7f4a14066650 2023-11-24T08:07:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.535+0000 7f4a26ffd640 1 -- 172.21.15.57:0/3189928935 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4a2c0ab920 con 0x7f4a14066650 2023-11-24T08:07:53.540 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T08:07:53.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a14066650 msgr2=0x7f4a14068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a14066650 0x7f4a14068b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0af000 tx=0x7f4a2c0a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 msgr2=0x7f4a30156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a30156250 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000e930 tx=0x7f4a2000edf0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 shutdown_connections 2023-11-24T08:07:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f4a14066650 0x7f4a14068b10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a3015b600 0x7f4a3009b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a3015b220 0x7f4a30156250 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 --2- 172.21.15.57:0/3189928935 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a300c9650 0x7f4a300b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 >> 172.21.15.57:0/3189928935 conn(0x7f4a300b0bf0 msgr2=0x7f4a3015e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 shutdown_connections 2023-11-24T08:07:53.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.539+0000 7f4a383aa640 1 -- 172.21.15.57:0/3189928935 wait complete. 2023-11-24T08:07:53.561 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T08:07:53.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.703+0000 7f7c29daa640 1 Processor -- start 2023-11-24T08:07:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.703+0000 7f7c29daa640 1 -- start start 2023-11-24T08:07:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c29daa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 0x7f7c2406b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c29daa640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c240d1000 0x7f7c240ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c29daa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c240ce060 con 0x7f7c240cfe40 2023-11-24T08:07:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c29daa640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c240d1a10 con 0x7f7c240d1000 2023-11-24T08:07:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c29daa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240cded0 con 0x7f7c240b2550 2023-11-24T08:07:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c23fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c240d1000 0x7f7c240ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c23fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c240d1000 0x7f7c240ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39002/0 (socket says 172.21.15.57:39002) 2023-11-24T08:07:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c23fff640 1 -- 172.21.15.57:0/3232493364 learned_addr learned my addr 172.21.15.57:0/3232493364 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c237fe640 1 --1- 172.21.15.57:0/3232493364 >> v1:172.21.15.132:6789/0 conn(0x7f7c240cfe40 0x7f7c240d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.57:48644/0 (socket says 172.21.15.57:48644) 2023-11-24T08:07:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c22ffd640 1 --2- 172.21.15.57:0/3232493364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 0x7f7c2406b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c23fff640 1 -- 172.21.15.57:0/3232493364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 msgr2=0x7f7c2406b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c23fff640 1 --2- 172.21.15.57:0/3232493364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 0x7f7c2406b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c23fff640 1 -- 172.21.15.57:0/3232493364 >> v1:172.21.15.132:6789/0 conn(0x7f7c240cfe40 legacy=0x7f7c240d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.707+0000 7f7c23fff640 1 -- 172.21.15.57:0/3232493364 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240d1c20 con 0x7f7c240d1000 2023-11-24T08:07:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c23fff640 1 --2- 172.21.15.57:0/3232493364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c240ce4f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009e50 tx=0x7f7c1c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acb3ba47e463140 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c227fc640 1 -- 172.21.15.57:0/3232493364 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0a56a0 con 0x7f7c240d1000 2023-11-24T08:07:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c227fc640 1 -- 172.21.15.57:0/3232493364 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0a5800 con 0x7f7c240d1000 2023-11-24T08:07:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c227fc640 1 -- 172.21.15.57:0/3232493364 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0a5b90 con 0x7f7c240d1000 2023-11-24T08:07:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 -- 172.21.15.57:0/3232493364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 msgr2=0x7f7c240ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 --2- 172.21.15.57:0/3232493364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c240ce4f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009e50 tx=0x7f7c1c01c8f0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 -- 172.21.15.57:0/3232493364 shutdown_connections 2023-11-24T08:07:53.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 --2- 172.21.15.57:0/3232493364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c240ce4f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 --2- 172.21.15.57:0/3232493364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 0x7f7c2406b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 -- 172.21.15.57:0/3232493364 >> 172.21.15.57:0/3232493364 conn(0x7f7c2409c780 msgr2=0x7f7c240d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 -- 172.21.15.57:0/3232493364 shutdown_connections 2023-11-24T08:07:53.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 -- 172.21.15.57:0/3232493364 wait complete. 2023-11-24T08:07:53.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 Processor -- start 2023-11-24T08:07:53.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.711+0000 7f7c29daa640 1 -- start start 2023-11-24T08:07:53.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 0x7f7c240ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c240cfe40 0x7f7c240cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c241583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240ca2e0 con 0x7f7c240d1000 2023-11-24T08:07:53.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2415a3a0 con 0x7f7c240cfe40 2023-11-24T08:07:53.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240c9d20 con 0x7f7c240b2550 2023-11-24T08:07:53.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c241583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c241583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39010/0 (socket says 172.21.15.57:39010) 2023-11-24T08:07:53.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 -- 172.21.15.57:0/3717858885 learned_addr learned my addr 172.21.15.57:0/3717858885 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c22ffd640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c240cfe40 0x7f7c240cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 -- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 msgr2=0x7f7c240ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c240b2550 0x7f7c240ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 -- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c240cfe40 msgr2=0x7f7c240cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c240cfe40 0x7f7c240cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 -- 172.21.15.57:0/3717858885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009b30 con 0x7f7c240d1000 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c23fff640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c241583f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0af040 tx=0x7f7c1c019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0b8640 con 0x7f7c240d1000 2023-11-24T08:07:53.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0b87c0 con 0x7f7c240d1000 2023-11-24T08:07:53.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0b8b70 con 0x7f7c240d1000 2023-11-24T08:07:53.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c240ca000 con 0x7f7c240d1000 2023-11-24T08:07:53.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c240b4400 con 0x7f7c240d1000 2023-11-24T08:07:53.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.715+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c240b3f80 con 0x7f7c240d1000 2023-11-24T08:07:53.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f7c1c0b8cd0 con 0x7f7c240d1000 2023-11-24T08:07:53.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c0bfff640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066650 0x7f7c10068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c1c11f740 con 0x7f7c240d1000 2023-11-24T08:07:53.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c0bfff640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7f7c1006c4b0 0x7f7c1006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 --> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c1006ef80 con 0x7f7c1006c4b0 2023-11-24T08:07:53.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c1c11fab0 con 0x7f7c240d1000 2023-11-24T08:07:53.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c237fe640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066650 0x7f7c10068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c22ffd640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7f7c1006c4b0 0x7f7c1006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c22ffd640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7f7c1006c4b0 0x7f7c1006e8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c237fe640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066650 0x7f7c10068b10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001550 tx=0x7f7c140079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.719+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== osd.3 v2:172.21.15.57:6816/1395957383 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7c1006ef80 con 0x7f7c1006c4b0 2023-11-24T08:07:53.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.731+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 --> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c240caa40 con 0x7f7c1006c4b0 2023-11-24T08:07:53.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.731+0000 7f7c0bfff640 1 -- 172.21.15.57:0/3717858885 <== osd.3 v2:172.21.15.57:6816/1395957383 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c240caa40 con 0x7f7c1006c4b0 2023-11-24T08:07:53.738 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:53.738 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:53.738 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:53.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7f7c1006c4b0 msgr2=0x7f7c1006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:6816/1395957383,v1:172.21.15.57:6817/1395957383] conn(0x7f7c1006c4b0 0x7f7c1006e8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066650 msgr2=0x7f7c10068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f7c10066650 0x7f7c10068b10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001550 tx=0x7f7c140079d0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 msgr2=0x7f7c241583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 --2- 172.21.15.57:0/3717858885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c240d1000 0x7f7c241583f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0af040 tx=0x7f7c1c019690 comp rx=0 tx=0).stop 2023-11-24T08:07:53.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c23fff640 1 -- 172.21.15.57:0/3717858885 reap_dead start 2023-11-24T08:07:53.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 shutdown_connections 2023-11-24T08:07:53.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 >> 172.21.15.57:0/3717858885 conn(0x7f7c2409c780 msgr2=0x7f7c240b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 shutdown_connections 2023-11-24T08:07:53.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.735+0000 7f7c29daa640 1 -- 172.21.15.57:0/3717858885 wait complete. 2023-11-24T08:07:53.756 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T08:07:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.895+0000 7fd2b522f640 1 Processor -- start 2023-11-24T08:07:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.895+0000 7fd2b522f640 1 -- start start 2023-11-24T08:07:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2b522f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b01608f0 0x7fd2b00b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2b522f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2b00b6760 0x7fd2b00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2b522f640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b00d1a00 con 0x7fd2b00b6320 2023-11-24T08:07:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2b522f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b0160cd0 con 0x7fd2b00b6760 2023-11-24T08:07:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2b522f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00b78f0 con 0x7fd2b01608f0 2023-11-24T08:07:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2af7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd2b00b6320 0x7fd2b00d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58552/0 (socket says 172.21.15.57:58552) 2023-11-24T08:07:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2af7fe640 1 -- 172.21.15.57:0/3678136405 learned_addr learned my addr 172.21.15.57:0/3678136405 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2b4a2e640 1 --2- 172.21.15.57:0/3678136405 >> v2:172.21.15.132:3300/0 conn(0x7fd2b00b6760 0x7fd2b00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2affff640 1 --2- 172.21.15.57:0/3678136405 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b01608f0 0x7fd2b00b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2aeffd640 1 -- 172.21.15.57:0/3678136405 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520369417 0 0) 0x7fd2b00d1a00 con 0x7fd2b00b6320 2023-11-24T08:07:53.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2aeffd640 1 -- 172.21.15.57:0/3678136405 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd298003530 con 0x7fd2b00b6320 2023-11-24T08:07:53.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2affff640 1 -- 172.21.15.57:0/3678136405 >> v2:172.21.15.132:3300/0 conn(0x7fd2b00b6760 msgr2=0x7fd2b00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:53.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2affff640 1 --2- 172.21.15.57:0/3678136405 >> v2:172.21.15.132:3300/0 conn(0x7fd2b00b6760 0x7fd2b00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2affff640 1 -- 172.21.15.57:0/3678136405 >> v1:172.21.15.57:6789/0 conn(0x7fd2b00b6320 legacy=0x7fd2b00d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.899+0000 7fd2affff640 1 -- 172.21.15.57:0/3678136405 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00b6c70 con 0x7fd2b01608f0 2023-11-24T08:07:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2affff640 1 --2- 172.21.15.57:0/3678136405 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b01608f0 0x7fd2b00b8ed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00097c0 tx=0x7fd2a001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3411a28c1347592d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2aeffd640 1 -- 172.21.15.57:0/3678136405 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00ab650 con 0x7fd2b01608f0 2023-11-24T08:07:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2aeffd640 1 -- 172.21.15.57:0/3678136405 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00ab7b0 con 0x7fd2b01608f0 2023-11-24T08:07:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2aeffd640 1 -- 172.21.15.57:0/3678136405 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00abb40 con 0x7fd2b01608f0 2023-11-24T08:07:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 -- 172.21.15.57:0/3678136405 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b01608f0 msgr2=0x7fd2b00b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 --2- 172.21.15.57:0/3678136405 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b01608f0 0x7fd2b00b8ed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00097c0 tx=0x7fd2a001c450 comp rx=0 tx=0).stop 2023-11-24T08:07:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 -- 172.21.15.57:0/3678136405 shutdown_connections 2023-11-24T08:07:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 --2- 172.21.15.57:0/3678136405 >> v2:172.21.15.132:3300/0 conn(0x7fd2b00b6760 0x7fd2b00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 --2- 172.21.15.57:0/3678136405 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b01608f0 0x7fd2b00b8ed0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 -- 172.21.15.57:0/3678136405 >> 172.21.15.57:0/3678136405 conn(0x7fd2b00613d0 msgr2=0x7fd2b00617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:53.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 -- 172.21.15.57:0/3678136405 shutdown_connections 2023-11-24T08:07:53.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 -- 172.21.15.57:0/3678136405 wait complete. 2023-11-24T08:07:53.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.903+0000 7fd2b522f640 1 Processor -- start 2023-11-24T08:07:53.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 -- start start 2023-11-24T08:07:53.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2b00b6320 0x7fd2b015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b00b6760 0x7fd2b01f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2b01608f0 0x7fd2b01f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00c4450 con 0x7fd2b00b6320 2023-11-24T08:07:53.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00c3b40 con 0x7fd2b01608f0 2023-11-24T08:07:53.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00ca430 con 0x7fd2b00b6760 2023-11-24T08:07:53.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2b00b6320 0x7fd2b015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2b00b6320 0x7fd2b015c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39024/0 (socket says 172.21.15.57:39024) 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 -- 172.21.15.57:0/2765145202 learned_addr learned my addr 172.21.15.57:0/2765145202 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 -- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b00b6760 msgr2=0x7fd2b01f9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b00b6760 0x7fd2b01f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 -- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2b01608f0 msgr2=0x7fd2b01f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2b01608f0 0x7fd2b01f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 -- 172.21.15.57:0/2765145202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0009420 con 0x7fd2b00b6320 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2affff640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2b00b6320 0x7fd2b015c670 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00ad040 tx=0x7fd2a001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2acff9640 1 -- 172.21.15.57:0/2765145202 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00bf610 con 0x7fd2b00b6320 2023-11-24T08:07:53.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2acff9640 1 -- 172.21.15.57:0/2765145202 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00bf790 con 0x7fd2b00b6320 2023-11-24T08:07:53.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2acff9640 1 -- 172.21.15.57:0/2765145202 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00bfb40 con 0x7fd2b00b6320 2023-11-24T08:07:53.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b015f6f0 con 0x7fd2b00b6320 2023-11-24T08:07:53.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b00c4070 con 0x7fd2b00b6320 2023-11-24T08:07:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.907+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b004e850 con 0x7fd2b00b6320 2023-11-24T08:07:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.911+0000 7fd2acff9640 1 -- 172.21.15.57:0/2765145202 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fd2a00b5400 con 0x7fd2b00b6320 2023-11-24T08:07:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.911+0000 7fd2acff9640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd29c066620 0x7fd29c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.911+0000 7fd2acff9640 1 -- 172.21.15.57:0/2765145202 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd2a011ea50 con 0x7fd2b00b6320 2023-11-24T08:07:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.911+0000 7fd2af7fe640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd29c066620 0x7fd29c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:53.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.911+0000 7fd2af7fe640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd29c066620 0x7fd29c068ae0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4007fd0 tx=0x7fd2a4007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:53.915+0000 7fd2acff9640 1 -- 172.21.15.57:0/2765145202 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2a00ec060 con 0x7fd2b00b6320 2023-11-24T08:07:54.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.075+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2b00ce8d0 con 0x7fd29c066620 2023-11-24T08:07:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.075+0000 7fd2acff9640 1 -- 172.21.15.57:0/2765145202 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd2a40058a0 con 0x7fd29c066620 2023-11-24T08:07:54.079 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T08:07:54.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.075+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd29c066620 msgr2=0x7fd29c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd29c066620 0x7fd29c068ae0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4007fd0 tx=0x7fd2a4007900 comp rx=0 tx=0).stop 2023-11-24T08:07:54.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2b00b6320 msgr2=0x7fd2b015c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2b00b6320 0x7fd2b015c670 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00ad040 tx=0x7fd2a001ac90 comp rx=0 tx=0).stop 2023-11-24T08:07:54.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 shutdown_connections 2023-11-24T08:07:54.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fd29c066620 0x7fd29c068ae0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2b01608f0 0x7fd2b01f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2b00b6760 0x7fd2b01f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 --2- 172.21.15.57:0/2765145202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2b00b6320 0x7fd2b015c670 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 >> 172.21.15.57:0/2765145202 conn(0x7fd2b00613d0 msgr2=0x7fd2b01593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 shutdown_connections 2023-11-24T08:07:54.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.079+0000 7fd2b522f640 1 -- 172.21.15.57:0/2765145202 wait complete. 2023-11-24T08:07:54.101 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T08:07:54.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 Processor -- start 2023-11-24T08:07:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 -- start start 2023-11-24T08:07:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7facf015a320 0x7facf00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf00b36c0 0x7facf0070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facf0070bd0 0x7facf0071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf00b2430 con 0x7facf0070bd0 2023-11-24T08:07:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf015a700 con 0x7facf015a320 2023-11-24T08:07:54.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf69df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf0071580 con 0x7facf00b36c0 2023-11-24T08:07:54.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facf0070bd0 0x7facf0071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facf0070bd0 0x7facf0071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39038/0 (socket says 172.21.15.57:39038) 2023-11-24T08:07:54.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 -- 172.21.15.57:0/582075810 learned_addr learned my addr 172.21.15.57:0/582075810 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:54.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7faceffff640 1 --2- 172.21.15.57:0/582075810 >> v2:172.21.15.132:3300/0 conn(0x7facf015a320 0x7facf00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facef7fe640 1 --2- 172.21.15.57:0/582075810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf00b36c0 0x7facf0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 -- 172.21.15.57:0/582075810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf00b36c0 msgr2=0x7facf0070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 --2- 172.21.15.57:0/582075810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf00b36c0 0x7facf0070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 -- 172.21.15.57:0/582075810 >> v2:172.21.15.132:3300/0 conn(0x7facf015a320 msgr2=0x7facf00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 --2- 172.21.15.57:0/582075810 >> v2:172.21.15.132:3300/0 conn(0x7facf015a320 0x7facf00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7facf4f7c640 1 -- 172.21.15.57:0/582075810 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf00b2620 con 0x7facf0070bd0 2023-11-24T08:07:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.247+0000 7faceffff640 1 --2- 172.21.15.57:0/582075810 >> v2:172.21.15.132:3300/0 conn(0x7facf015a320 0x7facf00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf4f7c640 1 --2- 172.21.15.57:0/582075810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf0070bd0 0x7facf0071040 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7facf006c0c0 tx=0x7face801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8078f25e06fe787f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7faceeffd640 1 -- 172.21.15.57:0/582075810 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80a5720 con 0x7facf0070bd0 2023-11-24T08:07:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7faceeffd640 1 -- 172.21.15.57:0/582075810 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face80a5880 con 0x7facf0070bd0 2023-11-24T08:07:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7faceeffd640 1 -- 172.21.15.57:0/582075810 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80a5c10 con 0x7facf0070bd0 2023-11-24T08:07:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 -- 172.21.15.57:0/582075810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf0070bd0 msgr2=0x7facf0071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 --2- 172.21.15.57:0/582075810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf0070bd0 0x7facf0071040 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7facf006c0c0 tx=0x7face801c9a0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 -- 172.21.15.57:0/582075810 shutdown_connections 2023-11-24T08:07:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 --2- 172.21.15.57:0/582075810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf0070bd0 0x7facf0071040 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 --2- 172.21.15.57:0/582075810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf00b36c0 0x7facf0070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 --2- 172.21.15.57:0/582075810 >> v2:172.21.15.132:3300/0 conn(0x7facf015a320 0x7facf00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 -- 172.21.15.57:0/582075810 >> 172.21.15.57:0/582075810 conn(0x7facf00b0bf0 msgr2=0x7facf00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 -- 172.21.15.57:0/582075810 shutdown_connections 2023-11-24T08:07:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 -- 172.21.15.57:0/582075810 wait complete. 2023-11-24T08:07:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.251+0000 7facf69df640 1 Processor -- start 2023-11-24T08:07:54.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 -- start start 2023-11-24T08:07:54.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf0070bd0 0x7facf009c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf00b36c0 0x7facf0159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf015a320 0x7facf01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf0152d10 con 0x7facf015a320 2023-11-24T08:07:54.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf0159bb0 con 0x7facf00b36c0 2023-11-24T08:07:54.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf0152100 con 0x7facf0070bd0 2023-11-24T08:07:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf015a320 0x7facf01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf015a320 0x7facf01531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39040/0 (socket says 172.21.15.57:39040) 2023-11-24T08:07:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 -- 172.21.15.57:0/860994326 learned_addr learned my addr 172.21.15.57:0/860994326 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facef7fe640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf00b36c0 0x7facf0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7faceffff640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf0070bd0 0x7facf009c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 -- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf0070bd0 msgr2=0x7facf009c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf0070bd0 0x7facf009c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 -- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf00b36c0 msgr2=0x7facf0159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf00b36c0 0x7facf0159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 -- 172.21.15.57:0/860994326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8009b30 con 0x7facf015a320 2023-11-24T08:07:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf4f7c640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf015a320 0x7facf01531a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7face801b050 tx=0x7face8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80b8670 con 0x7facf015a320 2023-11-24T08:07:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face80b87d0 con 0x7facf015a320 2023-11-24T08:07:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80b8b80 con 0x7facf015a320 2023-11-24T08:07:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf01523e0 con 0x7facf015a320 2023-11-24T08:07:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf01529a0 con 0x7facf015a320 2023-11-24T08:07:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.255+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facf00b31a0 con 0x7facf015a320 2023-11-24T08:07:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7face80b8ce0 con 0x7facf015a320 2023-11-24T08:07:54.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facecff9640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7facdc066620 0x7facdc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7face811f350 con 0x7facf015a320 2023-11-24T08:07:54.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facecff9640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7facdc06c480 0x7facdc06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 --> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facdc06ef50 con 0x7facdc06c480 2023-11-24T08:07:54.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7face8121930 con 0x7facf015a320 2023-11-24T08:07:54.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7faceffff640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7facdc066620 0x7facdc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facef7fe640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7facdc06c480 0x7facdc06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7faceffff640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7facdc066620 0x7facdc068ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7facf009a9d0 tx=0x7face0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facef7fe640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7facdc06c480 0x7facdc06e8a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.259+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== osd.4 v2:172.21.15.132:6800/2592632531 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7facdc06ef50 con 0x7facdc06c480 2023-11-24T08:07:54.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 --> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7facf0067520 con 0x7facdc06c480 2023-11-24T08:07:54.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facecff9640 1 -- 172.21.15.57:0/860994326 <== osd.4 v2:172.21.15.132:6800/2592632531 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7facf0067520 con 0x7facdc06c480 2023-11-24T08:07:54.279 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:54.279 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:54.280 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:54.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7facdc06c480 msgr2=0x7facdc06e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6800/2592632531,v1:172.21.15.132:6801/2592632531] conn(0x7facdc06c480 0x7facdc06e8a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7facdc066620 msgr2=0x7facdc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7facdc066620 0x7facdc068ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7facf009a9d0 tx=0x7face0008040 comp rx=0 tx=0).stop 2023-11-24T08:07:54.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf015a320 msgr2=0x7facf01531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 --2- 172.21.15.57:0/860994326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facf015a320 0x7facf01531a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7face801b050 tx=0x7face8019740 comp rx=0 tx=0).stop 2023-11-24T08:07:54.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf4f7c640 1 -- 172.21.15.57:0/860994326 reap_dead start 2023-11-24T08:07:54.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 shutdown_connections 2023-11-24T08:07:54.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 >> 172.21.15.57:0/860994326 conn(0x7facf00b0bf0 msgr2=0x7facf0099a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 shutdown_connections 2023-11-24T08:07:54.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.275+0000 7facf69df640 1 -- 172.21.15.57:0/860994326 wait complete. 2023-11-24T08:07:54.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T08:07:54.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.435+0000 7f0b72765640 1 Processor -- start 2023-11-24T08:07:54.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.435+0000 7f0b72765640 1 -- start start 2023-11-24T08:07:54.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b72765640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b6c0c9d60 0x7f0b6c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b72765640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c0abed0 con 0x7f0b6c15b220 2023-11-24T08:07:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b72765640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c072370 con 0x7f0b6c15b600 2023-11-24T08:07:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b72765640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c072710 con 0x7f0b6c0c9d60 2023-11-24T08:07:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0b6c15b220 0x7f0b6c06d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58568/0 (socket says 172.21.15.57:58568) 2023-11-24T08:07:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 -- 172.21.15.57:0/2815689664 learned_addr learned my addr 172.21.15.57:0/2815689664 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:54.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b70d02640 1 --2- 172.21.15.57:0/2815689664 >> v2:172.21.15.132:3300/0 conn(0x7f0b6c0c9d60 0x7f0b6c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737109504 0 0) 0x7f0b6c0abed0 con 0x7f0b6c15b220 2023-11-24T08:07:54.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b54003530 con 0x7f0b6c15b220 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107621284 0 0) 0x7f0b6c072370 con 0x7f0b6c15b600 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c0abed0 con 0x7f0b6c15b600 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2301991399 0 0) 0x7f0b54003530 con 0x7f0b6c15b220 2023-11-24T08:07:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 >> v2:172.21.15.132:3300/0 conn(0x7f0b6c0c9d60 msgr2=0x7f0b6c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 --2- 172.21.15.57:0/2815689664 >> v2:172.21.15.132:3300/0 conn(0x7f0b6c0c9d60 0x7f0b6c0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 >> v1:172.21.15.132:6789/0 conn(0x7f0b6c15b600 legacy=0x7f0b6c0c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c070670 con 0x7f0b6c15b220 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f0b5c001680 con 0x7f0b6c15b220 2023-11-24T08:07:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 >> v1:172.21.15.57:6789/0 conn(0x7f0b6c15b220 legacy=0x7f0b6c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b54003b60 0x7f0b54003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b540047d0 0x7f0b54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b54005190 0x7f0b5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c072710 con 0x7f0b54003b60 2023-11-24T08:07:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5400c060 con 0x7f0b540047d0 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5400c220 con 0x7f0b54005190 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b54003b60 0x7f0b54003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b70d02640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b54005190 0x7f0b5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6b7fe640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b540047d0 0x7f0b54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 -- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b54005190 msgr2=0x7f0b5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b54005190 0x7f0b5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 -- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b540047d0 msgr2=0x7f0b54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b540047d0 0x7f0b54004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b6bfff640 1 -- 172.21.15.57:0/2815689664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54003530 con 0x7f0b54003b60 2023-11-24T08:07:54.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.439+0000 7f0b70d02640 1 -- 172.21.15.57:0/2815689664 reap_dead start 2023-11-24T08:07:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b6bfff640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b54003b60 0x7f0b54003f60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c007fb0 tx=0x7f0b5c01cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a28a120fa373f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c005ae0 con 0x7f0b54003b60 2023-11-24T08:07:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c005c60 con 0x7f0b54003b60 2023-11-24T08:07:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b6affd640 1 -- 172.21.15.57:0/2815689664 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0072b0 con 0x7f0b54003b60 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b72765640 1 -- 172.21.15.57:0/2815689664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b54003b60 msgr2=0x7f0b54003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b72765640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b54003b60 0x7f0b54003f60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c007fb0 tx=0x7f0b5c01cad0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b72765640 1 -- 172.21.15.57:0/2815689664 shutdown_connections 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b72765640 1 --2- 172.21.15.57:0/2815689664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b54003b60 0x7f0b54003f60 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b72765640 1 -- 172.21.15.57:0/2815689664 >> 172.21.15.57:0/2815689664 conn(0x7f0b6c0b0bf0 msgr2=0x7f0b6c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b72765640 1 -- 172.21.15.57:0/2815689664 shutdown_connections 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.443+0000 7f0b72765640 1 -- 172.21.15.57:0/2815689664 wait complete. 2023-11-24T08:07:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 Processor -- start 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 -- start start 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b54003b60 0x7f0b6c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0c36c0 0x7f0b6c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b6c0c3b20 0x7f0b6c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c4d70 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c5190 con 0x7f0b54003b60 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b4d60 con 0x7f0b6c0c3b20 2023-11-24T08:07:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0c36c0 0x7f0b6c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0c36c0 0x7f0b6c0c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39048/0 (socket says 172.21.15.57:39048) 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 -- 172.21.15.57:0/2698816157 learned_addr learned my addr 172.21.15.57:0/2698816157 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6bfff640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b54003b60 0x7f0b6c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b70d02640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b6c0c3b20 0x7f0b6c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 -- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b6c0c3b20 msgr2=0x7f0b6c0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b6c0c3b20 0x7f0b6c0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 -- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b54003b60 msgr2=0x7f0b6c0b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b54003b60 0x7f0b6c0b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 -- 172.21.15.57:0/2698816157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0c40f0 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b6b7fe640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0c36c0 0x7f0b6c0c6d30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e7e0 tx=0x7f0b6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b68ff9640 1 -- 172.21.15.57:0/2698816157 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600050d0 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b68ff9640 1 -- 172.21.15.57:0/2698816157 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b60005230 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c0c43d0 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b68ff9640 1 -- 172.21.15.57:0/2698816157 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000c6c0 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c0c4990 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.447+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c0c4b50 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.451+0000 7f0b68ff9640 1 -- 172.21.15.57:0/2698816157 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f0b6000c820 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.451+0000 7f0b68ff9640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b58066620 0x7f0b58068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.451+0000 7f0b68ff9640 1 -- 172.21.15.57:0/2698816157 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0b60083be0 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.451+0000 7f0b6bfff640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b58066620 0x7f0b58068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.451+0000 7f0b6bfff640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b58066620 0x7f0b58068ae0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0ab000 tx=0x7f0b5c0b1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.455+0000 7f0b68ff9640 1 -- 172.21.15.57:0/2698816157 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b60051190 con 0x7f0b6c0c36c0 2023-11-24T08:07:54.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.611+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b6c0cb1b0 con 0x7f0b58066620 2023-11-24T08:07:54.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b68ff9640 1 -- 172.21.15.57:0/2698816157 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0b5c0b5040 con 0x7f0b58066620 2023-11-24T08:07:54.617 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T08:07:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b58066620 msgr2=0x7f0b58068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b58066620 0x7f0b58068ae0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0ab000 tx=0x7f0b5c0b1040 comp rx=0 tx=0).stop 2023-11-24T08:07:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0c36c0 msgr2=0x7f0b6c0c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0c36c0 0x7f0b6c0c6d30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e7e0 tx=0x7f0b6000eca0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 shutdown_connections 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0b58066620 0x7f0b58068ae0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b6c0c3b20 0x7f0b6c0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0c36c0 0x7f0b6c0c6d30 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 --2- 172.21.15.57:0/2698816157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b54003b60 0x7f0b6c0b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 >> 172.21.15.57:0/2698816157 conn(0x7f0b6c0b0bf0 msgr2=0x7f0b6c09c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 shutdown_connections 2023-11-24T08:07:54.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.615+0000 7f0b72765640 1 -- 172.21.15.57:0/2698816157 wait complete. 2023-11-24T08:07:54.638 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T08:07:54.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:54.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5e2580640 1 Processor -- start 2023-11-24T08:07:54.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5e2580640 1 -- start start 2023-11-24T08:07:54.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5e2580640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 0x7ff5dc0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5e2580640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc0d05b0 con 0x7ff5dc15d570 2023-11-24T08:07:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5e2580640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc0d0890 con 0x7ff5dc0d3020 2023-11-24T08:07:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5e2580640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0d0b70 con 0x7ff5dc0d14b0 2023-11-24T08:07:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5dbfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff5dc15d570 0x7ff5dc06bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58574/0 (socket says 172.21.15.57:58574) 2023-11-24T08:07:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5dbfff640 1 -- 172.21.15.57:0/1296006912 learned_addr learned my addr 172.21.15.57:0/1296006912 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5db7fe640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 0x7ff5dc0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163960748 0 0) 0x7ff5dc0d05b0 con 0x7ff5dc15d570 2023-11-24T08:07:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c4003530 con 0x7ff5dc15d570 2023-11-24T08:07:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264571788 0 0) 0x7ff5dc0d0890 con 0x7ff5dc0d3020 2023-11-24T08:07:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5dc0d05b0 con 0x7ff5dc0d3020 2023-11-24T08:07:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741872531 0 0) 0x7ff5c4003530 con 0x7ff5dc15d570 2023-11-24T08:07:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 msgr2=0x7ff5dc0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 0x7ff5dc0cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 >> v1:172.21.15.132:6789/0 conn(0x7ff5dc0d3020 legacy=0x7ff5dc0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0ce2f0 con 0x7ff5dc15d570 2023-11-24T08:07:54.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7ff5cc001680 con 0x7ff5dc15d570 2023-11-24T08:07:54.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 >> v1:172.21.15.57:6789/0 conn(0x7ff5dc15d570 legacy=0x7ff5dc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.783+0000 7ff5daffd640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c4003b40 0x7ff5c4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c40047d0 0x7ff5c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 0x7ff5c4005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0d0b70 con 0x7ff5c4003b40 2023-11-24T08:07:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c400bb50 con 0x7ff5c40047d0 2023-11-24T08:07:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c400bd10 con 0x7ff5dc0d14b0 2023-11-24T08:07:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5dbfff640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c4003b40 0x7ff5c4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5db7fe640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c40047d0 0x7ff5c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5e0b1d640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 0x7ff5c4005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5dbfff640 1 -- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 msgr2=0x7ff5c4005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5dbfff640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc0d14b0 0x7ff5c4005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5dbfff640 1 -- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c40047d0 msgr2=0x7ff5c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5dbfff640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c40047d0 0x7ff5c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5dbfff640 1 -- 172.21.15.57:0/1296006912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c4003530 con 0x7ff5c4003b40 2023-11-24T08:07:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5dbfff640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c4003b40 0x7ff5c4003f40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00c190 tx=0x7ff5cc01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736bb84cfc746be5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0058e0 con 0x7ff5c4003b40 2023-11-24T08:07:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc005a60 con 0x7ff5c4003b40 2023-11-24T08:07:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.787+0000 7ff5daffd640 1 -- 172.21.15.57:0/1296006912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc005e10 con 0x7ff5c4003b40 2023-11-24T08:07:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- 172.21.15.57:0/1296006912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c4003b40 msgr2=0x7ff5c4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 --2- 172.21.15.57:0/1296006912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c4003b40 0x7ff5c4003f40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00c190 tx=0x7ff5cc01cb90 comp rx=0 tx=0).stop 2023-11-24T08:07:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e0b1d640 1 -- 172.21.15.57:0/1296006912 reap_dead start 2023-11-24T08:07:54.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- 172.21.15.57:0/1296006912 shutdown_connections 2023-11-24T08:07:54.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- 172.21.15.57:0/1296006912 >> 172.21.15.57:0/1296006912 conn(0x7ff5dc08ceb0 msgr2=0x7ff5dc09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- 172.21.15.57:0/1296006912 shutdown_connections 2023-11-24T08:07:54.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- 172.21.15.57:0/1296006912 wait complete. 2023-11-24T08:07:54.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 Processor -- start 2023-11-24T08:07:54.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- start start 2023-11-24T08:07:54.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c4003b40 0x7ff5dc1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc1f60a0 0x7ff5dc0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5dc0ca4d0 0x7ff5dc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0cb5c0 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0caa40 con 0x7ff5c4003b40 2023-11-24T08:07:54.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e2580640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0cad20 con 0x7ff5dc1f60a0 2023-11-24T08:07:54.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e0b1d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5dc0ca4d0 0x7ff5dc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e0b1d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5dc0ca4d0 0x7ff5dc0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39066/0 (socket says 172.21.15.57:39066) 2023-11-24T08:07:54.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5e0b1d640 1 -- 172.21.15.57:0/1616404185 learned_addr learned my addr 172.21.15.57:0/1616404185 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:54.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5dbfff640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c4003b40 0x7ff5dc1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.791+0000 7ff5db7fe640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc1f60a0 0x7ff5dc0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e0b1d640 1 -- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc1f60a0 msgr2=0x7ff5dc0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e0b1d640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5dc1f60a0 0x7ff5dc0cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e0b1d640 1 -- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c4003b40 msgr2=0x7ff5dc1f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e0b1d640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5c4003b40 0x7ff5dc1f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e0b1d640 1 -- 172.21.15.57:0/1616404185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0cb000 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e0b1d640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5dc0ca4d0 0x7ff5dc0cc6b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4007fd0 tx=0x7ff5d400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4006d70 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4003980 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc0cb2e0 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4003d30 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc0b8750 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5dc067520 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7ff5d40050d0 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5d8ff9640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff5c8066650 0x7ff5c8068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.795+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff5d4083080 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5d8ff9640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7ff5c806c4b0 0x7ff5c806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 --> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5c806ef80 con 0x7ff5c806c4b0 2023-11-24T08:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5d4085600 con 0x7ff5dc0ca4d0 2023-11-24T08:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5dbfff640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff5c8066650 0x7ff5c8068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5db7fe640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7ff5c806c4b0 0x7ff5c806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5dbfff640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff5c8066650 0x7ff5c8068b10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0aa000 tx=0x7ff5cc001990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5db7fe640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7ff5c806c4b0 0x7ff5c806e8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.799+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== osd.5 v2:172.21.15.132:6808/774342191 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff5c806ef80 con 0x7ff5c806c4b0 2023-11-24T08:07:54.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.811+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 --> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5dc0b60b0 con 0x7ff5c806c4b0 2023-11-24T08:07:54.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5d8ff9640 1 -- 172.21.15.57:0/1616404185 <== osd.5 v2:172.21.15.132:6808/774342191 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff5dc0b60b0 con 0x7ff5c806c4b0 2023-11-24T08:07:54.818 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:54.818 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:54.818 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:54.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7ff5c806c4b0 msgr2=0x7ff5c806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6808/774342191,v1:172.21.15.132:6809/774342191] conn(0x7ff5c806c4b0 0x7ff5c806e8d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff5c8066650 msgr2=0x7ff5c8068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7ff5c8066650 0x7ff5c8068b10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0aa000 tx=0x7ff5cc001990 comp rx=0 tx=0).stop 2023-11-24T08:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5dc0ca4d0 msgr2=0x7ff5dc0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 --2- 172.21.15.57:0/1616404185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5dc0ca4d0 0x7ff5dc0cc6b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4007fd0 tx=0x7ff5d400feb0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e0b1d640 1 -- 172.21.15.57:0/1616404185 reap_dead start 2023-11-24T08:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 shutdown_connections 2023-11-24T08:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 >> 172.21.15.57:0/1616404185 conn(0x7ff5dc08ceb0 msgr2=0x7ff5dc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 shutdown_connections 2023-11-24T08:07:54.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.815+0000 7ff5e2580640 1 -- 172.21.15.57:0/1616404185 wait complete. 2023-11-24T08:07:54.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T08:07:54.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.975+0000 7f781772a640 1 Processor -- start 2023-11-24T08:07:54.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.975+0000 7f781772a640 1 -- start start 2023-11-24T08:07:54.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f781772a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f78100cab60 0x7f78100caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f781772a640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100ccbd0 con 0x7f78100cb480 2023-11-24T08:07:54.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f781772a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781006dac0 con 0x7f78100ce070 2023-11-24T08:07:54.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f781772a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781006dda0 con 0x7f78100cab60 2023-11-24T08:07:54.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f7814cc5640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f78100cb480 0x7f781006cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58576/0 (socket says 172.21.15.57:58576) 2023-11-24T08:07:54.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f7814cc5640 1 -- 172.21.15.57:0/144871739 learned_addr learned my addr 172.21.15.57:0/144871739 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:54.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f78154c6640 1 --2- 172.21.15.57:0/144871739 >> v2:172.21.15.132:3300/0 conn(0x7f78100cab60 0x7f78100caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f7807fff640 1 -- 172.21.15.57:0/144871739 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091692093 0 0) 0x7f78100ccbd0 con 0x7f78100cb480 2023-11-24T08:07:54.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f7807fff640 1 -- 172.21.15.57:0/144871739 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77fc003530 con 0x7f78100cb480 2023-11-24T08:07:54.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f78154c6640 1 -- 172.21.15.57:0/144871739 >> v1:172.21.15.132:6789/0 conn(0x7f78100ce070 legacy=0x7f781016b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f78154c6640 1 -- 172.21.15.57:0/144871739 >> v1:172.21.15.57:6789/0 conn(0x7f78100cb480 legacy=0x7f781006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.979+0000 7f78154c6640 1 -- 172.21.15.57:0/144871739 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781006e080 con 0x7f78100cab60 2023-11-24T08:07:54.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f78154c6640 1 --2- 172.21.15.57:0/144871739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100cab60 0x7f78100caf40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f780c0097c0 tx=0x7f780c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c2d5283166c83d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f7807fff640 1 -- 172.21.15.57:0/144871739 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0ab600 con 0x7f78100cab60 2023-11-24T08:07:54.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f7807fff640 1 -- 172.21.15.57:0/144871739 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c0a7050 con 0x7f78100cab60 2023-11-24T08:07:54.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f7807fff640 1 -- 172.21.15.57:0/144871739 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0ab960 con 0x7f78100cab60 2023-11-24T08:07:54.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 -- 172.21.15.57:0/144871739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100cab60 msgr2=0x7f78100caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 --2- 172.21.15.57:0/144871739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100cab60 0x7f78100caf40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f780c0097c0 tx=0x7f780c01c480 comp rx=0 tx=0).stop 2023-11-24T08:07:54.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 -- 172.21.15.57:0/144871739 shutdown_connections 2023-11-24T08:07:54.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 --2- 172.21.15.57:0/144871739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100cab60 0x7f78100caf40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 -- 172.21.15.57:0/144871739 >> 172.21.15.57:0/144871739 conn(0x7f78100b0bf0 msgr2=0x7f78100b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:54.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 -- 172.21.15.57:0/144871739 shutdown_connections 2023-11-24T08:07:54.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 -- 172.21.15.57:0/144871739 wait complete. 2023-11-24T08:07:54.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 Processor -- start 2023-11-24T08:07:54.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.983+0000 7f781772a640 1 -- start start 2023-11-24T08:07:54.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78100cab60 0x7f781009a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78100cb480 0x7f78100cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100ce070 0x7f78100cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810164e50 con 0x7f78100cab60 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810099a80 con 0x7f78100ce070 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7810099d60 con 0x7f78100cb480 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78100cab60 0x7f781009a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78100cab60 0x7f781009a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39070/0 (socket says 172.21.15.57:39070) 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 -- 172.21.15.57:0/3200647923 learned_addr learned my addr 172.21.15.57:0/3200647923 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f7814cc5640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78100cb480 0x7f78100cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f7815cc7640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100ce070 0x7f78100cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 -- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78100cb480 msgr2=0x7f78100cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78100cb480 0x7f78100cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 -- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100ce070 msgr2=0x7f78100cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100ce070 0x7f78100cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 -- 172.21.15.57:0/3200647923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c009420 con 0x7f78100cab60 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f7815cc7640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100ce070 0x7f78100cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f78154c6640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78100cab60 0x7f781009a840 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f780c019090 tx=0x7f780c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f7805ffb640 1 -- 172.21.15.57:0/3200647923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c006e20 con 0x7f78100cab60 2023-11-24T08:07:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f7805ffb640 1 -- 172.21.15.57:0/3200647923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c004020 con 0x7f78100cab60 2023-11-24T08:07:54.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781009a040 con 0x7f78100cab60 2023-11-24T08:07:54.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f7805ffb640 1 -- 172.21.15.57:0/3200647923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c004390 con 0x7f78100cab60 2023-11-24T08:07:54.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781009ad80 con 0x7f78100cab60 2023-11-24T08:07:54.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781009af70 con 0x7f78100cab60 2023-11-24T08:07:54.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.987+0000 7f7805ffb640 1 -- 172.21.15.57:0/3200647923 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f780c003620 con 0x7f78100cab60 2023-11-24T08:07:54.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.991+0000 7f7805ffb640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77f4066620 0x7f77f4068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:54.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.991+0000 7f7805ffb640 1 -- 172.21.15.57:0/3200647923 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f780c11e370 con 0x7f78100cab60 2023-11-24T08:07:54.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.991+0000 7f7814cc5640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77f4066620 0x7f77f4068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.991+0000 7f7814cc5640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77f4066620 0x7f77f4068ae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f78101639b0 tx=0x7f7800007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:54.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:54.995+0000 7f7805ffb640 1 -- 172.21.15.57:0/3200647923 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f780c0eb770 con 0x7f78100cab60 2023-11-24T08:07:55.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f781009d250 con 0x7f77f4066620 2023-11-24T08:07:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f7805ffb640 1 -- 172.21.15.57:0/3200647923 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f781009d250 con 0x7f77f4066620 2023-11-24T08:07:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T08:07:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77f4066620 msgr2=0x7f77f4068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77f4066620 0x7f77f4068ae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f78101639b0 tx=0x7f7800007d40 comp rx=0 tx=0).stop 2023-11-24T08:07:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78100cab60 msgr2=0x7f781009a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78100cab60 0x7f781009a840 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f780c019090 tx=0x7f780c01acc0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 shutdown_connections 2023-11-24T08:07:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f77f4066620 0x7f77f4068ae0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78100ce070 0x7f78100cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78100cb480 0x7f78100cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 --2- 172.21.15.57:0/3200647923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78100cab60 0x7f781009a840 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 >> 172.21.15.57:0/3200647923 conn(0x7f78100b0bf0 msgr2=0x7f78100af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 shutdown_connections 2023-11-24T08:07:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.151+0000 7f781772a640 1 -- 172.21.15.57:0/3200647923 wait complete. 2023-11-24T08:07:55.176 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T08:07:55.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:55.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8def6c9640 1 Processor -- start 2023-11-24T08:07:55.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8def6c9640 1 -- start start 2023-11-24T08:07:55.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8def6c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8de80b1ef0 0x7f8de8164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8def6c9640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de815a700 con 0x7f8de815a320 2023-11-24T08:07:55.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8def6c9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de80b2620 con 0x7f8de80b36c0 2023-11-24T08:07:55.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8def6c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de80b2900 con 0x7f8de80b1ef0 2023-11-24T08:07:55.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8ded465640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8de815a320 0x7f8de8070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58582/0 (socket says 172.21.15.57:58582) 2023-11-24T08:07:55.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8ded465640 1 -- 172.21.15.57:0/4091893641 learned_addr learned my addr 172.21.15.57:0/4091893641 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:55.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8dedc66640 1 --2- 172.21.15.57:0/4091893641 >> v2:172.21.15.132:3300/0 conn(0x7f8de80b1ef0 0x7f8de8164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925848503 0 0) 0x7f8de815a700 con 0x7f8de815a320 2023-11-24T08:07:55.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd4005740 con 0x7f8de815a320 2023-11-24T08:07:55.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443184206 0 0) 0x7f8de80b2620 con 0x7f8de80b36c0 2023-11-24T08:07:55.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de815a700 con 0x7f8de80b36c0 2023-11-24T08:07:55.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.319+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2966429227 0 0) 0x7f8dd4005740 con 0x7f8de815a320 2023-11-24T08:07:55.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 >> v2:172.21.15.132:3300/0 conn(0x7f8de80b1ef0 msgr2=0x7f8de8164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 --2- 172.21.15.57:0/4091893641 >> v2:172.21.15.132:3300/0 conn(0x7f8de80b1ef0 0x7f8de8164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 >> v1:172.21.15.132:6789/0 conn(0x7f8de80b36c0 legacy=0x7f8de8070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80b2be0 con 0x7f8de815a320 2023-11-24T08:07:55.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f8de4001680 con 0x7f8de815a320 2023-11-24T08:07:55.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 >> v1:172.21.15.57:6789/0 conn(0x7f8de815a320 legacy=0x7f8de8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dd4005d70 0x7f8dd4006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd40069e0 0x7f8dd4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8dd40073a0 0x7f8dd400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80b2900 con 0x7f8dd4005d70 2023-11-24T08:07:55.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd400e270 con 0x7f8dd40073a0 2023-11-24T08:07:55.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd400e430 con 0x7f8dd40069e0 2023-11-24T08:07:55.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ded465640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dd4005d70 0x7f8dd4006170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8decc64640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd40069e0 0x7f8dd4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8dedc66640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8dd40073a0 0x7f8dd400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ded465640 1 -- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd40069e0 msgr2=0x7f8dd4006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ded465640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd40069e0 0x7f8dd4006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ded465640 1 -- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8dd40073a0 msgr2=0x7f8dd400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ded465640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8dd40073a0 0x7f8dd400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ded465640 1 -- 172.21.15.57:0/4091893641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4005740 con 0x7f8dd4005d70 2023-11-24T08:07:55.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8dedc66640 1 -- 172.21.15.57:0/4091893641 reap_dead start 2023-11-24T08:07:55.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ded465640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dd4005d70 0x7f8dd4006170 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007fa0 tx=0x7f8de401cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc338f8f697ab32 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4005ae0 con 0x7f8dd4005d70 2023-11-24T08:07:55.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4005c40 con 0x7f8dd4005d70 2023-11-24T08:07:55.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.323+0000 7f8ddffff640 1 -- 172.21.15.57:0/4091893641 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40a5a60 con 0x7f8dd4005d70 2023-11-24T08:07:55.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- 172.21.15.57:0/4091893641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dd4005d70 msgr2=0x7f8dd4006170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dd4005d70 0x7f8dd4006170 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8de4007fa0 tx=0x7f8de401cad0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- 172.21.15.57:0/4091893641 shutdown_connections 2023-11-24T08:07:55.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 --2- 172.21.15.57:0/4091893641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dd4005d70 0x7f8dd4006170 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- 172.21.15.57:0/4091893641 >> 172.21.15.57:0/4091893641 conn(0x7f8de80b0bf0 msgr2=0x7f8de80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- 172.21.15.57:0/4091893641 shutdown_connections 2023-11-24T08:07:55.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- 172.21.15.57:0/4091893641 wait complete. 2023-11-24T08:07:55.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 Processor -- start 2023-11-24T08:07:55.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- start start 2023-11-24T08:07:55.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd4005d70 0x7f8de81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de814f060 0x7f8de809b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8de809bc60 0x7f8de814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de814f7d0 con 0x7f8de809bc60 2023-11-24T08:07:55.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de814fab0 con 0x7f8de814f060 2023-11-24T08:07:55.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8def6c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de814fd90 con 0x7f8dd4005d70 2023-11-24T08:07:55.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8dedc66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8de809bc60 0x7f8de814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8dedc66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8de809bc60 0x7f8de814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39098/0 (socket says 172.21.15.57:39098) 2023-11-24T08:07:55.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8dedc66640 1 -- 172.21.15.57:0/2954329197 learned_addr learned my addr 172.21.15.57:0/2954329197 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8ded465640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd4005d70 0x7f8de81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.327+0000 7f8decc64640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de814f060 0x7f8de809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dedc66640 1 -- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd4005d70 msgr2=0x7f8de81572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dedc66640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8dd4005d70 0x7f8de81572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dedc66640 1 -- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de814f060 msgr2=0x7f8de809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dedc66640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de814f060 0x7f8de809b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dedc66640 1 -- 172.21.15.57:0/2954329197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8150070 con 0x7f8de809bc60 2023-11-24T08:07:55.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dedc66640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8de809bc60 0x7f8de814a6a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8de80b5040 tx=0x7f8de00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000e070 con 0x7f8de809bc60 2023-11-24T08:07:55.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0011db0 con 0x7f8de809bc60 2023-11-24T08:07:55.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00039a0 con 0x7f8de809bc60 2023-11-24T08:07:55.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de8157960 con 0x7f8de809bc60 2023-11-24T08:07:55.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de814abe0 con 0x7f8de809bc60 2023-11-24T08:07:55.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8de80b22d0 con 0x7f8de809bc60 2023-11-24T08:07:55.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f8de0003b00 con 0x7f8de809bc60 2023-11-24T08:07:55.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dddffb640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8dcc066620 0x7f8dcc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8de0084740 con 0x7f8de809bc60 2023-11-24T08:07:55.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.331+0000 7f8dddffb640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7f8dcc06c480 0x7f8dcc06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.335+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 --> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8dcc06ef50 con 0x7f8dcc06c480 2023-11-24T08:07:55.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.335+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8de0086d20 con 0x7f8de809bc60 2023-11-24T08:07:55.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.335+0000 7f8ded465640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8dcc066620 0x7f8dcc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.335+0000 7f8decc64640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7f8dcc06c480 0x7f8dcc06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.335+0000 7f8decc64640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7f8dcc06c480 0x7f8dcc06e8a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.335+0000 7f8ded465640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8dcc066620 0x7f8dcc068ae0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ab000 tx=0x7f8de40a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.335+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== osd.6 v2:172.21.15.132:6824/4052258235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8dcc06ef50 con 0x7f8dcc06c480 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.347+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 --> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8de8157b50 con 0x7f8dcc06c480 2023-11-24T08:07:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.347+0000 7f8dddffb640 1 -- 172.21.15.57:0/2954329197 <== osd.6 v2:172.21.15.132:6824/4052258235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8de8157b50 con 0x7f8dcc06c480 2023-11-24T08:07:55.379 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:55.380 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:55.380 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:55.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7f8dcc06c480 msgr2=0x7f8dcc06e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6824/4052258235,v1:172.21.15.132:6825/4052258235] conn(0x7f8dcc06c480 0x7f8dcc06e8a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8dcc066620 msgr2=0x7f8dcc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f8dcc066620 0x7f8dcc068ae0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ab000 tx=0x7f8de40a7070 comp rx=0 tx=0).stop 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8de809bc60 msgr2=0x7f8de814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 --2- 172.21.15.57:0/2954329197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8de809bc60 0x7f8de814a6a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8de80b5040 tx=0x7f8de00115a0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8dedc66640 1 -- 172.21.15.57:0/2954329197 reap_dead start 2023-11-24T08:07:55.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 shutdown_connections 2023-11-24T08:07:55.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 >> 172.21.15.57:0/2954329197 conn(0x7f8de80b0bf0 msgr2=0x7f8de80b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 shutdown_connections 2023-11-24T08:07:55.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.351+0000 7f8def6c9640 1 -- 172.21.15.57:0/2954329197 wait complete. 2023-11-24T08:07:55.383 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T08:07:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.523+0000 7f14ec1f8640 1 Processor -- start 2023-11-24T08:07:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.523+0000 7f14ec1f8640 1 -- start start 2023-11-24T08:07:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ec1f8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e40cad20 0x7f14e40c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ec1f8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14e406d740 0x7f14e406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ec1f8640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e406e0d0 con 0x7f14e415a4d0 2023-11-24T08:07:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ec1f8640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e415a8b0 con 0x7f14e406d740 2023-11-24T08:07:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ec1f8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40c9c30 con 0x7f14e40cad20 2023-11-24T08:07:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ea795640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14e406d740 0x7f14e406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14e9f94640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f14e415a4d0 0x7f14e415e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58590/0 (socket says 172.21.15.57:58590) 2023-11-24T08:07:55.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14e9f94640 1 -- 172.21.15.57:0/4095368548 learned_addr learned my addr 172.21.15.57:0/4095368548 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:55.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14e9793640 1 --2- 172.21.15.57:0/4095368548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e40cad20 0x7f14e40c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ea795640 1 -- 172.21.15.57:0/4095368548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e40cad20 msgr2=0x7f14e40c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:55.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ea795640 1 --2- 172.21.15.57:0/4095368548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e40cad20 0x7f14e40c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ea795640 1 -- 172.21.15.57:0/4095368548 >> v1:172.21.15.57:6789/0 conn(0x7f14e415a4d0 legacy=0x7f14e415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ea795640 1 -- 172.21.15.57:0/4095368548 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e40c9f60 con 0x7f14e406d740 2023-11-24T08:07:55.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14e9793640 1 --2- 172.21.15.57:0/4095368548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e40cad20 0x7f14e40c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:55.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.527+0000 7f14ea795640 1 --2- 172.21.15.57:0/4095368548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e406d740 0x7f14e406db90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009d90 tx=0x7f14dc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa78714788cc2839 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14e8f92640 1 -- 172.21.15.57:0/4095368548 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0a5950 con 0x7f14e406d740 2023-11-24T08:07:55.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14e8f92640 1 -- 172.21.15.57:0/4095368548 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0a5ab0 con 0x7f14e406d740 2023-11-24T08:07:55.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14e8f92640 1 -- 172.21.15.57:0/4095368548 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0a5e40 con 0x7f14e406d740 2023-11-24T08:07:55.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- 172.21.15.57:0/4095368548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e406d740 msgr2=0x7f14e406db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/4095368548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e406d740 0x7f14e406db90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009d90 tx=0x7f14dc01c890 comp rx=0 tx=0).stop 2023-11-24T08:07:55.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- 172.21.15.57:0/4095368548 shutdown_connections 2023-11-24T08:07:55.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/4095368548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e40cad20 0x7f14e40c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/4095368548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e406d740 0x7f14e406db90 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- 172.21.15.57:0/4095368548 >> 172.21.15.57:0/4095368548 conn(0x7f14e40b0bf0 msgr2=0x7f14e40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- 172.21.15.57:0/4095368548 shutdown_connections 2023-11-24T08:07:55.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- 172.21.15.57:0/4095368548 wait complete. 2023-11-24T08:07:55.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 Processor -- start 2023-11-24T08:07:55.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- start start 2023-11-24T08:07:55.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e406d740 0x7f14e41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e40cad20 0x7f14e40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e415a4d0 0x7f14e4099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40c8c30 con 0x7f14e415a4d0 2023-11-24T08:07:55.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40c7e90 con 0x7f14e40cad20 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ec1f8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e409ab30 con 0x7f14e406d740 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ea795640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e415a4d0 0x7f14e4099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ea795640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e415a4d0 0x7f14e4099f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39118/0 (socket says 172.21.15.57:39118) 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.531+0000 7f14ea795640 1 -- 172.21.15.57:0/2663972456 learned_addr learned my addr 172.21.15.57:0/2663972456 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14e9f94640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e406d740 0x7f14e41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14e9793640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e40cad20 0x7f14e40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ea795640 1 -- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e406d740 msgr2=0x7f14e41580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ea795640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e406d740 0x7f14e41580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ea795640 1 -- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e40cad20 msgr2=0x7f14e40999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ea795640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e40cad20 0x7f14e40999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ea795640 1 -- 172.21.15.57:0/2663972456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc009a70 con 0x7f14e415a4d0 2023-11-24T08:07:55.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14e9f94640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e406d740 0x7f14e41580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:55.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ea795640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e415a4d0 0x7f14e4099f20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0b0040 tx=0x7f14dc019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14da7fc640 1 -- 172.21.15.57:0/2663972456 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0ade40 con 0x7f14e415a4d0 2023-11-24T08:07:55.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14da7fc640 1 -- 172.21.15.57:0/2663972456 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc0b9450 con 0x7f14e415a4d0 2023-11-24T08:07:55.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14da7fc640 1 -- 172.21.15.57:0/2663972456 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0b9800 con 0x7f14e415a4d0 2023-11-24T08:07:55.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e40c8150 con 0x7f14e415a4d0 2023-11-24T08:07:55.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e40c8710 con 0x7f14e415a4d0 2023-11-24T08:07:55.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e40c8900 con 0x7f14e415a4d0 2023-11-24T08:07:55.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14da7fc640 1 -- 172.21.15.57:0/2663972456 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f14dc0b9960 con 0x7f14e415a4d0 2023-11-24T08:07:55.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.535+0000 7f14da7fc640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14c8066620 0x7f14c8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.539+0000 7f14da7fc640 1 -- 172.21.15.57:0/2663972456 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f14dc11f840 con 0x7f14e415a4d0 2023-11-24T08:07:55.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.539+0000 7f14e9f94640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14c8066620 0x7f14c8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.539+0000 7f14e9f94640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14c8066620 0x7f14c8068ae0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f14e0005890 tx=0x7f14e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.539+0000 7f14da7fc640 1 -- 172.21.15.57:0/2663972456 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14dc0ecdf0 con 0x7f14e415a4d0 2023-11-24T08:07:55.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.699+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f14e40c9430 con 0x7f14c8066620 2023-11-24T08:07:55.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.699+0000 7f14da7fc640 1 -- 172.21.15.57:0/2663972456 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f14e40c9430 con 0x7f14c8066620 2023-11-24T08:07:55.705 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T08:07:55.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14c8066620 msgr2=0x7f14c8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14c8066620 0x7f14c8068ae0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f14e0005890 tx=0x7f14e0009040 comp rx=0 tx=0).stop 2023-11-24T08:07:55.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e415a4d0 msgr2=0x7f14e4099f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e415a4d0 0x7f14e4099f20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0b0040 tx=0x7f14dc019630 comp rx=0 tx=0).stop 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 shutdown_connections 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f14c8066620 0x7f14c8068ae0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e415a4d0 0x7f14e4099f20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e40cad20 0x7f14e40999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 --2- 172.21.15.57:0/2663972456 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14e406d740 0x7f14e41580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 >> 172.21.15.57:0/2663972456 conn(0x7f14e40b0bf0 msgr2=0x7f14e40b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 shutdown_connections 2023-11-24T08:07:55.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.703+0000 7f14ec1f8640 1 -- 172.21.15.57:0/2663972456 wait complete. 2023-11-24T08:07:55.726 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T08:07:55.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:07:55.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.867+0000 7fa5d24f7640 1 Processor -- start 2023-11-24T08:07:55.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.867+0000 7fa5d24f7640 1 -- start start 2023-11-24T08:07:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d24f7640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5cc0b1ef0 0x7fa5cc164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d24f7640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5cc15a700 con 0x7fa5cc0b36c0 2023-11-24T08:07:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d24f7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5cc0b2620 con 0x7fa5cc15a320 2023-11-24T08:07:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d24f7640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5cc0b2900 con 0x7fa5cc0b1ef0 2023-11-24T08:07:55.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5cb7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa5cc0b36c0 0x7fa5cc070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48592/0 (socket says 172.21.15.57:48592) 2023-11-24T08:07:55.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5cb7fe640 1 -- 172.21.15.57:0/2150348272 learned_addr learned my addr 172.21.15.57:0/2150348272 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:55.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d0a94640 1 --2- 172.21.15.57:0/2150348272 >> v2:172.21.15.57:3300/0 conn(0x7fa5cc0b1ef0 0x7fa5cc164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5caffd640 1 -- 172.21.15.57:0/2150348272 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630176118 0 0) 0x7fa5cc15a700 con 0x7fa5cc0b36c0 2023-11-24T08:07:55.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5caffd640 1 -- 172.21.15.57:0/2150348272 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b4003530 con 0x7fa5cc0b36c0 2023-11-24T08:07:55.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d0a94640 1 -- 172.21.15.57:0/2150348272 >> v1:172.21.15.132:6789/0 conn(0x7fa5cc15a320 legacy=0x7fa5cc070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d0a94640 1 -- 172.21.15.57:0/2150348272 >> v1:172.21.15.57:6789/0 conn(0x7fa5cc0b36c0 legacy=0x7fa5cc070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.871+0000 7fa5d0a94640 1 -- 172.21.15.57:0/2150348272 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc0b2be0 con 0x7fa5cc0b1ef0 2023-11-24T08:07:55.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d0a94640 1 --2- 172.21.15.57:0/2150348272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc0b1ef0 0x7fa5cc164f50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009d90 tx=0x7fa5c401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6561fbebf23e4675 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5caffd640 1 -- 172.21.15.57:0/2150348272 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40a5a10 con 0x7fa5cc0b1ef0 2023-11-24T08:07:55.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5caffd640 1 -- 172.21.15.57:0/2150348272 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c40a5b70 con 0x7fa5cc0b1ef0 2023-11-24T08:07:55.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5caffd640 1 -- 172.21.15.57:0/2150348272 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40ad440 con 0x7fa5cc0b1ef0 2023-11-24T08:07:55.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 -- 172.21.15.57:0/2150348272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc0b1ef0 msgr2=0x7fa5cc164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 --2- 172.21.15.57:0/2150348272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc0b1ef0 0x7fa5cc164f50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009d90 tx=0x7fa5c401c950 comp rx=0 tx=0).stop 2023-11-24T08:07:55.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 -- 172.21.15.57:0/2150348272 shutdown_connections 2023-11-24T08:07:55.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 --2- 172.21.15.57:0/2150348272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc0b1ef0 0x7fa5cc164f50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 -- 172.21.15.57:0/2150348272 >> 172.21.15.57:0/2150348272 conn(0x7fa5cc0b0bf0 msgr2=0x7fa5cc0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 -- 172.21.15.57:0/2150348272 shutdown_connections 2023-11-24T08:07:55.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 -- 172.21.15.57:0/2150348272 wait complete. 2023-11-24T08:07:55.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 Processor -- start 2023-11-24T08:07:55.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.875+0000 7fa5d24f7640 1 -- start start 2023-11-24T08:07:55.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5cc0b1ef0 0x7fa5cc09bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5cc0b36c0 0x7fa5cc15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc15a320 0x7fa5cc15ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc15bdd0 con 0x7fa5cc15a320 2023-11-24T08:07:55.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc15af00 con 0x7fa5cc0b1ef0 2023-11-24T08:07:55.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc15b1c0 con 0x7fa5cc0b36c0 2023-11-24T08:07:55.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc15a320 0x7fa5cc15ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc15a320 0x7fa5cc15ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39146/0 (socket says 172.21.15.57:39146) 2023-11-24T08:07:55.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 -- 172.21.15.57:0/323987455 learned_addr learned my addr 172.21.15.57:0/323987455 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:55.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5cbfff640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5cc0b1ef0 0x7fa5cc09bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5cb7fe640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5cc0b36c0 0x7fa5cc15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 -- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5cc0b36c0 msgr2=0x7fa5cc15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5cc0b36c0 0x7fa5cc15a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 -- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5cc0b1ef0 msgr2=0x7fa5cc09bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5cc0b1ef0 0x7fa5cc09bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 -- 172.21.15.57:0/323987455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c4009a70 con 0x7fa5cc15a320 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5cb7fe640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5cc0b36c0 0x7fa5cc15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:07:55.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d0a94640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc15a320 0x7fa5cc15ef00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4019560 tx=0x7fa5c40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40aee00 con 0x7fa5cc15a320 2023-11-24T08:07:55.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c4009450 con 0x7fa5cc15a320 2023-11-24T08:07:55.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc15b4a0 con 0x7fa5cc15a320 2023-11-24T08:07:55.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003bc0 con 0x7fa5cc15a320 2023-11-24T08:07:55.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc15ba60 con 0x7fa5cc15a320 2023-11-24T08:07:55.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.879+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5cc0cb7e0 con 0x7fa5cc15a320 2023-11-24T08:07:55.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fa5c40b4050 con 0x7fa5cc15a320 2023-11-24T08:07:55.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5c8ff9640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa5b8066620 0x7fa5b8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa5c411f330 con 0x7fa5cc15a320 2023-11-24T08:07:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5c8ff9640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7fa5b806c480 0x7fa5b806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 --> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5b806ef50 con 0x7fa5b806c480 2023-11-24T08:07:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c411f6a0 con 0x7fa5cc15a320 2023-11-24T08:07:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5cb7fe640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7fa5b806c480 0x7fa5b806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5cbfff640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa5b8066620 0x7fa5b8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5cb7fe640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7fa5b806c480 0x7fa5b806e8a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5cbfff640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa5b8066620 0x7fa5b8068ae0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc159a70 tx=0x7fa5bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:55.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.883+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== osd.7 v2:172.21.15.132:6816/786338062 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa5b806ef50 con 0x7fa5b806c480 2023-11-24T08:07:55.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 --> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5cc09caa0 con 0x7fa5b806c480 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5c8ff9640 1 -- 172.21.15.57:0/323987455 <== osd.7 v2:172.21.15.132:6816/786338062 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa5cc09caa0 con 0x7fa5b806c480 2023-11-24T08:07:55.902 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-11-24T08:07:55.903 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:07:55.903 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7fa5b806c480 msgr2=0x7fa5b806e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6816/786338062,v1:172.21.15.132:6817/786338062] conn(0x7fa5b806c480 0x7fa5b806e8a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa5b8066620 msgr2=0x7fa5b8068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fa5b8066620 0x7fa5b8068ae0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc159a70 tx=0x7fa5bc009040 comp rx=0 tx=0).stop 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc15a320 msgr2=0x7fa5cc15ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 --2- 172.21.15.57:0/323987455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc15a320 0x7fa5cc15ef00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4019560 tx=0x7fa5c40196f0 comp rx=0 tx=0).stop 2023-11-24T08:07:55.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d0a94640 1 -- 172.21.15.57:0/323987455 reap_dead start 2023-11-24T08:07:55.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 shutdown_connections 2023-11-24T08:07:55.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 >> 172.21.15.57:0/323987455 conn(0x7fa5cc0b0bf0 msgr2=0x7fa5cc0b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:55.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 shutdown_connections 2023-11-24T08:07:55.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:55.899+0000 7fa5d24f7640 1 -- 172.21.15.57:0/323987455 wait complete. 2023-11-24T08:07:55.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T08:07:56.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.059+0000 7f98e5b80640 1 Processor -- start 2023-11-24T08:07:56.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.059+0000 7f98e5b80640 1 -- start start 2023-11-24T08:07:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98e5b80640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 0x7f98e00cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98e5b80640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e0070f60 con 0x7f98e00ce3f0 2023-11-24T08:07:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98e5b80640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e0070070 con 0x7f98e006d340 2023-11-24T08:07:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98e5b80640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0070350 con 0x7f98e015d460 2023-11-24T08:07:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98dffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f98e00ce3f0 0x7f98e006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48594/0 (socket says 172.21.15.57:48594) 2023-11-24T08:07:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98dffff640 1 -- 172.21.15.57:0/2976934858 learned_addr learned my addr 172.21.15.57:0/2976934858 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:07:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98df7fe640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 0x7f98e00cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706151015 0 0) 0x7f98e0070f60 con 0x7f98e00ce3f0 2023-11-24T08:07:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c8003530 con 0x7f98e00ce3f0 2023-11-24T08:07:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481055223 0 0) 0x7f98c8003530 con 0x7f98e00ce3f0 2023-11-24T08:07:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 msgr2=0x7f98e00cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 0x7f98e00cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 >> v1:172.21.15.132:6789/0 conn(0x7f98e006d340 legacy=0x7f98e00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0070630 con 0x7f98e00ce3f0 2023-11-24T08:07:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f98d8001a00 con 0x7f98e00ce3f0 2023-11-24T08:07:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 >> v1:172.21.15.57:6789/0 conn(0x7f98e00ce3f0 legacy=0x7f98e006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 0x7f98c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c8004d10 0x7f98c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0070350 con 0x7f98c8003ef0 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c800b9f0 con 0x7f98c8004d10 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c800bbb0 con 0x7f98e015d460 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98deffd640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98df7fe640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 0x7f98c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98dffff640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c8004d10 0x7f98c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98deffd640 1 -- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 msgr2=0x7f98c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98deffd640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e015d460 0x7f98c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98deffd640 1 -- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c8004d10 msgr2=0x7f98c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98deffd640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c8004d10 0x7f98c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.063+0000 7f98deffd640 1 -- 172.21.15.57:0/2976934858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8003530 con 0x7f98c8003ef0 2023-11-24T08:07:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98deffd640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98c80047d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f98d4001860 tx=0x7f98d401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6309ec2bb4ba34e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40ac640 con 0x7f98c8003ef0 2023-11-24T08:07:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40ac7a0 con 0x7f98c8003ef0 2023-11-24T08:07:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98de7fc640 1 -- 172.21.15.57:0/2976934858 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40acb90 con 0x7f98c8003ef0 2023-11-24T08:07:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98e5b80640 1 -- 172.21.15.57:0/2976934858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 msgr2=0x7f98c80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98e5b80640 1 --2- 172.21.15.57:0/2976934858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98c80047d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f98d4001860 tx=0x7f98d401c3f0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98dffff640 1 -- 172.21.15.57:0/2976934858 reap_dead start 2023-11-24T08:07:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98e5b80640 1 -- 172.21.15.57:0/2976934858 shutdown_connections 2023-11-24T08:07:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98e5b80640 1 -- 172.21.15.57:0/2976934858 >> 172.21.15.57:0/2976934858 conn(0x7f98e006e880 msgr2=0x7f98e006ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98e5b80640 1 -- 172.21.15.57:0/2976934858 shutdown_connections 2023-11-24T08:07:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.067+0000 7f98e5b80640 1 -- 172.21.15.57:0/2976934858 wait complete. 2023-11-24T08:07:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 Processor -- start 2023-11-24T08:07:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 -- start start 2023-11-24T08:07:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98e00c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98e00c5e20 0x7f98e00c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e00c62a0 0x7f98e00c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00c9e70 con 0x7f98c8003ef0 2023-11-24T08:07:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e015a2d0 con 0x7f98e00c5e20 2023-11-24T08:07:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00c4d80 con 0x7f98e00c62a0 2023-11-24T08:07:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98e00c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98e00c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39168/0 (socket says 172.21.15.57:39168) 2023-11-24T08:07:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 -- 172.21.15.57:0/2574050475 learned_addr learned my addr 172.21.15.57:0/2574050475 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 -- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e00c62a0 msgr2=0x7f98e00c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e00c62a0 0x7f98e00c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 -- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98e00c5e20 msgr2=0x7f98e00c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98e00c5e20 0x7f98e00c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 -- 172.21.15.57:0/2574050475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00c5060 con 0x7f98c8003ef0 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98df7fe640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98e00c7a60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f98d00119d0 tx=0x7f98d0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98c7fff640 1 -- 172.21.15.57:0/2574050475 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000fad0 con 0x7f98c8003ef0 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98c7fff640 1 -- 172.21.15.57:0/2574050475 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000fc30 con 0x7f98c8003ef0 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98c7fff640 1 -- 172.21.15.57:0/2574050475 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0014440 con 0x7f98c8003ef0 2023-11-24T08:07:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e00c5340 con 0x7f98c8003ef0 2023-11-24T08:07:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e00c5900 con 0x7f98c8003ef0 2023-11-24T08:07:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.071+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e006fe60 con 0x7f98c8003ef0 2023-11-24T08:07:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.075+0000 7f98c7fff640 1 -- 172.21.15.57:0/2574050475 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f98d00145a0 con 0x7f98c8003ef0 2023-11-24T08:07:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.075+0000 7f98c7fff640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f98cc066620 0x7f98cc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.075+0000 7f98c7fff640 1 -- 172.21.15.57:0/2574050475 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f98d0084800 con 0x7f98c8003ef0 2023-11-24T08:07:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.075+0000 7f98deffd640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f98cc066620 0x7f98cc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.075+0000 7f98deffd640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f98cc066620 0x7f98cc068ae0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f98d40ae000 tx=0x7f98d4001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.079+0000 7f98c7fff640 1 -- 172.21.15.57:0/2574050475 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f98d0051d20 con 0x7f98c8003ef0 2023-11-24T08:07:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.235+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e0169640 con 0x7f98cc066620 2023-11-24T08:07:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.235+0000 7f98c7fff640 1 -- 172.21.15.57:0/2574050475 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f98d40ac5e0 con 0x7f98cc066620 2023-11-24T08:07:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T08:07:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f98cc066620 msgr2=0x7f98cc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f98cc066620 0x7f98cc068ae0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f98d40ae000 tx=0x7f98d4001240 comp rx=0 tx=0).stop 2023-11-24T08:07:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 msgr2=0x7f98e00c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98e00c7a60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f98d00119d0 tx=0x7f98d0011e90 comp rx=0 tx=0).stop 2023-11-24T08:07:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 shutdown_connections 2023-11-24T08:07:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f98cc066620 0x7f98cc068ae0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98e00c62a0 0x7f98e00c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98e00c5e20 0x7f98e00c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 --2- 172.21.15.57:0/2574050475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98c8003ef0 0x7f98e00c7a60 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 >> 172.21.15.57:0/2574050475 conn(0x7f98e006e880 msgr2=0x7f98e00d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 shutdown_connections 2023-11-24T08:07:56.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.239+0000 7f98e5b80640 1 -- 172.21.15.57:0/2574050475 wait complete. 2023-11-24T08:07:56.262 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:07:56.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 Processor -- start 2023-11-24T08:07:56.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 -- start start 2023-11-24T08:07:56.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f039415d5e0 0x7f03940d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03940d3ee0 0x7f03940d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f03940cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940d2170 con 0x7f039415d5e0 2023-11-24T08:07:56.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039415d9c0 con 0x7f03940d3ee0 2023-11-24T08:07:56.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039359e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940d1190 con 0x7f03940d1d00 2023-11-24T08:07:56.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f039415d5e0 0x7f03940d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f039415d5e0 0x7f03940d39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39178/0 (socket says 172.21.15.57:39178) 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 -- 172.21.15.57:0/927672484 learned_addr learned my addr 172.21.15.57:0/927672484 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f038bfff640 1 --2- 172.21.15.57:0/927672484 >> v2:172.21.15.132:3300/0 conn(0x7f03940d3ee0 0x7f03940d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f0392d9d640 1 --2- 172.21.15.57:0/927672484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f03940cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 -- 172.21.15.57:0/927672484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 msgr2=0x7f03940cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 --2- 172.21.15.57:0/927672484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f03940cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 -- 172.21.15.57:0/927672484 >> v2:172.21.15.132:3300/0 conn(0x7f03940d3ee0 msgr2=0x7f03940d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:07:56.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 --2- 172.21.15.57:0/927672484 >> v2:172.21.15.132:3300/0 conn(0x7f03940d3ee0 0x7f03940d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f039259c640 1 -- 172.21.15.57:0/927672484 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940d1470 con 0x7f039415d5e0 2023-11-24T08:07:56.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f038bfff640 1 --2- 172.21.15.57:0/927672484 >> v2:172.21.15.132:3300/0 conn(0x7f03940d3ee0 0x7f03940d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:56.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.403+0000 7f0392d9d640 1 --2- 172.21.15.57:0/927672484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f03940cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:56.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039259c640 1 --2- 172.21.15.57:0/927672484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f039415d5e0 0x7f03940d39a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f03940b5db0 tx=0x7f038401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e7728f10889d2e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f0391d9b640 1 -- 172.21.15.57:0/927672484 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840aa5f0 con 0x7f039415d5e0 2023-11-24T08:07:56.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f0391d9b640 1 -- 172.21.15.57:0/927672484 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03840aa750 con 0x7f039415d5e0 2023-11-24T08:07:56.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f0391d9b640 1 -- 172.21.15.57:0/927672484 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840aaae0 con 0x7f039415d5e0 2023-11-24T08:07:56.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 -- 172.21.15.57:0/927672484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f039415d5e0 msgr2=0x7f03940d39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 --2- 172.21.15.57:0/927672484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f039415d5e0 0x7f03940d39a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f03940b5db0 tx=0x7f038401c4d0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 -- 172.21.15.57:0/927672484 shutdown_connections 2023-11-24T08:07:56.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 --2- 172.21.15.57:0/927672484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f03940cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 --2- 172.21.15.57:0/927672484 >> v2:172.21.15.132:3300/0 conn(0x7f03940d3ee0 0x7f03940d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 --2- 172.21.15.57:0/927672484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f039415d5e0 0x7f03940d39a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 -- 172.21.15.57:0/927672484 >> 172.21.15.57:0/927672484 conn(0x7f039409c520 msgr2=0x7f03940d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 -- 172.21.15.57:0/927672484 shutdown_connections 2023-11-24T08:07:56.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.407+0000 7f039359e640 1 -- 172.21.15.57:0/927672484 wait complete. 2023-11-24T08:07:56.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 Processor -- start 2023-11-24T08:07:56.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 -- start start 2023-11-24T08:07:56.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f039414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03940d3ee0 0x7f03940c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f039415d5e0 0x7f03940c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0394159550 con 0x7f03940d3ee0 2023-11-24T08:07:56.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039415e290 con 0x7f039415d5e0 2023-11-24T08:07:56.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039414cdd0 con 0x7f03940d1d00 2023-11-24T08:07:56.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03940d3ee0 0x7f03940c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03940d3ee0 0x7f03940c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39186/0 (socket says 172.21.15.57:39186) 2023-11-24T08:07:56.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 -- 172.21.15.57:0/1306171686 learned_addr learned my addr 172.21.15.57:0/1306171686 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:07:56.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039259c640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f039414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 -- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 msgr2=0x7f039414c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f0392d9d640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f039415d5e0 0x7f03940c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f039414c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 -- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f039415d5e0 msgr2=0x7f03940c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f039415d5e0 0x7f03940c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 -- 172.21.15.57:0/1306171686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840094d0 con 0x7f03940d3ee0 2023-11-24T08:07:56.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f0392d9d640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f039415d5e0 0x7f03940c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:07:56.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038bfff640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03940d3ee0 0x7f03940c9720 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f037c00c7c0 tx=0x7f037c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038affd640 1 -- 172.21.15.57:0/1306171686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c007a30 con 0x7f03940d3ee0 2023-11-24T08:07:56.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038affd640 1 -- 172.21.15.57:0/1306171686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c007b90 con 0x7f03940d3ee0 2023-11-24T08:07:56.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f038affd640 1 -- 172.21.15.57:0/1306171686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00ce70 con 0x7f03940d3ee0 2023-11-24T08:07:56.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03941557e0 con 0x7f03940d3ee0 2023-11-24T08:07:56.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.411+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039415deb0 con 0x7f03940d3ee0 2023-11-24T08:07:56.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.415+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039415e3d0 con 0x7f03940d3ee0 2023-11-24T08:07:56.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.415+0000 7f038affd640 1 -- 172.21.15.57:0/1306171686 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f037c0113f0 con 0x7f03940d3ee0 2023-11-24T08:07:56.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.415+0000 7f038affd640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0374066620 0x7f0374068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:07:56.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.415+0000 7f038affd640 1 -- 172.21.15.57:0/1306171686 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f037c084420 con 0x7f03940d3ee0 2023-11-24T08:07:56.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.415+0000 7f039259c640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0374066620 0x7f0374068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:07:56.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.415+0000 7f039259c640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0374066620 0x7f0374068ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f03840ae000 tx=0x7f03840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:07:56.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.419+0000 7f038affd640 1 -- 172.21.15.57:0/1306171686 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f039415e3d0 con 0x7f03940d3ee0 2023-11-24T08:07:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.583+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03940b3560 con 0x7f0374066620 2023-11-24T08:07:56.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.587+0000 7f038affd640 1 -- 172.21.15.57:0/1306171686 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50740 (secure 0 0 0) 0x7f03840aa8c0 con 0x7f0374066620 2023-11-24T08:07:56.592 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:07:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:07:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0374066620 msgr2=0x7f0374068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0374066620 0x7f0374068ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f03840ae000 tx=0x7f03840a7000 comp rx=0 tx=0).stop 2023-11-24T08:07:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03940d3ee0 msgr2=0x7f03940c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:07:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03940d3ee0 0x7f03940c9720 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f037c00c7c0 tx=0x7f037c00cc80 comp rx=0 tx=0).stop 2023-11-24T08:07:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 shutdown_connections 2023-11-24T08:07:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f0374066620 0x7f0374068ae0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f039415d5e0 0x7f03940c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03940d3ee0 0x7f03940c9720 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 --2- 172.21.15.57:0/1306171686 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03940d1d00 0x7f039414c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:07:56.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 >> 172.21.15.57:0/1306171686 conn(0x7f039409c520 msgr2=0x7f03940afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:07:56.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 shutdown_connections 2023-11-24T08:07:56.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:07:56.591+0000 7f039359e640 1 -- 172.21.15.57:0/1306171686 wait complete. 2023-11-24T08:07:56.613 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2023-11-24T08:07:54.738024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248308,"kb_used_data":7176,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726412,"statfs":{"total":773094113280,"available":772839845888,"internally_reserved":0,"allocated":7348224,"data_stored":3725624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.310587"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":200,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T08:07:47.438650+0000","last_change":"2023-11-24T08:03:48.500845+0000","last_active":"2023-11-24T08:07:47.438650+0000","last_peered":"2023-11-24T08:07:47.438650+0000","last_clean":"2023-11-24T08:07:47.438650+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:07:47.438650+0000","last_undegraded":"2023-11-24T08:07:47.438650+0000","last_fullsized":"2023-11-24T08:07:47.438650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:03:47.484944+0000","last_clean_scrub_stamp":"2023-11-24T08:03:47.484944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:04.733313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1363968,"data_stored":908479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.82399999999999995,"15min":0.90600000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96999999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84599999999999997,"15min":0.92400000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.9790000000000001,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.89000000000000001},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80000000000000004,"5min":5.923,"15min":5.923},"last":0.745},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.91300000000000003},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0700000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.85499999999999998,"15min":0.95199999999999996},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93200000000000005,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.83399999999999996,"15min":0.92600000000000005},"min":{"1min":0.50600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.032,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84799999999999998,"15min":0.93799999999999994},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97899999999999998,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65900000000000003,"15min":0.68200000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70299999999999996,"15min":0.72399999999999998},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.006,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.48899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.55500000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.52800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.69999999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.64000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.747},"min":{"1min":0.61699999999999999,"5min":0.505,"15min":0.505},"max":{"1min":0.95499999999999996,"5min":1.347,"15min":1.347},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.749,"15min":0.73899999999999999},"min":{"1min":0.498,"5min":0.434,"15min":0.434},"max":{"1min":0.95499999999999996,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.88,"5min":1.982,"15min":1.982},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.74099999999999999,"15min":0.70899999999999996},"min":{"1min":0.54500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.58699999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93200000000000005,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99299999999999999,"5min":3.657,"15min":3.657},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83499999999999996},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90000000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91000000000000003,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90700000000000003,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":3.391,"15min":3.391},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.752,"15min":0.746},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.93200000000000005,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.96999999999999997,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.54100000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.79100000000000004},"min":{"1min":0.45000000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88700000000000001,"5min":2.698,"15min":2.698},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.54000000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94199999999999995,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":1.034,"5min":1.794,"15min":1.794},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88200000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.57599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.88900000000000001,"5min":1.831,"15min":1.831},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.875,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.88600000000000001,"5min":8.2880000000000003,"15min":8.2880000000000003},"last":0.754},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.55700000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.998,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.83699999999999997}]},{"osd":4,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63200000000000001,"15min":0.66000000000000003},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.052,"5min":1.087,"15min":1.087},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.72299999999999998},"min":{"1min":0.46000000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.98299999999999998,"5min":1.238,"15min":1.238},"last":0.63},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71699999999999997,"15min":0.754},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.77500000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.52700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.097,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.51200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91100000000000003,"5min":1.022,"15min":1.022},"last":0.754}]},{"osd":1,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.48299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98499999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86699999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.70299999999999996},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90900000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.90100000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":0.998,"15min":0.998},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97299999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.90000000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92700000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0289999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.625,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.67600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.67800000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.21,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.53000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.054,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1080000000000001,"5min":1.258,"15min":1.258},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.173,"5min":1.272,"15min":1.272},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.66500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.24,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.155,"15min":1.155},"last":0.69299999999999995}]},{"osd":7,"last update":"Fri Nov 24 08:06:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.63600000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1319999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.103,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82599999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69599999999999995,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67500000000000004,"15min":0.745},"min":{"1min":0.40999999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75600000000000001,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.59399999999999997},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.71299999999999997,"15min":0.79200000000000004},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.61899999999999999,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":5.907,"15min":5.907},"last":0.438},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63800000000000001,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77900000000000003,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.71699999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0109999999999999,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.64400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.883,"15min":1.883},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.72799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.034,"5min":1.147,"15min":1.147},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.69699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.0609999999999999,"5min":1.923,"15min":1.923},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Nov 24 08:06:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.78700000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.149,"5min":1.964,"15min":1.964},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.78300000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1339999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.78600000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.49299999999999999,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55700000000000005,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.374}]},{"osd":2,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.53200000000000003,"15min":0.60499999999999998},"min":{"1min":0.30299999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.63100000000000001,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.61399999999999999,"15min":0.71799999999999997},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67200000000000004,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.68400000000000005,"15min":0.81999999999999995},"min":{"1min":0.45500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.58899999999999997,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.61899999999999999,"15min":0.70899999999999996},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63900000000000001,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78200000000000003,"15min":0.83899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0029999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.89000000000000001,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0660000000000001,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.94699999999999995},"min":{"1min":0.56100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82399999999999995,"15min":0.90900000000000003},"min":{"1min":0.52700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.86699999999999999,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.877,"15min":0.97199999999999998},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96599999999999997,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95399999999999996,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.90700000000000003,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.93100000000000005,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.88200000000000001,"15min":0.97199999999999998},"min":{"1min":0.59599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0229999999999999,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.79900000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542198,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1363968,"data_stored":908479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.70299999999999996,"15min":0.97799999999999998},"min":{"1min":0.311,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68100000000000005,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.311},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.58399999999999996,"15min":0.68200000000000005},"min":{"1min":0.311,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66700000000000004,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.58299999999999996,"15min":0.67300000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64800000000000002,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.379},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.55900000000000005,"15min":0.60199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.63200000000000001,"15min":0.78400000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.54100000000000004,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.81599999999999995,"15min":1.0740000000000001},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.877,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.501}]},{"osd":4,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84999999999999998,"15min":0.92400000000000004},"min":{"1min":0.60199999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.01,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.90900000000000003,"15min":1.05},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":1.006,"15min":1.2370000000000001},"min":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.054,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":1.0509999999999999,"15min":1.3109999999999999},"min":{"1min":0.629,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.032,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.92600000000000005,"15min":1.0780000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90100000000000002,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.95699999999999996,"15min":1.109},"min":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.048,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85999999999999999,"15min":0.90700000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98199999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.97699999999999998,"15min":1.1319999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0629999999999999,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:07:56.617 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T08:03:47.484944+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=3, tm_sec=47, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=7, tm_sec=50, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T08:07:56.617 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T08:08:16.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:08:16.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a108d6640 1 Processor -- start 2023-11-24T08:08:16.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a108d6640 1 -- start start 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a108d6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a0c15d6f0 0x7f1a0c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a108d6640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c15dae0 con 0x7f1a0c0d20c0 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a108d6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c15dda0 con 0x7f1a0c0d3be0 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a108d6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c15e080 con 0x7f1a0c15d6f0 2023-11-24T08:08:16.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a0ad9d640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1a0c0d20c0 0x7f1a0c0ce020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56088/0 (socket says 172.21.15.57:56088) 2023-11-24T08:08:16.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a0ad9d640 1 -- 172.21.15.57:0/1132277546 learned_addr learned my addr 172.21.15.57:0/1132277546 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:08:16.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943151730 0 0) 0x7f1a0c15dae0 con 0x7f1a0c0d20c0 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a0a59c640 1 --2- 172.21.15.57:0/1132277546 >> v2:172.21.15.132:3300/0 conn(0x7f1a0c15d6f0 0x7f1a0c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f8003530 con 0x7f1a0c0d20c0 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2326679127 0 0) 0x7f19f8003530 con 0x7f1a0c0d20c0 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 >> v2:172.21.15.132:3300/0 conn(0x7f1a0c15d6f0 msgr2=0x7f1a0c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 --2- 172.21.15.57:0/1132277546 >> v2:172.21.15.132:3300/0 conn(0x7f1a0c15d6f0 0x7f1a0c0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 >> v1:172.21.15.132:6789/0 conn(0x7f1a0c0d3be0 legacy=0x7f1a0c0d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c15e360 con 0x7f1a0c0d20c0 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3854055278 0 0) 0x7f1a04001a00 con 0x7f1a0c0d20c0 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 >> v1:172.21.15.57:6789/0 conn(0x7f1a0c0d20c0 legacy=0x7f1a0c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f8003980 0x7f19f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f80047d0 0x7f19f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f19f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c15e080 con 0x7f19f8005190 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f800c030 con 0x7f19f80047d0 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.767+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f800c1f0 con 0x7f19f8003980 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f19f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0a59c640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f8003980 0x7f19f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a03fff640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f80047d0 0x7f19f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 -- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f8003980 msgr2=0x7f19f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f8003980 0x7f19f8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 -- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f80047d0 msgr2=0x7f19f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f80047d0 0x7f19f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 -- 172.21.15.57:0/1132277546 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8003530 con 0x7f19f8005190 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 -- 172.21.15.57:0/1132277546 reap_dead start 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a0ad9d640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f19f800b990 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400a830 tx=0x7f1a0401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8827e73246d9c1a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040072d0 con 0x7f19f8005190 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a040a8070 con 0x7f19f8005190 2023-11-24T08:08:16.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.771+0000 7f1a09d9b640 1 -- 172.21.15.57:0/1132277546 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040076b0 con 0x7f19f8005190 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- 172.21.15.57:0/1132277546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 msgr2=0x7f19f800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f19f800b990 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400a830 tx=0x7f1a0401d340 comp rx=0 tx=0).stop 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- 172.21.15.57:0/1132277546 shutdown_connections 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 --2- 172.21.15.57:0/1132277546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f19f800b990 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- 172.21.15.57:0/1132277546 >> 172.21.15.57:0/1132277546 conn(0x7f1a0c08af70 msgr2=0x7f1a0c0d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- 172.21.15.57:0/1132277546 shutdown_connections 2023-11-24T08:08:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- 172.21.15.57:0/1132277546 wait complete. 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 Processor -- start 2023-11-24T08:08:16.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- start start 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f1a0c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a0c0cb200 0x7f1a0c0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a0c0ccf10 0x7f1a0c0cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0cc920 con 0x7f19f8005190 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0cd8d0 con 0x7f1a0c0ccf10 2023-11-24T08:08:16.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a108d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0cbca0 con 0x7f1a0c0cb200 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a0a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f1a0c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a0a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f1a0c158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47316/0 (socket says 172.21.15.57:47316) 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a0a59c640 1 -- 172.21.15.57:0/656723573 learned_addr learned my addr 172.21.15.57:0/656723573 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.775+0000 7f1a03fff640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a0c0cb200 0x7f1a0c0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a0ad9d640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a0c0ccf10 0x7f1a0c0cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a0a59c640 1 -- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a0c0cb200 msgr2=0x7f1a0c0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a0a59c640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a0c0cb200 0x7f1a0c0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a0a59c640 1 -- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a0c0ccf10 msgr2=0x7f1a0c0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a0a59c640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a0c0ccf10 0x7f1a0c0cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a0a59c640 1 -- 172.21.15.57:0/656723573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0cbf80 con 0x7f19f8005190 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a0a59c640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f1a0c158860 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f19fc011960 tx=0x7f19fc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a02ffd640 1 -- 172.21.15.57:0/656723573 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00faf0 con 0x7f19f8005190 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a02ffd640 1 -- 172.21.15.57:0/656723573 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc00fc50 con 0x7f19f8005190 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c0cc260 con 0x7f19f8005190 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a02ffd640 1 -- 172.21.15.57:0/656723573 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc014440 con 0x7f19f8005190 2023-11-24T08:08:16.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c158da0 con 0x7f19f8005190 2023-11-24T08:08:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c067520 con 0x7f19f8005190 2023-11-24T08:08:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a02ffd640 1 -- 172.21.15.57:0/656723573 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f19fc01d400 con 0x7f19f8005190 2023-11-24T08:08:16.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a02ffd640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19ec066620 0x7f19ec068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:16.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.779+0000 7f1a02ffd640 1 -- 172.21.15.57:0/656723573 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f19fc084680 con 0x7f19f8005190 2023-11-24T08:08:16.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.783+0000 7f1a03fff640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19ec066620 0x7f19ec068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:16.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.783+0000 7f1a03fff640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19ec066620 0x7f19ec068ae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c09d200 tx=0x7f19f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:16.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.787+0000 7f1a02ffd640 1 -- 172.21.15.57:0/656723573 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19fc051b70 con 0x7f19f8005190 2023-11-24T08:08:16.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.939+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 --> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a0c0d0b50 con 0x7f19ec066620 2023-11-24T08:08:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a02ffd640 1 -- 172.21.15.57:0/656723573 <== mgr.4101 v2:172.21.15.132:6832/917156864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50799 (secure 0 0 0) 0x7f1a0c0d0b50 con 0x7f19ec066620 2023-11-24T08:08:16.946 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:08:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-11-24T08:08:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19ec066620 msgr2=0x7f19ec068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19ec066620 0x7f19ec068ae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c09d200 tx=0x7f19f4009040 comp rx=0 tx=0).stop 2023-11-24T08:08:16.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 msgr2=0x7f1a0c158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:16.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f1a0c158860 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f19fc011960 tx=0x7f19fc011e20 comp rx=0 tx=0).stop 2023-11-24T08:08:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 shutdown_connections 2023-11-24T08:08:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f19ec066620 0x7f19ec068ae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a0c0ccf10 0x7f1a0c0cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a0c0cb200 0x7f1a0c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 --2- 172.21.15.57:0/656723573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19f8005190 0x7f1a0c158860 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 >> 172.21.15.57:0/656723573 conn(0x7f1a0c08af70 msgr2=0x7f1a0c0c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 shutdown_connections 2023-11-24T08:08:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:16.943+0000 7f1a108d6640 1 -- 172.21.15.57:0/656723573 wait complete. 2023-11-24T08:08:16.967 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2023-11-24T08:08:16.742730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248292,"kb_used_data":7176,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726428,"statfs":{"total":773094113280,"available":772839862272,"internally_reserved":0,"allocated":7348224,"data_stored":3725624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"1.0","version":"64'119","reported_seq":211,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-24T08:07:57.049935+0000","last_change":"2023-11-24T08:07:57.049965+0000","last_active":"2023-11-24T08:07:57.049935+0000","last_peered":"2023-11-24T08:07:57.049935+0000","last_clean":"2023-11-24T08:07:57.049935+0000","last_became_active":"2023-11-24T08:03:48.500482+0000","last_became_peered":"2023-11-24T08:03:48.500482+0000","last_unstale":"2023-11-24T08:07:57.049935+0000","last_undegraded":"2023-11-24T08:07:57.049935+0000","last_fullsized":"2023-11-24T08:07:57.049935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'119","last_scrub_stamp":"2023-11-24T08:07:57.049843+0000","last_deep_scrub":"64'119","last_deep_scrub_stamp":"2023-11-24T08:07:57.049843+0000","last_clean_scrub_stamp":"2023-11-24T08:07:57.049843+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:17:11.175026+0000","scrub_duration":0.012385136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1363968,"data_stored":908479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.82399999999999995,"15min":0.90600000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96999999999999997,"5min":5.4539999999999997,"15min":5.4539999999999997},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84599999999999997,"15min":0.92400000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.9790000000000001,"5min":5.4260000000000002,"15min":5.4260000000000002},"last":0.89300000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.89000000000000001},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80000000000000004,"5min":5.923,"15min":5.923},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.91300000000000003},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":6.1210000000000004,"15min":6.1210000000000004},"last":0.94799999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0700000000000001,"5min":5.5350000000000001,"15min":5.5350000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.85499999999999998,"15min":0.95199999999999996},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93200000000000005,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.83399999999999996,"15min":0.92600000000000005},"min":{"1min":0.50600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.032,"5min":6.4569999999999999,"15min":6.4569999999999999},"last":0.877},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.84799999999999998,"15min":0.93799999999999994},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97899999999999998,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":0.86399999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65900000000000003,"15min":0.68200000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94799999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70299999999999996,"15min":0.72399999999999998},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.006,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.62},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.48899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.55500000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.52800000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80400000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70099999999999996,"15min":0.65500000000000003},"min":{"1min":0.51200000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.626},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77400000000000002,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.048,"5min":1.347,"15min":1.347},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.91500000000000004,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.71899999999999997},"min":{"1min":0.53300000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.1020000000000001,"5min":1.982,"15min":1.982},"last":0.755}]},{"osd":2,"last update":"Fri Nov 24 08:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.752,"15min":0.71199999999999997},"min":{"1min":0.59999999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0289999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71899999999999997,"15min":0.69299999999999995},"min":{"1min":0.50800000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95199999999999996,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Nov 24 08:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.84299999999999997},"min":{"1min":0.61899999999999999,"5min":0.495,"15min":0.495},"max":{"1min":1.0009999999999999,"5min":3.657,"15min":3.657},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96899999999999997,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94399999999999995,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68999999999999995,"15min":0.70999999999999996},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.89800000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.502,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.875,"5min":3.391,"15min":3.391},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.75600000000000001,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":3.4529999999999998,"15min":3.4529999999999998},"last":0.47199999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.747,"15min":0.76300000000000001},"min":{"1min":0.53400000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.89100000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.754,"15min":0.754},"min":{"1min":0.54100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95099999999999996,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.44700000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.79100000000000004},"min":{"1min":0.45000000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88700000000000001,"5min":2.698,"15min":2.698},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.54000000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94199999999999995,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.748}]},{"osd":1,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":1.034,"5min":1.794,"15min":1.794},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.88200000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.57599999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.88900000000000001,"5min":1.831,"15min":1.831},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.875,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.88600000000000001,"5min":8.2880000000000003,"15min":8.2880000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.55700000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.998,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63200000000000001,"15min":0.66000000000000003},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.052,"5min":1.087,"15min":1.087},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.72299999999999998},"min":{"1min":0.46000000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.98299999999999998,"5min":1.238,"15min":1.238},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71699999999999997,"15min":0.754},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Nov 24 08:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.77500000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.52700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.097,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.82999999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.66100000000000003},"min":{"1min":0.51200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91100000000000003,"5min":1.022,"15min":1.022},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.48299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98499999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.504}]},{"osd":2,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86699999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.70299999999999996},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90900000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76300000000000001,"15min":0.753},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":0.998,"15min":0.998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76200000000000001,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97299999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65900000000000003}]},{"osd":6,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.67400000000000004},"min":{"1min":0.39300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.90000000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68600000000000005,"15min":0.69299999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92700000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.95499999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77100000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32700000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58999999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63300000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57399999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78200000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.39400000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.69599999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Nov 24 08:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.77600000000000002,"15min":0.79000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.84899999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.92000000000000004,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94299999999999995,"5min":1.258,"15min":1.258},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93799999999999994,"5min":1.272,"15min":1.272},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Nov 24 08:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0129999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.996},{"interface":"front","average":{"1min":0.746,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.97899999999999998,"5min":1.155,"15min":1.155},"last":1.04}]},{"osd":7,"last update":"Fri Nov 24 08:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92000000000000004,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98899999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.018}]}]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.52600000000000002,"15min":0.63400000000000001},"min":{"1min":0.29199999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52800000000000002,"5min":6.1799999999999997,"15min":6.1799999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.61199999999999999,"15min":0.72399999999999998},"min":{"1min":0.31900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67800000000000005,"5min":6.9139999999999997,"15min":6.9139999999999997},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.53800000000000003,"15min":0.58399999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59699999999999998,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.64700000000000002,"15min":0.77000000000000002},"min":{"1min":0.38400000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78600000000000003,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.56799999999999995,"15min":0.65700000000000003},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.54000000000000004,"5min":5.907,"15min":5.907},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.60199999999999998,"15min":0.66300000000000003},"min":{"1min":0.42999999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67700000000000005,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.58099999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79100000000000004,"15min":0.81699999999999995},"min":{"1min":0.54900000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92500000000000004,"5min":1.883,"15min":1.883},"last":0.621}]},{"osd":5,"last update":"Fri Nov 24 08:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.59999999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93500000000000005,"5min":1.147,"15min":1.147},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.89600000000000002},"min":{"1min":0.64200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Nov 24 08:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.81200000000000006,"15min":0.83599999999999997},"min":{"1min":0.54800000000000004,"5min":0.498,"15min":0.498},"max":{"1min":0.95999999999999996,"5min":1.923,"15min":1.923},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95399999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.872,"15min":0.88700000000000001},"min":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.98599999999999999,"5min":1.964,"15min":1.964},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0309999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":318111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.49299999999999999,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55700000000000005,"15min":0.629},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.53200000000000003,"15min":0.60499999999999998},"min":{"1min":0.30299999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.63100000000000001,"5min":3.6059999999999999,"15min":3.6059999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.61399999999999999,"15min":0.71799999999999997},"min":{"1min":0.38600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67200000000000004,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.68400000000000005,"15min":0.81999999999999995},"min":{"1min":0.45500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.58899999999999997,"5min":4.9320000000000004,"15min":4.9320000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.61899999999999999,"15min":0.70899999999999996},"min":{"1min":0.40000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.63900000000000001,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78200000000000003,"15min":0.83899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0029999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.89000000000000001,"15min":1.03},"min":{"1min":0.53900000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0660000000000001,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.94699999999999995},"min":{"1min":0.56100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91000000000000003,"5min":4.1870000000000003,"15min":4.1870000000000003},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.82399999999999995,"15min":0.90900000000000003},"min":{"1min":0.52700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.86699999999999999,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.877,"15min":0.97199999999999998},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96599999999999997,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.83599999999999997,"15min":0.90800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95399999999999996,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.753}]},{"osd":7,"last update":"Fri Nov 24 08:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.90700000000000003,"15min":1.0549999999999999},"min":{"1min":0.61199999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.93100000000000005,"5min":4.9699999999999998,"15min":4.9699999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.88200000000000001,"15min":0.97199999999999998},"min":{"1min":0.59599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0229999999999999,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.80000000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542202,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1363968,"data_stored":908479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.70299999999999996,"15min":0.97799999999999998},"min":{"1min":0.311,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68100000000000005,"5min":10.880000000000001,"15min":10.880000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.58399999999999996,"15min":0.68200000000000005},"min":{"1min":0.311,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.66700000000000004,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.39800000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.58299999999999996,"15min":0.67300000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64800000000000002,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.55900000000000005,"15min":0.60199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.63200000000000001,"15min":0.78400000000000003},"min":{"1min":0.374,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.54100000000000004,"5min":6.5830000000000002,"15min":6.5830000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.81599999999999995,"15min":1.0740000000000001},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.877,"5min":8.9800000000000004,"15min":8.9800000000000004},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84999999999999998,"15min":0.92400000000000004},"min":{"1min":0.60199999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.01,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.90900000000000003,"15min":1.05},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98899999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":1.006,"15min":1.2370000000000001},"min":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.054,"5min":9.0299999999999994,"15min":9.0299999999999994},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":1.0509999999999999,"15min":1.3109999999999999},"min":{"1min":0.629,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.032,"5min":12.688000000000001,"15min":12.688000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.92600000000000005,"15min":1.0780000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.90100000000000002,"5min":6.7839999999999998,"15min":6.7839999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.95699999999999996,"15min":1.109},"min":{"1min":0.57199999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.048,"5min":5.1100000000000003,"15min":5.1100000000000003},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.85999999999999999,"15min":0.90700000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98199999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.97699999999999998,"15min":1.1319999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0629999999999999,"5min":6.6390000000000002,"15min":6.6390000000000002},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:08:16.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T08:08:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9f032640 1 Processor -- start 2023-11-24T08:08:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9f032640 1 -- start start 2023-11-24T08:08:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9f032640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9f032640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f980ce200 0x7f5f980cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9f032640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9806c620 con 0x7f5f980cf300 2023-11-24T08:08:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9f032640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f980cf790 con 0x7f5f980ce200 2023-11-24T08:08:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9f032640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980cbd80 con 0x7f5f9815d630 2023-11-24T08:08:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f97fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f980ce200 0x7f5f980cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9d5cf640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5f980cf300 0x7f5f9806cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56092/0 (socket says 172.21.15.57:56092) 2023-11-24T08:08:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9d5cf640 1 -- 172.21.15.57:0/1282532779 learned_addr learned my addr 172.21.15.57:0/1282532779 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-11-24T08:08:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f9cdce640 1 --2- 172.21.15.57:0/1282532779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f97fff640 1 -- 172.21.15.57:0/1282532779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 msgr2=0x7f5f980cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f97fff640 1 --2- 172.21.15.57:0/1282532779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f97fff640 1 -- 172.21.15.57:0/1282532779 >> v1:172.21.15.57:6789/0 conn(0x7f5f980cf300 legacy=0x7f5f9806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f97fff640 1 -- 172.21.15.57:0/1282532779 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9806ba10 con 0x7f5f980ce200 2023-11-24T08:08:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.111+0000 7f5f977fe640 1 -- 172.21.15.57:0/1282532779 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034831680 0 0) 0x7f5f9806c620 con 0x7f5f980cf300 2023-11-24T08:08:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f97fff640 1 --2- 172.21.15.57:0/1282532779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f980cedc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5f840097c0 tx=0x7f5f8401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11babe51af5f0be5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f977fe640 1 -- 172.21.15.57:0/1282532779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f840ab650 con 0x7f5f980ce200 2023-11-24T08:08:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f977fe640 1 -- 172.21.15.57:0/1282532779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f840ab7b0 con 0x7f5f980ce200 2023-11-24T08:08:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f977fe640 1 -- 172.21.15.57:0/1282532779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f840abb40 con 0x7f5f980ce200 2023-11-24T08:08:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 -- 172.21.15.57:0/1282532779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 msgr2=0x7f5f980cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1282532779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f980cedc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5f840097c0 tx=0x7f5f8401c450 comp rx=0 tx=0).stop 2023-11-24T08:08:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 -- 172.21.15.57:0/1282532779 shutdown_connections 2023-11-24T08:08:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1282532779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f980cedc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1282532779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 -- 172.21.15.57:0/1282532779 >> 172.21.15.57:0/1282532779 conn(0x7f5f9806e860 msgr2=0x7f5f9806ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 -- 172.21.15.57:0/1282532779 shutdown_connections 2023-11-24T08:08:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 -- 172.21.15.57:0/1282532779 wait complete. 2023-11-24T08:08:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.115+0000 7f5f9f032640 1 Processor -- start 2023-11-24T08:08:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 -- start start 2023-11-24T08:08:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f98154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f980cf300 0x7f5f980cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98150c10 con 0x7f5f980ce200 2023-11-24T08:08:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980cb250 con 0x7f5f980cf300 2023-11-24T08:08:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98150e20 con 0x7f5f9815d630 2023-11-24T08:08:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f98154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f98154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47340/0 (socket says 172.21.15.57:47340) 2023-11-24T08:08:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 -- 172.21.15.57:0/1358086009 learned_addr learned my addr 172.21.15.57:0/1358086009 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:08:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9d5cf640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f97fff640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f980cf300 0x7f5f980cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 -- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 msgr2=0x7f5f980b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 -- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f980cf300 msgr2=0x7f5f980cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f980cf300 0x7f5f980cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 -- 172.21.15.57:0/1358086009 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84009420 con 0x7f5f980ce200 2023-11-24T08:08:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9cdce640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f98154f10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00e870 tx=0x7f5f8c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c009510 con 0x7f5f980ce200 2023-11-24T08:08:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00eec0 con 0x7f5f980ce200 2023-11-24T08:08:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f98151100 con 0x7f5f980ce200 2023-11-24T08:08:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00cb40 con 0x7f5f980ce200 2023-11-24T08:08:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f981516c0 con 0x7f5f980ce200 2023-11-24T08:08:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.119+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9804e8c0 con 0x7f5f980ce200 2023-11-24T08:08:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.123+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f5f8c00cca0 con 0x7f5f980ce200 2023-11-24T08:08:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.123+0000 7f5f957fa640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f7c066620 0x7f5f7c068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.123+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5f8c084070 con 0x7f5f980ce200 2023-11-24T08:08:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.123+0000 7f5f97fff640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f7c066620 0x7f5f7c068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.123+0000 7f5f97fff640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f7c066620 0x7f5f7c068ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5f840af000 tx=0x7f5f840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.127+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f8c0b5280 con 0x7f5f980ce200 2023-11-24T08:08:17.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.283+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f5f980b2b50 con 0x7f5f980ce200 2023-11-24T08:08:17.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.287+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5f8c0170c0 con 0x7f5f980ce200 2023-11-24T08:08:17.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.287+0000 7f5f957fa640 1 -- 172.21.15.57:0/1358086009 <== mon.0 v2:172.21.15.57:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5f8c0514d0 con 0x7f5f980ce200 2023-11-24T08:08:17.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f7c066620 msgr2=0x7f5f7c068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f7c066620 0x7f5f7c068ae0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5f840af000 tx=0x7f5f840a7000 comp rx=0 tx=0).stop 2023-11-24T08:08:17.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 msgr2=0x7f5f98154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f98154f10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00e870 tx=0x7f5f8c00ec70 comp rx=0 tx=0).stop 2023-11-24T08:08:17.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 shutdown_connections 2023-11-24T08:08:17.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7f5f7c066620 0x7f5f7c068ae0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5f9815d630 0x7f5f980b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f980cf300 0x7f5f980cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 --2- 172.21.15.57:0/1358086009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f980ce200 0x7f5f98154f10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 >> 172.21.15.57:0/1358086009 conn(0x7f5f9806e860 msgr2=0x7f5f9806ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 shutdown_connections 2023-11-24T08:08:17.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.291+0000 7f5f9f032640 1 -- 172.21.15.57:0/1358086009 wait complete. 2023-11-24T08:08:17.314 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:08:17.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:08:17.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 Processor -- start 2023-11-24T08:08:17.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 -- start start 2023-11-24T08:08:17.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c15d570 0x7fbf2c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf2c0d3020 0x7fbf2c0d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf2c0ce8b0 0x7fbf2c0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c0d39c0 con 0x7fbf2c0d3020 2023-11-24T08:08:17.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c0d1cc0 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf33594640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0d1fa0 con 0x7fbf2c15d570 2023-11-24T08:08:17.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf2c0d3020 0x7fbf2c0d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf2c0d3020 0x7fbf2c0d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47352/0 (socket says 172.21.15.57:47352) 2023-11-24T08:08:17.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 -- 172.21.15.57:0/3429819702 learned_addr learned my addr 172.21.15.57:0/3429819702 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:08:17.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf31330640 1 --2- 172.21.15.57:0/3429819702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c15d570 0x7fbf2c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf31b31640 1 --2- 172.21.15.57:0/3429819702 >> v2:172.21.15.132:3300/0 conn(0x7fbf2c0ce8b0 0x7fbf2c0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 -- 172.21.15.57:0/3429819702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c15d570 msgr2=0x7fbf2c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:17.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 --2- 172.21.15.57:0/3429819702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c15d570 0x7fbf2c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 -- 172.21.15.57:0/3429819702 >> v2:172.21.15.132:3300/0 conn(0x7fbf2c0ce8b0 msgr2=0x7fbf2c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:08:17.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 --2- 172.21.15.57:0/3429819702 >> v2:172.21.15.132:3300/0 conn(0x7fbf2c0ce8b0 0x7fbf2c0ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.455+0000 7fbf30b2f640 1 -- 172.21.15.57:0/3429819702 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0ce0b0 con 0x7fbf2c0d3020 2023-11-24T08:08:17.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf30b2f640 1 --2- 172.21.15.57:0/3429819702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0d3020 0x7fbf2c0d3480 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0c6e60 tx=0x7fbf1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ed34c4449441fe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf23fff640 1 -- 172.21.15.57:0/3429819702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0aa610 con 0x7fbf2c0d3020 2023-11-24T08:08:17.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf23fff640 1 -- 172.21.15.57:0/3429819702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf1c0a6040 con 0x7fbf2c0d3020 2023-11-24T08:08:17.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf23fff640 1 -- 172.21.15.57:0/3429819702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0aa9b0 con 0x7fbf2c0d3020 2023-11-24T08:08:17.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 -- 172.21.15.57:0/3429819702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0d3020 msgr2=0x7fbf2c0d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 --2- 172.21.15.57:0/3429819702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0d3020 0x7fbf2c0d3480 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0c6e60 tx=0x7fbf1c01c4d0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 -- 172.21.15.57:0/3429819702 shutdown_connections 2023-11-24T08:08:17.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 --2- 172.21.15.57:0/3429819702 >> v2:172.21.15.132:3300/0 conn(0x7fbf2c0ce8b0 0x7fbf2c0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 --2- 172.21.15.57:0/3429819702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0d3020 0x7fbf2c0d3480 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 --2- 172.21.15.57:0/3429819702 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c15d570 0x7fbf2c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 -- 172.21.15.57:0/3429819702 >> 172.21.15.57:0/3429819702 conn(0x7fbf2c08ceb0 msgr2=0x7fbf2c09c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 -- 172.21.15.57:0/3429819702 shutdown_connections 2023-11-24T08:08:17.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.459+0000 7fbf33594640 1 -- 172.21.15.57:0/3429819702 wait complete. 2023-11-24T08:08:17.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 Processor -- start 2023-11-24T08:08:17.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 -- start start 2023-11-24T08:08:17.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0ce8b0 0x7fbf2c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c0d3020 0x7fbf2c1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf2c15d570 0x7fbf2c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c15b320 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c155ce0 con 0x7fbf2c15d570 2023-11-24T08:08:17.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c155ef0 con 0x7fbf2c0d3020 2023-11-24T08:08:17.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0ce8b0 0x7fbf2c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0ce8b0 0x7fbf2c15b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47360/0 (socket says 172.21.15.57:47360) 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 -- 172.21.15.57:0/4248069605 learned_addr learned my addr 172.21.15.57:0/4248069605 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 -- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c0d3020 msgr2=0x7fbf2c1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c0d3020 0x7fbf2c1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 -- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf2c15d570 msgr2=0x7fbf2c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf2c15d570 0x7fbf2c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 -- 172.21.15.57:0/4248069605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0094d0 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf31330640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0ce8b0 0x7fbf2c15b740 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d800 tx=0x7fbf2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf21ffb640 1 -- 172.21.15.57:0/4248069605 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800b6c0 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf21ffb640 1 -- 172.21.15.57:0/4248069605 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf2800b820 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf21ffb640 1 -- 172.21.15.57:0/4248069605 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800bbb0 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c15a980 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.463+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c15af40 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.467+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c067520 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.467+0000 7fbf21ffb640 1 -- 172.21.15.57:0/4248069605 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fbf2800bd10 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.467+0000 7fbf21ffb640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbf100666a0 0x7fbf10068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:08:17.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.467+0000 7fbf21ffb640 1 -- 172.21.15.57:0/4248069605 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf28084440 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.467+0000 7fbf30b2f640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbf100666a0 0x7fbf10068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:08:17.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.467+0000 7fbf30b2f640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbf100666a0 0x7fbf10068b60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0ae000 tx=0x7fbf1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:08:17.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.471+0000 7fbf21ffb640 1 -- 172.21.15.57:0/4248069605 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf28051920 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf2c15b590 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf21ffb640 1 -- 172.21.15.57:0/4248069605 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3703 (secure 0 0 0) 0x7fbf28054f40 con 0x7fbf2c0ce8b0 2023-11-24T08:08:17.667 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-11-24T08:08:17.667 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/4096569691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":4096569691},{"type":"v1","addr":"172.21.15.57:6834","nonce":4096569691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/671957004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":671957004},{"type":"v1","addr":"172.21.15.57:6835","nonce":671957004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6165,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1925156645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1925156645},{"type":"v1","addr":"172.21.15.132:6837","nonce":1925156645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":55589,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1672055447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1672055447},{"type":"v1","addr":"172.21.15.132:6836","nonce":1672055447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[]} 2023-11-24T08:08:17.668 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-11-24T08:08:17.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbf100666a0 msgr2=0x7fbf10068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbf100666a0 0x7fbf10068b60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0ae000 tx=0x7fbf1c008040 comp rx=0 tx=0).stop 2023-11-24T08:08:17.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0ce8b0 msgr2=0x7fbf2c15b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:08:17.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0ce8b0 0x7fbf2c15b740 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800d800 tx=0x7fbf2800dcc0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 shutdown_connections 2023-11-24T08:08:17.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:6832/917156864,v1:172.21.15.132:6833/917156864] conn(0x7fbf100666a0 0x7fbf10068b60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf2c15d570 0x7fbf2c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2c0d3020 0x7fbf2c1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 --2- 172.21.15.57:0/4248069605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf2c0ce8b0 0x7fbf2c15b740 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:08:17.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 >> 172.21.15.57:0/4248069605 conn(0x7fbf2c08ceb0 msgr2=0x7fbf2c156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:08:17.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 shutdown_connections 2023-11-24T08:08:17.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-11-24T08:08:17.663+0000 7fbf33594640 1 -- 172.21.15.57:0/4248069605 wait complete. 2023-11-24T08:08:17.688 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T08:08:17.688 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T08:08:17.688 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:08:17.688 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:17.701 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:08:17.701 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:08:17.702 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:17.757 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:08:17.757 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:08:17.758 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:17.773 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:08:17.773 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:08:17.773 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:17.833 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:08:17.833 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T08:08:17.833 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T08:08:17.833 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:17.916 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T08:08:17.916 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T08:08:17.916 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:18.000 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T08:08:18.000 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T08:08:18.000 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:18.091 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T08:08:18.091 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T08:08:18.091 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:18.168 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T08:08:18.168 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T08:08:18.169 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:18.263 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T08:08:18.264 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T08:08:18.264 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:20.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:20.129 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:21.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-24T08:08:24.366 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T08:08:24.366 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T08:08:24.366 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:24.426 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T08:08:24.427 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T08:08:24.427 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:24.502 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T08:08:24.503 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T08:08:24.503 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T08:08:24.503 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:24.556 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T08:08:24.557 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T08:08:24.557 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:24.614 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T08:08:24.614 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T08:08:24.615 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T08:08:24.615 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:24.636 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T08:08:24.636 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T08:08:24.637 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:24.653 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T08:08:24.654 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T08:08:24.654 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:08:24.719 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T08:08:24.719 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T08:08:24.719 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T08:08:24.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:08:24.755 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T08:08:25.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:08:25.053 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T08:08:25.294 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:08:25.294 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T08:08:25.592 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:08:25.593 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T08:08:25.767 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:08:25.767 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T08:08:26.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:08:26.042 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T08:08:26.232 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:08:26.232 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T08:08:26.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-24T08:08:26.389 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:08:26.389 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T08:08:26.595 INFO:tasks.ceph:Archiving mon data... 2023-11-24T08:08:26.596 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/data/mon.a.tgz 2023-11-24T08:08:26.597 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-11-24T08:08:26.608 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.ZIKJpkabLg 2023-11-24T08:08:26.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZIKJpkabLg 2023-11-24T08:08:26.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.ZIKJpkabLg 2023-11-24T08:08:26.846 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.ZIKJpkabLg is 487KB 2023-11-24T08:08:26.911 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.ZIKJpkabLg 2023-11-24T08:08:26.920 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/data/mon.b.tgz 2023-11-24T08:08:26.920 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-24T08:08:26.930 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.OeYcDZvZXf 2023-11-24T08:08:26.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.OeYcDZvZXf 2023-11-24T08:08:27.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.OeYcDZvZXf 2023-11-24T08:08:27.190 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.OeYcDZvZXf is 652KB 2023-11-24T08:08:27.256 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.OeYcDZvZXf 2023-11-24T08:08:27.265 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/data/mon.c.tgz 2023-11-24T08:08:27.266 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-11-24T08:08:27.317 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.Tyj3CHYSTX 2023-11-24T08:08:27.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Tyj3CHYSTX 2023-11-24T08:08:27.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.Tyj3CHYSTX 2023-11-24T08:08:27.578 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.Tyj3CHYSTX is 651KB 2023-11-24T08:08:27.648 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.Tyj3CHYSTX 2023-11-24T08:08:27.657 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T08:08:27.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:08:27.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:08:27.721 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T08:08:27.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:08:27.727 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:08:27.762 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:08:27.807 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:08:27.814 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T08:08:27.818 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/remote/smithi057/crash 2023-11-24T08:08:27.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:08:27.842 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/remote/smithi132/crash 2023-11-24T08:08:27.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:08:27.877 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T08:08:27.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:27.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:27.980 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:28.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:08:28.023 INFO:tasks.ceph:Compressing logs... 2023-11-24T08:08:28.023 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:08:28.048 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:08:28.072 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2023-11-24T08:08:28.073 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50904.log 2023-11-24T08:08:28.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51517.log 2023-11-24T08:08:28.074 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2023-11-24T08:08:28.075 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45135.log 2023-11-24T08:08:28.075 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50904.log.gz 2023-11-24T08:08:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48284.log 2023-11-24T08:08:28.076 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51517.log.gz 2023-11-24T08:08:28.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46862.log 2023-11-24T08:08:28.077 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45135.log.gz 2023-11-24T08:08:28.078 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48284.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48284.log.gz 2023-11-24T08:08:28.078 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52356.log 2023-11-24T08:08:28.079 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43524.log 2023-11-24T08:08:28.079 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46862.log.gz 2023-11-24T08:08:28.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52120.log 2023-11-24T08:08:28.080 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52356.log.gz 2023-11-24T08:08:28.081 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43805.log 2023-11-24T08:08:28.082 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43524.log.gz 2023-11-24T08:08:28.082 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52120.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T08:08:28.082 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52120.log.gz 2023-11-24T08:08:28.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45928.log 2023-11-24T08:08:28.083 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43805.log.gz 2023-11-24T08:08:28.084 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51785.log 2023-11-24T08:08:28.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48837.log 2023-11-24T08:08:28.085 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45928.log.gz 2023-11-24T08:08:28.086 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50403.log 2023-11-24T08:08:28.086 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51785.log.gz 2023-11-24T08:08:28.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49899.log 2023-11-24T08:08:28.087 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48837.log.gz 2023-11-24T08:08:28.088 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T08:08:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50403.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50403.log.gz 2023-11-24T08:08:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46170.log 2023-11-24T08:08:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2023-11-24T08:08:28.090 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49899.log.gz 2023-11-24T08:08:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52174.log 2023-11-24T08:08:28.091 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46170.log.gz 2023-11-24T08:08:28.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46966.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.0.47430.log 2023-11-24T08:08:28.093 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2023-11-24T08:08:28.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44722.log 2023-11-24T08:08:28.093 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52174.log.gz 2023-11-24T08:08:28.094 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44421.log 2023-11-24T08:08:28.094 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44121.log 2023-11-24T08:08:28.095 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.47430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47430.log.gz 2023-11-24T08:08:28.095 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44488.log 2023-11-24T08:08:28.095 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2023-11-24T08:08:28.095 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44722.log.gz 2023-11-24T08:08:28.097 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47446.log 2023-11-24T08:08:28.097 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44488.log.gz 2023-11-24T08:08:28.097 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49341.log 2023-11-24T08:08:28.097 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2023-11-24T08:08:28.098 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.1.44421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44421.log.gz 2023-11-24T08:08:28.098 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T08:08:28.099 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.3.44121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44121.log.gz 2023-11-24T08:08:28.099 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T08:08:28.099 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38326.log 2023-11-24T08:08:28.099 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2023-11-24T08:08:28.100 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.38326.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38326.log.gz -5 2023-11-24T08:08:28.100 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T08:08:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50117.log 2023-11-24T08:08:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47446.log: /var/log/ceph/ceph-client.admin.49341.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47446.log.gz 2023-11-24T08:08:28.102 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49341.log.gz 2023-11-24T08:08:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51413.log 2023-11-24T08:08:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50117.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.50117.log.gz --verbose 2023-11-24T08:08:28.102 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.50876.log 2023-11-24T08:08:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51413.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz -- 2023-11-24T08:08:28.103 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.49793.log 2023-11-24T08:08:28.103 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49767.log 2023-11-24T08:08:28.103 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50876.log.gz 2023-11-24T08:08:28.105 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49793.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45603.log 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49767.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49767.log.gz 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46730.log 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45603.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45603.log.gz 2023-11-24T08:08:28.106 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46087.log 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.38254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44243.log 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44036.log 2023-11-24T08:08:28.107 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.1.44243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44243.log.gz 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44648.log 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.1.44036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38350.log 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44036.log.gz 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.1.44648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44648.log.gz 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T08:08:28.108 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.38350.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38350.log.gz 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T08:08:28.110 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38374.log 2023-11-24T08:08:28.111 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.c.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:08:28.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46730.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T08:08:28.112 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46730.log.gz 2023-11-24T08:08:28.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46087.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46087.log.gz 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52330.log 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51465.log 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52330.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52330.log.gz 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51889.log 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51465.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.51465.log.gz /var/log/ceph/ceph-client.admin.48442.log 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51889.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.51889.log.gz /var/log/ceph/ceph-client.admin.49097.log 2023-11-24T08:08:28.113 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48414.log 2023-11-24T08:08:28.114 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48442.log.gz 2023-11-24T08:08:28.115 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:08:28.115 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.38374.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38374.log.gz 2023-11-24T08:08:28.116 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-24T08:08:28.116 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38302.log 2023-11-24T08:08:28.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2023-11-24T08:08:28.117 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49097.log.gz 2023-11-24T08:08:28.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48414.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48414.log.gz 2023-11-24T08:08:28.117 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51112.log 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48967.log 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51112.log.gz 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51286.log 2023-11-24T08:08:28.118 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2023-11-24T08:08:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-client.admin.38302.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:08:28.119 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38302.log.gz 2023-11-24T08:08:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2023-11-24T08:08:28.120 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T08:08:28.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46009.log 2023-11-24T08:08:28.121 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48967.log.gz 2023-11-24T08:08:28.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.51286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51286.log.gz 2023-11-24T08:08:28.121 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44974.log 2023-11-24T08:08:28.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45421.log 2023-11-24T08:08:28.122 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2023-11-24T08:08:28.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.44974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44974.log.gz 2023-11-24T08:08:28.122 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51491.log 2023-11-24T08:08:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.38278.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2023-11-24T08:08:28.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48572.log 2023-11-24T08:08:28.124 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45421.log.gz 2023-11-24T08:08:28.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51491.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.51491.log.gz 2023-11-24T08:08:28.124 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.43356.log 2023-11-24T08:08:28.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48572.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.48572.log.gz --verbose 2023-11-24T08:08:28.124 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.52434.log 2023-11-24T08:08:28.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48102.log 88.8% 2023-11-24T08:08:28.125 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43356.log.gz 2023-11-24T08:08:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T08:08:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52434.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.50377.log -- replaced with /var/log/ceph/ceph-client.admin.52434.log.gz 2023-11-24T08:08:28.127 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-11-24T08:08:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2023-11-24T08:08:28.127 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48102.log.gz 2023-11-24T08:08:28.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50377.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.50377.log.gz -- 2023-11-24T08:08:28.128 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.45525.log 2023-11-24T08:08:28.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 87.6% 2023-11-24T08:08:28.129 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2023-11-24T08:08:28.130 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38399.log 2023-11-24T08:08:28.130 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T08:08:28.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2023-11-24T08:08:28.130 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45525.log.gz 2023-11-24T08:08:28.131 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.38399.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38399.log.gz 2023-11-24T08:08:28.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52019.log 2023-11-24T08:08:28.132 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2023-11-24T08:08:28.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49741.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2023-11-24T08:08:28.132 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2023-11-24T08:08:28.133 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2023-11-24T08:08:28.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52019.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52019.log.gz 2023-11-24T08:08:28.134 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44644.log 2023-11-24T08:08:28.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43802.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2023-11-24T08:08:28.135 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50822.log 2023-11-24T08:08:28.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2023-11-24T08:08:28.136 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44644.log.gz 2023-11-24T08:08:28.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50822.log: gzip -5 88.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.50822.log.gz -- 2023-11-24T08:08:28.136 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.51354.log 2023-11-24T08:08:28.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49173.log 2023-11-24T08:08:28.137 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2023-11-24T08:08:28.138 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38230.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2023-11-24T08:08:28.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51354.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2023-11-24T08:08:28.139 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48993.log 2023-11-24T08:08:28.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51439.log 2023-11-24T08:08:28.140 INFO:teuthology.orchestra.run.smithi057.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49173.log.gz 2023-11-24T08:08:28.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51008.log 2023-11-24T08:08:28.140 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48993.log.gz 2023-11-24T08:08:28.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44001.log 2023-11-24T08:08:28.142 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51439.log.gz 2023-11-24T08:08:28.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2023-11-24T08:08:28.142 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51008.log.gz 2023-11-24T08:08:28.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44001.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T08:08:28.144 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44001.log.gz 2023-11-24T08:08:28.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44019.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2023-11-24T08:08:28.145 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48076.log 2023-11-24T08:08:28.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47472.log 2023-11-24T08:08:28.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48050.log 2023-11-24T08:08:28.147 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48076.log.gz 2023-11-24T08:08:28.148 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51138.log 2023-11-24T08:08:28.148 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47472.log.gz 2023-11-24T08:08:28.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48050.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48050.log.gz 2023-11-24T08:08:28.149 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51060.log 2023-11-24T08:08:28.150 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2023-11-24T08:08:28.150 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51138.log.gz 2023-11-24T08:08:28.151 INFO:teuthology.orchestra.run.smithi132.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T08:08:28.152 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51060.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51060.log.gz 2023-11-24T08:08:28.152 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2023-11-24T08:08:28.153 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45003.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2023-11-24T08:08:28.153 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43464.log 2023-11-24T08:08:28.154 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46782.log 2023-11-24T08:08:28.154 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2023-11-24T08:08:28.155 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43464.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2023-11-24T08:08:28.155 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2023-11-24T08:08:28.156 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46782.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46782.log.gz 2023-11-24T08:08:28.157 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2023-11-24T08:08:28.157 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45499.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2023-11-24T08:08:28.158 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47589.log 2023-11-24T08:08:28.159 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47893.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gz 2023-11-24T08:08:28.159 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51837.log 2023-11-24T08:08:28.160 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47589.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47589.log.gz 2023-11-24T08:08:28.160 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2023-11-24T08:08:28.161 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51837.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.51837.log.gz 2023-11-24T08:08:28.161 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52460.log 2023-11-24T08:08:28.162 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46113.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2023-11-24T08:08:28.162 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2023-11-24T08:08:28.163 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49313.log 2023-11-24T08:08:28.163 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52460.log.gz 2023-11-24T08:08:28.164 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2023-11-24T08:08:28.164 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T08:08:28.165 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47841.log 2023-11-24T08:08:28.166 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz 2023-11-24T08:08:28.166 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49235.log 2023-11-24T08:08:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47841.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47841.log.gz 2023-11-24T08:08:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2023-11-24T08:08:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49235.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49235.log.gz 2023-11-24T08:08:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47998.log 2023-11-24T08:08:28.171 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48128.log 2023-11-24T08:08:28.171 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2023-11-24T08:08:28.172 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47998.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2023-11-24T08:08:28.172 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46834.log 2023-11-24T08:08:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48128.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48128.log.gz 2023-11-24T08:08:28.174 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48811.log 2023-11-24T08:08:28.175 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50058.log 2023-11-24T08:08:28.175 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46834.log.gz 2023-11-24T08:08:28.176 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48811.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48811.log.gz 2023-11-24T08:08:28.176 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49847.log 2023-11-24T08:08:28.178 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51863.log 2023-11-24T08:08:28.178 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50058.log.gz 2023-11-24T08:08:28.179 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49847.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49847.log.gz 2023-11-24T08:08:28.179 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46535.log 2023-11-24T08:08:28.180 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51863.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51863.log.gz 2023-11-24T08:08:28.181 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43656.log 2023-11-24T08:08:28.182 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2023-11-24T08:08:28.183 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46535.log.gz 2023-11-24T08:08:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43656.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43656.log.gz 2023-11-24T08:08:28.184 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51380.log 2023-11-24T08:08:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45161.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2023-11-24T08:08:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47731.log 2023-11-24T08:08:28.186 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51086.log 2023-11-24T08:08:28.187 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51380.log.gz 2023-11-24T08:08:28.187 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47731.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47731.log.gz 2023-11-24T08:08:28.188 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47815.log 2023-11-24T08:08:28.189 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2023-11-24T08:08:28.189 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51086.log.gz 2023-11-24T08:08:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47815.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47815.log.gz 2023-11-24T08:08:28.191 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50769.log 2023-11-24T08:08:28.191 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45681.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2023-11-24T08:08:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2023-11-24T08:08:28.193 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43630.log 2023-11-24T08:08:28.194 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50769.log.gz 2023-11-24T08:08:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45793.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2023-11-24T08:08:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44211.log 2023-11-24T08:08:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43630.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43630.log.gz 2023-11-24T08:08:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2023-11-24T08:08:28.197 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2023-11-24T08:08:28.198 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44211.log.gz 2023-11-24T08:08:28.199 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43498.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2023-11-24T08:08:28.199 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48624.log 2023-11-24T08:08:28.200 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50646.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz 2023-11-24T08:08:28.201 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2023-11-24T08:08:28.202 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47020.log 2023-11-24T08:08:28.202 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48624.log.gz 2023-11-24T08:08:28.203 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44436.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2023-11-24T08:08:28.203 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50956.log 2023-11-24T08:08:28.204 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2023-11-24T08:08:28.205 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47020.log.gz 2023-11-24T08:08:28.205 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50956.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50956.log.gz 2023-11-24T08:08:28.206 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46940.log 2023-11-24T08:08:28.207 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46509.log 2023-11-24T08:08:28.207 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2023-11-24T08:08:28.208 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46940.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46940.log.gz 2023-11-24T08:08:28.208 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37991.log 2023-11-24T08:08:28.209 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48759.log 2023-11-24T08:08:28.210 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46509.log.gz 2023-11-24T08:08:28.211 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.37991.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.37991.log.gz 2023-11-24T08:08:28.211 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43436.log 2023-11-24T08:08:28.212 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48759.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48759.log.gz 2023-11-24T08:08:28.212 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47230.log 2023-11-24T08:08:28.213 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43436.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43436.log.gz 2023-11-24T08:08:28.214 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44016.log 2023-11-24T08:08:28.215 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52408.log 2023-11-24T08:08:28.215 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47230.log.gz 2023-11-24T08:08:28.216 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44016.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44016.log.gz 2023-11-24T08:08:28.216 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46888.log 2023-11-24T08:08:28.217 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46378.log 2023-11-24T08:08:28.218 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52408.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52408.log.gz 2023-11-24T08:08:28.218 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46888.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46888.log.gz 2023-11-24T08:08:28.219 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49446.log 2023-11-24T08:08:28.220 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47334.log 2023-11-24T08:08:28.220 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46378.log.gz 2023-11-24T08:08:28.221 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49446.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49446.log.gz 2023-11-24T08:08:28.221 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51653.log 2023-11-24T08:08:28.222 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48258.log 2023-11-24T08:08:28.223 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51653.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47334.log.gz 2023-11-24T08:08:28.223 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51653.log.gz 2023-11-24T08:08:28.224 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45291.log 2023-11-24T08:08:28.225 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48258.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T08:08:28.225 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48258.log.gz 2023-11-24T08:08:28.226 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45291.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45291.log.gz 2023-11-24T08:08:28.226 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48024.log 2023-11-24T08:08:28.227 INFO:teuthology.orchestra.run.smithi132.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T08:08:28.227 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50325.log 2023-11-24T08:08:28.228 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48024.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48024.log.gz 2023-11-24T08:08:28.229 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2023-11-24T08:08:28.230 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44213.log 2023-11-24T08:08:28.230 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50325.log.gz 2023-11-24T08:08:28.231 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47563.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2023-11-24T08:08:28.231 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2023-11-24T08:08:28.232 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51034.log 2023-11-24T08:08:28.233 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44213.log.gz 2023-11-24T08:08:28.234 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47527.log: gzip -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.49607.log -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2023-11-24T08:08:28.234 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-11-24T08:08:28.235 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51034.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51034.log.gz 2023-11-24T08:08:28.235 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46632.log 2023-11-24T08:08:28.236 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45767.log 2023-11-24T08:08:28.237 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49607.log.gz 2023-11-24T08:08:28.238 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46632.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46632.log.gz 2023-11-24T08:08:28.238 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48388.log 2023-11-24T08:08:28.240 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45767.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45767.log.gz 2023-11-24T08:08:28.240 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50585.log 2023-11-24T08:08:28.241 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48388.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48388.log.gz 2023-11-24T08:08:28.242 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48785.log 2023-11-24T08:08:28.242 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50585.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50585.log.gz 2023-11-24T08:08:28.243 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2023-11-24T08:08:28.244 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50848.log 2023-11-24T08:08:28.244 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48785.log.gz 2023-11-24T08:08:28.245 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43550.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2023-11-24T08:08:28.245 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44225.log 2023-11-24T08:08:28.246 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45655.log 2023-11-24T08:08:28.247 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50848.log.gz 2023-11-24T08:08:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44225.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44225.log.gz 2023-11-24T08:08:28.248 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46144.log 2023-11-24T08:08:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49477.log 2023-11-24T08:08:28.249 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45655.log.gz 2023-11-24T08:08:28.250 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46144.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46144.log.gz 2023-11-24T08:08:28.250 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45819.log 2023-11-24T08:08:28.251 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48733.log 2023-11-24T08:08:28.252 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49477.log.gz 2023-11-24T08:08:28.252 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45819.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45819.log.gz 2023-11-24T08:08:28.253 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50351.log 2023-11-24T08:08:28.254 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52590.log 2023-11-24T08:08:28.254 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48733.log.gz 2023-11-24T08:08:28.255 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50351.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50351.log.gz 2023-11-24T08:08:28.255 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43330.log 2023-11-24T08:08:28.256 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47100.log 2023-11-24T08:08:28.257 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52590.log.gz 2023-11-24T08:08:28.258 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43330.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43330.log.gz 2023-11-24T08:08:28.258 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44774.log 2023-11-24T08:08:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2023-11-24T08:08:28.260 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47100.log.gz 2023-11-24T08:08:28.260 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44774.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44774.log.gz 2023-11-24T08:08:28.261 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47074.log 2023-11-24T08:08:28.262 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45845.log 2023-11-24T08:08:28.262 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2023-11-24T08:08:28.263 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47074.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47074.log.gz 2023-11-24T08:08:28.263 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44540.log 2023-11-24T08:08:28.264 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50032.log 2023-11-24T08:08:28.265 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45845.log.gz 2023-11-24T08:08:28.265 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44540.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44540.log.gz 2023-11-24T08:08:28.266 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48651.log 2023-11-24T08:08:28.267 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.50032.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2023-11-24T08:08:28.268 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50032.log.gz 2023-11-24T08:08:28.268 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48651.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48651.log.gz 2023-11-24T08:08:28.269 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T08:08:28.269 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47152.log 2023-11-24T08:08:28.270 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47679.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2023-11-24T08:08:28.271 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46457.log 2023-11-24T08:08:28.273 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43708.log 2023-11-24T08:08:28.273 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47152.log.gz 2023-11-24T08:08:28.274 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2023-11-24T08:08:28.274 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46457.log.gz 2023-11-24T08:08:28.276 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2023-11-24T08:08:28.276 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43708.log.gz 2023-11-24T08:08:28.277 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44618.log 2023-11-24T08:08:28.277 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2023-11-24T08:08:28.279 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50507.log 2023-11-24T08:08:28.279 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz 2023-11-24T08:08:28.280 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49715.log 2023-11-24T08:08:28.280 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44618.log.gz 2023-11-24T08:08:28.281 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50195.log 2023-11-24T08:08:28.282 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50507.log.gz 2023-11-24T08:08:28.283 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2023-11-24T08:08:28.283 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49715.log.gz 2023-11-24T08:08:28.285 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50930.log 2023-11-24T08:08:28.285 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50195.log.gz 2023-11-24T08:08:28.286 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44226.log 2023-11-24T08:08:28.286 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2023-11-24T08:08:28.287 INFO:teuthology.orchestra.run.smithi132.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T08:08:28.288 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50930.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50930.log.gz 2023-11-24T08:08:28.289 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44226.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44226.log.gz 2023-11-24T08:08:28.289 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52486.log 2023-11-24T08:08:28.291 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47204.log 2023-11-24T08:08:28.292 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44223.log 2023-11-24T08:08:28.292 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52486.log.gz 2023-11-24T08:08:28.294 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47204.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47204.log.gz 2023-11-24T08:08:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44223.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44223.log.gz 2023-11-24T08:08:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52512.log 2023-11-24T08:08:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2023-11-24T08:08:28.298 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2023-11-24T08:08:28.299 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52512.log.gz 2023-11-24T08:08:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43812.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2023-11-24T08:08:28.301 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49045.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2023-11-24T08:08:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52382.log 2023-11-24T08:08:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44592.log 2023-11-24T08:08:28.305 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52382.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.49659.log -- replaced with /var/log/ceph/ceph-client.admin.52382.log.gz 2023-11-24T08:08:28.305 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-11-24T08:08:28.306 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44592.log.gz 2023-11-24T08:08:28.307 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49659.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49659.log.gz 2023-11-24T08:08:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45265.log 2023-11-24T08:08:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46326.log 2023-11-24T08:08:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45265.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.45265.log.gz -5 2023-11-24T08:08:28.311 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45551.log 2023-11-24T08:08:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51240.log 2023-11-24T08:08:28.313 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46326.log.gz 2023-11-24T08:08:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45551.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45551.log.gz 2023-11-24T08:08:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2023-11-24T08:08:28.315 INFO:teuthology.orchestra.run.smithi132.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T08:08:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50169.log 2023-11-24T08:08:28.316 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51240.log.gz 2023-11-24T08:08:28.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47972.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2023-11-24T08:08:28.317 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2023-11-24T08:08:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50169.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33138.log 2023-11-24T08:08:28.319 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50169.log.gz 2023-11-24T08:08:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50084.log 2023-11-24T08:08:28.320 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2023-11-24T08:08:28.321 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T08:08:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.33138.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33138.log.gz 2023-11-24T08:08:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47783.log 2023-11-24T08:08:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48310.log 2023-11-24T08:08:28.323 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50084.log.gz 2023-11-24T08:08:28.324 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2023-11-24T08:08:28.325 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47783.log.gz 2023-11-24T08:08:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48310.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48310.log.gz 2023-11-24T08:08:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43578.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz 2023-11-24T08:08:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51302.log 2023-11-24T08:08:28.329 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43251.log 2023-11-24T08:08:28.331 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51328.log 2023-11-24T08:08:28.331 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51302.log.gz 2023-11-24T08:08:28.332 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43251.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43251.log.gz 2023-11-24T08:08:28.333 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51328.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51328.log.gz 2023-11-24T08:08:28.334 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43682.log 2023-11-24T08:08:28.335 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51627.log 2023-11-24T08:08:28.337 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43682.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43682.log.gz /var/log/ceph/ceph.log 2023-11-24T08:08:28.337 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-11-24T08:08:28.338 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51627.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51627.log.gz 2023-11-24T08:08:28.338 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2023-11-24T08:08:28.340 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2023-11-24T08:08:28.341 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49873.log: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:08:28.341 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2023-11-24T08:08:28.343 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49367.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2023-11-24T08:08:28.344 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2023-11-24T08:08:28.345 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45447.log 2023-11-24T08:08:28.347 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44514.log 2023-11-24T08:08:28.347 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2023-11-24T08:08:28.348 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50299.log 2023-11-24T08:08:28.348 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45447.log.gz 2023-11-24T08:08:28.350 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44514.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44514.log.gz 2023-11-24T08:08:28.351 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50299.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50299.log.gz 2023-11-24T08:08:28.351 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46992.log 2023-11-24T08:08:28.353 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52538.log 2023-11-24T08:08:28.355 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49019.log 2023-11-24T08:08:28.355 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T08:08:28.355 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46992.log.gz 2023-11-24T08:08:28.356 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51164.log 2023-11-24T08:08:28.356 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52538.log.gz 2023-11-24T08:08:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49019.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49019.log.gz 2023-11-24T08:08:28.358 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51811.log 2023-11-24T08:08:28.359 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50982.log 2023-11-24T08:08:28.359 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51164.log.gz 2023-11-24T08:08:28.360 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51811.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51811.log.gz 2023-11-24T08:08:28.360 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49393.log 2023-11-24T08:08:28.361 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50982.log: -- /var/log/ceph/ceph-client.admin.51548.log 2023-11-24T08:08:28.362 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50982.log.gz 2023-11-24T08:08:28.363 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49393.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49393.log.gz 2023-11-24T08:08:28.363 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52718.log 2023-11-24T08:08:28.365 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51548.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51548.log.gz 2023-11-24T08:08:28.365 INFO:teuthology.orchestra.run.smithi132.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T08:08:28.366 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38101.log 2023-11-24T08:08:28.366 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52718.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52718.log.gz 2023-11-24T08:08:28.367 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45395.log 2023-11-24T08:08:28.368 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.38101.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38101.log.gz 2023-11-24T08:08:28.368 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44021.log 2023-11-24T08:08:28.370 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45395.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.45395.log.gz 2023-11-24T08:08:28.370 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2023-11-24T08:08:28.371 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49123.log 2023-11-24T08:08:28.372 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44021.log.gz 2023-11-24T08:08:28.373 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44670.log 2023-11-24T08:08:28.373 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2023-11-24T08:08:28.375 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47646.log 2023-11-24T08:08:28.377 INFO:teuthology.orchestra.run.smithi057.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49123.log.gz 2023-11-24T08:08:28.378 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T08:08:28.378 INFO:teuthology.orchestra.run.smithi132.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T08:08:28.380 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44670.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44670.log.gz 2023-11-24T08:08:28.380 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2023-11-24T08:08:28.380 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2023-11-24T08:08:28.381 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2023-11-24T08:08:28.381 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48705.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2023-11-24T08:08:28.381 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48206.log 2023-11-24T08:08:28.383 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43304.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2023-11-24T08:08:28.383 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49219.log 2023-11-24T08:08:28.384 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48206.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48206.log.gz 2023-11-24T08:08:28.384 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47867.log 2023-11-24T08:08:28.384 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.49219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49219.log.gz 2023-11-24T08:08:28.384 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47048.log 2023-11-24T08:08:28.385 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47867.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47867.log.gz 2023-11-24T08:08:28.385 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43382.log 2023-11-24T08:08:28.385 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T08:08:28.386 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47048.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47048.log.gz 2023-11-24T08:08:28.386 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44748.log 2023-11-24T08:08:28.387 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43382.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43382.log.gz 2023-11-24T08:08:28.387 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49685.log 2023-11-24T08:08:28.388 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44748.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44748.log.gz 2023-11-24T08:08:28.388 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48336.log 2023-11-24T08:08:28.389 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49685.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49685.log.gz 2023-11-24T08:08:28.390 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44005.log 2023-11-24T08:08:28.391 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44003.log 2023-11-24T08:08:28.391 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48336.log.gz 2023-11-24T08:08:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44005.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44005.log.gz 2023-11-24T08:08:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51707.log 2023-11-24T08:08:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46274.log 2023-11-24T08:08:28.393 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44003.log.gz 2023-11-24T08:08:28.395 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51707.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51707.log.gz 2023-11-24T08:08:28.396 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43186.log 2023-11-24T08:08:28.396 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50613.log 2023-11-24T08:08:28.396 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46274.log.gz 2023-11-24T08:08:28.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43186.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43186.log.gz 2023-11-24T08:08:28.399 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50678.log 2023-11-24T08:08:28.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51681.log 2023-11-24T08:08:28.399 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50613.log.gz 2023-11-24T08:08:28.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50678.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50678.log.gz 2023-11-24T08:08:28.400 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45577.log 2023-11-24T08:08:28.403 INFO:teuthology.orchestra.run.smithi132.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T08:08:28.403 INFO:teuthology.orchestra.run.smithi132.stderr: 2023-11-24T08:08:28.404 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m0.329s 2023-11-24T08:08:28.404 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m1.677s 2023-11-24T08:08:28.404 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m0.200s 2023-11-24T08:08:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44232.log 2023-11-24T08:08:28.411 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51681.log.gz 2023-11-24T08:08:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45577.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45577.log.gz 2023-11-24T08:08:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51993.log 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43277.log 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44232.log.gz 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51993.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51993.log.gz 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38227.log 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50455.log 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43277.log.gz 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.38227.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38227.log.gz 2023-11-24T08:08:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50429.log 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50455.log.gz 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50429.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50429.log.gz 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48863.log 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50247.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2023-11-24T08:08:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45741.log 2023-11-24T08:08:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48941.log 2023-11-24T08:08:28.415 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48863.log.gz 2023-11-24T08:08:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45741.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45741.log.gz 2023-11-24T08:08:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46196.log 2023-11-24T08:08:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2023-11-24T08:08:28.416 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48941.log.gz 2023-11-24T08:08:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46196.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46196.log.gz 2023-11-24T08:08:28.416 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:08:28.417 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49503.log 2023-11-24T08:08:28.417 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2023-11-24T08:08:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45085.log 2023-11-24T08:08:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49503.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:08:28.419 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49503.log.gz 2023-11-24T08:08:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51574.log 2023-11-24T08:08:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.2.45085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45085.log.gz 2023-11-24T08:08:28.421 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T08:08:28.421 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46808.log 2023-11-24T08:08:28.422 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51574.log.gz 2023-11-24T08:08:28.422 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43153.log 2023-11-24T08:08:28.424 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46808.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46808.log.gz 2023-11-24T08:08:28.424 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T08:08:28.425 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2023-11-24T08:08:28.426 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2023-11-24T08:08:28.427 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49071.log 2023-11-24T08:08:28.427 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44566.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T08:08:28.428 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49261.log 2023-11-24T08:08:28.428 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2023-11-24T08:08:28.429 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2023-11-24T08:08:28.430 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49261.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49071.log.gz 2023-11-24T08:08:28.430 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49261.log.gz 2023-11-24T08:08:28.431 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50795.log 2023-11-24T08:08:28.431 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46248.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2023-11-24T08:08:28.432 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2023-11-24T08:08:28.433 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2023-11-24T08:08:28.433 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50795.log.gz 2023-11-24T08:08:28.435 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45473.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2023-11-24T08:08:28.435 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2023-11-24T08:08:28.436 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2023-11-24T08:08:28.436 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51190.log 2023-11-24T08:08:28.438 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45107.log 2023-11-24T08:08:28.438 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2023-11-24T08:08:28.440 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48154.log 2023-11-24T08:08:28.440 INFO:teuthology.orchestra.run.smithi057.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51190.log.gz 2023-11-24T08:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45107.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45107.log.gz 2023-11-24T08:08:28.441 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50143.log 2023-11-24T08:08:28.442 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52045.log 2023-11-24T08:08:28.443 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48154.log.gz 2023-11-24T08:08:28.444 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50143.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50143.log.gz 2023-11-24T08:08:28.444 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50481.log 2023-11-24T08:08:28.445 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51733.log 2023-11-24T08:08:28.445 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52045.log.gz 2023-11-24T08:08:28.446 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50481.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50481.log.gz 2023-11-24T08:08:28.447 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46035.log 2023-11-24T08:08:28.448 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2023-11-24T08:08:28.449 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51733.log.gz 2023-11-24T08:08:28.449 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46035.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46035.log.gz 2023-11-24T08:08:28.449 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52616.log 2023-11-24T08:08:28.450 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2023-11-24T08:08:28.450 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2023-11-24T08:08:28.451 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52616.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52616.log.gz 2023-11-24T08:08:28.451 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46756.log 2023-11-24T08:08:28.452 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47308.log 2023-11-24T08:08:28.452 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2023-11-24T08:08:28.453 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46756.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46756.log.gz 2023-11-24T08:08:28.454 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52668.log 2023-11-24T08:08:28.455 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45343.log 2023-11-24T08:08:28.455 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2023-11-24T08:08:28.456 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52668.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52668.log.gz 2023-11-24T08:08:28.456 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49555.log 2023-11-24T08:08:28.457 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2023-11-24T08:08:28.458 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45343.log.gz 2023-11-24T08:08:28.458 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49555.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49555.log.gz 2023-11-24T08:08:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50743.log 2023-11-24T08:08:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46061.log 2023-11-24T08:08:28.460 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2023-11-24T08:08:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50743.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50743.log.gz 2023-11-24T08:08:28.462 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51941.log 2023-11-24T08:08:28.463 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45980.log 2023-11-24T08:08:28.463 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46061.log.gz 2023-11-24T08:08:28.464 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51941.log: 94.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T08:08:28.465 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51941.log.gz 2023-11-24T08:08:28.465 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45707.log 2023-11-24T08:08:28.466 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44800.log 2023-11-24T08:08:28.466 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45980.log.gz 2023-11-24T08:08:28.466 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51759.log 2023-11-24T08:08:28.467 INFO:teuthology.orchestra.run.smithi057.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45707.log.gz 2023-11-24T08:08:28.467 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2023-11-24T08:08:28.468 INFO:teuthology.orchestra.run.smithi057.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44800.log.gz 2023-11-24T08:08:28.468 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51759.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51759.log.gz 2023-11-24T08:08:28.469 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52642.log 2023-11-24T08:08:28.469 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2023-11-24T08:08:28.470 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2023-11-24T08:08:28.471 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52642.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52642.log.gz 2023-11-24T08:08:28.471 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2023-11-24T08:08:28.472 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52278.log 2023-11-24T08:08:28.472 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2023-11-24T08:08:28.474 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48475.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2023-11-24T08:08:28.474 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49925.log 2023-11-24T08:08:28.475 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43809.log 2023-11-24T08:08:28.475 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52278.log.gz 2023-11-24T08:08:28.476 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48598.log 2023-11-24T08:08:28.476 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49925.log.gz 2023-11-24T08:08:28.477 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43809.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43809.log.gz 2023-11-24T08:08:28.477 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2023-11-24T08:08:28.478 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 2023-11-24T08:08:28.478 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48598.log.gz 2023-11-24T08:08:28.479 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52692.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2023-11-24T08:08:28.479 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50559.log 2023-11-24T08:08:28.480 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48889.log 2023-11-24T08:08:28.481 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2023-11-24T08:08:28.482 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50559.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50559.log.gz 2023-11-24T08:08:28.482 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2023-11-24T08:08:28.483 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52252.log 2023-11-24T08:08:28.483 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48889.log.gz 2023-11-24T08:08:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45317.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2023-11-24T08:08:28.484 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49420.log 2023-11-24T08:08:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52252.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52252.log.gz 2023-11-24T08:08:28.486 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46664.log 2023-11-24T08:08:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49420.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49420.log.gz 2023-11-24T08:08:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48232.log 2023-11-24T08:08:28.488 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45629.log 2023-11-24T08:08:28.488 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46664.log.gz 2023-11-24T08:08:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48232.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48232.log.gz 2023-11-24T08:08:28.489 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 2023-11-24T08:08:28.490 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48915.log 2023-11-24T08:08:28.490 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45629.log.gz 2023-11-24T08:08:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47126.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2023-11-24T08:08:28.491 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46914.log 2023-11-24T08:08:28.492 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47618.log 2023-11-24T08:08:28.492 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48915.log.gz 2023-11-24T08:08:28.493 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2023-11-24T08:08:28.494 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46914.log.gz 2023-11-24T08:08:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2023-11-24T08:08:28.495 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gz 2023-11-24T08:08:28.495 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51915.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2023-11-24T08:08:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48677.log 2023-11-24T08:08:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49581.log 2023-11-24T08:08:28.497 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2023-11-24T08:08:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48677.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48677.log.gz 2023-11-24T08:08:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47919.log 2023-11-24T08:08:28.499 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52200.log 2023-11-24T08:08:28.500 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49581.log.gz 2023-11-24T08:08:28.501 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47919.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47919.log.gz 2023-11-24T08:08:28.501 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2023-11-24T08:08:28.502 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45213.log 2023-11-24T08:08:28.502 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52200.log.gz 2023-11-24T08:08:28.503 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43795.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2023-11-24T08:08:28.503 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50273.log 2023-11-24T08:08:28.505 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46561.log 2023-11-24T08:08:28.505 INFO:teuthology.orchestra.run.smithi057.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45213.log.gz 2023-11-24T08:08:28.506 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50273.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50273.log.gz 2023-11-24T08:08:28.506 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52564.log 2023-11-24T08:08:28.507 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50221.log 2023-11-24T08:08:28.507 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46561.log.gz 2023-11-24T08:08:28.508 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52564.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52564.log.gz 2023-11-24T08:08:28.508 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48362.log 2023-11-24T08:08:28.509 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2023-11-24T08:08:28.509 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50221.log.gz 2023-11-24T08:08:28.510 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48362.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48362.log.gz 2023-11-24T08:08:28.510 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2023-11-24T08:08:28.511 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T08:08:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43408.log 2023-11-24T08:08:28.512 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz 2023-11-24T08:08:28.512 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46404.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2023-11-24T08:08:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2023-11-24T08:08:28.513 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45187.log 2023-11-24T08:08:28.514 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43408.log.gz 2023-11-24T08:08:28.514 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44022.log 2023-11-24T08:08:28.515 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2023-11-24T08:08:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43095.log 2023-11-24T08:08:28.515 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45187.log.gz 2023-11-24T08:08:28.517 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43797.log 2023-11-24T08:08:28.517 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44022.log.gz 2023-11-24T08:08:28.518 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43095.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43095.log.gz 2023-11-24T08:08:28.518 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50006.log 2023-11-24T08:08:28.519 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49978.log 2023-11-24T08:08:28.519 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43797.log.gz 2023-11-24T08:08:28.519 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50006.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.50006.log.gz 2023-11-24T08:08:28.520 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.45369.log 2023-11-24T08:08:28.521 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47946.log 2023-11-24T08:08:28.521 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz 2023-11-24T08:08:28.522 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45369.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45369.log.gz 2023-11-24T08:08:28.522 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52146.log 2023-11-24T08:08:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47178.log 2023-11-24T08:08:28.523 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47946.log.gz 2023-11-24T08:08:28.524 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45902.log 2023-11-24T08:08:28.524 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52146.log.gz 2023-11-24T08:08:28.525 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2023-11-24T08:08:28.525 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47178.log.gz 2023-11-24T08:08:28.526 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45902.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45902.log.gz 2023-11-24T08:08:28.526 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2023-11-24T08:08:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43604.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz -5 2023-11-24T08:08:28.527 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43734.log 2023-11-24T08:08:28.528 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47705.log 2023-11-24T08:08:28.528 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2023-11-24T08:08:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52071.log 2023-11-24T08:08:28.529 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43734.log.gz 2023-11-24T08:08:28.530 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49529.log 2023-11-24T08:08:28.530 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47705.log.gz 2023-11-24T08:08:28.531 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52071.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52071.log.gz 2023-11-24T08:08:28.531 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46606.log 2023-11-24T08:08:28.532 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46483.log 2023-11-24T08:08:28.532 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49529.log.gz 2023-11-24T08:08:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2023-11-24T08:08:28.533 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46606.log.gz 2023-11-24T08:08:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46483.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46483.log.gz 2023-11-24T08:08:28.535 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46352.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2023-11-24T08:08:28.590 INFO:teuthology.orchestra.run.smithi057.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T08:08:28.592 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T08:08:28.594 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-11-24T08:08:28.594 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m0.543s 2023-11-24T08:08:28.594 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m1.846s 2023-11-24T08:08:28.594 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m0.750s 2023-11-24T08:08:28.595 INFO:tasks.ceph:Archiving logs... 2023-11-24T08:08:28.596 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/remote/smithi057/log 2023-11-24T08:08:28.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:08:29.091 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/remote/smithi132/log 2023-11-24T08:08:29.092 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:08:29.294 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T08:08:29.316 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T08:08:29.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:08:29.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:08:29.390 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T08:08:29.401 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T08:08:29.401 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:08:29.405 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:08:29.416 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T08:08:29.417 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2023-11-24T08:08:29.417 INFO:teuthology.orchestra.run.smithi057.stdout:*hv01.front.sepi 44.4.53.2 2 u 54 64 377 0.096 -2.318 1.570 2023-11-24T08:08:29.417 INFO:teuthology.orchestra.run.smithi057.stdout:+hv02.front.sepi 63.231.80.2 3 u 50 64 377 0.065 -0.658 1.360 2023-11-24T08:08:29.417 INFO:teuthology.orchestra.run.smithi057.stdout:+hv03.front.sepi 74.6.168.72 3 u 55 64 377 0.095 +1.490 1.518 2023-11-24T08:08:29.417 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T08:08:29.419 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2023-11-24T08:08:29.419 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2023-11-24T08:08:29.420 INFO:teuthology.orchestra.run.smithi132.stdout:+hv01.front.sepi 44.4.53.2 2 u 58 64 377 0.096 -3.885 1.642 2023-11-24T08:08:29.420 INFO:teuthology.orchestra.run.smithi132.stdout:*hv02.front.sepi 63.231.80.2 3 u 57 64 377 0.084 -1.531 1.516 2023-11-24T08:08:29.420 INFO:teuthology.orchestra.run.smithi132.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 377 0.090 +0.719 2.033 2023-11-24T08:08:29.420 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-24T08:08:29.422 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T08:08:29.432 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T08:08:29.432 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T08:08:29.441 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T08:08:29.457 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T08:08:29.466 INFO:teuthology.task.internal:Duration was 1045.377154 seconds 2023-11-24T08:08:29.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T08:08:29.474 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T08:08:29.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:08:29.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:08:29.563 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T08:08:29.563 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2023-11-24T08:08:29.563 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:08:29.586 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2023-11-24T08:08:29.586 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:08:29.608 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T08:08:29.608 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:08:29.636 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:08:29.686 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T08:08:29.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:08:29.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:08:29.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T08:08:29.810 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T08:08:29.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:08:29.833 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:08:29.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T08:08:29.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:29.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:29.895 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2023-11-24T08:08:29.919 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2023-11-24T08:08:29.938 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:29.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:29.964 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:08:29.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:08:29.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T08:08:30.005 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T08:08:30.006 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/remote/smithi057 2023-11-24T08:08:30.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:08:30.033 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579/remote/smithi132 2023-11-24T08:08:30.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:08:30.062 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T08:08:30.062 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:08:30.080 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:08:30.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T08:08:30.125 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T08:08:30.126 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T08:08:30.234 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T08:08:30.234 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:08:30.238 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:08:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: 658043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:08 /home/ubuntu/cephtest 2023-11-24T08:08:30.247 INFO:teuthology.orchestra.run.smithi132.stdout: 658039 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:08 /home/ubuntu/cephtest 2023-11-24T08:08:30.249 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T08:08:30.260 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T08:08:30.285 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T08:08:30.312 DEBUG:teuthology.nuke:shortname: smithi057 2023-11-24T08:08:30.312 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:08:30.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:40:55.919543', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCeL7qpF0g8jOSUJk9M3DdZzOZBiSaEjQJplzTLcUp4IbDOp1u0rj4wznLjrsN8DRqMVk/huQCDco4ekQVz6sNs='} 2023-11-24T08:08:30.341 DEBUG:teuthology.nuke:shortname: smithi132 2023-11-24T08:08:30.341 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:08:30.368 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465579', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:40:55.917838', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGIe2tkCczRgq6/RDlu4Ojzb+oCLrtYmGgskPGqK3yhm3Y1A4CW64NRWjOpumgD1KT/psl644oFybQ8RZXnuuTc='} 2023-11-24T08:08:30.399 INFO:teuthology.orchestra.console.smithi057:Power off 2023-11-24T08:08:30.399 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:08:30.425 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-11-24T08:08:30.426 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:30.441 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-24T08:08:30.441 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:08:30.451 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-11-24T08:08:30.463 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-24T08:08:30.463 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:30.485 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-24T08:08:34.452 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:34.487 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:34.563 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-11-24T08:08:34.597 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-24T08:08:38.566 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:38.599 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:38.677 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-11-24T08:08:38.709 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-24T08:08:42.680 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:42.710 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:08:42.790 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-11-24T08:08:42.820 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-24T08:08:42.892 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-11-24T08:08:42.922 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-24T08:08:43.028 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 1045.377153635025 failure_reason: 'Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a2d6d13da75b44518c63bc788c0732cf status: fail success: false 2023-11-24T08:08:43.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T08:08:43.104 INFO:teuthology.run:FAIL